Hey All,
This thread is a continuation of my work that was detailed in my other thread here -
i7 Nehalem Hyperthreading in DAW Performance , I have decided to start a new thread as the focus has shifted significantly from the original thread and I thought it better to start fresh.
The initial thread started out as an investigation of the cross platform performance of the Steinberg products and the area of Hyperthreading , it has expanded to include testing across numerous other DAW applications.
The focus will remain on cross platform DAW applications - the current testing pool includes Cubendo ( Cubase/Nuendo), Protools, Reaper and StudioOne , the reference plugin list includes the WaveArts MD5 ( which has been one of my reference plugins for many years) , URS Channel Strip Pro and Elysia mPressor. The expanded list of 3rd party plugins was included to level the playing field across all of the applications , the operating systems and the differing plugin formats.
First up I needed to round off the Steinberg specific test to compare the Nuendo 4 to Nuendo 5 to quantify the highly publicised multiprocessor and low latency improvements in N5, and then compare those results to the other DAW applications most similar to the Steinberg product, that being Reaper and StudioOne
This is the worksheet of all the results across the 4 applications on Windows 7 x64 and OSX 10.6.2.
This was a huge undertaking as each latency run was 28 test passes ( 14 each for Win7 / OSX) , and thats not counting going back and rerunning some test to double check the results. I have completed a few reports based on the above data that are now uploaded at the DAWbench website
Here
In short Nuendo 5 does not deliver any performance advantage worth talking about over Nuendo 4 on either OSX or Win7 on the current i7/i9 systems. In some cases it was worse depending on the plugin. Both StudioOne and Reaper also performed substantially better on Win7 over OSX , so the performance variable is not reserved to Cubendo , but what is not evident in the results is that Reaper was light years ahead of both Nuendo and StudioOne on OSX at the ultra low latencies, but had a slight glitch at the loop point, so I backed off the plugins until I cleared that glitch - I could have easily loaded another 15-20 plugins in some instances as the playback was crystal clear apart from the loop glitch. So in short Justin is on to something in regards to scaling on OSX that the other guys haven't quite worked out yet.
There is definitely a lot to absorb, but if you have a closer look at the MD5 results on OSX, you will see @256 that they are not far off Win7 on N4/N5 , also N4 does measurably better with all the 3rd party plugs than N5, which is an eye opener. The plugs with the inherent delay which need the PDC/ADC calcs - the MBC and EMP do significantly worse on OSX than say the 2 plugs without any inherent delay - MD5/CMP. Thats not immediately obvious , so its something that I have noted in the reports.
The other thing is just how much better Win7 feels when pushing the sessions to the limits , OSX just has this underlying feeling of being close to the edge all the time. Mind you it did get ugly on Win7 right at the top end of these tests - ASIO/CPU meters pegged and I mean pegged 100 % , GUI slowing to a crawl, navigation almost non existent, but the playback was still clean. Incredible actually just how well all the apps scaled on Win7. Each had their specific quirks when taken to the limits, Nuendo and Reaper were a little less ugly at those points, StudioOne was getting very- hmmmm, cranky, and you will notice that after a good start on OSX, pretty much fell in a heap even worse than Nuendo.
The 3rd party plugins were all great in regards to stability as well.
Also StudioOne on OSX had some added quirks in regards to loading / saving sessions , activations expiring, etc,
I am talking to Justin over at Cockos to get that OSX loop glitch sorted in Reaper, its the exact same issue we had on Windows a few years back and is related to its read ahead buffering. Justin made some adjustments on Windows which resolved it, so if he can do the same on OSX, the results will be significantly better and make a mockery of the other 2 apps. Its really close now.
The Protools LE /MP RTAS testing is next, but I freaked out when I discovered you can't have both LE and MP on the same O.S install, PITA, which means I had to do all the testing in LE with my 002 , then test one or a few of the other apps as a cross reference using the same hardware/ASIO/CoreAudio driver, then uninstall LE, install MP and use an M-Audio interface , etc.
One last note - All results are with Hyperthreading ON, there are no Hyperthreading OFF results this time around, simply because after close to 2 years and countless hours of testing , with volumes of empirical data showing that in the vast majority of cases it is in fact beneficial to have Hyperthreading ON.
I am not willing to waste any more time arm wrestling the powers at be at Steinberg over their continuing stance that it is in some way preferable to have it OFF.
More to come , I am just rounding off the PT testing over the next week.
Here are some graphs of the Multi App Cross Platform results taken from the work sheet above.
Check out the reports at DAWbench for the full details.
Part I - XP/Win7 x64 : OSX 10.5.8/ OSX 10.6.2 : Cubendo
Part II - Win7 x64/OSX 10.6.2 : Nuendo 4 v Nuendo 5
Part III - Win7 x64/OSX 10.6.2 : Nuendo 5 v Reaper 3.6 v StudioOne 1.5