Spherical Solutions first began exploring the possibility of producing an accelerator card for 68040-based NeXT computers in early 1994. We approached one of the leading manufacturers of accelerator products for the Macintosh computer, Newer Technology, who expressed considerable interest. They produced a working prototype to our specifications.
In early July of last year, Spherical Solutions asked readers of the comp.sys.next.hardware Usenet newsgroup to suggest appropriate tests of the accelerator board performance. The response was very helpful. Correspondents agreed that general-purpose benchmarks would not give an adequate picture of the accelerator's performance. Over two dozen individuals suggested applications that would demonstrate the real-world performance of the accelerator product.
Sam Goldberger, President of Spherical Solutions, wished to obtain accurate performance data before committing to full-scale production of the accelerator product. Clearly, potential purchasers of the product would also want to see accurate and reliable performance data. So in September, Sam Goldberger asked Daniel Miles Kehoe of Fortuity Consulting, a contributing editor of NeXTWORLD magazine and an independent marketing consultant, to conduct tests of the accelerator's performance.
Kehoe reviewed suggestions made by the NEXTSTEP user community and identified a suite of tests that reflected a consensus of user opinion and focused on processor performance. The community was interested in standard performance benchmarks, including dhrystone and MIPS measures, as tested by the standard NXBench and Byte BenchMark suites. Suggestions also included tests of real-world performance with processor-intensive operations using popular NEXTSTEP applications. Kehoe developed a test suite that included:
Kehoe also tested compilation speed. Typical compiling operations are constrained more by speed of access to disk files than by processor performance. Testing of compiling speed served two purposes: First, the user community wanted to know if the accelerator card offered any advantage in compiling. Second, tests of compiling provide a good indication of the accelerator card's performance with the many applications that do not perform processor-intensive operations.
Kehoe prepared a table of results from the testing, which you may wish to examine.
Kehoe drew the following conclusions from the tests. First, he found no incompatibilities with any application or function. He noted there was ample reason for Spherical Solutions to expect that the user community would find value in the product. Specifically, the accelerator product improved processor performance an average of 66% relative to the standard (25 MHz) 68040-based NeXT cube and NeXTstation with a suite of seven processor-intensive operations in real-world applications. Improvements in compiling and (presumably) other disk-intensive operations were not as pronounced, relative to the standard 68040-based NeXT computers. The product also showed improvements averaging 23% in processor-intensive operations relative to the Turbo (33 MHZ) NeXT cube and NeXTstation, but disk-intensive operations were slightly slower, presumably because Turbo motherboards offer better disk access speed than the 25 MHz NeXT motherboards.
Kehoe also tested performance of the Pyro accelerator card relative to a privately-owned prototype of the legendary Nitro NeXTstation, which never went into actual production. The Pyro accelerator card was faster than the Nitro on standard benchmarks and on a few real-world tests, including the Mandelbrot, WetPaint, Virtuoso, and JPEG conversion tests. On average, the Pyro accelerator card closely matched the legendary Nitro performance, though the Nitro outperformed the Pyro accelerator card on disk-intensive applications, presumably because, as with the Turbo, the Nitro disk access is superior.
Kehoe concludes, "The Pyro accelerator card significantly improves the performance of a standard 25 MHz NeXT cube or NeXTstation. It delivers processor performance comparable to the legendary Nitro workstation."