Re: ** FOR IMMEDIATE RELEASE - RECORD-BREAKING TPC-C RECORD!! **
edward@igate1.hac.com (Ed Bruce) wrote: >The problem is no generic benchmark can truly be real world. If you want >an acurate benchmark, build your own that models your environment. The >problem is it will wind up costing you as much or more to benchmark your >system versus implementing it. > >So those poor IS managers who want to keep their jobs purchase systems >from the companies that have the better marketing, higher tpC numbers, and >appear more stable. Just remember company A does not want you to know that >company B makes a better product or that company C makes one that's just >as good and is cheaper. And the fact that all the companies follow the >tpcC bandwagon just shows that it is a useless number. It is a little known fact that many vendors have been releasing benchmarks based on real applications. The SAP R/3 application suite is very popular in the "real world" and a number of benchmarks exist for the Sales and Distribution (SD) module. These benchmarks are performed in conformance with SAP guidelines and results and system configurations are documented with SAP for verification purposes. This benchmark can give you a better indication of application performance. It also uses commercially available products which is not always the case with the TPC (witness the recent Oracle/DEC benchmark which was based on Oracle 7.3, a release not scheduled for production until next year). An "apples to apples" comparison exists for the HP T500 platform. An Oracle 7.1.4 configuration on HP/UX 10.0 was documented in June. This ran 900 SD users with an average response time below 2 seconds. Total throughput was 108,000 transactions per hour. Informix released a benchmark in September. This ran Informix OnLine Dynamic Server 7.1 and HP/UX 10.01. This configuration ran 1110 SD users with average response times below 1.6 seconds. Total throughput was 139,128 transactions per hour. I am not aware of any Sybase SD benchmarks on the HP/UX platform. regards Dave