How to evaluate the benchmarks' performance? CPI? or transactions? I have seen
gems advises to use transactions.
As I have build only 3 workloads Apache,JBB and DSS, I can understand using
transactions to evaluate JBB and DSS, but what about Apache? I take notice of the
setup_run_for_n_transactions in all *_build.py. How can I understand this?
Another question, can we say A performs better than B because of more finished
transactions in the same ruby cycles (of course, the same benchmark and the same
ruby confiuration)? But, i think there is an important precondition that the
cycles per transaction or instructions per transaction are almost the same, am I
right? How can I evaluate A and B with different cycles per transaction (A's
cycles per transaction almost 10 times than B)
|
![[Computer Systems Lab]](https://www-auth.cs.wisc.edu/pics/csl_logo.gif){kind=logo}