Comparing and summarizing benchmark performance
For execution times, use (weighted) arithmetic mean:
Weight. Ex. Time = ? Weighti * Timei
For rates, use (weighted) harmonic mean:
Weight. Rate = 1 / ? (Weighti / Rate i )
See paper by Jim Smith (link in outline)
“Simply put, we consider one computer to be faster than another if it executes the same set of programs in less time”