Lies, Damn Lies and Benchmarks
Dr. Yair Wiseman's home page
D. Citron, "MisSPECulation: partial and misleading use of spec CPU2000
in computer architecture conferences", Proceedings of the 30th Annual
International Symposium on Computer Architecture, pp. 52-59, June 9-11,
2003.
D. Citron, J. Hennessy, D. Patterson, G. Sohi,
"The Use and Abuse of SPEC", Proceedings of the 30th Annual
International Symposium on Computer Architecture, pp. 73-77, June 9-11,
2003.
SPEC
J. C. Mogul. , "Brittle Metrics in Operating
Systems Research", In Proc. HotOS-VII, pp. 90-95. Rio Rico, AZ,
March, 1999.
X. Zhang, "Application-Specific Benchmarking",
Ph.D. Thesis, Harvard University, May 2001.
M. Seltzer, D. Krinsky, K. Smith, X. Zhang,
"The Case for Application-Specific Benchmarking", In Proc. HotOS-VII,
pp. 90-95. Rio Rico, AZ, March, 1999.