Hello everybody, I applaud the critical reasoning and writing style used in the preparation of the paper referenced below. There are two issues, that I'd like to raise, that are by no means intended as to discount the quality of the paper. However: A. The KEIL benchmark used LPC2294 in their *simulator* to obtain those published values. B. Thiadmer's paper describes benchmarking of a *real* LPC2106 system. To acknowledge the difference, and then to proceed with the testing - puzzles me (see quote below). The means and ways of the benchmark code compilation [unreferenced in KEIL source] under respective compilers could skew only the results for the size of the executables. But the size of the code is only one aspect of the cited benchmarks [this is an area where Thiadmer's paper excels]. The other aspect is the execution speed in two different environments, that I view as uncomparable. Is the objective to benchmark the CPU simulator or the real HW? Are those two identical? There is probably NO better compiler than a sharp mind, fortified by large amount of experience, an assembler, infinite time and financial resources. In the land of Shan-gri-la. 'nuff said. --roger Edited quote: " My controller is close enough to the test setup of KEIL (µVision Simulator that emulates a Philips LPC2294 running at 60 MHz in Thumb Mode). Still, my benchmarks run significantly faster than what KEIL documents, and the sizes of my programs are smaller than any of the benchmark programs from KEIL. It is obvious that, despite the similarity in the specifications of our benchmarks, KEIL and I have tested entirely different systems." --- In lpc2000@yahoogroups.com, "ukkie9a" <docent@c...> wrote: > Hello everyone, > > To satisfy my curiosity (and verify the code generation of the GNU > compiler), I repeated the Dhrystone benchmark with GNU GCC after > reading the tables in the (otherwise nice book) "The Insider's Guide > to the Philips ARM7-Based Microcontrollers" by Trevor Martin (see > http://www.hitex.co.uk/arm/lpc2000book/index.html) and finding the > same table on KEILs web site. > > My results, which you can read about on > http://compuphase.com/dhrystone.htm, differ from the published results > by a factor of 5! > > Kind regards, > Thiadmer Riemersma
Message
Re: On KEILs Dhrystone benchmarks --again
2005-05-05 by roger_lynx
Attachments
- No local attachments were found for this message.