[LLVMdev] Benchmarks

[Vikram S. Adve]

I think this is a very good idea and we will definitely pursue it.  
Give us a little time, though.  Several of the students are either 
doing their Ph.D. proposal or preparing to go away for summer 
internships or both.  Adding the benchmarks and reporting initial 
numbers should not be too difficult, but reporting any meaningful 
numbers will take some work.

--Vikram
http://www.cs.uiuc.edu/~vadve
http://llvm.cs.uiuc.edu/

On Apr 30, 2004, at 11:36 AM, Reid Spencer wrote:

> Dear List,
>
> There's been some recent discussion on the list about benchmarks. I 
> just
> read a Dr. Dobbs article on the relative runtime performance of various
> compilers (8 of them compared) on Intel platforms. The test focused on
> mainly template type things but offers Dhrystone and zlib for
> comparisons.
>
> There's no clear winner as all compilers perform well in some areas and
> poorly in others. The overall rating (Table 2 in the article) ranks the
> compilers thusly (higher is better):
>
> Intel 8.0	9.22
> VC++ 7.1	7.56
> CodeWarrior	7.44
> GCC 3.2		6.67
> VC++ 6.0	6.00
> Comeau 4.3.3	4.56
> Borland 5.6.4	3.78
> Open Watcom 1.2	3.00
>
> I am, of course, curious how LLVM stacks up in both native code
> generation and the CBE. I guess the main point is that GCC is not the
> compiler to beat, Intel 8.0 is (at least for the template based tests
> this benchmark was aimed at). Any chance we can get this test suite
> included in the benchmark?
>
> You can find the article online here:
> http://www.ddj.com/articles/2004/0405/
> but you'll need to register.
>
> Reid