[LLVMdev] [RFC] Benchmarking subset of the test suite

[Hal Finkel]

----- Original Message -----
> From: "Evan Cheng" <evan.cheng at apple.com>
> To: "Hal Finkel" <hfinkel at anl.gov>
> Cc: "LLVM Developers Mailing List" <llvmdev at cs.uiuc.edu>
> Sent: Monday, May 19, 2014 3:35:45 PM
> Subject: Re: [LLVMdev] [RFC] Benchmarking subset of the test suite
> 
> 
> 
> 
> On May 4, 2014, at 5:39 AM, Hal Finkel < hfinkel at anl.gov > wrote:
> 
> 
> security-blowfish
> 
> Sorry that I'm late to this. I scanned the list you provided and it
> makes sense to me. But this one caught me by surprise. I remember we
> put quite a bit of effort tuning the scheduler to improve codegen
> quality of blowfish. Are you sure this particular benchmark isn't
> serving its purpose?

Yes. As currently configured, the running time is much too short. On PPC64, the running time is <= 0.001s, and -O3 and -O0 cannot be statistically distinguished. On x86-64, the running time is even smaller (timeit reports 0.0000 for -O3 builds).

 -Hal

> 
> 
> Evan

-- 
Hal Finkel
Assistant Computational Scientist
Leadership Computing Facility
Argonne National Laboratory