[llvm-testresults] Grawp nightly tester results

Sun Oct 11 22:26:20 PDT 2009

What's up with the significant changes?

The LLC performance seems relatively neutral overall (oh for a
geometric mean summary), but the bitcode's all got larger.

I'm just pointing it out, I'm not up-to-date on commits so this may be expected.

 - Daniel

On Sun, Oct 11, 2009 at 1:55 PM,  <daniel_dunbar at apple.com> wrote:
> http://smooshlab.apple.com/perf.cgi/db_nt_internal/nightlytest//2288
> Name:  grawp.apple.com
> Nickname: Grawp:4
> Buildstatus: OK
>
> Run: 2288, Start Time: 2009-10-11 00:34:53
> Comparing To: 2268, Start Time: 2009-10-10 00:36:02
>
> --- Changes Summary ---
> New Test Passes: 0
> New Test Failures: 0
> Added Tests: 0
> Removed Tests: 0
> Significant Changes: 58
>
> --- Tests Summary ---
> Total Tests: 3852
> Total Test Failures: 91
>
> Total Test Failures By Type:
>  CBE: 43
>  JIT: 24
>  JIT codegen: 24
>
> --- Changes Detail ---
> New Test Passes:
>
> New Test Failures:
>
> Added Tests:
>
> Removed Tests:
>
> Significant Changes in Test Results:
> Bitcode:
>  Externals/SPEC/CINT2000/164_gzip/164_gzip: 5.81% (74864.0000 => 79216.0000)
>  Externals/SPEC/CINT2000/300_twolf/300_twolf: 18.06% (406512.0000 => 479920.0000)
>  Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 50.81% (136080.0000 => 205216.0000)
>  MultiSource/Benchmarks/FreeBench/neural/neural: 5.42% (8848.0000 => 9328.0000)
>  MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 5.88% (1904.0000 => 2016.0000)
>  SingleSource/Benchmarks/Misc/ReedSolomon: 7.72% (9744.0000 => 10496.0000)
>  SingleSource/UnitTests/SignlessTypes/factor: 25.86% (928.0000 => 1168.0000)
> JIT codegen:
>  Externals/SPEC/CINT2000/164_gzip/164_gzip: 5.95% (0.3934 => 0.4168)
>  Externals/SPEC/CINT2000/300_twolf/300_twolf: 12.79% (1.7676 => 1.9936)
>  Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 50.59% (0.6598 => 0.9936)
> CBE:
>  Externals/SPEC/CINT2000/186_crafty/186_crafty: 14.65% (8.3300 => 9.5500)
>  Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 12.78% (4.0700 => 4.5900)
>  MultiSource/Applications/sgefa/sgefa: 9.09% (0.6600 => 0.7200)
>  MultiSource/Benchmarks/FreeBench/neural/neural: -17.24% (0.2900 => 0.2400)
>  MultiSource/Benchmarks/Olden/power/power: 9.96% (2.8100 => 3.0900)
>  MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 8.55% (5.3800 => 5.8400)
>  SingleSource/Benchmarks/Misc/fbench: 5.00% (2.6000 => 2.7300)
> LLC-BETA:
>  Externals/SPEC/CINT2000/186_crafty/186_crafty: 8.77% (6.7300 => 7.3200)
>  Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: -5.58% (1.9700 => 1.8600)
>  MultiSource/Applications/sgefa/sgefa: 8.45% (0.7100 => 0.7700)
>  MultiSource/Benchmarks/Olden/bisort/bisort: 6.76% (0.7400 => 0.7900)
>  MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.68% (0.3100 => 0.3400)
>  MultiSource/Benchmarks/Olden/power/power: 9.49% (2.7400 => 3.0000)
>  MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.13% (0.3900 => 0.4100)
>  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -12.87% (1.0100 => 0.8800)
>  SingleSource/Benchmarks/McGill/chomp: 11.46% (0.9600 => 1.0700)
>  SingleSource/Benchmarks/Misc/fbench: 7.21% (2.2200 => 2.3800)
> LLC compile:
>  Externals/SPEC/CINT2000/164_gzip/164_gzip: 6.00% (0.3967 => 0.4205)
>  Externals/SPEC/CINT2000/300_twolf/300_twolf: 11.57% (2.2696 => 2.5321)
>  Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 46.66% (0.7104 => 1.0419)
> GCCAS:
>  Externals/SPEC/CINT2000/186_crafty/186_crafty: 5.54% (1.8633 => 1.9665)
> JIT:
>  Externals/SPEC/CINT2000/164_gzip/164_gzip: 5.20% (13.2800 => 13.9700)
>  Externals/SPEC/CINT2000/186_crafty/186_crafty: 6.38% (9.0900 => 9.6700)
>  Externals/SPEC/CINT2000/300_twolf/300_twolf: 6.19% (6.1400 => 6.5200)
>  Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 10.13% (3.9500 => 4.3500)
>  MultiSource/Applications/hexxagon/hexxagon: 9.12% (9.4300 => 10.2900)
>  MultiSource/Applications/lua/lua: 5.14% (15.5600 => 16.3600)
>  MultiSource/Benchmarks/Olden/bisort/bisort: 7.50% (0.8000 => 0.8600)
>  MultiSource/Benchmarks/Olden/perimeter/perimeter: 5.41% (0.3700 => 0.3900)
>  MultiSource/Benchmarks/Olden/power/power: 8.90% (2.8100 => 3.0600)
>  MultiSource/Benchmarks/Ptrdist/ks/ks: -15.42% (2.4000 => 2.0300)
>  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.22% (1.4100 => 1.2800)
>  MultiSource/Benchmarks/mafft/pairlocalalign: 12.66% (33.8200 => 38.1000)
>  SingleSource/Benchmarks/McGill/queens: -7.00% (2.4300 => 2.2600)
>  SingleSource/Benchmarks/Misc/fbench: 5.22% (2.3000 => 2.4200)
>  SingleSource/Benchmarks/Shootout/lists: 30.56% (6.8400 => 8.9300)
> LLC:
>  Externals/SPEC/CINT2000/186_crafty/186_crafty: 8.62% (6.7300 => 7.3100)
>  MultiSource/Applications/sgefa/sgefa: -7.79% (0.7700 => 0.7100)
>  MultiSource/Benchmarks/Olden/bisort/bisort: 5.41% (0.7400 => 0.7800)
>  MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.45% (0.3100 => 0.3300)
>  MultiSource/Benchmarks/Olden/power/power: 9.49% (2.7400 => 3.0000)
>  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -12.87% (1.0100 => 0.8800)
>  SingleSource/Benchmarks/Dhrystone/dry: -15.25% (0.5900 => 0.5000)
>  SingleSource/Benchmarks/McGill/chomp: 10.42% (0.9600 => 1.0600)
>  SingleSource/Benchmarks/Misc/fbench: 7.21% (2.2200 => 2.3800)
> LLC-BETA compile:
>  Externals/SPEC/CINT2000/164_gzip/164_gzip: 7.03% (0.3955 => 0.4233)
>  Externals/SPEC/CINT2000/300_twolf/300_twolf: 11.60% (2.2735 => 2.5372)
>  Externals/SPEC/CINT2006/401_bzip2/401_bzip2: 50.92% (0.6909 => 1.0427)
> _______________________________________________
> llvm-testresults mailing list
> llvm-testresults at cs.uiuc.edu
> http://lists.cs.uiuc.edu/mailman/listinfo/llvm-testresults
>