[llvm-testresults] Grawp nightly tester results
daniel_dunbar at apple.com
daniel_dunbar at apple.com
Sat Sep 19 03:53:19 PDT 2009
http://smooshlab.apple.com/perf.cgi/db_nt_internal/nightlytest//1872
Name: grawp.apple.com
Nickname: Grawp:4
Buildstatus: OK
Run: 1872, Start Time: 2009-09-19 00:39:21
Comparing To: 1855, Start Time: 2009-09-18 00:38:28
--- Changes Summary ---
New Test Passes: 0
New Test Failures: 25
Added Tests: 0
Removed Tests: 0
Significant Changes: 94
--- Tests Summary ---
Total Tests: 3852
Total Test Failures: 120
Total Test Failures By Type:
Bitcode: 1
CBE: 44
GCCAS: 1
JIT: 25
JIT codegen: 25
LLC: 5
LLC compile: 5
LLC-BETA: 7
LLC_BETA compile: 7
--- Changes Detail ---
New Test Passes:
New Test Failures:
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Externals/SPEC/CINT2006/483_xalancbmk/483_xalancbmk [JIT, CBE, JIT codegen, LLC, LLC-BETA, LLC compile, Bitcode, GCCAS, LLC_BETA compile]
SingleSource/Benchmarks/Shootout-C++/except [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/EH/ctor_dtor_count-2 [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
SingleSource/Regression/C++/EH/throw_rethrow_test [LLC, LLC-BETA, LLC compile, LLC_BETA compile]
Added Tests:
Removed Tests:
Significant Changes in Test Results:
Bitcode:
Externals/Nurbs/nurbs: 7.51% (138672.0000 => 149088.0000)
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -7.01% (1614128.0000 => 1501008.0000)
Externals/SPEC/CINT2000/255_vortex/255_vortex: 42.94% (858384.0000 => 1226992.0000)
Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -8.63% (3047312.0000 => 2784224.0000)
MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -12.50% (3584.0000 => 3136.0000)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.69% (4784.0000 => 4464.0000)
MultiSource/Benchmarks/Olden/em3d/em3d: 8.60% (5952.0000 => 6464.0000)
MultiSource/Benchmarks/Olden/perimeter/perimeter: -21.91% (13728.0000 => 10720.0000)
SingleSource/Benchmarks/BenchmarkGame/recursive: -13.95% (3440.0000 => 2960.0000)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.73% (2448.0000 => 2784.0000)
SingleSource/Benchmarks/Dhrystone/fldry: 17.72% (1264.0000 => 1488.0000)
SingleSource/Benchmarks/Shootout/ackermann: -9.72% (1152.0000 => 1040.0000)
SingleSource/Benchmarks/Stanford/Perm: -26.84% (3040.0000 => 2224.0000)
SingleSource/Benchmarks/Stanford/Quicksort: -23.36% (2192.0000 => 1680.0000)
SingleSource/Benchmarks/Stanford/Towers: -7.50% (2560.0000 => 2368.0000)
SingleSource/Benchmarks/Stanford/Treesort: -10.00% (2240.0000 => 2016.0000)
SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 9.68% (496.0000 => 544.0000)
JIT codegen:
Externals/Nurbs/nurbs: 16.59% (0.5889 => 0.6866)
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -20.08% (5.4007 => 4.3163)
Externals/SPEC/CINT2000/255_vortex/255_vortex: 119.82% (4.6435 => 10.2073)
Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -22.41% (8.7989 => 6.8273)
CBE:
Externals/SPEC/CINT2000/255_vortex/255_vortex: 17.11% (2.2800 => 2.6700)
MultiSource/Applications/siod/siod: 6.87% (3.3500 => 3.5800)
MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -16.33% (6.4300 => 5.3800)
SingleSource/Benchmarks/BenchmarkGame/recursive: 79.01% (0.8100 => 1.4500)
SingleSource/Benchmarks/Dhrystone/fldry: 141.13% (1.2400 => 2.9900)
SingleSource/Benchmarks/Shootout-C++/ackermann: 169.44% (0.7200 => 1.9400)
LLC-BETA:
Externals/SPEC/CINT2000/255_vortex/255_vortex: 12.96% (2.4700 => 2.7900)
MultiSource/Applications/lua/lua: -5.66% (13.7900 => 13.0100)
MultiSource/Applications/siod/siod: 5.47% (3.2900 => 3.4700)
MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.25% (0.3200 => 0.3000)
MultiSource/Benchmarks/Ptrdist/ks/ks: 7.60% (1.7100 => 1.8400)
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 20.52% (2.6800 => 3.2300)
MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 6.03% (4.6400 => 4.9200)
MultiSource/Benchmarks/sim/sim: -9.91% (7.5700 => 6.8200)
SingleSource/Benchmarks/BenchmarkGame/recursive: 29.67% (0.9100 => 1.1800)
SingleSource/Benchmarks/Dhrystone/fldry: 8.45% (0.7100 => 0.7700)
SingleSource/Benchmarks/Shootout-C++/ackermann: 53.57% (0.8400 => 1.2900)
LLC compile:
Externals/Nurbs/nurbs: 15.43% (0.6230 => 0.7191)
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -12.20% (9.0144 => 7.9146)
Externals/SPEC/CINT2000/255_vortex/255_vortex: 122.31% (4.7499 => 10.5593)
Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -11.18% (16.6593 => 14.7976)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.30% (2.8425 => 2.6919)
GCCAS:
Externals/Nurbs/nurbs: 10.98% (0.5830 => 0.6470)
Externals/SPEC/CFP2000/188_ammp/188_ammp: 6.48% (1.0163 => 1.0822)
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -11.34% (5.7877 => 5.1315)
Externals/SPEC/CINT2000/254_gap/254_gap: 6.90% (4.8479 => 5.1823)
Externals/SPEC/CINT2006/445_gobmk/445_gobmk: -8.47% (8.2145 => 7.5190)
Externals/SPEC/CINT2006/471_omnetpp/471_omnetpp: 6.50% (6.6346 => 7.0661)
Externals/SPEC/CINT2006/473_astar/473_astar: 5.13% (0.3350 => 0.3522)
MultiSource/Applications/hbd/hbd: 7.62% (0.3202 => 0.3446)
MultiSource/Applications/kimwitu++/kc: 6.81% (6.2123 => 6.6352)
MultiSource/Applications/lambda-0_1_3/lambda: 7.95% (0.2640 => 0.2850)
MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.43% (0.3407 => 0.3660)
MultiSource/Benchmarks/MallocBench/gs/gs: 5.15% (1.4319 => 1.5057)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -9.09% (0.6404 => 0.5822)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.48% (0.5032 => 0.5358)
MultiSource/Benchmarks/PAQ8p/paq8p: 7.48% (1.0862 => 1.1674)
MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 10.97% (0.2434 => 0.2701)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.09% (0.4951 => 0.5203)
SingleSource/Benchmarks/Misc-C++/bigfib: 5.18% (0.2914 => 0.3065)
JIT:
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -10.44% (13.3200 => 11.9300)
Externals/SPEC/CINT2000/255_vortex/255_vortex: 80.05% (7.3700 => 13.2700)
Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -16.32% (18.5000 => 15.4800)
MultiSource/Applications/sgefa/sgefa: 9.64% (0.8300 => 0.9100)
MultiSource/Applications/siod/siod: 6.70% (4.1800 => 4.4600)
MultiSource/Benchmarks/BitBench/drop3/drop3: -5.88% (0.5100 => 0.4800)
MultiSource/Benchmarks/Olden/bisort/bisort: 8.64% (0.8100 => 0.8800)
MultiSource/Benchmarks/Olden/perimeter/perimeter: -7.32% (0.4100 => 0.3800)
MultiSource/Benchmarks/Olden/treeadd/treeadd: -6.25% (0.4800 => 0.4500)
MultiSource/Benchmarks/Ptrdist/ft/ft: 9.71% (1.0300 => 1.1300)
MultiSource/Benchmarks/Ptrdist/ks/ks: 5.12% (2.1500 => 2.2600)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.34% (1.4200 => 1.3300)
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.43% (2.9100 => 3.3300)
MultiSource/Benchmarks/sim/sim: -9.27% (7.7700 => 7.0500)
SingleSource/Benchmarks/BenchmarkGame/recursive: 34.83% (0.8900 => 1.2000)
SingleSource/Benchmarks/Dhrystone/fldry: 30.77% (0.6500 => 0.8500)
SingleSource/Benchmarks/McGill/chomp: 27.17% (0.9200 => 1.1700)
SingleSource/Benchmarks/Shootout-C++/ackermann: 34.00% (1.0000 => 1.3400)
LLC:
Externals/SPEC/CINT2000/255_vortex/255_vortex: 11.69% (2.4800 => 2.7700)
MultiSource/Applications/lua/lua: -5.79% (13.6400 => 12.8500)
MultiSource/Applications/siod/siod: 8.31% (3.2500 => 3.5200)
MultiSource/Benchmarks/Olden/bisort/bisort: 7.89% (0.7600 => 0.8200)
MultiSource/Benchmarks/Ptrdist/ks/ks: 7.60% (1.7100 => 1.8400)
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 20.97% (2.6700 => 3.2300)
MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 6.03% (4.6400 => 4.9200)
MultiSource/Benchmarks/sim/sim: -9.78% (7.5700 => 6.8300)
SingleSource/Benchmarks/BenchmarkGame/recursive: 31.11% (0.9000 => 1.1800)
SingleSource/Benchmarks/Dhrystone/fldry: 8.45% (0.7100 => 0.7700)
SingleSource/Benchmarks/Shootout-C++/ackermann: 55.42% (0.8300 => 1.2900)
LLC-BETA compile:
Externals/Nurbs/nurbs: 11.48% (0.6350 => 0.7079)
Externals/SPEC/CINT2000/253_perlbmk/253_perlbmk: -12.99% (9.1639 => 7.9734)
Externals/SPEC/CINT2000/255_vortex/255_vortex: 121.52% (4.8216 => 10.6807)
Externals/SPEC/CINT2006/400_perlbench/400_perlbench: -11.39% (17.2539 => 15.2894)
More information about the llvm-testresults
mailing list