[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Mon May 6 11:51:24 PDT 2013
http://llvm.org/perf/db_default/v4/nts/11346?compare_to=11344&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11
Comparing:
Run: 11346, Order: 181211, Start Time: 2013-05-06 17:01:36, End Time: 2013-05-06 18:51:30
To: 11344, Order: 181196, Start Time: 2013-05-06 14:54:04, End Time: 2013-05-06 16:39:28
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00
===============
Tests Summary
===============
New Failures: 0 (1 on baseline)
New Passes: 0 (20 on baseline)
Performance Regressions: 51 (123 on baseline)
Performance Improvements: 3 (58 on baseline)
Removed Tests: 0 (2 on baseline)
Added Tests: 0 (4 on baseline)
Existing Failures: 13 (12 on baseline)
Unchanged Tests: 1041 (888 on baseline)
Total Tests: 1108
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Benchmarks/BenchmarkGame/recursive: 71.38% (0.0269 => 0.0461, std.dev.: 0.0018)
MultiSource/Benchmarks/Prolangs-C++/family/family: 57.67% (0.0430 => 0.0678, std.dev.: 0.0032)
MultiSource/Benchmarks/Ptrdist/ft/ft: 34.18% (0.2159 => 0.2897, std.dev.: 0.0160)
MultiSource/Benchmarks/Olden/em3d/em3d: 25.23% (0.1946 => 0.2437, std.dev.: 0.0117)
MultiSource/Benchmarks/McCat/05-eks/eks: 21.11% (0.5167 => 0.6258, std.dev.: 0.0360)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: 18.99% (0.0969 => 0.1153, std.dev.: 0.0016)
MultiSource/Benchmarks/Olden/bh/bh: 16.29% (0.3254 => 0.3784, std.dev.: 0.0166)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.36% (0.5915 => 0.6705, std.dev.: 0.0147)
MultiSource/Applications/aha/aha: 10.57% (0.1258 => 0.1391, std.dev.: 0.0014)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.83% (2.5554 => 2.8065, std.dev.: 0.0326)
SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.46% (6.6281 => 7.1891, std.dev.: 0.1721)
MultiSource/Applications/kimwitu++/kc: 8.01% (18.8632 => 20.3744, std.dev.: 0.0469)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.04% (1.4510 => 1.5531, std.dev.: 0.0336)
MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.92% (1.3933 => 1.4897, std.dev.: 0.0345)
MultiSource/Benchmarks/Ptrdist/bc/bc: 6.85% (1.2680 => 1.3548, std.dev.: 0.0293)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.31% (4.1035 => 4.3623, std.dev.: 0.0528)
SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.79% (0.4117 => 0.4314, std.dev.: 0.0016)
MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.77% (1.1597 => 1.2150, std.dev.: 0.0140)
SingleSource/Benchmarks/Shootout-C++/ary3: 4.61% (0.2752 => 0.2879, std.dev.: 0.0028)
SingleSource/Benchmarks/Shootout-C++/hash: 3.88% (0.4327 => 0.4495, std.dev.: 0.0022)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.29% (26.7721 => 27.6530, std.dev.: 0.2018)
MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.87% (1.6078 => 1.6540, std.dev.: 0.0101)
MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.82% (1.6120 => 1.6575, std.dev.: 0.0081)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/Olden/mst/mst: 75.19% (0.1346 => 0.2358, std.dev.: 0.0180)
MultiSource/Benchmarks/Ptrdist/ft/ft: 62.50% (0.7723 => 1.2550, std.dev.: 0.1704)
SingleSource/Benchmarks/Shootout/heapsort: 56.16% (3.0263 => 4.7260, std.dev.: 0.2512)
SingleSource/Benchmarks/Shootout/ary3: 55.06% (6.8641 => 10.6432, std.dev.: 0.2969)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 35.14% (4.4992 => 6.0801, std.dev.: 0.0913)
MultiSource/Applications/minisat/minisat: 28.71% (6.3595 => 8.1852, std.dev.: 0.1310)
MultiSource/Benchmarks/Fhourstones/fhourstones: 22.02% (1.3271 => 1.6193, std.dev.: 0.0624)
SingleSource/Benchmarks/Misc/flops-7: 21.71% (1.7201 => 2.0935, std.dev.: 0.0142)
SingleSource/Benchmarks/Shootout-C++/fibo: 16.53% (4.1336 => 4.8170, std.dev.: 0.0203)
SingleSource/Benchmarks/CoyoteBench/fftbench: 15.12% (1.5111 => 1.7396, std.dev.: 0.0374)
MultiSource/Benchmarks/McCat/18-imp/imp: 12.64% (0.1290 => 0.1453, std.dev.: 0.0034)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: 12.58% (0.4318 => 0.4861, std.dev.: 0.0185)
SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 11.02% (28.5866 => 31.7372, std.dev.: 0.8101)
MultiSource/Benchmarks/nbench/nbench: 8.94% (19.5535 => 21.3013, std.dev.: 0.5515)
SingleSource/Benchmarks/Misc/flops: 8.58% (9.3615 => 10.1650, std.dev.: 0.0080)
SingleSource/Benchmarks/Misc/salsa20: 7.92% (9.5694 => 10.3274, std.dev.: 0.0137)
MultiSource/Benchmarks/Olden/health/health: 5.96% (0.3338 => 0.3537, std.dev.: 0.0050)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.96% (41.3306 => 43.7941, std.dev.: 0.6389)
MultiSource/Benchmarks/llubenchmark/llu: 5.76% (2.0293 => 2.1461, std.dev.: 0.0234)
SingleSource/Benchmarks/BenchmarkGame/recursive: 5.69% (2.4226 => 2.5605, std.dev.: 0.0135)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.37% (22.1127 => 23.0795, std.dev.: 0.2807)
MultiSource/Benchmarks/Olden/bh/bh: 4.23% (2.4347 => 2.5376, std.dev.: 0.0149)
MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.81% (0.3336 => 0.3463, std.dev.: 0.0021)
SingleSource/Benchmarks/BenchmarkGame/partialsums: 3.65% (1.1691 => 1.2118, std.dev.: 0.0081)
SingleSource/Benchmarks/BenchmarkGame/puzzle: 2.99% (1.1199 => 1.1534, std.dev.: 0.0065)
SingleSource/Benchmarks/Misc/ffbench: 2.11% (1.4085 => 1.4382, std.dev.: 0.0065)
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.74% (39.8090 => 40.5024, std.dev.: 0.1803)
SingleSource/Benchmarks/Misc/whetstone: 1.11% (3.5733 => 3.6130, std.dev.: 0.0059)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/Prolangs-C++/life/life: -4.72% (2.6344 => 2.5101, std.dev.: 0.0356)
MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.79% (7.4854 => 7.3517, std.dev.: 0.0338)
MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.21% (2.1660 => 2.1397, std.dev.: 0.0028)
Existing Failures - Compile Time
--------------------------------
MultiSource/Applications/obsequi/Obsequi
MultiSource/Applications/obsequi/Obsequi: 10.80% (1.1644 => 1.2902, std.dev.: 0.0831)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lua/lua
MultiSource/Applications/obsequi/Obsequi
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
MultiSource/Benchmarks/MiBench/security-sha/security-sha
SingleSource/Regression/C/2003-05-21-UnionBitfields
SingleSource/Regression/C/2003-05-21-UnionTest
SingleSource/UnitTests/2005-07-15-Bitfield-ABI
SingleSource/UnitTests/2006-01-23-UnionInit
SingleSource/UnitTests/2007-04-10-BitfieldTest
SingleSource/UnitTests/SignlessTypes/Large/cast
MultiSource/Applications/ClamAV/clamscan: 0.66% (0.1509 => 0.1519, std.dev.: 0.0040)
MultiSource/Applications/lua/lua: 4.10% (27.3747 => 28.4974, std.dev.: 0.0537)
MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.82% (0.0584 => 0.0515, std.dev.: 0.0036)
MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.40% (0.0265 => 0.0256, std.dev.: 0.0002)
SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004)
SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -75.00% (0.0008 => 0.0002, std.dev.: 0.0003)
SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005, std.dev.: 0.0002)
SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004)
SingleSource/UnitTests/SignlessTypes/Large/cast: -42.42% (0.0066 => 0.0038, std.dev.: 0.0033)
================================
Run-Over-Baseline Changes Detail
================================
New Failures - Execution Time
-----------------------------
MultiSource/Applications/lua/lua
MultiSource/Applications/lua/lua: 1.16% (28.1709 => 28.4974, std.dev.: 0.0537)
New Passes - Execution Time
---------------------------
MultiSource/Applications/ALAC/decode/alacconvert-decode
MultiSource/Applications/Burg/burg
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/McCat/12-IOtest/iotest
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Ptrdist/anagram/anagram
MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
MultiSource/Benchmarks/mediabench/g721/g721encode/encode
MultiSource/Benchmarks/mediabench/gsm/toast/toast
SingleSource/Benchmarks/BenchmarkGame/puzzle
SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
SingleSource/UnitTests/Vector/Altivec/alti_expandfft
SingleSource/UnitTests/Vector/Altivec/alti_isamax
SingleSource/UnitTests/Vector/Altivec/alti_sdot
SingleSource/UnitTests/Vector/Altivec/alti_stepfft
SingleSource/UnitTests/Vector/Altivec/casts
SingleSource/UnitTests/Vector/Altivec/test1
SingleSource/UnitTests/Vectorizer/gcc-loops
MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.40% (0.0248 => 0.0247, std.dev.: 0.0046)
MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0000)
MultiSource/Applications/lemon/lemon: -17.64% (1.1794 => 0.9713, std.dev.: 0.2133)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.84% (0.4125 => 0.4861, std.dev.: 0.0185)
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -8.33% (0.1309 => 0.1200, std.dev.: 0.0258)
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -14.33% (0.0663 => 0.0568, std.dev.: 0.0098)
MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.25% (1.1660 => 1.3205, std.dev.: 0.1096)
MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 10.34% (0.0029 => 0.0032, std.dev.: 0.0005)
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.70% (0.0027 => 0.0028, std.dev.: 0.0004)
MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.56% (0.0594 => 0.0627, std.dev.: 0.0139)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -22.99% (0.0361 => 0.0278, std.dev.: 0.0067)
SingleSource/Benchmarks/BenchmarkGame/puzzle: -31.36% (1.6803 => 1.1534, std.dev.: 0.0065)
SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0004)
SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 6.52% (29.7937 => 31.7372, std.dev.: 0.8101)
SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0001)
SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0005)
SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 79.31% (0.0029 => 0.0052, std.dev.: 0.0012)
SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0003)
SingleSource/UnitTests/Vector/Altivec/test1: -83.33% (0.0006 => 0.0001, std.dev.: 0.0001)
SingleSource/UnitTests/Vectorizer/gcc-loops: -15.37% (26.9213 => 22.7828, std.dev.: 0.0262)
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Benchmarks/BenchmarkGame/recursive: 62.90% (0.0283 => 0.0461, std.dev.: 0.0018)
MultiSource/Benchmarks/Prolangs-C++/family/family: 52.70% (0.0444 => 0.0678, std.dev.: 0.0032)
MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 40.31% (1.0617 => 1.4897, std.dev.: 0.0345)
MultiSource/Benchmarks/Ptrdist/ft/ft: 37.17% (0.2112 => 0.2897, std.dev.: 0.0160)
MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 35.09% (1.2270 => 1.6575, std.dev.: 0.0081)
MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 33.63% (1.0864 => 1.4518, std.dev.: 0.0385)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 33.01% (1.0890 => 1.4485, std.dev.: 0.0470)
MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 32.76% (1.0528 => 1.3977, std.dev.: 0.0359)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.44% (1.1727 => 1.5531, std.dev.: 0.0336)
MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 32.32% (1.0418 => 1.3785, std.dev.: 0.0524)
MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 32.19% (1.1209 => 1.4817, std.dev.: 0.0437)
MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 31.62% (1.0958 => 1.4423, std.dev.: 0.0627)
MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 31.42% (1.1023 => 1.4486, std.dev.: 0.0407)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.27% (1.2853 => 1.6872, std.dev.: 0.0384)
MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 31.22% (1.1428 => 1.4996, std.dev.: 0.1080)
MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 31.14% (1.1626 => 1.5246, std.dev.: 0.0783)
MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 31.03% (1.0687 => 1.4003, std.dev.: 0.0787)
MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 30.83% (1.1744 => 1.5365, std.dev.: 0.0248)
MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 30.79% (1.3313 => 1.7412, std.dev.: 0.0434)
MultiSource/Benchmarks/McCat/05-eks/eks: 30.43% (0.4798 => 0.6258, std.dev.: 0.0360)
MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 30.09% (1.0507 => 1.3669, std.dev.: 0.0235)
MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 29.18% (1.3638 => 1.7617, std.dev.: 0.1133)
MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.87% (1.2835 => 1.6540, std.dev.: 0.0101)
MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 27.96% (1.1699 => 1.4970, std.dev.: 0.1168)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 27.64% (1.0951 => 1.3978, std.dev.: 0.0429)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 26.93% (1.2537 => 1.5913, std.dev.: 0.0294)
MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 26.71% (1.0526 => 1.3338, std.dev.: 0.0406)
MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 26.67% (1.2929 => 1.6377, std.dev.: 0.0205)
MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 26.33% (1.4622 => 1.8472, std.dev.: 0.0432)
MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 26.06% (1.2419 => 1.5656, std.dev.: 0.0355)
MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 25.91% (1.2704 => 1.5995, std.dev.: 0.0206)
MultiSource/Benchmarks/Olden/em3d/em3d: 25.75% (0.1938 => 0.2437, std.dev.: 0.0117)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 25.57% (1.3046 => 1.6382, std.dev.: 0.0731)
MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 25.02% (1.3357 => 1.6699, std.dev.: 0.0429)
MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 24.96% (1.3692 => 1.7109, std.dev.: 0.0678)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 24.52% (1.3451 => 1.6749, std.dev.: 0.0252)
MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 24.14% (1.2925 => 1.6045, std.dev.: 0.0745)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: 21.75% (0.0947 => 0.1153, std.dev.: 0.0016)
MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 21.75% (1.4005 => 1.7051, std.dev.: 0.0320)
MultiSource/Benchmarks/MallocBench/gs/gs: 17.41% (4.4482 => 5.2225, std.dev.: 0.2940)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 16.05% (23.8286 => 27.6530, std.dev.: 0.2018)
MultiSource/Benchmarks/Olden/bh/bh: 14.56% (0.3303 => 0.3784, std.dev.: 0.0166)
MultiSource/Applications/aha/aha: 14.30% (0.1217 => 0.1391, std.dev.: 0.0014)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.58% (0.5956 => 0.6705, std.dev.: 0.0147)
MultiSource/Applications/kimwitu++/kc: 10.45% (18.4474 => 20.3744, std.dev.: 0.0469)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.96% (2.5524 => 2.8065, std.dev.: 0.0326)
SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.06% (0.1357 => 0.1480, std.dev.: 0.0016)
MultiSource/Benchmarks/Olden/tsp/tsp: 8.82% (0.1292 => 0.1406, std.dev.: 0.0025)
MultiSource/Benchmarks/Ptrdist/bc/bc: 7.52% (1.2600 => 1.3548, std.dev.: 0.0293)
MultiSource/Applications/ALAC/encode/alacconvert-encode: 7.33% (1.1320 => 1.2150, std.dev.: 0.0140)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.21% (4.0688 => 4.3623, std.dev.: 0.0528)
MultiSource/Applications/SIBsim4/SIBsim4: 6.84% (1.4195 => 1.5166, std.dev.: 0.0205)
SingleSource/Benchmarks/Shootout-C++/ary3: 6.79% (0.2696 => 0.2879, std.dev.: 0.0028)
SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.26% (0.4060 => 0.4314, std.dev.: 0.0016)
MultiSource/Applications/sqlite3/sqlite3: 5.81% (16.1895 => 17.1307, std.dev.: 0.2899)
SingleSource/Benchmarks/Shootout-C++/fibo: 5.28% (0.1950 => 0.2053, std.dev.: 0.0011)
SingleSource/Benchmarks/Shootout-C++/ary2: 5.09% (0.2712 => 0.2850, std.dev.: 0.0034)
SingleSource/Benchmarks/Shootout-C++/hash: 5.02% (0.4280 => 0.4495, std.dev.: 0.0022)
SingleSource/Benchmarks/CoyoteBench/fftbench: 4.09% (0.3887 => 0.4046, std.dev.: 0.0015)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/Olden/mst/mst: 71.87% (0.1372 => 0.2358, std.dev.: 0.0180)
MultiSource/Benchmarks/BitBench/drop3/drop3: 54.15% (0.3010 => 0.4640, std.dev.: 0.0014)
SingleSource/Benchmarks/Shootout/heapsort: 50.49% (3.1404 => 4.7260, std.dev.: 0.2512)
SingleSource/Benchmarks/Misc/lowercase: 45.42% (0.7986 => 1.1613, std.dev.: 0.0565)
SingleSource/Benchmarks/Misc/fp-convert: 40.33% (5.6800 => 7.9710, std.dev.: 0.0140)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 35.25% (4.4954 => 6.0801, std.dev.: 0.0913)
SingleSource/Benchmarks/Shootout-C++/methcall: 34.70% (8.6184 => 11.6086, std.dev.: 0.0220)
SingleSource/Benchmarks/Shootout/hash: 32.52% (4.1780 => 5.5365, std.dev.: 0.2095)
MultiSource/Applications/minisat/minisat: 32.14% (6.1945 => 8.1852, std.dev.: 0.1310)
MultiSource/Benchmarks/Ptrdist/ks/ks: 30.52% (1.1586 => 1.5122, std.dev.: 0.0156)
SingleSource/Benchmarks/Shootout/ary3: 28.39% (8.2895 => 10.6432, std.dev.: 0.2969)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 25.66% (12.6632 => 15.9130, std.dev.: 0.2493)
SingleSource/Benchmarks/Shootout-C++/matrix: 21.63% (2.8804 => 3.5033, std.dev.: 0.0600)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.72% (3.7569 => 4.4978, std.dev.: 0.0861)
MultiSource/Applications/lambda-0_1_3/lambda: 19.43% (6.9897 => 8.3480, std.dev.: 0.0234)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.42% (4.0968 => 4.8516, std.dev.: 0.0182)
MultiSource/Benchmarks/Fhourstones/fhourstones: 17.67% (1.3761 => 1.6193, std.dev.: 0.0624)
MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 16.90% (4.8478 => 5.6670, std.dev.: 0.0072)
MultiSource/Benchmarks/Olden/tsp/tsp: 14.35% (1.4232 => 1.6275, std.dev.: 0.0253)
MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 14.29% (4.5865 => 5.2421, std.dev.: 0.0281)
MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 14.17% (8.7510 => 9.9908, std.dev.: 0.0019)
SingleSource/Benchmarks/Misc/salsa20: 12.85% (9.1513 => 10.3274, std.dev.: 0.0137)
SingleSource/Benchmarks/Shootout-C++/hash: 12.29% (0.6540 => 0.7344, std.dev.: 0.0169)
SingleSource/Benchmarks/Shootout/matrix: 11.90% (1.5499 => 1.7344, std.dev.: 0.0340)
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.66% (2.5283 => 2.8230, std.dev.: 0.0151)
SingleSource/Benchmarks/Shootout/sieve: 11.51% (6.8087 => 7.5923, std.dev.: 0.0952)
MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.16% (4.8642 => 5.4072, std.dev.: 0.1562)
SingleSource/Benchmarks/CoyoteBench/fftbench: 10.80% (1.5701 => 1.7396, std.dev.: 0.0374)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 10.30% (1.0331 => 1.1395, std.dev.: 0.0200)
MultiSource/Benchmarks/McCat/09-vor/vor: 10.12% (0.1136 => 0.1251, std.dev.: 0.0019)
MultiSource/Applications/hexxagon/hexxagon: 8.97% (14.4795 => 15.7789, std.dev.: 0.0759)
SingleSource/Benchmarks/McGill/chomp: 8.89% (1.0339 => 1.1258, std.dev.: 0.0312)
SingleSource/Benchmarks/Misc/flops: 8.42% (9.3754 => 10.1650, std.dev.: 0.0080)
SingleSource/Benchmarks/BenchmarkGame/recursive: 8.16% (2.3673 => 2.5605, std.dev.: 0.0135)
SingleSource/Benchmarks/Misc/flops-7: 7.92% (1.9399 => 2.0935, std.dev.: 0.0142)
MultiSource/Benchmarks/Olden/health/health: 7.90% (0.3278 => 0.3537, std.dev.: 0.0050)
MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.26% (2.5458 => 2.7307, std.dev.: 0.0289)
MultiSource/Benchmarks/Olden/bh/bh: 6.85% (2.3749 => 2.5376, std.dev.: 0.0149)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.69% (4.7982 => 5.1193, std.dev.: 0.0247)
MultiSource/Benchmarks/llubenchmark/llu: 6.36% (2.0177 => 2.1461, std.dev.: 0.0234)
SingleSource/Benchmarks/Shootout-C++/hash2: 6.28% (3.3943 => 3.6076, std.dev.: 0.0192)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.80% (41.3934 => 43.7941, std.dev.: 0.6389)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 5.54% (9.0122 => 9.5114, std.dev.: 0.0192)
SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.45% (6.2349 => 6.5748, std.dev.: 0.0154)
SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.25% (2.7893 => 2.9358, std.dev.: 0.0191)
MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.93% (5.1346 => 5.3878, std.dev.: 0.0071)
SingleSource/Benchmarks/Dhrystone/fldry: 4.91% (0.6480 => 0.6798, std.dev.: 0.0031)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.54% (22.0762 => 23.0795, std.dev.: 0.2807)
SingleSource/Benchmarks/Misc/whetstone: 4.45% (3.4590 => 3.6130, std.dev.: 0.0059)
SingleSource/Benchmarks/CoyoteBench/huffbench: 4.16% (23.4908 => 24.4687, std.dev.: 0.0203)
MultiSource/Applications/sqlite3/sqlite3: 4.07% (4.2776 => 4.4518, std.dev.: 0.0666)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 3.79% (1.0374 => 1.0767, std.dev.: 0.0045)
MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.73% (5.1006 => 5.2908, std.dev.: 0.0684)
MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.33% (6.1397 => 6.3443, std.dev.: 0.0051)
MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.76% (9.6958 => 9.9634, std.dev.: 0.0216)
MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.75% (7.1548 => 7.3517, std.dev.: 0.0338)
SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.75% (4.7361 => 4.8664, std.dev.: 0.0468)
MultiSource/Applications/aha/aha: 2.60% (3.4994 => 3.5903, std.dev.: 0.0171)
SingleSource/Benchmarks/BenchmarkGame/partialsums: 2.45% (1.1828 => 1.2118, std.dev.: 0.0081)
SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.41% (1.4499 => 1.4848, std.dev.: 0.0016)
MultiSource/Benchmarks/Olden/power/power: 2.34% (1.2248 => 1.2535, std.dev.: 0.0006)
MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.10% (2.0956 => 2.1397, std.dev.: 0.0028)
SingleSource/Benchmarks/Shootout-C++/sieve: 1.29% (3.4522 => 3.4968, std.dev.: 0.0058)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.21% (2.3310 => 2.3592, std.dev.: 0.0016)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/Regression/C/sumarraymalloc: -48.15% (0.0810 => 0.0420, std.dev.: 0.0008)
MultiSource/Benchmarks/FreeBench/neural/neural: -21.48% (0.2542 => 0.1996, std.dev.: 0.0112)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -11.34% (0.0908 => 0.0805, std.dev.: 0.0038)
SingleSource/Benchmarks/Linpack/linpack-pc: -7.20% (0.2751 => 0.2553, std.dev.: 0.0027)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/FreeBench/neural/neural: -73.02% (1.0845 => 0.2926, std.dev.: 0.0011)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -64.34% (0.3861 => 0.1377, std.dev.: 0.0104)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -56.87% (3.8940 => 1.6796, std.dev.: 0.0025)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -56.84% (3.4380 => 1.4840, std.dev.: 0.0148)
MultiSource/Benchmarks/FreeBench/mason/mason: -45.14% (0.5213 => 0.2860, std.dev.: 0.0144)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -41.48% (0.3091 => 0.1809, std.dev.: 0.0454)
MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -33.40% (6.8267 => 4.5463, std.dev.: 0.0797)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -28.36% (0.4520 => 0.3238, std.dev.: 0.0115)
MultiSource/Applications/viterbi/viterbi: -26.46% (3.4506 => 2.5374, std.dev.: 0.0330)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.15% (0.4111 => 0.3036, std.dev.: 0.0286)
MultiSource/Benchmarks/FreeBench/pifft/pifft: -23.59% (0.1789 => 0.1367, std.dev.: 0.0008)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -23.06% (0.2316 => 0.1782, std.dev.: 0.0202)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -21.97% (0.1871 => 0.1460, std.dev.: 0.0017)
SingleSource/Benchmarks/Misc/perlin: -20.56% (4.5691 => 3.6296, std.dev.: 0.0014)
MultiSource/Benchmarks/mafft/pairlocalalign: -20.02% (57.5400 => 46.0216, std.dev.: 0.1015)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.51% (0.3279 => 0.2672, std.dev.: 0.0048)
MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -16.94% (1.9660 => 1.6330, std.dev.: 0.0002)
MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -16.64% (6.4626 => 5.3870, std.dev.: 0.0049)
MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -16.33% (6.0446 => 5.0573, std.dev.: 0.0380)
MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -13.84% (6.7010 => 5.7734, std.dev.: 0.0264)
SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -13.11% (3.5506 => 3.0850, std.dev.: 0.0863)
MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -12.31% (6.0602 => 5.3141, std.dev.: 0.1015)
SingleSource/Benchmarks/Misc/mandel: -11.81% (1.0882 => 0.9597, std.dev.: 0.0043)
MultiSource/Benchmarks/BitBench/uudecode/uudecode: -11.44% (0.1040 => 0.0921, std.dev.: 0.0013)
MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -10.37% (5.0054 => 4.4862, std.dev.: 0.0152)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -10.02% (5.8948 => 5.3040, std.dev.: 0.0129)
MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -8.74% (5.0816 => 4.6377, std.dev.: 0.0424)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.45% (0.4924 => 0.4508, std.dev.: 0.0032)
SingleSource/Benchmarks/McGill/queens: -7.72% (1.7928 => 1.6544, std.dev.: 0.0355)
MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -7.59% (9.5512 => 8.8265, std.dev.: 0.0151)
MultiSource/Benchmarks/NPB-serial/is/is: -7.41% (13.2022 => 12.2244, std.dev.: 0.0007)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -7.01% (3.3978 => 3.1596, std.dev.: 0.0696)
MultiSource/Applications/sgefa/sgefa: -6.19% (1.2184 => 1.1430, std.dev.: 0.0122)
MultiSource/Applications/SIBsim4/SIBsim4: -6.01% (3.4205 => 3.2149, std.dev.: 0.0458)
SingleSource/Benchmarks/Dhrystone/dry: -5.91% (0.5278 => 0.4966, std.dev.: 0.0034)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -5.68% (4.2970 => 4.0529, std.dev.: 0.0624)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.98% (3.9434 => 3.7472, std.dev.: 0.0155)
SingleSource/Benchmarks/BenchmarkGame/n-body: -4.92% (1.5779 => 1.5003, std.dev.: 0.0179)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.90% (0.5182 => 0.4928, std.dev.: 0.0085)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.47% (5.7666 => 5.5086, std.dev.: 0.0521)
SingleSource/Benchmarks/Linpack/linpack-pc: -4.44% (52.8418 => 50.4949, std.dev.: 0.6233)
SingleSource/Benchmarks/Misc/ReedSolomon: -4.33% (9.0356 => 8.6447, std.dev.: 0.0063)
MultiSource/Benchmarks/Olden/em3d/em3d: -4.24% (4.5899 => 4.3955, std.dev.: 0.0688)
SingleSource/Benchmarks/Misc/fbench: -4.21% (4.9661 => 4.7570, std.dev.: 0.0345)
MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.18% (4.4289 => 4.2438, std.dev.: 0.0041)
MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.13% (5.6245 => 5.3920, std.dev.: 0.0607)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.16% (4.3713 => 4.2333, std.dev.: 0.0031)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.71% (3.8286 => 3.7249, std.dev.: 0.0008)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.21% (6.7917 => 6.6415, std.dev.: 0.0405)
SingleSource/Benchmarks/CoyoteBench/almabench: -2.21% (35.0623 => 34.2889, std.dev.: 0.0508)
SingleSource/Benchmarks/Misc/flops-3: -1.94% (2.0809 => 2.0406, std.dev.: 0.0041)
SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.90% (1.3158 => 1.2908, std.dev.: 0.0050)
MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.55% (1.8732 => 1.8442, std.dev.: 0.0104)
MultiSource/Benchmarks/SciMark2-C/scimark2: -1.26% (89.3093 => 88.1869, std.dev.: 0.2076)
Removed Tests - Compile Time
----------------------------
SingleSource/Benchmarks/Shootout-C++/except
Removed Tests - Execution Time
------------------------------
SingleSource/Benchmarks/Shootout-C++/except
Added Tests - Compile Time
--------------------------
SingleSource/Benchmarks/Shootout-C++/EH/except
SingleSource/Regression/C++/EH/recursive-throw
Added Tests - Execution Time
----------------------------
SingleSource/Benchmarks/Shootout-C++/EH/except
SingleSource/Regression/C++/EH/recursive-throw
Existing Failures - Compile Time
--------------------------------
MultiSource/Applications/obsequi/Obsequi
MultiSource/Applications/obsequi/Obsequi: 14.30% (1.1288 => 1.2902, std.dev.: 0.0831)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/obsequi/Obsequi
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
MultiSource/Benchmarks/MiBench/security-sha/security-sha
SingleSource/Regression/C/2003-05-21-UnionBitfields
SingleSource/Regression/C/2003-05-21-UnionTest
SingleSource/UnitTests/2005-07-15-Bitfield-ABI
SingleSource/UnitTests/2006-01-23-UnionInit
SingleSource/UnitTests/2007-04-10-BitfieldTest
SingleSource/UnitTests/SignlessTypes/Large/cast
MultiSource/Applications/ClamAV/clamscan: 2.84% (0.1477 => 0.1519, std.dev.: 0.0040)
MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -15.99% (0.0613 => 0.0515, std.dev.: 0.0036)
MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.25% (0.0276 => 0.0256, std.dev.: 0.0002)
SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004)
SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003)
SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005, std.dev.: 0.0002)
SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
SingleSource/UnitTests/SignlessTypes/Large/cast: -58.70% (0.0092 => 0.0038, std.dev.: 0.0033)
Report Time: 1.11s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130506/db9e3ac2/attachment.html>
More information about the llvm-testresults
mailing list