[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Thu Aug 15 21:10:26 PDT 2013
http://llvm.org/perf/db_default/v4/nts/14461?compare_to=14457&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15
Comparing:
Run: 14461, Order: 188523, Start Time: 2013-08-16 02:20:11, End Time: 2013-08-16 04:12:27
To: 14457, Order: 188508, Start Time: 2013-08-15 23:55:01, End Time: 2013-08-16 01:53:05
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57
===============
Tests Summary
===============
Performance Regressions: 20 (45 on baseline)
Performance Improvements: 47 (40 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1040 (1022 on baseline)
Total Tests: 1108
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Benchmarks/McCat/12-IOtest/iotest: 48.11% (0.1060 => 0.1570, std.dev.: 0.0095)
MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 40.54% (0.1083 => 0.1522, std.dev.: 0.0097)
MultiSource/Applications/spiff/spiff: 31.27% (0.9608 => 1.2612, std.dev.: 0.0720)
MultiSource/Applications/treecc/treecc: 21.18% (2.3658 => 2.8669, std.dev.: 0.0799)
MultiSource/Applications/JM/ldecod/ldecod: 15.84% (8.1021 => 9.3857, std.dev.: 0.2381)
MultiSource/Benchmarks/McCat/08-main/main: 13.90% (0.3087 => 0.3516, std.dev.: 0.0086)
MultiSource/Applications/d/make_dparser: 13.54% (3.7554 => 4.2639, std.dev.: 0.1925)
MultiSource/Applications/siod/siod: 12.82% (2.5757 => 2.9060, std.dev.: 0.0483)
MultiSource/Applications/SPASS/SPASS: 7.82% (18.8874 => 20.3652, std.dev.: 0.3920)
MultiSource/Applications/oggenc/oggenc: 6.34% (6.0571 => 6.4410, std.dev.: 0.1010)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Applications/d/make_dparser: 59.53% (0.0383 => 0.0611, std.dev.: 0.0009)
MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 19.26% (1.3161 => 1.5696, std.dev.: 0.0063)
MultiSource/Benchmarks/Fhourstones/fhourstones: 16.51% (1.5303 => 1.7829, std.dev.: 0.0490)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 11.80% (0.3219 => 0.3599, std.dev.: 0.0103)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.13% (2.9530 => 3.1340, std.dev.: 0.0619)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.94% (3.9902 => 4.2272, std.dev.: 0.0536)
MultiSource/Benchmarks/mafft/pairlocalalign: 3.39% (44.3150 => 45.8193, std.dev.: 0.4663)
MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.15% (5.0257 => 5.1839, std.dev.: 0.0566)
SingleSource/Benchmarks/Shootout/methcall: 1.78% (8.3978 => 8.5469, std.dev.: 0.0431)
SingleSource/Benchmarks/Shootout-C++/matrix: 1.09% (4.3041 => 4.3512, std.dev.: 0.0142)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/Benchmarks/Misc/whetstone: -41.24% (0.1586 => 0.0932, std.dev.: 0.0011)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -38.65% (0.1035 => 0.0635, std.dev.: 0.0033)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -38.09% (0.0617 => 0.0382, std.dev.: 0.0053)
MultiSource/Benchmarks/Olden/em3d/em3d: -36.88% (0.3240 => 0.2045, std.dev.: 0.0316)
SingleSource/Benchmarks/Misc/flops-3: -36.36% (0.0506 => 0.0322, std.dev.: 0.0025)
SingleSource/Benchmarks/BenchmarkGame/recursive: -34.44% (0.0453 => 0.0297, std.dev.: 0.0002)
SingleSource/Benchmarks/Misc/salsa20: -26.64% (0.0807 => 0.0592, std.dev.: 0.0003)
MultiSource/Benchmarks/MallocBench/gs/gs: -24.30% (6.5224 => 4.9377, std.dev.: 0.3597)
SingleSource/Benchmarks/Misc/ReedSolomon: -23.19% (0.3032 => 0.2329, std.dev.: 0.0005)
SingleSource/Benchmarks/Misc/flops: -22.03% (0.1380 => 0.1076, std.dev.: 0.0059)
SingleSource/Benchmarks/Misc-C++/Large/ray: -20.56% (0.4602 => 0.3656, std.dev.: 0.0057)
MultiSource/Benchmarks/Olden/bh/bh: -20.24% (0.4319 => 0.3445, std.dev.: 0.0298)
MultiSource/Benchmarks/MallocBench/espresso/espresso: -18.83% (7.1686 => 5.8190, std.dev.: 0.4360)
SingleSource/Benchmarks/Shootout-C++/hash2: -17.17% (0.5969 => 0.4944, std.dev.: 0.0257)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -16.98% (0.0901 => 0.0748, std.dev.: 0.0027)
MultiSource/Applications/minisat/minisat: -15.35% (0.9426 => 0.7979, std.dev.: 0.0550)
SingleSource/Benchmarks/BenchmarkGame/n-body: -15.21% (0.0901 => 0.0764, std.dev.: 0.0018)
SingleSource/Benchmarks/Misc/ffbench: -14.23% (0.0956 => 0.0820, std.dev.: 0.0003)
SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -13.41% (0.3796 => 0.3287, std.dev.: 0.0186)
SingleSource/Benchmarks/Misc/fbench: -13.07% (0.0849 => 0.0738, std.dev.: 0.0015)
MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -11.40% (1.6368 => 1.4502, std.dev.: 0.0211)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -10.62% (0.9116 => 0.8148, std.dev.: 0.0274)
MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -10.26% (1.5244 => 1.3680, std.dev.: 0.0591)
MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -10.06% (1.5484 => 1.3927, std.dev.: 0.0597)
MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -7.34% (1.5949 => 1.4778, std.dev.: 0.0316)
MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -6.29% (1.4323 => 1.3422, std.dev.: 0.0151)
SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.03% (6.9459 => 6.5965, std.dev.: 0.0912)
MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.78% (1.4213 => 1.3534, std.dev.: 0.0164)
MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.38% (1.3885 => 1.3277, std.dev.: 0.0164)
MultiSource/Applications/lemon/lemon: -3.43% (1.2951 => 1.2507, std.dev.: 0.0099)
MultiSource/Applications/lambda-0_1_3/lambda: -2.25% (0.8685 => 0.8490, std.dev.: 0.0013)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/Misc-C++/stepanov_container: -34.56% (6.8869 => 4.5070, std.dev.: 0.8948)
MultiSource/Benchmarks/Olden/mst/mst: -30.69% (0.2949 => 0.2044, std.dev.: 0.0304)
MultiSource/Benchmarks/7zip/7zip-benchmark: -13.88% (10.6524 => 9.1735, std.dev.: 0.1979)
SingleSource/Benchmarks/Misc-C++/bigfib: -7.24% (0.3537 => 0.3281, std.dev.: 0.0057)
SingleSource/Benchmarks/BenchmarkGame/recursive: -6.00% (2.5237 => 2.3722, std.dev.: 0.0117)
SingleSource/Benchmarks/Misc/flops-7: -5.86% (1.8537 => 1.7450, std.dev.: 0.0421)
MultiSource/Benchmarks/Olden/bh/bh: -5.71% (2.5728 => 2.4258, std.dev.: 0.0545)
MultiSource/Benchmarks/Bullet/bullet: -5.12% (7.3664 => 6.9892, std.dev.: 0.1363)
SingleSource/Benchmarks/Misc/ffbench: -4.78% (1.4616 => 1.3918, std.dev.: 0.0055)
SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.98% (3.3801 => 3.2456, std.dev.: 0.0098)
SingleSource/UnitTests/Vectorizer/gcc-loops: -3.44% (21.7006 => 20.9539, std.dev.: 0.2411)
SingleSource/Benchmarks/Shootout/sieve: -2.23% (7.9590 => 7.7817, std.dev.: 0.0242)
MultiSource/Benchmarks/Olden/em3d/em3d: -1.41% (5.2531 => 5.1792, std.dev.: 0.0256)
SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.38% (1.1949 => 1.1784, std.dev.: 0.0007)
MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.26% (9.8481 => 9.7237, std.dev.: 0.0169)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -1.03% (1.4434 => 1.4286, std.dev.: 0.0044)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: -0.61% (0.1317 => 0.1309, std.dev.: 0.0048)
================================
Run-Over-Baseline Changes Detail
================================
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Benchmarks/McCat/12-IOtest/iotest: 54.68% (0.1015 => 0.1570, std.dev.: 0.0095)
MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 43.86% (0.1058 => 0.1522, std.dev.: 0.0097)
MultiSource/Applications/spiff/spiff: 31.68% (0.9578 => 1.2612, std.dev.: 0.0720)
MultiSource/Applications/treecc/treecc: 21.22% (2.3651 => 2.8669, std.dev.: 0.0799)
MultiSource/Benchmarks/FreeBench/distray/distray: 18.68% (0.1033 => 0.1226, std.dev.: 0.0053)
MultiSource/Benchmarks/McCat/08-main/main: 15.70% (0.3039 => 0.3516, std.dev.: 0.0086)
MultiSource/Applications/SPASS/SPASS: 13.70% (17.9111 => 20.3652, std.dev.: 0.3920)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.55% (2.6390 => 2.8646, std.dev.: 0.0799)
MultiSource/Applications/JM/ldecod/ldecod: 8.23% (8.6720 => 9.3857, std.dev.: 0.2381)
MultiSource/Applications/siod/siod: 7.03% (2.7150 => 2.9060, std.dev.: 0.0483)
MultiSource/Applications/oggenc/oggenc: 5.38% (6.1121 => 6.4410, std.dev.: 0.1010)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Applications/d/make_dparser: 75.07% (0.0349 => 0.0611, std.dev.: 0.0009)
MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 67.07% (3.7285 => 6.2291, std.dev.: 0.1247)
SingleSource/Benchmarks/Shootout-C++/matrix: 50.73% (2.8867 => 4.3512, std.dev.: 0.0142)
MultiSource/Benchmarks/Fhourstones/fhourstones: 41.97% (1.2558 => 1.7829, std.dev.: 0.0490)
MultiSource/Benchmarks/FreeBench/neural/neural: 37.62% (0.3171 => 0.4364, std.dev.: 0.0146)
SingleSource/Benchmarks/Shootout/hash: 25.11% (4.1846 => 5.2353, std.dev.: 0.3396)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.10% (1.5030 => 1.8802, std.dev.: 0.0194)
MultiSource/Applications/kimwitu++/kc: 21.53% (0.0511 => 0.0621, std.dev.: 0.0013)
MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 19.38% (1.3148 => 1.5696, std.dev.: 0.0063)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 13.43% (0.3173 => 0.3599, std.dev.: 0.0103)
MultiSource/Applications/lambda-0_1_3/lambda: 10.83% (7.0762 => 7.8429, std.dev.: 0.0802)
MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.52% (5.4910 => 5.9588, std.dev.: 0.0420)
SingleSource/Benchmarks/Linpack/linpack-pc: 8.28% (48.3256 => 52.3293, std.dev.: 0.0391)
MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.36% (3.2027 => 3.4384, std.dev.: 0.0256)
MultiSource/Applications/siod/siod: 7.14% (3.3761 => 3.6173, std.dev.: 0.0513)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 5.99% (2.9568 => 3.1340, std.dev.: 0.0619)
MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.99% (5.3042 => 5.6219, std.dev.: 0.0469)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.48% (5.5008 => 5.8025, std.dev.: 0.0093)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.48% (4.0075 => 4.2272, std.dev.: 0.0536)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.72% (4.3151 => 4.5188, std.dev.: 0.0295)
MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.24% (5.1471 => 5.3654, std.dev.: 0.0513)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.89% (3.3384 => 3.4684, std.dev.: 0.0326)
SingleSource/Benchmarks/Misc/whetstone: 3.83% (3.4559 => 3.5883, std.dev.: 0.0170)
MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.69% (4.9995 => 5.1839, std.dev.: 0.0566)
MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.47% (3.3464 => 3.4625, std.dev.: 0.0214)
SingleSource/Benchmarks/CoyoteBench/huffbench: 3.27% (25.0200 => 25.8394, std.dev.: 0.0533)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.08% (4.8739 => 5.0241, std.dev.: 0.0287)
SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.81% (4.4624 => 4.5878, std.dev.: 0.0450)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 2.56% (5.8390 => 5.9887, std.dev.: 0.0516)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.16% (12.8625 => 13.1409, std.dev.: 0.0443)
SingleSource/Benchmarks/Misc/ffbench: 1.75% (1.3679 => 1.3918, std.dev.: 0.0055)
MultiSource/Benchmarks/PAQ8p/paq8p: 1.72% (93.6732 => 95.2821, std.dev.: 0.2501)
SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.43% (1.1618 => 1.1784, std.dev.: 0.0007)
MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.13% (4.9040 => 4.9594, std.dev.: 0.0155)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Benchmarks/Olden/power/power: -34.38% (0.2237 => 0.1468, std.dev.: 0.0197)
MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: -23.69% (0.0439 => 0.0335, std.dev.: 0.0027)
MultiSource/Benchmarks/Olden/tsp/tsp: -22.88% (0.1818 => 0.1402, std.dev.: 0.0097)
MultiSource/Benchmarks/Olden/perimeter/perimeter: -19.84% (0.1114 => 0.0893, std.dev.: 0.0022)
MultiSource/Benchmarks/MallocBench/gs/gs: -18.97% (6.0938 => 4.9377, std.dev.: 0.3597)
MultiSource/Benchmarks/Olden/health/health: -18.77% (0.1993 => 0.1619, std.dev.: 0.0090)
MultiSource/Applications/obsequi/Obsequi: -18.67% (1.4685 => 1.1943, std.dev.: 0.0204)
MultiSource/Benchmarks/Olden/voronoi/voronoi: -18.29% (0.3576 => 0.2922, std.dev.: 0.0106)
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -17.79% (0.1518 => 0.1248, std.dev.: 0.0047)
MultiSource/Applications/lua/lua: -14.63% (5.3200 => 4.5419, std.dev.: 0.1876)
MultiSource/Applications/lambda-0_1_3/lambda: -10.26% (0.9461 => 0.8490, std.dev.: 0.0013)
MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.75% (1.4514 => 1.3534, std.dev.: 0.0164)
MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.25% (1.4166 => 1.3422, std.dev.: 0.0151)
MultiSource/Applications/lemon/lemon: -3.61% (1.2976 => 1.2507, std.dev.: 0.0099)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Applications/lemon/lemon: -35.49% (1.4194 => 0.9157, std.dev.: 0.0440)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.04% (2.1022 => 1.4286, std.dev.: 0.0044)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -29.04% (0.0816 => 0.0579, std.dev.: 0.0092)
MultiSource/Applications/viterbi/viterbi: -25.79% (3.4923 => 2.5917, std.dev.: 0.0988)
MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -23.78% (6.9552 => 5.3016, std.dev.: 0.2972)
SingleSource/Benchmarks/Misc/perlin: -21.35% (4.5989 => 3.6171, std.dev.: 0.0115)
MultiSource/Applications/obsequi/Obsequi: -18.64% (2.6081 => 2.1219, std.dev.: 0.0640)
SingleSource/Benchmarks/Misc/mandel: -14.16% (1.1996 => 1.0297, std.dev.: 0.0141)
MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.45% (0.3557 => 0.3114, std.dev.: 0.0118)
MultiSource/Applications/SIBsim4/SIBsim4: -6.28% (3.5791 => 3.3545, std.dev.: 0.0593)
MultiSource/Benchmarks/Olden/treeadd/treeadd: -5.43% (0.3773 => 0.3568, std.dev.: 0.0034)
SingleSource/Regression/C/uint64_to_float: -4.93% (1.5184 => 1.4436, std.dev.: 0.0210)
SingleSource/Benchmarks/Misc/fbench: -4.89% (4.9602 => 4.7176, std.dev.: 0.0247)
MultiSource/Applications/lua/lua: -4.44% (31.0707 => 29.6913, std.dev.: 0.3251)
SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.30% (0.7355 => 0.7039, std.dev.: 0.0010)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.70% (1.1024 => 1.0616, std.dev.: 0.0081)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.48% (1.7207 => 1.6608, std.dev.: 0.0081)
MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.45% (6.0444 => 5.8359, std.dev.: 0.0782)
SingleSource/UnitTests/Vectorizer/gcc-loops: -3.38% (21.6864 => 20.9539, std.dev.: 0.2411)
MultiSource/Benchmarks/BitBench/drop3/drop3: -3.18% (0.4783 => 0.4631, std.dev.: 0.0023)
MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.06% (6.1482 => 5.9603, std.dev.: 0.0333)
MultiSource/Benchmarks/mafft/pairlocalalign: -2.98% (47.2250 => 45.8193, std.dev.: 0.4663)
MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.78% (5.2218 => 5.0766, std.dev.: 0.0505)
SingleSource/Benchmarks/Misc/ReedSolomon: -2.43% (8.6172 => 8.4082, std.dev.: 0.0355)
SingleSource/Benchmarks/Misc/oourafft: -2.16% (3.7891 => 3.7074, std.dev.: 0.0150)
SingleSource/Benchmarks/CoyoteBench/almabench: -2.02% (34.8438 => 34.1405, std.dev.: 0.0909)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: -5.01% (0.1378 => 0.1309, std.dev.: 0.0048)
Report Time: 0.73s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130815/34d947a3/attachment.html>
More information about the llvm-testresults
mailing list