[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Oct 16 12:14:38 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16379?compare_to=16375&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16379, Order: 192809, Start Time: 2013-10-16 17:22:34, End Time: 2013-10-16 19:17:48
      To: 16375, Order: 192795, Start Time: 2013-10-16 15:05:15, End Time: 2013-10-16 16:55:51
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 45 (50 on baseline)
Performance Improvements: 2 (14 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1060 (1043 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/flops-7: 74.91% (0.0291 => 0.0509, std.dev.: 0.0033)
  MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 71.56% (0.0742 => 0.1273, std.dev.: 0.0045)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 47.88% (0.7390 => 1.0928, std.dev.: 0.1093)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 38.30% (0.3922 => 0.5424, std.dev.: 0.0406)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 23.80% (1.4913 => 1.8462, std.dev.: 0.0801)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.94% (5.0199 => 6.0211, std.dev.: 0.1817)
  MultiSource/Applications/sqlite3/sqlite3: 16.00% (16.6373 => 19.2989, std.dev.: 0.8095)
  MultiSource/Benchmarks/mafft/pairlocalalign: 13.27% (10.2702 => 11.6326, std.dev.: 0.4471)
  MultiSource/Applications/siod/siod: 12.88% (2.5465 => 2.8746, std.dev.: 0.1074)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.63% (1.2292 => 1.3844, std.dev.: 0.0312)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.14% (2.0107 => 2.2547, std.dev.: 0.0569)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.22% (4.1914 => 4.6615, std.dev.: 0.0276)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 10.98% (1.4568 => 1.6167, std.dev.: 0.0520)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.44% (1.2675 => 1.3998, std.dev.: 0.0433)
  SingleSource/Benchmarks/Shootout-C++/ary3: 10.25% (0.2547 => 0.2808, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 10.21% (0.3536 => 0.3897, std.dev.: 0.0109)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 9.72% (0.1090 => 0.1196, std.dev.: 0.0021)
  SingleSource/Benchmarks/Shootout-C++/moments: 8.94% (0.3827 => 0.4169, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.60% (1.2809 => 1.3782, std.dev.: 0.0345)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.80% (1.3179 => 1.4075, std.dev.: 0.0336)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.61% (0.8383 => 0.8937, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.56% (1.4554 => 1.5509, std.dev.: 0.0250)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.49% (1.2993 => 1.3316, std.dev.: 0.0100)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 91.69% (0.7567 => 1.4505, std.dev.: 0.0205)
  MultiSource/Applications/minisat/minisat: 34.26% (6.3222 => 8.4880, std.dev.: 0.2441)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 30.97% (4.0952 => 5.3633, std.dev.: 0.3470)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 26.30% (0.3339 => 0.4217, std.dev.: 0.0266)
  SingleSource/Benchmarks/Shootout/ary3: 23.74% (4.6841 => 5.7960, std.dev.: 0.0812)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 18.14% (1.2995 => 1.5352, std.dev.: 0.0158)
  SingleSource/Benchmarks/Linpack/linpack-pc: 18.01% (43.1273 => 50.8924, std.dev.: 2.4720)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 16.77% (9.4891 => 11.0808, std.dev.: 0.1598)
  SingleSource/Benchmarks/Shootout/heapsort: 16.20% (4.2480 => 4.9361, std.dev.: 0.1600)
  SingleSource/Benchmarks/Shootout-C++/fibo: 10.99% (4.9557 => 5.5002, std.dev.: 0.0327)
  MultiSource/Benchmarks/mafft/pairlocalalign: 10.01% (40.8141 => 44.8976, std.dev.: 0.8828)
  SingleSource/Benchmarks/Shootout/hash: 8.02% (5.1751 => 5.5901, std.dev.: 0.1076)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.68% (2.9534 => 3.1506, std.dev.: 0.0454)
  MultiSource/Applications/lua/lua: 6.43% (28.2291 => 30.0437, std.dev.: 0.2017)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 6.11% (4.0368 => 4.2836, std.dev.: 0.0351)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 5.56% (6.2543 => 6.6020, std.dev.: 0.0776)
  MultiSource/Benchmarks/nbench/nbench: 5.32% (21.4170 => 22.5556, std.dev.: 0.0582)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 5.15% (1.4869 => 1.5635, std.dev.: 0.0283)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.50% (5.9006 => 6.1664, std.dev.: 0.1015)
  SingleSource/Benchmarks/Misc/flops: 3.87% (9.2718 => 9.6303, std.dev.: 0.0132)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.34% (2.6329 => 2.6683, std.dev.: 0.0068)
  SingleSource/Regression/C/uint64_to_float: 1.30% (1.4585 => 1.4774, std.dev.: 0.0042)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/sieve: -4.23% (7.3721 => 7.0602, std.dev.: 0.0123)
  MultiSource/Benchmarks/sim/sim: -4.22% (4.0688 => 3.8973, std.dev.: 0.0331)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 7.10% (0.1352 => 0.1448, std.dev.: 0.0107)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/flops-7: 76.12% (0.0289 => 0.0509, std.dev.: 0.0033)
  MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 70.19% (0.0748 => 0.1273, std.dev.: 0.0045)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 46.47% (0.7461 => 1.0928, std.dev.: 0.1093)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 41.92% (0.3822 => 0.5424, std.dev.: 0.0406)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 25.20% (1.4746 => 1.8462, std.dev.: 0.0801)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 22.15% (4.9293 => 6.0211, std.dev.: 0.1817)
  MultiSource/Applications/sqlite3/sqlite3: 18.48% (16.2888 => 19.2989, std.dev.: 0.8095)
  MultiSource/Applications/siod/siod: 17.43% (2.4480 => 2.8746, std.dev.: 0.1074)
  MultiSource/Benchmarks/mafft/pairlocalalign: 16.44% (9.9903 => 11.6326, std.dev.: 0.4471)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 15.77% (1.9476 => 2.2547, std.dev.: 0.0569)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 15.39% (4.0397 => 4.6615, std.dev.: 0.0276)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.92% (1.2152 => 1.3844, std.dev.: 0.0312)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 12.04% (1.2494 => 1.3998, std.dev.: 0.0433)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 11.26% (0.1012 => 0.1126, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 10.74% (1.4599 => 1.6167, std.dev.: 0.0520)
  SingleSource/Benchmarks/Shootout-C++/moments: 10.55% (0.3771 => 0.4169, std.dev.: 0.0080)
  SingleSource/Benchmarks/Shootout-C++/ary3: 10.46% (0.2542 => 0.2808, std.dev.: 0.0024)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.25% (0.2956 => 0.3259, std.dev.: 0.0107)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.19% (1.2622 => 1.3782, std.dev.: 0.0345)
  MultiSource/Benchmarks/McCat/08-main/main: 9.06% (0.2870 => 0.3130, std.dev.: 0.0038)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.55% (0.8233 => 0.8937, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.42% (1.4304 => 1.5509, std.dev.: 0.0250)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 8.34% (0.3597 => 0.3897, std.dev.: 0.0109)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.97% (1.3036 => 1.4075, std.dev.: 0.0336)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.67% (1.3365 => 1.3855, std.dev.: 0.0143)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.97% (1.2932 => 1.3316, std.dev.: 0.0100)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 95.75% (0.7410 => 1.4505, std.dev.: 0.0205)
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.29% (7.6426 => 12.4797, std.dev.: 0.0286)
  SingleSource/Benchmarks/Shootout/heapsort: 37.50% (3.5900 => 4.9361, std.dev.: 0.1600)
  MultiSource/Applications/minisat/minisat: 35.25% (6.2760 => 8.4880, std.dev.: 0.2441)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 30.80% (4.1004 => 5.3633, std.dev.: 0.3470)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 27.65% (1.1431 => 1.4592, std.dev.: 0.0248)
  SingleSource/Benchmarks/Shootout/ary3: 23.39% (4.6972 => 5.7960, std.dev.: 0.0812)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 21.81% (0.3462 => 0.4217, std.dev.: 0.0266)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 17.15% (9.4586 => 11.0808, std.dev.: 0.1598)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 16.81% (1.3143 => 1.5352, std.dev.: 0.0158)
  SingleSource/Benchmarks/Shootout-C++/fibo: 11.28% (4.9428 => 5.5002, std.dev.: 0.0327)
  SingleSource/Benchmarks/Shootout/hash: 7.48% (5.2009 => 5.5901, std.dev.: 0.1076)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.48% (3.9856 => 4.2836, std.dev.: 0.0351)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 7.27% (2.9372 => 3.1506, std.dev.: 0.0454)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.92% (3.1730 => 3.3608, std.dev.: 0.0197)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 5.43% (1.4830 => 1.5635, std.dev.: 0.0283)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 5.18% (2.5368 => 2.6683, std.dev.: 0.0068)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.29% (89.7126 => 92.6641, std.dev.: 0.0447)
  MultiSource/Applications/hexxagon/hexxagon: 2.66% (14.7810 => 15.1749, std.dev.: 0.1110)
  SingleSource/Benchmarks/Misc/flops: 1.98% (9.4433 => 9.6303, std.dev.: 0.0132)
  MultiSource/Benchmarks/nbench/nbench: 1.94% (22.1263 => 22.5556, std.dev.: 0.0582)
  MultiSource/Applications/lua/lua: 1.77% (29.5202 => 30.0437, std.dev.: 0.2017)
  SingleSource/Regression/C/uint64_to_float: 1.69% (1.4528 => 1.4774, std.dev.: 0.0042)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.50% (16.7972 => 17.0498, std.dev.: 0.0075)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.73% (0.5226 => 0.2366, std.dev.: 0.0401)
  MultiSource/Applications/sgefa/sgefa: -42.74% (1.5790 => 0.9041, std.dev.: 0.0059)
  MultiSource/Benchmarks/Olden/em3d/em3d: -29.08% (5.0288 => 3.5665, std.dev.: 0.0944)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.81% (15.9508 => 12.9501, std.dev.: 0.4807)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.31% (20.8247 => 18.4694, std.dev.: 0.4722)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.26% (3.4956 => 3.1368, std.dev.: 0.0876)
  MultiSource/Benchmarks/mafft/pairlocalalign: -10.26% (50.0284 => 44.8976, std.dev.: 0.8828)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.72% (5.4473 => 5.2444, std.dev.: 0.0134)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.64% (2.5938 => 2.4995, std.dev.: 0.0221)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.84% (2.4471 => 2.3775, std.dev.: 0.0078)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.54% (17.1431 => 16.7080, std.dev.: 0.1216)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.37% (4.3592 => 4.2561, std.dev.: 0.0127)
  SingleSource/Benchmarks/Shootout/sieve: -2.29% (7.2254 => 7.0602, std.dev.: 0.0123)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.65% (4.9459 => 4.8643, std.dev.: 0.0146)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 7.42% (0.1348 => 0.1448, std.dev.: 0.0107)

Report Time: 0.75s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131016/ae6b4501/attachment.html>


More information about the llvm-testresults mailing list