[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Jun 26 01:51:34 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12770?compare_to=12767&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12770, Order: 184922, Start Time: 2013-06-26 07:08:02, End Time: 2013-06-26 08:52:36
      To: 12767, Order: 184912, Start Time: 2013-06-26 04:56:07, End Time: 2013-06-26 06:48:06
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 5 (19 on baseline)
Performance Improvements: 67 (55 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1035 (1033 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 8.74% (0.8245 => 0.8966, std.dev.: 0.0258)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.63% (3.2678 => 3.3863, std.dev.: 0.0365)
  MultiSource/Benchmarks/Olden/em3d/em3d: 2.25% (5.0534 => 5.1672, std.dev.: 0.0021)
  SingleSource/Benchmarks/Misc/flops: 1.79% (9.6288 => 9.8008, std.dev.: 0.0307)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.05% (5.5185 => 5.5765, std.dev.: 0.0118)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc/flops-2: -36.35% (0.0509 => 0.0324, std.dev.: 0.0009)
  SingleSource/Benchmarks/Stanford/Treesort: -35.68% (0.0723 => 0.0465, std.dev.: 0.0088)
  SingleSource/Benchmarks/Shootout/nestedloop: -24.61% (0.0451 => 0.0340, std.dev.: 0.0010)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -21.02% (0.0923 => 0.0729, std.dev.: 0.0005)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -20.69% (0.2910 => 0.2308, std.dev.: 0.0099)
  SingleSource/Benchmarks/Stanford/FloatMM: -20.10% (0.0577 => 0.0461, std.dev.: 0.0041)
  SingleSource/Benchmarks/McGill/chomp: -19.90% (0.2296 => 0.1839, std.dev.: 0.0052)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -19.88% (0.0981 => 0.0786, std.dev.: 0.0005)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -18.80% (0.3431 => 0.2786, std.dev.: 0.0119)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -16.71% (0.1221 => 0.1017, std.dev.: 0.0035)
  MultiSource/Benchmarks/Olden/health/health: -15.93% (0.1871 => 0.1573, std.dev.: 0.0022)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -15.11% (0.0986 => 0.0837, std.dev.: 0.0025)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -14.70% (0.1211 => 0.1033, std.dev.: 0.0020)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -14.10% (0.1128 => 0.0969, std.dev.: 0.0009)
  MultiSource/Benchmarks/Olden/power/power: -13.24% (0.1654 => 0.1435, std.dev.: 0.0015)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -12.22% (0.2586 => 0.2270, std.dev.: 0.0036)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -11.50% (1.8125 => 1.6041, std.dev.: 0.0213)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -11.12% (1.4854 => 1.3202, std.dev.: 0.0073)
  MultiSource/Benchmarks/Olden/tsp/tsp: -10.15% (0.1487 => 0.1336, std.dev.: 0.0021)
  MultiSource/Applications/d/make_dparser: -10.13% (4.0967 => 3.6816, std.dev.: 0.1481)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -9.57% (1.6276 => 1.4718, std.dev.: 0.0455)
  MultiSource/Benchmarks/McCat/09-vor/vor: -9.44% (0.3878 => 0.3512, std.dev.: 0.0059)
  MultiSource/Applications/siod/siod: -9.43% (2.7622 => 2.5018, std.dev.: 0.0980)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -8.95% (0.2962 => 0.2697, std.dev.: 0.0053)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -8.73% (28.0463 => 25.5972, std.dev.: 0.3947)
  MultiSource/Applications/kimwitu++/kc: -7.84% (20.7423 => 19.1157, std.dev.: 0.5679)
  MultiSource/Benchmarks/MallocBench/gs/gs: -7.73% (5.0588 => 4.6676, std.dev.: 0.0229)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -7.67% (6.8640 => 6.3374, std.dev.: 0.0829)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -7.67% (8.1220 => 7.4990, std.dev.: 0.2382)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -7.35% (0.3103 => 0.2875, std.dev.: 0.0008)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -7.27% (10.6849 => 9.9079, std.dev.: 0.0303)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.98% (0.2578 => 0.2398, std.dev.: 0.0056)
  MultiSource/Benchmarks/nbench/nbench: -6.93% (1.3672 => 1.2725, std.dev.: 0.0184)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.74% (1.7207 => 1.6219, std.dev.: 0.0323)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.52% (1.5247 => 1.4405, std.dev.: 0.0167)
  MultiSource/Benchmarks/Olden/bh/bh: -5.46% (0.3551 => 0.3357, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.87% (1.6660 => 1.5848, std.dev.: 0.0251)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.99% (0.3010 => 0.2890, std.dev.: 0.0040)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -3.96% (5.2303 => 5.0231, std.dev.: 0.0701)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.22% (1.0045 => 0.9722, std.dev.: 0.0111)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -3.18% (1.5555 => 1.5061, std.dev.: 0.0047)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -2.44% (1.6576 => 1.6172, std.dev.: 0.0093)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.26% (0.7002 => 0.6844, std.dev.: 0.0045)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: -44.62% (0.2396 => 0.1327, std.dev.: 0.0072)
  SingleSource/Benchmarks/Shootout/ary3: -44.58% (10.4114 => 5.7698, std.dev.: 1.5741)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -38.32% (1.2471 => 0.7692, std.dev.: 0.0672)
  MultiSource/Benchmarks/Olden/bisort/bisort: -26.31% (0.9108 => 0.6712, std.dev.: 0.0213)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -18.81% (0.0792 => 0.0643, std.dev.: 0.0034)
  MultiSource/Benchmarks/MallocBench/gs/gs: -13.55% (0.0871 => 0.0753, std.dev.: 0.0038)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -11.61% (41.8802 => 37.0182, std.dev.: 1.0616)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -10.70% (0.3719 => 0.3321, std.dev.: 0.0011)
  SingleSource/Benchmarks/McGill/chomp: -10.32% (1.1189 => 1.0034, std.dev.: 0.0375)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -9.48% (0.4777 => 0.4324, std.dev.: 0.0058)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -9.17% (0.2954 => 0.2683, std.dev.: 0.0006)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -7.41% (42.9583 => 39.7771, std.dev.: 0.7584)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -7.07% (0.3340 => 0.3104, std.dev.: 0.0063)
  MultiSource/Benchmarks/Bullet/bullet: -5.43% (7.3064 => 6.9098, std.dev.: 0.0810)
  MultiSource/Benchmarks/Olden/health/health: -5.40% (0.3484 => 0.3296, std.dev.: 0.0007)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -4.35% (3.1388 => 3.0024, std.dev.: 0.0520)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.87% (0.3102 => 0.2982, std.dev.: 0.0026)
  MultiSource/Applications/obsequi/Obsequi: -3.39% (2.2479 => 2.1717, std.dev.: 0.0229)
  MultiSource/Benchmarks/Olden/tsp/tsp: -3.23% (1.6581 => 1.6046, std.dev.: 0.0066)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -2.21% (4.6992 => 4.5955, std.dev.: 0.0308)
  MultiSource/Applications/siod/siod: -1.64% (3.4189 => 3.3627, std.dev.: 0.0216)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.27% (4.8441 => 4.7824, std.dev.: 0.0132)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.23% (1.5412 => 1.5223, std.dev.: 0.0028)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.11% (5.9501 => 5.8839, std.dev.: 0.0176)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.66% (0.1362 => 0.1371, std.dev.: 0.0106)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.21% (0.2721 => 0.2890, std.dev.: 0.0040)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/sgefa/sgefa: 29.97% (1.1695 => 1.5200, std.dev.: 0.0013)
  SingleSource/Benchmarks/Stanford/Puzzle: 18.08% (0.1455 => 0.1718, std.dev.: 0.0063)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.64% (0.9806 => 1.1340, std.dev.: 0.0227)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.86% (6.1372 => 7.0493, std.dev.: 0.1635)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 8.34% (0.8276 => 0.8966, std.dev.: 0.0258)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.99% (5.2003 => 5.6159, std.dev.: 0.0210)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.31% (3.1853 => 3.3863, std.dev.: 0.0365)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.91% (3.2201 => 3.3781, std.dev.: 0.0306)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.65% (4.6639 => 4.8807, std.dev.: 0.0431)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.63% (2.5366 => 2.6540, std.dev.: 0.0223)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.17% (2.8994 => 3.0204, std.dev.: 0.0149)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.07% (1.0571 => 1.1001, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.79% (5.9362 => 6.1610, std.dev.: 0.0827)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.44% (5.2788 => 5.4604, std.dev.: 0.0097)
  SingleSource/Regression/C/uint64_to_float: 3.05% (1.6851 => 1.7365, std.dev.: 0.0197)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.01% (5.5010 => 5.6664, std.dev.: 0.0131)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.45% (4.3727 => 4.4800, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.76% (5.6582 => 5.7577, std.dev.: 0.0061)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -16.06% (0.0803 => 0.0674, std.dev.: 0.0012)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -15.91% (0.1075 => 0.0904, std.dev.: 0.0062)
  SingleSource/Benchmarks/Misc/whetstone: -14.68% (0.1097 => 0.0936, std.dev.: 0.0016)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -13.56% (0.7918 => 0.6844, std.dev.: 0.0045)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.64% (0.1151 => 0.1017, std.dev.: 0.0045)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.02% (0.2006 => 0.1805, std.dev.: 0.0010)
  MultiSource/Applications/JM/lencod/lencod: -9.84% (18.9387 => 17.0752, std.dev.: 0.4171)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.43% (0.8025 => 0.7268, std.dev.: 0.0085)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -9.17% (1.7804 => 1.6172, std.dev.: 0.0093)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -8.88% (1.0314 => 0.9398, std.dev.: 0.0100)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -8.32% (5.4314 => 4.9797, std.dev.: 0.1431)
  MultiSource/Applications/lemon/lemon: -7.05% (1.3155 => 1.2227, std.dev.: 0.0316)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.42% (0.7381 => 0.6907, std.dev.: 0.0137)
  MultiSource/Benchmarks/McCat/09-vor/vor: -5.67% (0.3723 => 0.3512, std.dev.: 0.0059)
  MultiSource/Benchmarks/McCat/18-imp/imp: -5.64% (0.4199 => 0.3962, std.dev.: 0.0053)
  MultiSource/Benchmarks/Olden/em3d/em3d: -5.05% (0.2117 => 0.2010, std.dev.: 0.0022)
  MultiSource/Benchmarks/McCat/05-eks/eks: -4.84% (0.5698 => 0.5422, std.dev.: 0.0078)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.32% (6.6236 => 6.3374, std.dev.: 0.0829)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.91% (0.5748 => 0.5523, std.dev.: 0.0041)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -3.54% (1.3686 => 1.3202, std.dev.: 0.0073)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -2.48% (10.1602 => 9.9079, std.dev.: 0.0303)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -44.10% (1.2911 => 0.7217, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -37.78% (4.4050 => 2.7410, std.dev.: 0.2094)
  MultiSource/Benchmarks/Olden/mst/mst: -36.78% (0.2099 => 0.1327, std.dev.: 0.0072)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -24.96% (1.0251 => 0.7692, std.dev.: 0.0672)
  MultiSource/Benchmarks/Olden/bisort/bisort: -22.01% (0.8606 => 0.6712, std.dev.: 0.0213)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -20.47% (4.8986 => 3.8959, std.dev.: 0.0390)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -20.02% (5.7264 => 4.5802, std.dev.: 0.1019)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -18.67% (6.2328 => 5.0692, std.dev.: 0.0270)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -15.68% (25.3677 => 21.3888, std.dev.: 0.2540)
  MultiSource/Benchmarks/mafft/pairlocalalign: -13.89% (48.3307 => 41.6165, std.dev.: 0.2783)
  MultiSource/Benchmarks/MallocBench/gs/gs: -13.35% (0.0869 => 0.0753, std.dev.: 0.0038)
  SingleSource/Benchmarks/Misc/salsa20: -13.11% (10.3398 => 8.9846, std.dev.: 0.0222)
  MultiSource/Benchmarks/FreeBench/neural/neural: -12.24% (0.3513 => 0.3083, std.dev.: 0.0038)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -9.75% (0.2973 => 0.2683, std.dev.: 0.0006)
  MultiSource/Applications/siod/siod: -9.70% (3.7240 => 3.3627, std.dev.: 0.0216)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -9.53% (4.2167 => 3.8150, std.dev.: 0.1557)
  SingleSource/Benchmarks/Shootout-C++/hash: -9.28% (0.7941 => 0.7204, std.dev.: 0.0160)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.73% (1.6679 => 1.5223, std.dev.: 0.0028)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -8.72% (0.3267 => 0.2982, std.dev.: 0.0026)
  MultiSource/Applications/sqlite3/sqlite3: -7.35% (4.6358 => 4.2949, std.dev.: 0.0572)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -7.14% (4.5717 => 4.2452, std.dev.: 0.0431)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -6.97% (3.2030 => 2.9797, std.dev.: 0.0438)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.06% (9.8728 => 9.2744, std.dev.: 0.0264)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.73% (5.3184 => 5.0670, std.dev.: 0.0226)
  SingleSource/Benchmarks/Misc/flops: -4.07% (10.2170 => 9.8008, std.dev.: 0.0307)
  MultiSource/Benchmarks/Bullet/bullet: -3.95% (7.1938 => 6.9098, std.dev.: 0.0810)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.92% (9.1099 => 8.7524, std.dev.: 0.0039)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.48% (0.4480 => 0.4324, std.dev.: 0.0058)
  MultiSource/Benchmarks/Olden/tsp/tsp: -3.41% (1.6613 => 1.6046, std.dev.: 0.0066)
  MultiSource/Applications/obsequi/Obsequi: -3.04% (2.2398 => 2.1717, std.dev.: 0.0229)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -2.50% (2.8537 => 2.7824, std.dev.: 0.0067)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.18% (4.5094 => 4.4110, std.dev.: 0.0328)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.97% (8.5243 => 8.3564, std.dev.: 0.0143)
  MultiSource/Benchmarks/BitBench/five11/five11: -1.73% (5.7342 => 5.6349, std.dev.: 0.0065)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.86% (0.1441 => 0.1371, std.dev.: 0.0106)

Report Time: 1.74s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130626/fa159782/attachment.html>


More information about the llvm-testresults mailing list