[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Jul 2 22:33:06 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13018?compare_to=13014&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 13018, Order: 185500, Start Time: 2013-07-03 03:43:19, End Time: 2013-07-03 05:34:19
      To: 13014, Order: 185489, Start Time: 2013-07-03 01:32:37, End Time: 2013-07-03 03:23:11
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 17 (42 on baseline)
Performance Improvements: 11 (41 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1079 (1024 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: 63.73% (0.1034 => 0.1693, std.dev.: 0.0031)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 60.97% (0.0269 => 0.0433, std.dev.: 0.0029)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 27.98% (1.6289 => 2.0847, std.dev.: 0.0753)
  MultiSource/Benchmarks/Bullet/bullet: 17.75% (35.5220 => 41.8254, std.dev.: 0.5701)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.94% (25.8990 => 28.4739, std.dev.: 0.0329)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.29% (1.7279 => 1.8712, std.dev.: 0.0222)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.23% (1.8384 => 1.9897, std.dev.: 0.0414)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.17% (1.6652 => 1.8013, std.dev.: 0.0215)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.16% (1.6183 => 1.7341, std.dev.: 0.0138)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.12% (1.5632 => 1.6588, std.dev.: 0.0203)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.60% (1.6308 => 1.7221, std.dev.: 0.0344)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/7zip/7zip-benchmark: 9.13% (9.5047 => 10.3728, std.dev.: 0.1981)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.61% (1.2793 => 1.3767, std.dev.: 0.0051)
  MultiSource/Benchmarks/PAQ8p/paq8p: 6.12% (90.6864 => 96.2379, std.dev.: 0.6658)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.43% (5.3533 => 5.4836, std.dev.: 0.0296)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.25% (7.1197 => 7.2087, std.dev.: 0.0327)
  SingleSource/Benchmarks/Shootout/random: 1.22% (2.4408 => 2.4705, std.dev.: 0.0042)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -24.39% (0.1029 => 0.0778, std.dev.: 0.0010)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -11.66% (0.2574 => 0.2274, std.dev.: 0.0063)
  SingleSource/Benchmarks/Shootout-C++/random: -4.77% (0.2325 => 0.2214, std.dev.: 0.0028)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: -45.36% (10.6168 => 5.8012, std.dev.: 1.5574)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -24.96% (0.0673 => 0.0505, std.dev.: 0.0061)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.56% (0.0811 => 0.0701, std.dev.: 0.0014)
  SingleSource/Benchmarks/Shootout/nestedloop: -8.29% (0.1495 => 0.1371, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout-C++/ary3: -8.16% (2.1932 => 2.0143, std.dev.: 0.0398)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -6.42% (0.5125 => 0.4796, std.dev.: 0.0037)
  SingleSource/Benchmarks/Shootout/hash: -2.70% (4.3762 => 4.2580, std.dev.: 0.0372)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.06% (1.2594 => 1.2461, std.dev.: 0.0050)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.51% (0.1360 => 0.1353, std.dev.: 0.0186)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: 63.73% (0.1034 => 0.1693, std.dev.: 0.0031)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 59.78% (0.0271 => 0.0433, std.dev.: 0.0029)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 31.43% (1.5862 => 2.0847, std.dev.: 0.0753)
  MultiSource/Benchmarks/Bullet/bullet: 17.72% (35.5296 => 41.8254, std.dev.: 0.5701)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.52% (1.6299 => 1.8013, std.dev.: 0.0215)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 10.12% (1.6993 => 1.8712, std.dev.: 0.0222)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.79% (25.9348 => 28.4739, std.dev.: 0.0329)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.49% (1.5984 => 1.7341, std.dev.: 0.0138)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.93% (1.8435 => 1.9897, std.dev.: 0.0414)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.39% (1.4238 => 1.5290, std.dev.: 0.0224)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.17% (1.5478 => 1.6588, std.dev.: 0.0203)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.14% (1.6073 => 1.7221, std.dev.: 0.0344)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 6.56% (1.6563 => 1.7650, std.dev.: 0.0406)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 6.31% (1.6070 => 1.7084, std.dev.: 0.0298)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.27% (1.6881 => 1.7940, std.dev.: 0.0336)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.05% (1.4202 => 1.5061, std.dev.: 0.0279)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 4.74% (0.2238 => 0.2344, std.dev.: 0.0025)
  SingleSource/Benchmarks/Shootout-C++/matrix: 4.22% (0.2513 => 0.2619, std.dev.: 0.0036)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/viterbi/viterbi: 38.91% (2.5688 => 3.5683, std.dev.: 0.0977)
  MultiSource/Applications/sgefa/sgefa: 29.95% (1.1695 => 1.5198, std.dev.: 0.0151)
  SingleSource/Benchmarks/Misc/perlin: 26.57% (3.6271 => 4.5907, std.dev.: 0.0156)
  SingleSource/Benchmarks/Stanford/Puzzle: 22.06% (0.1455 => 0.1776, std.dev.: 0.0089)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 17.46% (6.1372 => 7.2087, std.dev.: 0.0327)
  SingleSource/Benchmarks/Misc/mandel: 16.76% (1.0293 => 1.2018, std.dev.: 0.0036)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.00% (0.9806 => 1.1375, std.dev.: 0.0411)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.62% (1.2224 => 1.3767, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.30% (5.2003 => 5.6319, std.dev.: 0.0549)
  SingleSource/Benchmarks/Shootout/strcat: 8.24% (0.1456 => 0.1576, std.dev.: 0.0007)
  MultiSource/Applications/lua/lua: 6.71% (28.2496 => 30.1452, std.dev.: 0.5926)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.45% (3.1853 => 3.3906, std.dev.: 0.0397)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 5.17% (4.6639 => 4.9051, std.dev.: 0.0345)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 5.13% (3.2201 => 3.3854, std.dev.: 0.0174)
  SingleSource/Benchmarks/Misc/fbench: 4.90% (4.7508 => 4.9837, std.dev.: 0.0397)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.38% (2.8994 => 3.0263, std.dev.: 0.0347)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.29% (5.9362 => 6.1910, std.dev.: 0.0153)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.93% (5.5010 => 5.7171, std.dev.: 0.0293)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.73% (5.2788 => 5.4759, std.dev.: 0.0162)
  MultiSource/Benchmarks/sim/sim: 2.88% (3.8805 => 3.9922, std.dev.: 0.0019)
  SingleSource/Benchmarks/CoyoteBench/almabench: 2.23% (34.3107 => 35.0766, std.dev.: 0.1588)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.22% (4.3727 => 4.4699, std.dev.: 0.0139)
  MultiSource/Benchmarks/PAQ8p/paq8p: 2.06% (94.2966 => 96.2379, std.dev.: 0.6658)
  SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (16.5355 => 16.7079, std.dev.: 0.0283)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -10.59% (0.1322 => 0.1182, std.dev.: 0.0040)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.43% (1.2911 => 0.7304, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -38.02% (4.4050 => 2.7304, std.dev.: 0.0059)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -24.59% (1.6105 => 1.2145, std.dev.: 0.0226)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -20.89% (4.8986 => 3.8751, std.dev.: 0.0208)
  SingleSource/Benchmarks/Shootout/hash: -20.64% (5.3656 => 4.2580, std.dev.: 0.0372)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -20.15% (5.7264 => 4.5723, std.dev.: 0.0180)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -18.20% (6.2328 => 5.0985, std.dev.: 0.0248)
  SingleSource/Benchmarks/Shootout-C++/hash: -17.26% (0.7941 => 0.6570, std.dev.: 0.0442)
  MultiSource/Applications/lambda-0_1_3/lambda: -17.15% (9.1099 => 7.5480, std.dev.: 0.0148)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -15.93% (25.3677 => 21.3271, std.dev.: 0.1055)
  MultiSource/Benchmarks/Olden/tsp/tsp: -13.83% (1.6613 => 1.4316, std.dev.: 0.0794)
  SingleSource/Benchmarks/Misc/salsa20: -13.08% (10.3398 => 8.9872, std.dev.: 0.2161)
  MultiSource/Benchmarks/nbench/nbench: -11.40% (22.3004 => 19.7574, std.dev.: 0.9749)
  MultiSource/Applications/siod/siod: -10.16% (3.7240 => 3.3456, std.dev.: 0.0680)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -9.27% (2.4808 => 2.2509, std.dev.: 0.0841)
  SingleSource/Regression/C/uint64_to_float: -8.79% (1.6851 => 1.5370, std.dev.: 0.0206)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -8.26% (9.8728 => 9.0578, std.dev.: 0.0298)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -7.17% (4.5717 => 4.2439, std.dev.: 0.0111)
  SingleSource/Benchmarks/Shootout-C++/hash2: -6.23% (3.5939 => 3.3700, std.dev.: 0.0403)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.98% (5.5889 => 5.2548, std.dev.: 0.0159)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -4.76% (1.3084 => 1.2461, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.62% (5.3184 => 5.0728, std.dev.: 0.0611)
  SingleSource/Benchmarks/Misc/flops: -4.12% (10.2170 => 9.7964, std.dev.: 0.0362)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.96% (5.3276 => 5.1165, std.dev.: 0.0545)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -3.86% (1.6535 => 1.5896, std.dev.: 0.0112)
  MultiSource/Applications/hexxagon/hexxagon: -3.54% (15.4979 => 14.9487, std.dev.: 0.1315)
  SingleSource/Benchmarks/Misc/whetstone: -3.51% (3.5970 => 3.4709, std.dev.: 0.0081)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.19% (1.4783 => 1.4312, std.dev.: 0.0104)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -2.90% (1.6440 => 1.5964, std.dev.: 0.0147)
  SingleSource/Benchmarks/Shootout/sieve: -2.87% (8.0178 => 7.7876, std.dev.: 0.0370)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.58% (48.3307 => 47.0829, std.dev.: 0.2127)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.42% (1.6980 => 1.6569, std.dev.: 0.0108)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.38% (0.6548 => 0.6392, std.dev.: 0.0050)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.15% (1.1791 => 1.1537, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.09% (4.2167 => 4.1286, std.dev.: 0.0024)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.88% (5.9068 => 5.7958, std.dev.: 0.0297)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.83% (4.5094 => 4.4269, std.dev.: 0.0195)
  MultiSource/Benchmarks/Olden/power/power: -1.43% (1.2558 => 1.2378, std.dev.: 0.0042)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.43% (4.7814 => 4.7131, std.dev.: 0.0233)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.35% (12.1841 => 12.0192, std.dev.: 0.0075)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -6.11% (0.1441 => 0.1353, std.dev.: 0.0186)

Report Time: 0.74s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130703/edba4ef1/attachment.html>


More information about the llvm-testresults mailing list