[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Jul 8 17:02:59 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13212?compare_to=13210&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 13212, Order: 185873, Start Time: 2013-07-08 22:15:01, End Time: 2013-07-09 00:04:17
      To: 13210, Order: 185852, Start Time: 2013-07-08 19:57:57, End Time: 2013-07-08 21:50:19
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 8 (28 on baseline)
Performance Improvements: 22 (50 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1077 (1029 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/SPASS/SPASS: 11.40% (17.3180 => 19.2915, std.dev.: 0.4622)
  MultiSource/Applications/minisat/minisat: 9.86% (0.7995 => 0.8783, std.dev.: 0.0251)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/minisat/minisat: 20.34% (6.5774 => 7.9150, std.dev.: 0.2548)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.35% (2.3990 => 2.5273, std.dev.: 0.0304)
  MultiSource/Applications/spiff/spiff: 1.88% (2.7669 => 2.8189, std.dev.: 0.0145)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.18% (2.7126 => 2.7446, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.17% (5.0242 => 5.0830, std.dev.: 0.0040)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.01% (4.4255 => 4.4704, std.dev.: 0.0017)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -37.84% (0.1184 => 0.0736, std.dev.: 0.0036)
  MultiSource/Benchmarks/Prolangs-C++/NP/np: -33.96% (0.0321 => 0.0212, std.dev.: 0.0027)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -32.22% (0.2151 => 0.1458, std.dev.: 0.0213)
  SingleSource/UnitTests/SignlessTypes/rem: -19.25% (0.1522 => 0.1229, std.dev.: 0.0011)
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: -14.20% (0.1211 => 0.1039, std.dev.: 0.0033)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -10.91% (0.1576 => 0.1404, std.dev.: 0.0042)
  MultiSource/Benchmarks/McCat/08-main/main: -10.73% (0.3337 => 0.2979, std.dev.: 0.0120)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -10.07% (1.1110 => 0.9991, std.dev.: 0.0178)
  MultiSource/Applications/SIBsim4/SIBsim4: -8.01% (1.7737 => 1.6317, std.dev.: 0.0289)
  MultiSource/Benchmarks/sim/sim: -7.15% (0.3999 => 0.3713, std.dev.: 0.0043)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -6.39% (0.1595 => 0.1493, std.dev.: 0.0006)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.88% (0.3725 => 0.3506, std.dev.: 0.0048)
  MultiSource/Benchmarks/Prolangs-C++/office/office: -5.41% (0.2497 => 0.2362, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.21% (1.5477 => 1.4671, std.dev.: 0.0116)
  MultiSource/Benchmarks/FreeBench/neural/neural: -4.91% (0.2159 => 0.2053, std.dev.: 0.0019)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.28% (0.3113 => 0.3011, std.dev.: 0.0026)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: -39.63% (0.0434 => 0.0262, std.dev.: 0.0064)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -14.80% (0.1128 => 0.0961, std.dev.: 0.0054)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -8.28% (0.2054 => 0.1884, std.dev.: 0.0012)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -7.55% (0.1801 => 0.1665, std.dev.: 0.0014)
  MultiSource/Benchmarks/FreeBench/distray/distray: -7.33% (0.2387 => 0.2212, std.dev.: 0.0059)
  MultiSource/Applications/SIBsim4/SIBsim4: -2.52% (3.3405 => 3.2562, std.dev.: 0.0201)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -7.77% (0.1442 => 0.1330, std.dev.: 0.0192)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 36.24% (1.1193 => 1.5249, std.dev.: 0.0895)
  MultiSource/Applications/spiff/spiff: 33.61% (0.9365 => 1.2513, std.dev.: 0.1128)
  MultiSource/Applications/minisat/minisat: 11.97% (0.7844 => 0.8783, std.dev.: 0.0251)
  MultiSource/Applications/SPASS/SPASS: 9.38% (17.6379 => 19.2915, std.dev.: 0.4622)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.04% (1.4991 => 1.5596, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.82% (1.4131 => 1.4671, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.43% (1.5735 => 1.6117, std.dev.: 0.0040)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/viterbi/viterbi: 36.81% (2.5688 => 3.5143, std.dev.: 0.0229)
  MultiSource/Applications/sgefa/sgefa: 30.10% (1.1695 => 1.5215, std.dev.: 0.0061)
  SingleSource/Benchmarks/Misc/perlin: 26.79% (3.6271 => 4.5988, std.dev.: 0.0032)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 16.82% (1.0251 => 1.1975, std.dev.: 0.0415)
  SingleSource/Benchmarks/Misc/mandel: 16.34% (1.0293 => 1.1975, std.dev.: 0.0096)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.08% (6.1372 => 7.1239, std.dev.: 0.2331)
  MultiSource/Applications/lua/lua: 11.64% (28.2496 => 31.5380, std.dev.: 0.3485)
  SingleSource/Benchmarks/Shootout/strcat: 9.07% (0.1456 => 0.1588, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.89% (5.2003 => 5.6106, std.dev.: 0.0263)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.26% (0.4572 => 0.4904, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.91% (3.1853 => 3.3735, std.dev.: 0.0047)
  SingleSource/Benchmarks/Misc/fbench: 4.87% (4.7508 => 4.9823, std.dev.: 0.0161)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.59% (4.6639 => 4.8780, std.dev.: 0.0464)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.50% (2.8994 => 3.0300, std.dev.: 0.0084)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.24% (1.0571 => 1.1019, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.63% (5.2788 => 5.4704, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.84% (5.5010 => 5.6570, std.dev.: 0.0213)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.45% (4.6379 => 4.7514, std.dev.: 0.0291)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.44% (4.3727 => 4.4795, std.dev.: 0.0059)
  SingleSource/Benchmarks/CoyoteBench/almabench: 2.10% (34.3107 => 35.0312, std.dev.: 0.0567)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.01% (5.6582 => 5.7721, std.dev.: 0.0121)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -35.22% (0.1113 => 0.0721, std.dev.: 0.0013)
  SingleSource/Benchmarks/Misc/whetstone: -14.22% (0.1097 => 0.0941, std.dev.: 0.0023)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -10.17% (0.1563 => 0.1404, std.dev.: 0.0042)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.12% (0.2006 => 0.1803, std.dev.: 0.0027)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.30% (1.2911 => 0.7320, std.dev.: 0.0144)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -37.78% (4.4050 => 2.7407, std.dev.: 0.0138)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -23.82% (1.6105 => 1.2269, std.dev.: 0.0043)
  MultiSource/Applications/lambda-0_1_3/lambda: -22.81% (9.1099 => 7.0321, std.dev.: 0.0102)
  SingleSource/Benchmarks/Shootout/hash: -20.89% (5.3656 => 4.2449, std.dev.: 0.0662)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -20.87% (4.8986 => 3.8762, std.dev.: 0.0092)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -20.21% (5.7264 => 4.5693, std.dev.: 0.0179)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -18.45% (6.2328 => 5.0830, std.dev.: 0.0040)
  SingleSource/Benchmarks/Shootout-C++/hash: -16.89% (0.7941 => 0.6600, std.dev.: 0.0262)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.38% (25.3677 => 21.2127, std.dev.: 0.1267)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -14.40% (0.1945 => 0.1665, std.dev.: 0.0014)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -13.38% (1.6679 => 1.4447, std.dev.: 0.0779)
  SingleSource/Benchmarks/Misc/salsa20: -13.00% (10.3398 => 8.9953, std.dev.: 0.0344)
  MultiSource/Benchmarks/Olden/tsp/tsp: -12.48% (1.6613 => 1.4540, std.dev.: 0.0461)
  MultiSource/Benchmarks/FreeBench/neural/neural: -10.76% (0.3513 => 0.3135, std.dev.: 0.0047)
  SingleSource/Regression/C/uint64_to_float: -9.34% (1.6851 => 1.5277, std.dev.: 0.0069)
  MultiSource/Applications/siod/siod: -9.28% (3.7240 => 3.3783, std.dev.: 0.0280)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -8.35% (9.8728 => 9.0487, std.dev.: 0.0071)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -8.30% (0.3267 => 0.2996, std.dev.: 0.0078)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.83% (3.5327 => 3.2562, std.dev.: 0.0201)
  MultiSource/Applications/sqlite3/sqlite3: -7.42% (4.6358 => 4.2917, std.dev.: 0.0424)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -7.11% (4.5717 => 4.2467, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.74% (5.5889 => 5.2121, std.dev.: 0.0224)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.05% (0.4445 => 0.4176, std.dev.: 0.0044)
  SingleSource/Benchmarks/Shootout-C++/hash2: -5.85% (3.5939 => 3.3836, std.dev.: 0.0503)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -4.88% (1.3084 => 1.2445, std.dev.: 0.0109)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.88% (6.3757 => 6.0644, std.dev.: 0.0834)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.86% (5.3184 => 5.0600, std.dev.: 0.0256)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -4.66% (2.5087 => 2.3919, std.dev.: 0.0354)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.22% (5.3276 => 5.1029, std.dev.: 0.0165)
  SingleSource/Benchmarks/Misc/flops: -4.10% (10.2170 => 9.7981, std.dev.: 0.1037)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -3.99% (2.8537 => 2.7397, std.dev.: 0.0325)
  MultiSource/Benchmarks/PAQ8p/paq8p: -3.83% (94.2966 => 90.6819, std.dev.: 1.4017)
  SingleSource/Benchmarks/Misc/whetstone: -3.57% (3.5970 => 3.4687, std.dev.: 0.0043)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -3.51% (1.6535 => 1.5954, std.dev.: 0.0053)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -3.24% (1.6440 => 1.5908, std.dev.: 0.0077)
  MultiSource/Applications/hexxagon/hexxagon: -3.07% (15.4979 => 15.0217, std.dev.: 0.0446)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -2.68% (4.5935 => 4.4704, std.dev.: 0.0017)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.59% (3.8665 => 3.7663, std.dev.: 0.0086)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.20% (4.5094 => 4.4103, std.dev.: 0.0259)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.18% (48.3307 => 47.2762, std.dev.: 0.2088)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.98% (3.6122 => 3.5405, std.dev.: 0.0223)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.69% (4.9946 => 4.9101, std.dev.: 0.0173)
  MultiSource/Benchmarks/Olden/power/power: -1.62% (1.2558 => 1.2355, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.20% (9.6556 => 9.5401, std.dev.: 0.0101)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.12% (1.1791 => 1.1659, std.dev.: 0.0049)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -7.70% (0.1441 => 0.1330, std.dev.: 0.0192)

Report Time: 1.05s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130708/83a2688e/attachment.html>


More information about the llvm-testresults mailing list