[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Aug 27 10:36:46 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14846?compare_to=14843&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14846, Order: 189357, Start Time: 2013-08-27 15:45:16, End Time: 2013-08-27 17:38:59
      To: 14843, Order: 189341, Start Time: 2013-08-27 13:20:28, End Time: 2013-08-27 15:18:40
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 8 (43 on baseline)
Performance Improvements: 45 (34 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1054 (1030 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 60.11% (0.0702 => 0.1124, std.dev.: 0.0127)
  SingleSource/Benchmarks/Shootout/objinst: 58.87% (0.0496 => 0.0788, std.dev.: 0.0108)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 34.42% (3.7749 => 5.0742, std.dev.: 0.3956)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 12.11% (0.1379 => 0.1546, std.dev.: 0.0006)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 8.55% (2.9422 => 3.1938, std.dev.: 0.0715)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.40% (15.4208 => 16.7169, std.dev.: 0.2431)
  MultiSource/Applications/siod/siod: 3.31% (3.5659 => 3.6840, std.dev.: 0.0309)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.93% (4.1640 => 4.2442, std.dev.: 0.0211)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc/pi: -41.29% (0.0373 => 0.0219, std.dev.: 0.0033)
  SingleSource/Benchmarks/Stanford/Treesort: -40.15% (0.0787 => 0.0471, std.dev.: 0.0072)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -39.82% (0.1675 => 0.1008, std.dev.: 0.0146)
  MultiSource/Benchmarks/Olden/bisort/bisort: -38.28% (0.1199 => 0.0740, std.dev.: 0.0088)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -37.84% (0.1739 => 0.1081, std.dev.: 0.0123)
  SingleSource/Benchmarks/Misc/ffbench: -37.82% (0.1330 => 0.0827, std.dev.: 0.0133)
  SingleSource/Benchmarks/Misc/mandel: -36.73% (0.0795 => 0.0503, std.dev.: 0.0017)
  MultiSource/Benchmarks/Olden/tsp/tsp: -34.35% (0.2128 => 0.1397, std.dev.: 0.0032)
  SingleSource/Benchmarks/Misc/oourafft: -33.05% (0.3664 => 0.2453, std.dev.: 0.0103)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -30.48% (0.4203 => 0.2922, std.dev.: 0.0468)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -27.06% (1.8362 => 1.3393, std.dev.: 0.1196)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -23.47% (0.1338 => 0.1024, std.dev.: 0.0066)
  MultiSource/Benchmarks/McCat/15-trie/trie: -22.87% (0.0822 => 0.0634, std.dev.: 0.0036)
  MultiSource/Applications/lua/lua: -22.65% (5.7467 => 4.4449, std.dev.: 0.4396)
  MultiSource/Benchmarks/Olden/power/power: -19.51% (0.1861 => 0.1498, std.dev.: 0.0006)
  MultiSource/Benchmarks/Olden/mst/mst: -18.83% (0.1747 => 0.1418, std.dev.: 0.0009)
  SingleSource/Benchmarks/McGill/queens: -17.39% (0.0667 => 0.0551, std.dev.: 0.0025)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: -16.33% (0.4262 => 0.3566, std.dev.: 0.0187)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -15.38% (0.1339 => 0.1133, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -15.07% (1.6498 => 1.4011, std.dev.: 0.0706)
  MultiSource/Benchmarks/Prolangs-C++/city/city: -15.03% (1.9713 => 1.6750, std.dev.: 0.1049)
  MultiSource/Applications/minisat/minisat: -13.78% (0.9443 => 0.8142, std.dev.: 0.0355)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -12.30% (7.4355 => 6.5210, std.dev.: 0.1824)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -11.87% (0.1736 => 0.1530, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -10.95% (1.8022 => 1.6049, std.dev.: 0.0162)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.45% (0.3673 => 0.3289, std.dev.: 0.0132)
  MultiSource/Applications/kimwitu++/kc: -10.34% (22.4363 => 20.1160, std.dev.: 0.4522)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -9.28% (0.1810 => 0.1642, std.dev.: 0.0057)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -8.96% (1.8343 => 1.6700, std.dev.: 0.0625)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -8.78% (0.2347 => 0.2141, std.dev.: 0.0069)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -6.67% (0.2444 => 0.2281, std.dev.: 0.0026)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: -47.47% (0.3164 => 0.1662, std.dev.: 0.0101)
  SingleSource/Benchmarks/Stanford/Treesort: -24.07% (0.0914 => 0.0694, std.dev.: 0.0009)
  SingleSource/Benchmarks/Stanford/Puzzle: -19.61% (0.2203 => 0.1771, std.dev.: 0.0053)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -15.59% (1.4095 => 1.1898, std.dev.: 0.0758)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -14.35% (10.4438 => 8.9449, std.dev.: 0.3808)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: -13.67% (0.9587 => 0.8276, std.dev.: 0.0280)
  MultiSource/Benchmarks/Olden/tsp/tsp: -7.88% (1.7661 => 1.6269, std.dev.: 0.0427)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -5.55% (0.2325 => 0.2196, std.dev.: 0.0047)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -4.36% (2.6013 => 2.4880, std.dev.: 0.0177)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.54% (3.7057 => 3.5744, std.dev.: 0.0295)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.40% (5.9449 => 5.8021, std.dev.: 0.0488)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.22% (5.0509 => 4.9387, std.dev.: 0.0304)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.43% (3.2906 => 3.2436, std.dev.: 0.0155)
  MultiSource/Applications/hexxagon/hexxagon: -1.00% (15.6751 => 15.5181, std.dev.: 0.0562)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 5.68% (0.1337 => 0.1413, std.dev.: 0.0210)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 63.37% (0.0688 => 0.1124, std.dev.: 0.0127)
  SingleSource/Benchmarks/Shootout/objinst: 58.55% (0.0497 => 0.0788, std.dev.: 0.0108)
  MultiSource/Benchmarks/FreeBench/neural/neural: 35.15% (0.2071 => 0.2799, std.dev.: 0.0089)
  SingleSource/Benchmarks/Shootout-C++/ary: 9.64% (0.2863 => 0.3139, std.dev.: 0.0104)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 5.21% (0.2168 => 0.2281, std.dev.: 0.0026)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 4.53% (0.2318 => 0.2423, std.dev.: 0.0038)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 77.97% (3.7285 => 6.6357, std.dev.: 0.0129)
  SingleSource/Benchmarks/Shootout/heapsort: 74.23% (2.9123 => 5.0742, std.dev.: 0.3956)
  MultiSource/Benchmarks/FreeBench/neural/neural: 36.80% (0.3171 => 0.4338, std.dev.: 0.0162)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 28.26% (2.9033 => 3.7239, std.dev.: 0.2734)
  SingleSource/Benchmarks/Misc/pi: 26.62% (1.9835 => 2.5115, std.dev.: 0.0190)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.62% (1.5030 => 1.8881, std.dev.: 0.0215)
  SingleSource/Benchmarks/Shootout-C++/hash: 23.54% (0.6295 => 0.7777, std.dev.: 0.0189)
  MultiSource/Benchmarks/llubenchmark/llu: 22.43% (2.0187 => 2.4715, std.dev.: 0.0950)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.85% (9.6817 => 11.6999, std.dev.: 0.0462)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 18.89% (0.1678 => 0.1995, std.dev.: 0.0104)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 16.28% (3.0680 => 3.5675, std.dev.: 0.0533)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 13.26% (0.1365 => 0.1546, std.dev.: 0.0006)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.76% (14.9584 => 16.7169, std.dev.: 0.2431)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.54% (4.9231 => 5.4913, std.dev.: 0.0365)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.90% (7.0762 => 7.8472, std.dev.: 0.0743)
  SingleSource/Benchmarks/Shootout/ary3: 10.56% (5.8158 => 6.4299, std.dev.: 0.0669)
  SingleSource/Benchmarks/Linpack/linpack-pc: 9.55% (48.3256 => 52.9401, std.dev.: 0.2206)
  MultiSource/Applications/siod/siod: 9.12% (3.3761 => 3.6840, std.dev.: 0.0309)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 9.10% (1.2557 => 1.3700, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.37% (2.9467 => 3.1933, std.dev.: 0.0319)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.30% (5.4910 => 5.9467, std.dev.: 0.0597)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 8.02% (2.9568 => 3.1938, std.dev.: 0.0715)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.23% (3.7593 => 3.9936, std.dev.: 0.0374)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.00% (5.3042 => 5.6225, std.dev.: 0.0527)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.66% (3.4085 => 3.6015, std.dev.: 0.0584)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 5.58% (4.0200 => 4.2442, std.dev.: 0.0211)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.48% (5.5008 => 5.8021, std.dev.: 0.0488)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.44% (4.9040 => 5.1710, std.dev.: 0.0144)
  SingleSource/Benchmarks/Shootout-C++/hash2: 5.39% (3.3877 => 3.5703, std.dev.: 0.0599)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.26% (5.1471 => 5.3663, std.dev.: 0.0700)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 4.13% (2.3894 => 2.4880, std.dev.: 0.0177)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.97% (3.3384 => 3.4708, std.dev.: 0.0484)
  SingleSource/Benchmarks/Misc/whetstone: 3.41% (3.4559 => 3.5737, std.dev.: 0.0173)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.31% (25.0200 => 25.8473, std.dev.: 0.0641)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.82% (1.3104 => 1.3473, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.70% (12.8625 => 13.2099, std.dev.: 0.0955)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.26% (1.5957 => 1.6317, std.dev.: 0.0087)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -33.04% (0.2237 => 0.1498, std.dev.: 0.0006)
  MultiSource/Benchmarks/Olden/bisort/bisort: -30.97% (0.1072 => 0.0740, std.dev.: 0.0088)
  MultiSource/Benchmarks/Olden/tsp/tsp: -23.16% (0.1818 => 0.1397, std.dev.: 0.0032)
  MultiSource/Applications/hexxagon/hexxagon: -15.05% (1.3285 => 1.1286, std.dev.: 0.0686)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -9.82% (1.7797 => 1.6049, std.dev.: 0.0162)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.98% (1.6226 => 1.5094, std.dev.: 0.0321)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.95% (1.5815 => 1.4874, std.dev.: 0.0136)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -34.79% (1.4194 => 0.9256, std.dev.: 0.1510)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.13% (2.1022 => 1.4267, std.dev.: 0.0336)
  MultiSource/Applications/viterbi/viterbi: -27.05% (3.4923 => 2.5478, std.dev.: 0.0176)
  MultiSource/Benchmarks/Olden/mst/mst: -22.12% (0.2134 => 0.1662, std.dev.: 0.0101)
  SingleSource/Benchmarks/Misc/perlin: -21.31% (4.5989 => 3.6191, std.dev.: 0.0321)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -15.96% (5.3098 => 4.4626, std.dev.: 0.1736)
  SingleSource/Benchmarks/Misc/mandel: -14.26% (1.1996 => 1.0285, std.dev.: 0.0076)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.88% (0.3557 => 0.3099, std.dev.: 0.0121)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.32% (6.2627 => 5.4912, std.dev.: 0.0838)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.51% (0.5173 => 0.4681, std.dev.: 0.0165)
  SingleSource/Benchmarks/Misc/fp-convert: -6.21% (8.0730 => 7.5713, std.dev.: 0.0575)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.28% (1.7207 => 1.6299, std.dev.: 0.0188)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.49% (3.8119 => 3.6407, std.dev.: 0.0246)
  SingleSource/Benchmarks/Misc/fbench: -4.47% (4.9602 => 4.7385, std.dev.: 0.0152)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.35% (0.7355 => 0.7035, std.dev.: 0.0113)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.63% (21.6864 => 20.9000, std.dev.: 0.1701)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -3.55% (0.2849 => 0.2748, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.43% (6.0444 => 5.8368, std.dev.: 0.0264)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.27% (5.2218 => 5.0513, std.dev.: 0.0520)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.25% (1.1024 => 1.0666, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.05% (5.0417 => 4.8878, std.dev.: 0.0204)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.04% (6.1482 => 5.9616, std.dev.: 0.0479)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.66% (1.8144 => 1.7661, std.dev.: 0.0137)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.25% (8.6172 => 8.4236, std.dev.: 0.0267)
  SingleSource/Benchmarks/Misc/oourafft: -2.21% (3.7891 => 3.7055, std.dev.: 0.0097)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.58% (5.0180 => 4.9387, std.dev.: 0.0304)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.15% (4.4805 => 4.4291, std.dev.: 0.0189)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.54% (0.1378 => 0.1413, std.dev.: 0.0210)

Report Time: 0.77s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130827/f08a4bd7/attachment.html>


More information about the llvm-testresults mailing list