[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Aug 23 15:17:00 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14721?compare_to=14717&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14721, Order: 189133, Start Time: 2013-08-23 20:21:58, End Time: 2013-08-23 22:19:10
      To: 14717, Order: 189113, Start Time: 2013-08-23 18:06:05, End Time: 2013-08-23 19:59:43
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 36 (59 on baseline)
Performance Improvements: 0 (24 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1071 (1024 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Fhourstones/fhourstones: 72.62% (0.1724 => 0.2976, std.dev.: 0.0038)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 44.89% (0.1087 => 0.1575, std.dev.: 0.0116)
  MultiSource/Benchmarks/Olden/mst/mst: 37.62% (0.1454 => 0.2001, std.dev.: 0.0115)
  MultiSource/Benchmarks/Olden/bh/bh: 33.71% (0.3438 => 0.4597, std.dev.: 0.0194)
  MultiSource/Benchmarks/MallocBench/gs/gs: 27.37% (4.7999 => 6.1137, std.dev.: 0.3291)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 26.20% (7.7578 => 9.7907, std.dev.: 0.1016)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 22.07% (0.7418 => 0.9055, std.dev.: 0.0370)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.76% (0.1498 => 0.1809, std.dev.: 0.0112)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.39% (1.5522 => 1.8222, std.dev.: 0.0960)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.67% (5.9593 => 6.9527, std.dev.: 0.1641)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.49% (1.0488 => 1.2113, std.dev.: 0.0301)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 14.15% (15.3808 => 17.5573, std.dev.: 0.6457)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 13.09% (4.2835 => 4.8443, std.dev.: 0.0887)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.70% (2.6672 => 2.9259, std.dev.: 0.0983)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 2.50% (0.5632 => 0.5773, std.dev.: 0.0014)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 82.69% (0.1641 => 0.2998, std.dev.: 0.0232)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 69.15% (0.8888 => 1.5034, std.dev.: 0.0487)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 47.29% (1.2621 => 1.8589, std.dev.: 0.0617)
  MultiSource/Applications/SPASS/SPASS: 39.02% (8.4662 => 11.7698, std.dev.: 0.6403)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 34.04% (0.4356 => 0.5839, std.dev.: 0.0194)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 29.63% (37.5524 => 48.6782, std.dev.: 2.0880)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.99% (2.5788 => 3.2748, std.dev.: 0.0506)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.48% (1.2471 => 1.5773, std.dev.: 0.0292)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 25.71% (2.6835 => 3.3734, std.dev.: 0.2247)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 22.75% (0.0778 => 0.0955, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc/flops: 19.41% (8.2299 => 9.8271, std.dev.: 0.0257)
  MultiSource/Benchmarks/llubenchmark/llu: 19.09% (2.1016 => 2.5027, std.dev.: 0.0691)
  MultiSource/Applications/JM/ldecod/ldecod: 18.59% (0.0651 => 0.0772, std.dev.: 0.0043)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 17.14% (0.2759 => 0.3232, std.dev.: 0.0169)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 8.34% (3.1516 => 3.4144, std.dev.: 0.0611)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.28% (2.5169 => 2.6750, std.dev.: 0.0464)
  MultiSource/Benchmarks/Olden/bh/bh: 5.72% (2.4412 => 2.5809, std.dev.: 0.0278)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.72% (16.2307 => 16.6724, std.dev.: 0.1400)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.33% (3.5941 => 3.6780, std.dev.: 0.0135)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.33% (1.2645 => 1.2940, std.dev.: 0.0067)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.98% (1.6106 => 1.6425, std.dev.: 0.0108)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.53% (0.1307 => 0.1327, std.dev.: 0.0071)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Fhourstones/fhourstones: 71.92% (0.1731 => 0.2976, std.dev.: 0.0038)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 43.70% (0.0778 => 0.1118, std.dev.: 0.0126)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 38.04% (0.1141 => 0.1575, std.dev.: 0.0116)
  MultiSource/Benchmarks/Olden/mst/mst: 37.62% (0.1454 => 0.2001, std.dev.: 0.0115)
  MultiSource/Benchmarks/Olden/bh/bh: 27.59% (0.3603 => 0.4597, std.dev.: 0.0194)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 27.09% (7.7035 => 9.7907, std.dev.: 0.1016)
  MultiSource/Benchmarks/FreeBench/distray/distray: 23.52% (0.1033 => 0.1276, std.dev.: 0.0042)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 21.85% (0.9941 => 1.2113, std.dev.: 0.0301)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.33% (0.1491 => 0.1809, std.dev.: 0.0112)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 20.94% (0.7487 => 0.9055, std.dev.: 0.0370)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.23% (1.5544 => 1.8222, std.dev.: 0.0960)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 14.13% (4.2444 => 4.8443, std.dev.: 0.0887)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.91% (15.5498 => 17.5573, std.dev.: 0.6457)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.81% (6.1631 => 6.9527, std.dev.: 0.1641)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.75% (0.2721 => 0.3068, std.dev.: 0.0122)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.87% (2.6390 => 2.9259, std.dev.: 0.0983)
  MultiSource/Applications/JM/lencod/lencod: 8.18% (18.5029 => 20.0157, std.dev.: 0.4939)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 2.10% (0.5654 => 0.5773, std.dev.: 0.0014)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 72.44% (3.7285 => 6.4296, std.dev.: 0.0635)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.37% (2.8867 => 4.2831, std.dev.: 0.1272)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 48.03% (1.2558 => 1.8589, std.dev.: 0.0617)
  MultiSource/Benchmarks/FreeBench/neural/neural: 41.00% (0.3171 => 0.4471, std.dev.: 0.0165)
  MultiSource/Benchmarks/Olden/mst/mst: 40.49% (0.2134 => 0.2998, std.dev.: 0.0232)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 37.52% (0.4246 => 0.5839, std.dev.: 0.0194)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 37.15% (1.0962 => 1.5034, std.dev.: 0.0487)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 31.96% (36.8900 => 48.6782, std.dev.: 2.0880)
  MultiSource/Applications/SPASS/SPASS: 27.63% (9.2220 => 11.7698, std.dev.: 0.6403)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.50% (2.6094 => 3.2748, std.dev.: 0.0506)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 24.98% (2.6992 => 3.3734, std.dev.: 0.2247)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 24.84% (1.5030 => 1.8764, std.dev.: 0.0303)
  SingleSource/Benchmarks/Shootout/hash: 24.08% (4.1846 => 5.1924, std.dev.: 0.3576)
  MultiSource/Benchmarks/llubenchmark/llu: 23.98% (2.0187 => 2.5027, std.dev.: 0.0691)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 20.64% (0.2679 => 0.3232, std.dev.: 0.0169)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 19.97% (1.3148 => 1.5773, std.dev.: 0.0292)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 13.96% (2.9962 => 3.4144, std.dev.: 0.0611)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.46% (14.9584 => 16.6724, std.dev.: 0.1400)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.88% (7.0762 => 7.8463, std.dev.: 0.0204)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 9.94% (1.2557 => 1.3805, std.dev.: 0.0147)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 9.01% (2.9568 => 3.2232, std.dev.: 0.0586)
  MultiSource/Applications/JM/lencod/lencod: 8.88% (7.1799 => 7.8175, std.dev.: 0.1277)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.20% (5.4910 => 5.9410, std.dev.: 0.0896)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.64% (48.3256 => 52.0156, std.dev.: 0.1861)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.93% (3.2027 => 3.4248, std.dev.: 0.0267)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.65% (2.5081 => 2.6750, std.dev.: 0.0464)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.00% (5.3042 => 5.6226, std.dev.: 0.1109)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 6.00% (5.5008 => 5.8306, std.dev.: 0.0460)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.97% (3.4085 => 3.6121, std.dev.: 0.0142)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.25% (4.3151 => 4.4983, std.dev.: 0.0574)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.04% (3.5351 => 3.6780, std.dev.: 0.0135)
  MultiSource/Applications/spiff/spiff: 3.89% (2.7609 => 2.8683, std.dev.: 0.0027)
  MultiSource/Benchmarks/Olden/bh/bh: 3.74% (2.4879 => 2.5809, std.dev.: 0.0278)
  SingleSource/Benchmarks/Misc/whetstone: 3.30% (3.4559 => 3.5698, std.dev.: 0.0193)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.26% (25.0200 => 25.8351, std.dev.: 0.1921)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.09% (4.8739 => 5.0245, std.dev.: 0.0184)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.93% (1.5957 => 1.6425, std.dev.: 0.0108)
  SingleSource/Benchmarks/Shootout-C++/hash2: 2.90% (3.3877 => 3.4861, std.dev.: 0.0273)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.70% (12.8625 => 13.2098, std.dev.: 0.1283)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.38% (1.2639 => 1.2940, std.dev.: 0.0067)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.13% (4.9040 => 4.9596, std.dev.: 0.0175)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/bisort/bisort: -22.57% (0.1072 => 0.0830, std.dev.: 0.0089)
  MultiSource/Applications/hbd/hbd: -13.99% (2.0193 => 1.7369, std.dev.: 0.1028)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -10.44% (0.7091 => 0.6351, std.dev.: 0.0226)
  MultiSource/Applications/lambda-0_1_3/lambda: -9.62% (0.9461 => 0.8551, std.dev.: 0.0054)
  MultiSource/Benchmarks/PAQ8p/paq8p: -5.30% (2.6853 => 2.5429, std.dev.: 0.0370)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.02% (0.3309 => 0.3209, std.dev.: 0.0033)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/simul/simul: -96.40% (0.0111 => 0.0004, std.dev.: 0.0017)
  MultiSource/Applications/lemon/lemon: -34.77% (1.4194 => 0.9259, std.dev.: 0.0310)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -31.90% (2.1022 => 1.4316, std.dev.: 0.0102)
  MultiSource/Benchmarks/MallocBench/gs/gs: -28.51% (0.1189 => 0.0850, std.dev.: 0.0065)
  MultiSource/Applications/viterbi/viterbi: -26.86% (3.4923 => 2.5541, std.dev.: 0.0603)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.72% (6.9552 => 5.2356, std.dev.: 0.0502)
  SingleSource/Benchmarks/Misc/perlin: -21.36% (4.5989 => 3.6164, std.dev.: 0.1589)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.10% (6.2627 => 5.4420, std.dev.: 0.2462)
  MultiSource/Benchmarks/mafft/pairlocalalign: -5.19% (47.2250 => 44.7719, std.dev.: 0.5769)
  SingleSource/Benchmarks/Misc/fbench: -5.11% (4.9602 => 4.7068, std.dev.: 0.0338)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.71% (3.8119 => 3.6322, std.dev.: 0.0569)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.67% (1.7207 => 1.6575, std.dev.: 0.0190)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.42% (6.0444 => 5.8377, std.dev.: 0.0682)
  SingleSource/Regression/C/uint64_to_float: -3.14% (1.5184 => 1.4707, std.dev.: 0.0137)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.02% (6.1482 => 5.9624, std.dev.: 0.0617)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.96% (0.7355 => 0.7137, std.dev.: 0.0080)
  MultiSource/Applications/sgefa/sgefa: -2.52% (1.4030 => 1.3677, std.dev.: 0.0013)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -2.45% (21.6864 => 21.1547, std.dev.: 0.1991)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.70% (0.1378 => 0.1327, std.dev.: 0.0071)

Report Time: 0.68s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130823/9c1a4400/attachment.html>


More information about the llvm-testresults mailing list