[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Dec 1 21:50:56 PST 2013


http://llvm.org/perf/db_default/v4/nts/17795?compare_to=17789&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 17795, Order: 196059, Start Time: 2013-12-02 04:05:05, End Time: 2013-12-02 05:55:00
      To: 17789, Order: 196052, Start Time: 2013-12-01 22:00:50, End Time: 2013-12-01 23:40:33
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 43 (40 on baseline)
Performance Improvements: 16 (10 on baseline)
Unchanged Tests: 1051 (1060 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 74.20% (0.0942 => 0.1641, std.dev.: 0.0072)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: 61.71% (0.0491 => 0.0794, std.dev.: 0.0016)
  MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 49.49% (0.0687 => 0.1027, std.dev.: 0.0125)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 27.78% (0.2653 => 0.3390, std.dev.: 0.0192)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 25.49% (0.8651 => 1.0856, std.dev.: 0.0433)
  MultiSource/Benchmarks/Prolangs-C/football/football: 21.86% (0.9826 => 1.1974, std.dev.: 0.0167)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.81% (1.6874 => 2.0216, std.dev.: 0.0636)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 19.38% (7.2743 => 8.6844, std.dev.: 0.3684)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.69% (5.4857 => 6.2917, std.dev.: 0.0241)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 11.96% (43.8516 => 49.0984, std.dev.: 1.1108)
  MultiSource/Benchmarks/Olden/mst/mst: 9.96% (0.1305 => 0.1435, std.dev.: 0.0010)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.27% (2.7350 => 2.9886, std.dev.: 0.0268)
  MultiSource/Benchmarks/PAQ8p/paq8p: 8.52% (2.4847 => 2.6963, std.dev.: 0.0392)
  MultiSource/Applications/sqlite3/sqlite3: 7.50% (15.8497 => 17.0392, std.dev.: 0.3504)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.36% (4.2453 => 4.5155, std.dev.: 0.0591)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.18% (1.3373 => 1.3665, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.85% (1.3436 => 1.3684, std.dev.: 0.0010)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: 54.30% (2.8449 => 4.3896, std.dev.: 0.3073)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.09% (2.3803 => 3.0252, std.dev.: 0.2076)
  MultiSource/Benchmarks/Olden/bisort/bisort: 24.38% (0.6705 => 0.8340, std.dev.: 0.0510)
  SingleSource/Benchmarks/Shootout/ary3: 21.32% (4.6523 => 5.6441, std.dev.: 0.1941)
  MultiSource/Applications/lemon/lemon: 18.93% (0.8282 => 0.9850, std.dev.: 0.0322)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 13.59% (3.8157 => 4.3342, std.dev.: 0.0930)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 12.95% (0.8273 => 0.9344, std.dev.: 0.0146)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 11.58% (2.0965 => 2.3392, std.dev.: 0.0205)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.85% (1.2944 => 1.4348, std.dev.: 0.0427)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 9.33% (1.0985 => 1.2010, std.dev.: 0.0138)
  SingleSource/Benchmarks/Misc/salsa20: 9.05% (7.4748 => 8.1510, std.dev.: 0.2115)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 9.00% (28.5799 => 31.1511, std.dev.: 0.2908)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 8.97% (9.3127 => 10.1479, std.dev.: 0.2905)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 7.95% (2.3102 => 2.4939, std.dev.: 0.0244)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.54% (6.4494 => 6.9357, std.dev.: 0.0787)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.20% (40.5481 => 42.6584, std.dev.: 0.5995)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 5.16% (3.9419 => 4.1454, std.dev.: 0.0556)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.89% (60.7072 => 63.6745, std.dev.: 1.0087)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.58% (5.8945 => 6.1645, std.dev.: 0.0434)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.52% (95.3769 => 99.6896, std.dev.: 0.7031)
  SingleSource/Benchmarks/Misc/flops: 3.84% (9.2718 => 9.6282, std.dev.: 0.0201)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.12% (3.6312 => 3.7445, std.dev.: 0.0077)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 3.09% (4.0485 => 4.1736, std.dev.: 0.0081)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 2.40% (2.3769 => 2.4340, std.dev.: 0.0139)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.30% (5.9705 => 6.1076, std.dev.: 0.0109)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.87% (5.8102 => 5.9186, std.dev.: 0.0185)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc/pi: -37.07% (2.6112 => 1.6432, std.dev.: 0.0327)
  SingleSource/Benchmarks/Stanford/Puzzle: -8.86% (0.1852 => 0.1688, std.dev.: 0.0017)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -8.84% (1.5079 => 1.3746, std.dev.: 0.0447)
  MultiSource/Benchmarks/Olden/em3d/em3d: -8.00% (4.9131 => 4.5200, std.dev.: 0.0772)
  MultiSource/Benchmarks/sim/sim: -4.74% (4.0115 => 3.8213, std.dev.: 0.0675)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.05% (4.3961 => 4.2180, std.dev.: 0.0236)
  MultiSource/Applications/hexxagon/hexxagon: -4.04% (15.6150 => 14.9839, std.dev.: 0.0395)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -2.95% (3.6019 => 3.4958, std.dev.: 0.0290)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -2.64% (6.0887 => 5.9278, std.dev.: 0.0027)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.57% (51.9668 => 50.6314, std.dev.: 0.2165)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.13% (5.6228 => 5.5032, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.98% (6.0093 => 5.8905, std.dev.: 0.0154)
  MultiSource/Applications/lambda-0_1_3/lambda: -1.85% (7.9866 => 7.8392, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.70% (12.1426 => 11.9361, std.dev.: 0.0765)
  SingleSource/Benchmarks/Shootout-C++/hash2: -1.59% (3.6512 => 3.5932, std.dev.: 0.0139)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -1.02% (6.8388 => 6.7690, std.dev.: 0.0104)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 56.14% (0.1051 => 0.1641, std.dev.: 0.0072)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: 55.38% (0.0511 => 0.0794, std.dev.: 0.0016)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 24.45% (0.2724 => 0.3390, std.dev.: 0.0192)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 22.25% (0.8880 => 1.0856, std.dev.: 0.0433)
  MultiSource/Benchmarks/Prolangs-C/football/football: 20.77% (0.9915 => 1.1974, std.dev.: 0.0167)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.54% (1.7054 => 2.0216, std.dev.: 0.0636)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.60% (7.5124 => 8.6844, std.dev.: 0.3684)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.50% (5.5433 => 6.2917, std.dev.: 0.0241)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 9.31% (44.9186 => 49.0984, std.dev.: 1.1108)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.39% (2.7572 => 2.9886, std.dev.: 0.0268)
  MultiSource/Applications/sqlite3/sqlite3: 8.24% (15.7419 => 17.0392, std.dev.: 0.3504)
  MultiSource/Benchmarks/PAQ8p/paq8p: 6.22% (2.5384 => 2.6963, std.dev.: 0.0392)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.71% (4.2717 => 4.5155, std.dev.: 0.0591)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.42% (0.4793 => 0.4957, std.dev.: 0.0056)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.87% (0.3758 => 0.3866, std.dev.: 0.0036)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: 46.59% (2.9945 => 4.3896, std.dev.: 0.3073)
  MultiSource/Benchmarks/Olden/bisort/bisort: 23.89% (0.6732 => 0.8340, std.dev.: 0.0510)
  SingleSource/Benchmarks/Shootout/ary3: 22.76% (4.5977 => 5.6441, std.dev.: 0.1941)
  SingleSource/Benchmarks/Shootout/sieve: 19.14% (6.7454 => 8.0365, std.dev.: 0.0485)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 16.86% (1.2278 => 1.4348, std.dev.: 0.0427)
  MultiSource/Applications/lemon/lemon: 14.11% (0.8632 => 0.9850, std.dev.: 0.0322)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 11.47% (3.8883 => 4.3342, std.dev.: 0.0930)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 11.28% (2.1020 => 2.3392, std.dev.: 0.0205)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 8.99% (1.1019 => 1.2010, std.dev.: 0.0138)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 8.68% (28.6638 => 31.1511, std.dev.: 0.2908)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.35% (3.5771 => 3.8759, std.dev.: 0.0023)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 8.20% (0.8636 => 0.9344, std.dev.: 0.0146)
  SingleSource/Benchmarks/Misc/salsa20: 7.32% (7.5947 => 8.1510, std.dev.: 0.2115)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 6.78% (2.3355 => 2.4939, std.dev.: 0.0244)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.19% (40.5530 => 42.6584, std.dev.: 0.5995)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 4.27% (3.9755 => 4.1454, std.dev.: 0.0556)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.25% (5.9133 => 6.1645, std.dev.: 0.0434)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.06% (5.0601 => 5.2654, std.dev.: 0.0265)
  SingleSource/Benchmarks/Misc/flops: 3.89% (9.2673 => 9.6282, std.dev.: 0.0201)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.61% (3.6142 => 3.7445, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.30% (5.9126 => 6.1076, std.dev.: 0.0109)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 2.82% (4.0593 => 4.1736, std.dev.: 0.0081)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.92% (2.3882 => 2.4340, std.dev.: 0.0139)
  SingleSource/Benchmarks/Misc/oourafft: 1.22% (3.6501 => 3.6948, std.dev.: 0.0152)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.06% (5.9583 => 6.0214, std.dev.: 0.0213)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.87% (1.3676 => 1.2873, std.dev.: 0.0164)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.06% (1.4277 => 1.3555, std.dev.: 0.0194)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.17% (1.4113 => 1.3665, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.10% (1.4125 => 1.3687, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.68% (1.3918 => 1.3684, std.dev.: 0.0010)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/nbench/nbench: -12.98% (23.4696 => 20.4229, std.dev.: 0.9986)
  MultiSource/Benchmarks/sim/sim: -4.79% (4.0134 => 3.8213, std.dev.: 0.0675)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.23% (6.0535 => 5.9186, std.dev.: 0.0185)
  SingleSource/Benchmarks/Shootout-C++/hash2: -1.84% (3.6605 => 3.5932, std.dev.: 0.0139)
  MultiSource/Applications/lambda-0_1_3/lambda: -1.51% (7.9597 => 7.8392, std.dev.: 0.0065)

Report Time: 0.74s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131201/9d29a42d/attachment.html>


More information about the llvm-testresults mailing list