[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Sep 19 15:57:28 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15466?compare_to=15462&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15466, Order: 191030, Start Time: 2013-09-19 21:04:12, End Time: 2013-09-19 23:00:10
      To: 15462, Order: 191022, Start Time: 2013-09-19 18:48:05, End Time: 2013-09-19 20:37:20
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 51 (56 on baseline)
Performance Improvements: 3 (14 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1053 (1037 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2002-05-02-CastTest2: 66.83% (0.0202 => 0.0337, std.dev.: 0.0014)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 61.47% (0.6652 => 1.0741, std.dev.: 0.0218)
  SingleSource/UnitTests/Vector/constpool: 60.22% (9.1764 => 14.7023, std.dev.: 1.4535)
  SingleSource/UnitTests/2002-05-03-NotTest: 57.21% (0.0201 => 0.0316, std.dev.: 0.0032)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 55.03% (0.2635 => 0.4085, std.dev.: 0.0068)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: 54.79% (0.0188 => 0.0291, std.dev.: 0.0039)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 52.76% (0.2701 => 0.4126, std.dev.: 0.0352)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 52.15% (0.1605 => 0.2442, std.dev.: 0.0037)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 44.98% (0.8833 => 1.2806, std.dev.: 0.0880)
  SingleSource/UnitTests/SignlessTypes/ccc: 44.92% (0.0256 => 0.0371, std.dev.: 0.0035)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 34.91% (4.6773 => 6.3100, std.dev.: 0.1777)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 32.97% (4.9112 => 6.5305, std.dev.: 0.3128)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 30.89% (7.3998 => 9.6854, std.dev.: 0.3688)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 18.92% (14.7577 => 17.5504, std.dev.: 0.5901)
  MultiSource/Applications/d/make_dparser: 11.24% (3.5228 => 3.9187, std.dev.: 0.0941)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.23% (1.2265 => 1.3520, std.dev.: 0.0188)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.23% (0.1289 => 0.1408, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.98% (1.3112 => 1.4290, std.dev.: 0.0357)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.03% (1.2635 => 1.3649, std.dev.: 0.0371)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 7.89% (1.3042 => 1.4071, std.dev.: 0.0387)
  MultiSource/Benchmarks/PAQ8p/paq8p: 2.85% (2.5794 => 2.6528, std.dev.: 0.0193)
  MultiSource/Applications/JM/lencod/lencod: 2.79% (17.0044 => 17.4789, std.dev.: 0.1482)
  MultiSource/Applications/lemon/lemon: 1.77% (1.2122 => 1.2337, std.dev.: 0.0077)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 62.54% (0.0566 => 0.0920, std.dev.: 0.0032)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 43.38% (0.1102 => 0.1580, std.dev.: 0.0141)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 37.13% (2.4094 => 3.3041, std.dev.: 0.1715)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 25.38% (2.4941 => 3.1271, std.dev.: 0.0610)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 23.66% (60.8328 => 75.2259, std.dev.: 1.0610)
  SingleSource/Benchmarks/Linpack/linpack-pc: 18.63% (43.1587 => 51.2010, std.dev.: 1.1868)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 16.96% (9.4459 => 11.0483, std.dev.: 0.1346)
  MultiSource/Benchmarks/llubenchmark/llu: 16.77% (1.9612 => 2.2900, std.dev.: 0.1183)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 14.34% (21.5240 => 24.6104, std.dev.: 0.6786)
  SingleSource/Benchmarks/Shootout/matrix: 13.47% (1.8615 => 2.1123, std.dev.: 0.0022)
  SingleSource/Benchmarks/Shootout-C++/moments: 12.77% (0.1151 => 0.1298, std.dev.: 0.0054)
  SingleSource/Benchmarks/Shootout/sieve: 12.23% (7.0698 => 7.9343, std.dev.: 0.2668)
  MultiSource/Applications/lemon/lemon: 7.90% (0.8647 => 0.9330, std.dev.: 0.0166)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.36% (4.0017 => 4.2963, std.dev.: 0.0577)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.08% (5.1092 => 5.4711, std.dev.: 0.0156)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.82% (93.7158 => 99.1706, std.dev.: 1.8105)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 5.09% (6.5565 => 6.8899, std.dev.: 0.0590)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 4.72% (1.4762 => 1.5459, std.dev.: 0.0264)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.21% (13.0260 => 13.5743, std.dev.: 0.1628)
  SingleSource/Benchmarks/Misc/salsa20: 3.90% (7.7509 => 8.0531, std.dev.: 0.0765)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 3.26% (4.1597 => 4.2951, std.dev.: 0.0315)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 3.15% (18.0509 => 18.6191, std.dev.: 0.0587)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.75% (3.8918 => 3.9987, std.dev.: 0.0074)
  MultiSource/Benchmarks/Olden/em3d/em3d: 2.21% (5.0311 => 5.1425, std.dev.: 0.0310)
  SingleSource/Benchmarks/Shootout/ary3: 1.85% (4.6844 => 4.7710, std.dev.: 0.0016)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.46% (3.8006 => 3.8561, std.dev.: 0.0057)
  SingleSource/Benchmarks/Misc/flops: 1.41% (9.4683 => 9.6021, std.dev.: 0.0417)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.05% (5.7890 => 5.8495, std.dev.: 0.0195)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc/pi: -17.50% (2.0568 => 1.6969, std.dev.: 0.1052)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.15% (5.2528 => 5.0875, std.dev.: 0.0413)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.07% (5.9957 => 5.9314, std.dev.: 0.0133)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 9.90% (0.1354 => 0.1488, std.dev.: 0.0156)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/constpool: 65.34% (8.8921 => 14.7023, std.dev.: 1.4535)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 62.32% (0.6617 => 1.0741, std.dev.: 0.0218)
  SingleSource/UnitTests/2002-05-03-NotTest: 62.05% (0.0195 => 0.0316, std.dev.: 0.0032)
  SingleSource/UnitTests/2002-05-02-CastTest2: 60.48% (0.0210 => 0.0337, std.dev.: 0.0014)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 57.05% (0.2601 => 0.4085, std.dev.: 0.0068)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 52.82% (0.1598 => 0.2442, std.dev.: 0.0037)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 51.91% (0.2716 => 0.4126, std.dev.: 0.0352)
  SingleSource/UnitTests/SignlessTypes/ccc: 50.81% (0.0246 => 0.0371, std.dev.: 0.0035)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 47.76% (0.8667 => 1.2806, std.dev.: 0.0880)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 35.92% (4.6423 => 6.3100, std.dev.: 0.1777)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 33.30% (7.2661 => 9.6854, std.dev.: 0.3688)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 32.99% (4.9105 => 6.5305, std.dev.: 0.3128)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.23% (14.4764 => 17.5504, std.dev.: 0.5901)
  MultiSource/Applications/d/make_dparser: 12.08% (3.4962 => 3.9187, std.dev.: 0.0941)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.48% (0.1263 => 0.1408, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.50% (1.2932 => 1.4290, std.dev.: 0.0357)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.37% (1.2250 => 1.3520, std.dev.: 0.0188)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.76% (1.2550 => 1.3649, std.dev.: 0.0371)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.67% (1.2948 => 1.4071, std.dev.: 0.0387)
  MultiSource/Applications/JM/lencod/lencod: 5.36% (16.5902 => 17.4789, std.dev.: 0.1482)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.30% (0.2908 => 0.3062, std.dev.: 0.0049)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.87% (1.5333 => 1.6079, std.dev.: 0.0244)
  MultiSource/Applications/lemon/lemon: 4.00% (1.1862 => 1.2337, std.dev.: 0.0077)
  MultiSource/Benchmarks/PAQ8p/paq8p: 3.36% (2.5666 => 2.6528, std.dev.: 0.0193)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 62.54% (0.0566 => 0.0920, std.dev.: 0.0032)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 37.61% (2.4010 => 3.3041, std.dev.: 0.1715)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 26.33% (2.4753 => 3.1271, std.dev.: 0.0610)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 23.91% (60.7119 => 75.2259, std.dev.: 1.0610)
  SingleSource/Benchmarks/Shootout/matrix: 18.61% (1.7809 => 2.1123, std.dev.: 0.0022)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 16.81% (9.4586 => 11.0483, std.dev.: 0.1346)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 14.35% (21.5217 => 24.6104, std.dev.: 0.6786)
  SingleSource/Benchmarks/Shootout-C++/fibo: 10.69% (4.9428 => 5.4711, std.dev.: 0.0156)
  SingleSource/Benchmarks/Shootout/sieve: 9.81% (7.2254 => 7.9343, std.dev.: 0.2668)
  MultiSource/Applications/lemon/lemon: 9.43% (0.8526 => 0.9330, std.dev.: 0.0166)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 8.35% (0.8273 => 0.8964, std.dev.: 0.0216)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.80% (3.9856 => 4.2963, std.dev.: 0.0577)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.11% (1.2516 => 1.3406, std.dev.: 0.0224)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 5.80% (4.0596 => 4.2951, std.dev.: 0.0315)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 5.79% (2.9372 => 3.1072, std.dev.: 0.0586)
  SingleSource/UnitTests/Vector/multiplies: 5.52% (0.5561 => 0.5868, std.dev.: 0.0053)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.15% (6.1088 => 6.4237, std.dev.: 0.0777)
  MultiSource/Benchmarks/BitBench/five11/five11: 4.50% (5.3716 => 5.6135, std.dev.: 0.0495)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.41% (6.5990 => 6.8899, std.dev.: 0.0590)
  MultiSource/Applications/siod/siod: 4.01% (3.5310 => 3.6727, std.dev.: 0.0441)
  SingleSource/Benchmarks/Misc/salsa20: 3.29% (7.7964 => 8.0531, std.dev.: 0.0765)
  MultiSource/Benchmarks/Olden/power/power: 2.33% (1.2170 => 1.2454, std.dev.: 0.0027)
  MultiSource/Benchmarks/Olden/em3d/em3d: 2.26% (5.0288 => 5.1425, std.dev.: 0.0310)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.81% (3.7874 => 3.8561, std.dev.: 0.0057)
  SingleSource/Benchmarks/Misc/flops: 1.68% (9.4433 => 9.6021, std.dev.: 0.0417)
  SingleSource/Benchmarks/Shootout/fib2: 1.64% (3.5966 => 3.6555, std.dev.: 0.0032)
  SingleSource/Benchmarks/Shootout/ary3: 1.57% (4.6972 => 4.7710, std.dev.: 0.0016)
  SingleSource/Benchmarks/Shootout/methcall: 1.43% (8.5434 => 8.6659, std.dev.: 0.0182)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.40% (16.7972 => 17.0321, std.dev.: 0.0248)
  MultiSource/Applications/sqlite3/sqlite3: 1.38% (4.2733 => 4.3321, std.dev.: 0.0185)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.10% (3.9552 => 3.9987, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.06% (5.7884 => 5.8495, std.dev.: 0.0195)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -52.01% (0.5226 => 0.2508, std.dev.: 0.0370)
  MultiSource/Applications/sgefa/sgefa: -46.80% (1.5790 => 0.8400, std.dev.: 0.0453)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.90% (15.9508 => 13.5743, std.dev.: 0.1628)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.59% (20.8247 => 18.6191, std.dev.: 0.0587)
  SingleSource/Benchmarks/Linpack/linpack-pc: -10.54% (57.2347 => 51.2010, std.dev.: 1.1868)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -9.98% (3.4956 => 3.1466, std.dev.: 0.0372)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.34% (50.0284 => 46.3550, std.dev.: 0.3643)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -4.77% (3.0561 => 2.9102, std.dev.: 0.0296)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.34% (4.3592 => 4.2134, std.dev.: 0.0449)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.95% (5.2422 => 5.0875, std.dev.: 0.0413)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.68% (17.1431 => 16.6842, std.dev.: 0.1551)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.48% (2.5938 => 2.5295, std.dev.: 0.0168)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.35% (6.0128 => 5.9314, std.dev.: 0.0133)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.12% (89.7126 => 88.7078, std.dev.: 0.0610)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 10.39% (0.1348 => 0.1488, std.dev.: 0.0156)

Report Time: 0.67s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130919/f77768d3/attachment.html>


More information about the llvm-testresults mailing list