[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Oct 8 16:21:26 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16118?compare_to=16115&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16118, Order: 192232, Start Time: 2013-10-08 21:31:18, End Time: 2013-10-08 23:24:27
      To: 16115, Order: 192213, Start Time: 2013-10-08 19:10:47, End Time: 2013-10-08 21:05:18
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 27 (43 on baseline)
Performance Improvements: 30 (11 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1050 (1053 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 69.65% (0.0570 => 0.0967, std.dev.: 0.0035)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 34.88% (5.0418 => 6.8004, std.dev.: 0.1311)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 28.26% (5.0952 => 6.5350, std.dev.: 0.3052)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 24.28% (0.3324 => 0.4131, std.dev.: 0.0214)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 23.16% (1.6579 => 2.0419, std.dev.: 0.1102)
  MultiSource/Benchmarks/nbench/nbench: 22.32% (1.2798 => 1.5654, std.dev.: 0.0756)
  MultiSource/Benchmarks/McCat/08-main/main: 19.89% (0.2916 => 0.3496, std.dev.: 0.0220)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 19.56% (7.6188 => 9.1088, std.dev.: 0.5074)
  MultiSource/Benchmarks/mafft/pairlocalalign: 15.96% (10.4161 => 12.0783, std.dev.: 0.2833)
  MultiSource/Benchmarks/MallocBench/gs/gs: 14.81% (5.4138 => 6.2158, std.dev.: 0.2896)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 13.39% (48.3001 => 54.7680, std.dev.: 1.6337)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.74% (6.2926 => 7.0941, std.dev.: 0.1556)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.01% (1.1114 => 1.2227, std.dev.: 0.0368)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.95% (0.1742 => 0.2107, std.dev.: 0.0079)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.47% (62.7176 => 74.2990, std.dev.: 0.9463)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.94% (2.6019 => 2.9646, std.dev.: 0.1257)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 12.05% (10.2012 => 11.4306, std.dev.: 0.1191)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 11.40% (0.8500 => 0.9469, std.dev.: 0.0360)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.70% (1.2603 => 1.3573, std.dev.: 0.0126)
  SingleSource/Regression/C/uint64_to_float: 5.45% (1.4073 => 1.4840, std.dev.: 0.0075)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.29% (1.0172 => 1.0710, std.dev.: 0.0077)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.45% (1.8185 => 1.8813, std.dev.: 0.0094)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 3.25% (2.4997 => 2.5809, std.dev.: 0.0198)
  MultiSource/Applications/lua/lua: 2.80% (29.9303 => 30.7697, std.dev.: 0.1688)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.91% (6.5795 => 6.7049, std.dev.: 0.0108)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.61% (3.9310 => 3.9941, std.dev.: 0.0067)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.10% (8.6433 => 8.7386, std.dev.: 0.0081)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/SignlessTypes/div: -38.03% (0.0568 => 0.0352, std.dev.: 0.0050)
  MultiSource/Applications/SPASS/SPASS: -17.50% (20.3024 => 16.7499, std.dev.: 0.8793)
  SingleSource/UnitTests/SignlessTypes/rem: -16.14% (0.1468 => 0.1231, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.84% (1.4351 => 1.2365, std.dev.: 0.0119)
  MultiSource/Benchmarks/NPB-serial/is/is: -13.17% (0.0896 => 0.0778, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -12.82% (1.4863 => 1.2957, std.dev.: 0.0467)
  SingleSource/Benchmarks/CoyoteBench/almabench: -12.17% (0.0871 => 0.0765, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -11.24% (1.4935 => 1.3256, std.dev.: 0.0569)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -11.23% (1.4528 => 1.2897, std.dev.: 0.0405)
  MultiSource/Applications/JM/lencod/lencod: -10.60% (19.4685 => 17.4049, std.dev.: 0.7284)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -10.34% (0.2320 => 0.2080, std.dev.: 0.0027)
  SingleSource/Benchmarks/McGill/chomp: -9.98% (0.2455 => 0.2210, std.dev.: 0.0026)
  MultiSource/Applications/ClamAV/clamscan: -9.51% (18.8436 => 17.0507, std.dev.: 0.5841)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -9.32% (1.4316 => 1.2982, std.dev.: 0.0471)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: -9.15% (0.3716 => 0.3376, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -9.12% (1.3678 => 1.2431, std.dev.: 0.0301)
  SingleSource/Benchmarks/Shootout-C++/ary2: -8.87% (0.2773 => 0.2527, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -8.74% (1.4485 => 1.3219, std.dev.: 0.0223)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -7.98% (1.3654 => 1.2564, std.dev.: 0.0093)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: -7.95% (0.4125 => 0.3797, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -7.73% (1.3585 => 1.2535, std.dev.: 0.0276)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -7.25% (1.4363 => 1.3322, std.dev.: 0.0113)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -6.66% (0.4237 => 0.3955, std.dev.: 0.0014)
  SingleSource/Benchmarks/Shootout-C++/strcat: -6.58% (0.2189 => 0.2045, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.70% (1.3939 => 1.3145, std.dev.: 0.0012)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: -31.30% (2.5089 => 1.7236, std.dev.: 0.0295)
  MultiSource/Applications/JM/ldecod/ldecod: -30.76% (0.0972 => 0.0673, std.dev.: 0.0048)
  MultiSource/Applications/SPASS/SPASS: -25.77% (11.4209 => 8.4772, std.dev.: 0.7637)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.93% (3.7753 => 3.5891, std.dev.: 0.0014)
  SingleSource/Benchmarks/Shootout-C++/sieve: -1.72% (3.5328 => 3.4720, std.dev.: 0.0220)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -15.68% (0.1614 => 0.1361, std.dev.: 0.0164)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 70.25% (0.0568 => 0.0967, std.dev.: 0.0035)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 52.31% (0.0910 => 0.1386, std.dev.: 0.0179)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 38.49% (4.9105 => 6.8004, std.dev.: 0.1311)
  MultiSource/Benchmarks/MallocBench/gs/gs: 35.47% (4.5883 => 6.2158, std.dev.: 0.2896)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 33.43% (0.3096 => 0.4131, std.dev.: 0.0214)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 32.57% (4.9293 => 6.5350, std.dev.: 0.3052)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 28.95% (5.5014 => 7.0941, std.dev.: 0.1556)
  MultiSource/Benchmarks/nbench/nbench: 25.39% (1.2484 => 1.5654, std.dev.: 0.0756)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 25.36% (7.2661 => 9.1088, std.dev.: 0.5074)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 24.01% (1.6465 => 2.0419, std.dev.: 0.1102)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 23.68% (44.2807 => 54.7680, std.dev.: 1.6337)
  MultiSource/Benchmarks/McCat/08-main/main: 21.81% (0.2870 => 0.3496, std.dev.: 0.0220)
  MultiSource/Benchmarks/mafft/pairlocalalign: 20.90% (9.9903 => 12.0783, std.dev.: 0.2833)
  MultiSource/Applications/siod/siod: 18.01% (2.4480 => 2.8889, std.dev.: 0.0535)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.53% (0.2883 => 0.3302, std.dev.: 0.0154)
  MultiSource/Applications/kimwitu++/kc: 13.89% (18.3608 => 20.9107, std.dev.: 0.7188)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.68% (1.0756 => 1.2227, std.dev.: 0.0368)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.02% (0.1597 => 0.1741, std.dev.: 0.0042)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.82% (4.0397 => 4.3959, std.dev.: 0.1251)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.46% (1.2660 => 1.3605, std.dev.: 0.0327)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.19% (24.6139 => 26.1382, std.dev.: 0.5523)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 5.43% (1.2468 => 1.3145, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.91% (1.2695 => 1.3191, std.dev.: 0.0168)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.98% (1.2007 => 1.2365, std.dev.: 0.0119)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.93% (1.3278 => 1.3534, std.dev.: 0.0093)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 60.55% (7.6426 => 12.2704, std.dev.: 0.1980)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.63% (1.4830 => 1.8779, std.dev.: 0.0134)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.38% (60.7119 => 74.2990, std.dev.: 0.9463)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 20.85% (9.4586 => 11.4306, std.dev.: 0.1191)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.13% (0.1754 => 0.2107, std.dev.: 0.0079)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 19.77% (2.4753 => 2.9646, std.dev.: 0.1257)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 14.46% (0.8273 => 0.9469, std.dev.: 0.0360)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 12.79% (21.5217 => 24.2742, std.dev.: 0.9979)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.48% (0.3501 => 0.3833, std.dev.: 0.0097)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.45% (1.2516 => 1.3573, std.dev.: 0.0126)
  MultiSource/Applications/lambda-0_1_3/lambda: 7.43% (8.1346 => 8.7386, std.dev.: 0.0081)
  SingleSource/UnitTests/Vector/multiplies: 6.65% (0.5561 => 0.5931, std.dev.: 0.0051)
  MultiSource/Applications/lua/lua: 4.23% (29.5202 => 30.7697, std.dev.: 0.1688)
  MultiSource/Applications/siod/siod: 3.09% (3.5310 => 3.6401, std.dev.: 0.0377)
  SingleSource/Regression/C/uint64_to_float: 2.15% (1.4528 => 1.4840, std.dev.: 0.0075)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.65% (16.7972 => 17.0745, std.dev.: 0.0330)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.59% (1.8519 => 1.8813, std.dev.: 0.0094)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.55% (6.6028 => 6.7049, std.dev.: 0.0108)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -52.10% (0.5226 => 0.2503, std.dev.: 0.0314)
  MultiSource/Applications/sgefa/sgefa: -46.88% (1.5790 => 0.8387, std.dev.: 0.0330)
  SingleSource/Benchmarks/Linpack/linpack-pc: -24.44% (57.2347 => 43.2488, std.dev.: 3.6942)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.01% (15.9508 => 13.2380, std.dev.: 0.2604)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.52% (20.8247 => 18.4247, std.dev.: 0.1640)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.52% (3.4956 => 3.1279, std.dev.: 0.0387)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.02% (50.0284 => 46.5160, std.dev.: 0.5599)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.75% (3.7437 => 3.5285, std.dev.: 0.0496)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -3.08% (0.6563 => 0.6361, std.dev.: 0.0074)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.91% (4.3592 => 4.2322, std.dev.: 0.0323)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.64% (17.1431 => 16.6910, std.dev.: 0.0869)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.96% (0.1348 => 0.1361, std.dev.: 0.0164)

Report Time: 0.80s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131008/3e463289/attachment.html>


More information about the llvm-testresults mailing list