[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Dec 16 16:52:38 PST 2013


http://llvm.org/perf/db_default/v4/nts/18499?compare_to=18495&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18499, Order: 197433, Start Time: 2013-12-16 23:10:04, End Time: 2013-12-17 00:56:57
      To: 18495, Order: 197418, Start Time: 2013-12-16 20:53:52, End Time: 2013-12-16 22:42:35
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

New Passes: 3 (0 on baseline)
Performance Regressions: 21 (29 on baseline)
Performance Improvements: 33 (18 on baseline)
Unchanged Tests: 1053 (1063 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

New Passes - Compile Time
-------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Benchmarks/7zip/7zip-benchmark
  MultiSource/Applications/ClamAV/clamscan: -1.64% (17.1177 => 16.8370, std.dev.: 1.0800)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -1.73% (47.6559 => 46.8336, std.dev.: 1.3049)

New Passes - Execution Time
---------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1280, std.dev.: 0.0056)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/McGill/exptree: 60.78% (0.0928 => 0.1492, std.dev.: 0.0076)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 7.81% (0.1383 => 0.1491, std.dev.: 0.0014)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.73% (5.6566 => 5.9241, std.dev.: 0.0488)
  MultiSource/Applications/oggenc/oggenc: 2.78% (5.7537 => 5.9138, std.dev.: 0.0365)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.56% (0.9012 => 0.9243, std.dev.: 0.0051)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.38% (5.0950 => 5.9294, std.dev.: 0.1149)
  SingleSource/Benchmarks/Shootout/heapsort: 11.42% (3.9648 => 4.4174, std.dev.: 0.0737)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 9.65% (3.9902 => 4.3753, std.dev.: 0.0482)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.30% (5.0297 => 5.3968, std.dev.: 0.0422)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.46% (5.5783 => 5.9387, std.dev.: 0.0110)
  MultiSource/Applications/JM/lencod/lencod: 6.22% (7.4099 => 7.8705, std.dev.: 0.0517)
  MultiSource/Benchmarks/nbench/nbench: 6.06% (21.0411 => 22.3172, std.dev.: 0.1630)
  SingleSource/Benchmarks/Shootout-C++/random: 5.53% (2.3469 => 2.4768, std.dev.: 0.0014)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 4.81% (3.9174 => 4.1059, std.dev.: 0.0486)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.12% (96.0282 => 99.9819, std.dev.: 0.6444)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.86% (1.2505 => 1.2863, std.dev.: 0.0019)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.80% (49.3406 => 50.7229, std.dev.: 0.1176)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.13% (2.4710 => 2.5237, std.dev.: 0.0023)
  SingleSource/Benchmarks/Misc/ffbench: 2.08% (1.3966 => 1.4256, std.dev.: 0.0072)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.64% (1.6488 => 1.6758, std.dev.: 0.0091)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.39% (3.5375 => 3.5867, std.dev.: 0.0022)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -26.20% (0.1042 => 0.0769, std.dev.: 0.0010)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -21.60% (1.7733 => 1.3902, std.dev.: 0.0144)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -21.36% (0.0693 => 0.0545, std.dev.: 0.0012)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -20.70% (0.0628 => 0.0498, std.dev.: 0.0007)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -19.91% (0.2712 => 0.2172, std.dev.: 0.0040)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -17.45% (0.1261 => 0.1041, std.dev.: 0.0045)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -16.38% (0.2826 => 0.2363, std.dev.: 0.0011)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -14.91% (6.0267 => 5.1282, std.dev.: 0.0224)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: -13.14% (0.0784 => 0.0681, std.dev.: 0.0017)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.19% (0.1124 => 0.0987, std.dev.: 0.0048)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -10.88% (2.1250 => 1.8937, std.dev.: 0.0109)
  MultiSource/Applications/kimwitu++/kc: -10.68% (20.6973 => 18.4861, std.dev.: 0.7325)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -10.66% (0.3519 => 0.3144, std.dev.: 0.0034)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -10.19% (1.8324 => 1.6456, std.dev.: 0.0096)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -8.86% (1.6107 => 1.4680, std.dev.: 0.0386)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.04% (0.1331 => 0.1224, std.dev.: 0.0022)
  MultiSource/Benchmarks/nbench/nbench: -5.06% (1.2950 => 1.2295, std.dev.: 0.0054)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.96% (7.7053 => 7.3232, std.dev.: 0.1239)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.67% (4.5560 => 4.3890, std.dev.: 0.0532)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.46% (1.4476 => 1.3975, std.dev.: 0.0152)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.39% (1.3173 => 1.2727, std.dev.: 0.0041)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.92% (0.6643 => 0.6449, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.86% (1.4013 => 1.3612, std.dev.: 0.0142)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -44.30% (0.0474 => 0.0264, std.dev.: 0.0038)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -23.52% (0.2011 => 0.1538, std.dev.: 0.0028)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -16.47% (1.7763 => 1.4837, std.dev.: 0.0407)
  SingleSource/Benchmarks/Shootout/matrix: -13.90% (2.1060 => 1.8133, std.dev.: 0.0474)
  MultiSource/Applications/obsequi/Obsequi: -8.91% (2.5824 => 2.3524, std.dev.: 0.0746)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.82% (42.8611 => 41.2254, std.dev.: 0.3288)
  SingleSource/Benchmarks/Shootout-C++/hash: -3.07% (0.7585 => 0.7352, std.dev.: 0.0078)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -2.28% (0.6538 => 0.6389, std.dev.: 0.0041)
  SingleSource/Benchmarks/Shootout/methcall: -1.26% (8.6638 => 8.5548, std.dev.: 0.0330)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.26% (8.5837 => 8.4758, std.dev.: 0.0261)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/McGill/exptree: 60.09% (0.0932 => 0.1492, std.dev.: 0.0076)
  MultiSource/Applications/sqlite3/sqlite3: 41.67% (15.7419 => 22.3016, std.dev.: 0.8806)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 13.92% (25.9661 => 29.5814, std.dev.: 0.3355)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 9.81% (0.1080 => 0.1186, std.dev.: 0.0039)
  MultiSource/Applications/oggenc/oggenc: 7.59% (5.4968 => 5.9138, std.dev.: 0.0365)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.23% (2.5384 => 2.6712, std.dev.: 0.0376)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.19% (0.8787 => 0.9243, std.dev.: 0.0051)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.68% (0.6322 => 0.6618, std.dev.: 0.0037)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.42% (1.9834 => 2.0710, std.dev.: 0.0269)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.67% (1.2356 => 1.2686, std.dev.: 0.0094)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.44% (5.0556 => 5.1282, std.dev.: 0.0224)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 49.78% (2.9492 => 4.4174, std.dev.: 0.0737)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 29.55% (4.5769 => 5.9294, std.dev.: 0.1149)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.49% (5.9583 => 6.9406, std.dev.: 0.0404)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 14.77% (1.4716 => 1.6889, std.dev.: 0.0482)
  SingleSource/Benchmarks/Shootout-C++/ary3: 12.84% (4.6797 => 5.2807, std.dev.: 0.1513)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 12.42% (2.1020 => 2.3630, std.dev.: 0.0156)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 9.35% (4.0012 => 4.3753, std.dev.: 0.0482)
  SingleSource/Benchmarks/Shootout/strcat: 8.40% (0.1417 => 0.1536, std.dev.: 0.0041)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.25% (5.0320 => 5.3968, std.dev.: 0.0422)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 6.48% (35.9684 => 38.2987, std.dev.: 0.7233)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 5.60% (3.8883 => 4.1059, std.dev.: 0.0486)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.91% (3.4043 => 3.5713, std.dev.: 0.0367)
  SingleSource/Benchmarks/Shootout/hash: 4.32% (5.1896 => 5.4137, std.dev.: 0.0129)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 3.21% (1.2463 => 1.2863, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.35% (1.5797 => 1.6168, std.dev.: 0.0119)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.07% (5.9126 => 6.0348, std.dev.: 0.0358)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.63% (11.7894 => 11.9815, std.dev.: 0.0516)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.17% (3.5451 => 3.5867, std.dev.: 0.0022)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -14.91% (0.1938 => 0.1649, std.dev.: 0.0095)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.58% (0.3402 => 0.3144, std.dev.: 0.0034)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.04% (1.5034 => 1.3975, std.dev.: 0.0152)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.97% (0.2540 => 0.2363, std.dev.: 0.0011)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.65% (0.1774 => 0.1656, std.dev.: 0.0014)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.29% (0.6882 => 0.6449, std.dev.: 0.0028)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.28% (2.0207 => 1.8937, std.dev.: 0.0109)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.03% (1.3146 => 1.2616, std.dev.: 0.0136)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.79% (1.4449 => 1.3902, std.dev.: 0.0144)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.45% (1.3182 => 1.2727, std.dev.: 0.0041)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.37% (0.3714 => 0.3589, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.28% (1.4074 => 1.3612, std.dev.: 0.0142)
  MultiSource/Benchmarks/nbench/nbench: -2.78% (1.2647 => 1.2295, std.dev.: 0.0054)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/McGill/misr: -5.91% (0.4029 => 0.3791, std.dev.: 0.0049)
  MultiSource/Benchmarks/nbench/nbench: -4.91% (23.4696 => 22.3172, std.dev.: 0.1630)
  MultiSource/Benchmarks/Olden/em3d/em3d: -2.30% (4.6123 => 4.5060, std.dev.: 0.0357)
  MultiSource/Applications/sqlite3/sqlite3: -2.29% (4.2978 => 4.1993, std.dev.: 0.0195)
  SingleSource/Benchmarks/Shootout/methcall: -1.29% (8.6669 => 8.5548, std.dev.: 0.0330)

Report Time: 1.01s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131216/c37a0626/attachment.html>


More information about the llvm-testresults mailing list