[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Jul 26 20:10:49 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13803?compare_to=13800&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 13803, Order: 187280, Start Time: 2013-07-27 01:24:14, End Time: 2013-07-27 03:12:27
      To: 13800, Order: 187261, Start Time: 2013-07-26 23:05:58, End Time: 2013-07-27 01:00:50
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 4 (22 on baseline)
Performance Improvements: 84 (23 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1019 (1062 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 20.90% (1.9712 => 2.3832, std.dev.: 0.0151)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.46% (0.6349 => 0.6632, std.dev.: 0.0091)
  SingleSource/Benchmarks/Linpack/linpack-pc: 4.00% (50.1692 => 52.1764, std.dev.: 0.0576)
  MultiSource/Applications/viterbi/viterbi: 2.35% (3.4820 => 3.5640, std.dev.: 0.0056)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Stanford/Treesort: -41.59% (0.0791 => 0.0462, std.dev.: 0.0028)
  SingleSource/Benchmarks/Misc/ffbench: -38.57% (0.1304 => 0.0801, std.dev.: 0.0009)
  SingleSource/UnitTests/2002-05-02-CastTest2: -38.55% (0.0332 => 0.0204, std.dev.: 0.0030)
  SingleSource/UnitTests/2003-05-31-CastToBool: -37.65% (0.0425 => 0.0265, std.dev.: 0.0010)
  SingleSource/Benchmarks/Misc/flops-4: -37.42% (0.0497 => 0.0311, std.dev.: 0.0007)
  SingleSource/Benchmarks/Misc-C++/mandel-text: -33.92% (0.0339 => 0.0224, std.dev.: 0.0006)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -29.18% (0.3451 => 0.2444, std.dev.: 0.0359)
  SingleSource/Benchmarks/Stanford/Oscar: -28.69% (0.0969 => 0.0691, std.dev.: 0.0005)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -28.62% (0.1394 => 0.0995, std.dev.: 0.0032)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -23.48% (0.0890 => 0.0681, std.dev.: 0.0002)
  SingleSource/Benchmarks/Stanford/IntMM: -23.12% (0.0597 => 0.0459, std.dev.: 0.0000)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -22.46% (0.0993 => 0.0770, std.dev.: 0.0011)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -14.94% (0.7541 => 0.6414, std.dev.: 0.0049)
  SingleSource/Benchmarks/Dhrystone/dry: -14.57% (0.0714 => 0.0610, std.dev.: 0.0013)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -13.52% (1.7915 => 1.5493, std.dev.: 0.0205)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.79% (3.0357 => 2.6474, std.dev.: 0.0037)
  SingleSource/Benchmarks/BenchmarkGame/n-body: -12.66% (0.0877 => 0.0766, std.dev.: 0.0007)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -12.64% (2.2199 => 1.9392, std.dev.: 0.0104)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -12.57% (4.8527 => 4.2426, std.dev.: 0.0111)
  SingleSource/Benchmarks/Shootout-C++/strcat: -12.52% (0.2628 => 0.2299, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -11.77% (1.1095 => 0.9789, std.dev.: 0.0018)
  SingleSource/Benchmarks/McGill/exptree: -11.44% (0.1101 => 0.0975, std.dev.: 0.0017)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -11.25% (0.1271 => 0.1128, std.dev.: 0.0005)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -11.23% (0.3679 => 0.3266, std.dev.: 0.0002)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -10.83% (0.3990 => 0.3558, std.dev.: 0.0007)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -10.55% (0.1583 => 0.1416, std.dev.: 0.0003)
  SingleSource/Benchmarks/McGill/chomp: -10.04% (0.2081 => 0.1872, std.dev.: 0.0012)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -9.76% (0.4684 => 0.4227, std.dev.: 0.0039)
  SingleSource/Benchmarks/Misc-C++/bigfib: -9.46% (0.8016 => 0.7258, std.dev.: 0.0019)
  SingleSource/Benchmarks/Stanford/Puzzle: -9.38% (0.1375 => 0.1246, std.dev.: 0.0027)
  SingleSource/Benchmarks/Shootout-C++/objinst: -9.11% (0.2634 => 0.2394, std.dev.: 0.0011)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -8.84% (0.8757 => 0.7983, std.dev.: 0.0042)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: -8.75% (0.4719 => 0.4306, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -8.60% (0.2373 => 0.2169, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -8.41% (0.2342 => 0.2145, std.dev.: 0.0014)
  SingleSource/Benchmarks/Shootout-C++/hash: -8.28% (0.4950 => 0.4540, std.dev.: 0.0026)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -7.93% (0.5753 => 0.5297, std.dev.: 0.0046)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: -7.91% (0.3908 => 0.3599, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc/oourafft: -7.29% (0.2457 => 0.2278, std.dev.: 0.0011)
  SingleSource/Benchmarks/Shootout-C++/ary2: -7.24% (0.3231 => 0.2997, std.dev.: 0.0004)
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.91% (0.2330 => 0.2169, std.dev.: 0.0005)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.85% (0.7458 => 0.6947, std.dev.: 0.0193)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -6.81% (0.2392 => 0.2229, std.dev.: 0.0006)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -6.28% (0.1592 => 0.1492, std.dev.: 0.0007)
  SingleSource/Benchmarks/Misc/ReedSolomon: -6.16% (0.2467 => 0.2315, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout-C++/sieve: -3.32% (0.3318 => 0.3208, std.dev.: 0.0027)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.32% (6.5710 => 6.4842, std.dev.: 0.0083)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: -56.04% (1.7363 => 0.7633, std.dev.: 0.3260)
  MultiSource/Benchmarks/Olden/mst/mst: -55.89% (0.3081 => 0.1359, std.dev.: 0.0659)
  SingleSource/Benchmarks/Stanford/Towers: -43.98% (0.0332 => 0.0186, std.dev.: 0.0037)
  SingleSource/Benchmarks/Stanford/Bubblesort: -35.53% (0.0501 => 0.0323, std.dev.: 0.0032)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -34.58% (6.8951 => 4.5111, std.dev.: 0.0140)
  SingleSource/Benchmarks/Stanford/Treesort: -27.26% (0.1005 => 0.0731, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -27.09% (4.3347 => 3.1605, std.dev.: 0.1170)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -24.41% (1.9713 => 1.4902, std.dev.: 0.1489)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -21.03% (3.7115 => 2.9311, std.dev.: 0.0830)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -13.49% (33.4545 => 28.9423, std.dev.: 0.7588)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -12.66% (46.0074 => 40.1838, std.dev.: 0.2435)
  SingleSource/Benchmarks/McGill/chomp: -12.00% (1.2157 => 1.0698, std.dev.: 0.0046)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -9.96% (40.8270 => 36.7617, std.dev.: 1.1197)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -8.92% (66.9822 => 61.0107, std.dev.: 0.4182)
  SingleSource/Benchmarks/Shootout-C++/hash: -8.55% (0.6937 => 0.6344, std.dev.: 0.0117)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.86% (3.1926 => 2.9416, std.dev.: 0.0265)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -6.68% (0.3129 => 0.2920, std.dev.: 0.0034)
  SingleSource/Benchmarks/Misc/flops-7: -6.17% (1.8451 => 1.7313, std.dev.: 0.0044)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -4.62% (2.8878 => 2.7545, std.dev.: 0.0063)
  SingleSource/Benchmarks/Misc/ffbench: -4.27% (1.4600 => 1.3976, std.dev.: 0.0030)
  SingleSource/Benchmarks/Misc-C++/bigfib: -4.15% (0.3468 => 0.3324, std.dev.: 0.0005)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -3.41% (2.5118 => 2.4261, std.dev.: 0.0193)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -3.17% (4.1476 => 4.0161, std.dev.: 0.0032)
  SingleSource/Benchmarks/Misc/lowercase: -3.10% (0.7996 => 0.7748, std.dev.: 0.0032)
  SingleSource/Benchmarks/Dhrystone/fldry: -2.97% (0.6803 => 0.6601, std.dev.: 0.0034)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -1.96% (4.0574 => 3.9777, std.dev.: 0.0152)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.92% (3.3076 => 3.2440, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc/richards_benchmark: -1.73% (1.3673 => 1.3436, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -1.43% (5.4506 => 5.3728, std.dev.: 0.0181)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -1.35% (21.2818 => 20.9949, std.dev.: 0.0771)
  SingleSource/Benchmarks/Misc/flops-4: -1.30% (1.6397 => 1.6184, std.dev.: 0.0057)
  SingleSource/Benchmarks/Misc/flops-3: -1.30% (2.0736 => 2.0467, std.dev.: 0.0011)
  SingleSource/Benchmarks/Shootout-C++/methcall: -1.28% (11.6570 => 11.5076, std.dev.: 0.0570)
  SingleSource/Benchmarks/Misc/flops-8: -1.20% (2.5734 => 2.5425, std.dev.: 0.0089)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.19% (4.4913 => 4.4379, std.dev.: 0.0197)
  SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.5168 => 1.5003, std.dev.: 0.0031)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -1.07% (1.4352 => 1.4198, std.dev.: 0.0035)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 4.92% (0.1300 => 0.1364, std.dev.: 0.0026)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.08% (1.5437 => 1.6530, std.dev.: 0.0217)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.80% (2.8867 => 4.2955, std.dev.: 0.0309)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 34.31% (0.0341 => 0.0458, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc/pi: 20.15% (1.9835 => 2.3832, std.dev.: 0.0151)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 19.01% (0.0526 => 0.0626, std.dev.: 0.0007)
  MultiSource/Applications/siod/siod: 13.81% (3.3761 => 3.8422, std.dev.: 0.0482)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.34% (5.4910 => 5.9487, std.dev.: 0.0456)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.97% (48.3256 => 52.1764, std.dev.: 0.0576)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 7.93% (1.2557 => 1.3553, std.dev.: 0.0287)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.41% (3.2027 => 3.4401, std.dev.: 0.0306)
  SingleSource/Benchmarks/McGill/chomp: 6.44% (1.0051 => 1.0698, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.95% (5.5008 => 5.8280, std.dev.: 0.0157)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.94% (5.3042 => 5.6193, std.dev.: 0.0173)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.90% (3.4085 => 3.6095, std.dev.: 0.0325)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.38% (5.1471 => 5.3728, std.dev.: 0.0181)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.24% (4.3151 => 4.4980, std.dev.: 0.0214)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.54% (4.8739 => 5.0462, std.dev.: 0.0088)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.18% (3.5351 => 3.6121, std.dev.: 0.0215)
  SingleSource/Benchmarks/Misc/ffbench: 2.17% (1.3679 => 1.3976, std.dev.: 0.0030)
  MultiSource/Applications/viterbi/viterbi: 2.05% (3.4923 => 3.5640, std.dev.: 0.0056)
  SingleSource/Benchmarks/Misc/flops: 1.56% (9.7664 => 9.9190, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.22% (9.7023 => 9.8202, std.dev.: 0.0083)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -37.15% (0.2237 => 0.1406, std.dev.: 0.0261)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -10.15% (0.3655 => 0.3284, std.dev.: 0.0029)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.81% (0.7189 => 0.6987, std.dev.: 0.0047)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.97% (0.0816 => 0.0498, std.dev.: 0.0044)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.46% (2.1022 => 1.4198, std.dev.: 0.0035)
  MultiSource/Benchmarks/MallocBench/gs/gs: -27.92% (0.1189 => 0.0857, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.33% (6.9552 => 5.2632, std.dev.: 0.3337)
  MultiSource/Applications/sgefa/sgefa: -12.94% (1.4030 => 1.2215, std.dev.: 0.0119)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.83% (6.2627 => 5.4593, std.dev.: 0.2176)
  MultiSource/Benchmarks/mafft/pairlocalalign: -5.98% (47.2250 => 44.3992, std.dev.: 0.3496)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.55% (0.7355 => 0.7020, std.dev.: 0.0041)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.38% (0.2854 => 0.2729, std.dev.: 0.0014)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.59% (0.3649 => 0.3518, std.dev.: 0.0046)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.49% (1.7207 => 1.6606, std.dev.: 0.0196)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.19% (21.6864 => 20.9949, std.dev.: 0.0771)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.17% (6.0444 => 5.8529, std.dev.: 0.0371)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.81% (6.1482 => 5.9752, std.dev.: 0.0375)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -1.81% (2.8052 => 2.7545, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.78% (5.8810 => 5.7762, std.dev.: 0.0398)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.34% (4.9231 => 4.8571, std.dev.: 0.0104)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.30% (2.1343 => 2.1065, std.dev.: 0.0008)
  SingleSource/Benchmarks/Misc/lowercase: -1.29% (0.7849 => 0.7748, std.dev.: 0.0032)
  SingleSource/Benchmarks/Misc/oourafft: -1.17% (3.7891 => 3.7449, std.dev.: 0.0011)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.02% (0.1378 => 0.1364, std.dev.: 0.0026)

Report Time: 0.69s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130726/64cec1c9/attachment.html>


More information about the llvm-testresults mailing list