[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Jun 19 20:34:35 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12556?compare_to=12553&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12556, Order: 184387, Start Time: 2013-06-20 01:46:58, End Time: 2013-06-20 03:35:32
      To: 12553, Order: 184382, Start Time: 2013-06-19 23:39:35, End Time: 2013-06-20 01:26:42
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 29 (38 on baseline)
Performance Improvements: 4 (43 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1074 (1026 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/McCat/05-eks/eks: 48.73% (0.5553 => 0.8259, std.dev.: 0.0211)
  MultiSource/Benchmarks/Olden/power/power: 43.75% (0.1472 => 0.2116, std.dev.: 0.0125)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 42.48% (0.1064 => 0.1516, std.dev.: 0.0091)
  MultiSource/Benchmarks/Olden/em3d/em3d: 40.62% (0.2046 => 0.2877, std.dev.: 0.0188)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 33.30% (0.1021 => 0.1361, std.dev.: 0.0110)
  MultiSource/Benchmarks/McCat/09-vor/vor: 31.37% (0.3589 => 0.4715, std.dev.: 0.0370)
  MultiSource/Benchmarks/Olden/bh/bh: 26.07% (0.3376 => 0.4256, std.dev.: 0.0184)
  MultiSource/Benchmarks/Olden/tsp/tsp: 25.42% (0.1385 => 0.1737, std.dev.: 0.0131)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 21.23% (0.0961 => 0.1165, std.dev.: 0.0004)
  MultiSource/Applications/siod/siod: 9.07% (2.5048 => 2.7321, std.dev.: 0.0520)
  MultiSource/Benchmarks/Olden/mst/mst: 8.67% (0.1431 => 0.1555, std.dev.: 0.0041)
  MultiSource/Applications/sqlite3/sqlite3: 4.65% (16.5303 => 17.2994, std.dev.: 0.2321)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 105.19% (0.1330 => 0.2729, std.dev.: 0.0159)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 42.97% (0.0263 => 0.0376, std.dev.: 0.0004)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.36% (2.4247 => 2.7244, std.dev.: 0.0935)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.19% (18.4821 => 20.3658, std.dev.: 0.4202)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 7.23% (0.3044 => 0.3264, std.dev.: 0.0005)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.79% (2.9848 => 3.1876, std.dev.: 0.0053)
  SingleSource/Benchmarks/Misc/lowercase: 4.73% (0.7712 => 0.8077, std.dev.: 0.0122)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.41% (5.9049 => 6.1655, std.dev.: 0.0106)
  MultiSource/Applications/SIBsim4/SIBsim4: 3.41% (3.2879 => 3.3999, std.dev.: 0.0257)
  SingleSource/Benchmarks/McGill/misr: 3.32% (0.3852 => 0.3980, std.dev.: 0.0005)
  MultiSource/Applications/siod/siod: 2.59% (3.3733 => 3.4608, std.dev.: 0.0105)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.24% (1.4837 => 1.5170, std.dev.: 0.0014)
  SingleSource/Benchmarks/McGill/queens: 2.05% (1.6466 => 1.6803, std.dev.: 0.0017)
  MultiSource/Benchmarks/Olden/bh/bh: 1.94% (2.4226 => 2.4696, std.dev.: 0.0098)
  MultiSource/Benchmarks/Olden/power/power: 1.68% (1.2526 => 1.2737, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.15% (3.0178 => 3.0524, std.dev.: 0.0009)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.06% (5.8676 => 5.9299, std.dev.: 0.0048)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -12.92% (0.1494 => 0.1301, std.dev.: 0.0052)
  SingleSource/Benchmarks/Shootout-C++/lists: -5.13% (0.3004 => 0.2850, std.dev.: 0.0046)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -12.95% (33.9285 => 29.5362, std.dev.: 1.5283)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.39% (1.8918 => 1.8655, std.dev.: 0.0095)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.95% (0.1367 => 0.1380, std.dev.: 0.0046)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Olden/power/power: 45.23% (0.1457 => 0.2116, std.dev.: 0.0125)
  MultiSource/Benchmarks/McCat/05-eks/eks: 44.95% (0.5698 => 0.8259, std.dev.: 0.0211)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 42.35% (0.1065 => 0.1516, std.dev.: 0.0091)
  MultiSource/Benchmarks/Olden/em3d/em3d: 35.90% (0.2117 => 0.2877, std.dev.: 0.0188)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.55% (0.1067 => 0.1361, std.dev.: 0.0110)
  MultiSource/Benchmarks/McCat/09-vor/vor: 26.65% (0.3723 => 0.4715, std.dev.: 0.0370)
  MultiSource/Benchmarks/Olden/bh/bh: 24.12% (0.3429 => 0.4256, std.dev.: 0.0184)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.63% (0.0950 => 0.1165, std.dev.: 0.0004)
  MultiSource/Benchmarks/Olden/mst/mst: 10.68% (0.1405 => 0.1555, std.dev.: 0.0041)
  MultiSource/Applications/siod/siod: 9.53% (2.4944 => 2.7321, std.dev.: 0.0520)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.40% (0.3429 => 0.3614, std.dev.: 0.0027)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 45.17% (0.0259 => 0.0376, std.dev.: 0.0004)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 39.43% (0.0459 => 0.0640, std.dev.: 0.0062)
  MultiSource/Applications/sgefa/sgefa: 33.45% (1.1695 => 1.5607, std.dev.: 0.0258)
  MultiSource/Benchmarks/Olden/mst/mst: 30.01% (0.2099 => 0.2729, std.dev.: 0.0159)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 23.68% (16.4665 => 20.3658, std.dev.: 0.4202)
  SingleSource/Benchmarks/Stanford/Puzzle: 21.31% (0.1455 => 0.1765, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.21% (6.1372 => 7.1322, std.dev.: 0.1053)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.94% (5.2003 => 5.6130, std.dev.: 0.0097)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.24% (3.1853 => 3.3842, std.dev.: 0.0145)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 5.24% (2.9004 => 3.0524, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.91% (3.2201 => 3.3781, std.dev.: 0.0211)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.66% (4.6639 => 4.8813, std.dev.: 0.0347)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.52% (1.0571 => 1.1049, std.dev.: 0.0021)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.28% (94.2966 => 98.3290, std.dev.: 1.3194)
  SingleSource/Benchmarks/Misc/lowercase: 4.27% (0.7746 => 0.8077, std.dev.: 0.0122)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.90% (1.2224 => 1.2701, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.86% (5.9362 => 6.1655, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.70% (5.2788 => 5.4739, std.dev.: 0.0168)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.58% (4.8986 => 5.0742, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.06% (4.8966 => 5.0462, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.87% (5.5010 => 5.6590, std.dev.: 0.0374)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.21% (1.4842 => 1.5170, std.dev.: 0.0014)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.20% (4.3727 => 4.4690, std.dev.: 0.0131)
  SingleSource/Benchmarks/McGill/queens: 1.97% (1.6478 => 1.6803, std.dev.: 0.0017)
  MultiSource/Benchmarks/Olden/power/power: 1.43% (1.2558 => 1.2737, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.20% (2.9023 => 2.9372, std.dev.: 0.0002)
  MultiSource/Benchmarks/Olden/bh/bh: 1.07% (2.4435 => 2.4696, std.dev.: 0.0098)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/viterbi/viterbi: -17.69% (0.2431 => 0.2001, std.dev.: 0.0085)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -13.82% (0.0803 => 0.0692, std.dev.: 0.0034)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.82% (0.1151 => 0.1015, std.dev.: 0.0016)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.37% (0.2006 => 0.1798, std.dev.: 0.0028)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.35% (1.5932 => 1.4283, std.dev.: 0.0100)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.27% (0.1646 => 0.1477, std.dev.: 0.0011)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.97% (0.7381 => 0.6940, std.dev.: 0.0057)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -4.84% (0.2416 => 0.2299, std.dev.: 0.0025)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.31% (1.2911 => 0.7319, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.94% (4.4050 => 3.2182, std.dev.: 0.0242)
  MultiSource/Benchmarks/FreeBench/neural/neural: -25.36% (0.3513 => 0.2622, std.dev.: 0.0275)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -25.09% (6.2328 => 4.6690, std.dev.: 0.0595)
  SingleSource/Benchmarks/Misc/salsa20: -21.60% (10.3398 => 8.1059, std.dev.: 0.4176)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -15.93% (25.3677 => 21.3265, std.dev.: 0.1529)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -14.13% (11.6227 => 9.9800, std.dev.: 0.0474)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -10.47% (7.0179 => 6.2830, std.dev.: 0.0094)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.68% (1.6679 => 1.5065, std.dev.: 0.0024)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -9.18% (0.2973 => 0.2700, std.dev.: 0.0103)
  MultiSource/Applications/lambda-0_1_3/lambda: -8.86% (9.1099 => 8.3032, std.dev.: 0.0134)
  SingleSource/Benchmarks/Shootout-C++/hash: -8.31% (0.7941 => 0.7281, std.dev.: 0.0231)
  MultiSource/Applications/siod/siod: -7.07% (3.7240 => 3.4608, std.dev.: 0.0105)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.72% (5.5889 => 5.2132, std.dev.: 0.0892)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.68% (0.1945 => 0.1815, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.66% (9.8728 => 9.2153, std.dev.: 0.0562)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.17% (4.5717 => 4.2897, std.dev.: 0.0045)
  SingleSource/Benchmarks/Misc/flops: -5.82% (10.2170 => 9.6224, std.dev.: 0.1084)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.71% (0.4445 => 0.4191, std.dev.: 0.0068)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -4.77% (2.8537 => 2.7177, std.dev.: 0.0498)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.75% (5.3184 => 5.0660, std.dev.: 0.0036)
  MultiSource/Applications/sqlite3/sqlite3: -4.45% (4.6358 => 4.4297, std.dev.: 0.0377)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.39% (0.2777 => 0.2655, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.27% (4.2167 => 4.0365, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.22% (5.3276 => 5.1029, std.dev.: 0.0121)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.76% (3.5327 => 3.3999, std.dev.: 0.0257)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.60% (3.8665 => 3.7661, std.dev.: 0.0090)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.22% (4.5094 => 4.4093, std.dev.: 0.0150)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.09% (5.4801 => 5.3655, std.dev.: 0.0407)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.76% (1.8989 => 1.8655, std.dev.: 0.0095)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.57% (8.5243 => 8.3903, std.dev.: 0.0495)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.48% (2.8573 => 2.8150, std.dev.: 0.0041)
  SingleSource/Benchmarks/Shootout/hash: -1.43% (5.3656 => 5.2891, std.dev.: 0.0296)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.31% (12.1841 => 12.0240, std.dev.: 0.0467)
  MultiSource/Applications/hexxagon/hexxagon: -1.16% (15.4979 => 15.3183, std.dev.: 0.0498)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.23% (0.1441 => 0.1380, std.dev.: 0.0046)

Report Time: 1.51s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130619/50a27aa0/attachment.html>


More information about the llvm-testresults mailing list