[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Jun 26 03:57:48 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12774?compare_to=12770&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12774, Order: 184924, Start Time: 2013-06-26 09:12:13, End Time: 2013-06-26 10:58:51
      To: 12770, Order: 184922, Start Time: 2013-06-26 07:08:02, End Time: 2013-06-26 08:52:36
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 14 (25 on baseline)
Performance Improvements: 4 (56 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1089 (1026 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.60% (25.5972 => 27.5429, std.dev.: 0.1806)
  MultiSource/Benchmarks/Bullet/bullet: 7.03% (35.1080 => 37.5745, std.dev.: 0.6523)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 17.83% (2.0190 => 2.3789, std.dev.: 0.0722)
  SingleSource/Benchmarks/Shootout-C++/fibo: 15.07% (4.1980 => 4.8305, std.dev.: 0.0006)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 13.22% (0.1876 => 0.2124, std.dev.: 0.0001)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 10.96% (0.2683 => 0.2977, std.dev.: 0.0005)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 9.46% (0.2982 => 0.3264, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.58% (3.8150 => 4.1425, std.dev.: 0.0202)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.23% (20.9096 => 22.0039, std.dev.: 0.0591)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.02% (16.2491 => 17.0643, std.dev.: 0.0453)
  MultiSource/Applications/sqlite3/sqlite3: 3.00% (4.2949 => 4.4236, std.dev.: 0.0304)
  MultiSource/Applications/spiff/spiff: 1.73% (2.8644 => 2.9139, std.dev.: 0.0178)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.70% (5.3544 => 5.4454, std.dev.: 0.0112)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.04% (3.9943 => 4.0357, std.dev.: 0.0105)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: -7.11% (0.3783 => 0.3514, std.dev.: 0.0082)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.39% (1.0831 => 1.0464, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -1.55% (2.9488 => 2.9030, std.dev.: 0.0162)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.31% (1.9024 => 1.8774, std.dev.: 0.0091)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.29% (0.1371 => 0.1375, std.dev.: 0.0189)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.20% (25.9348 => 27.5429, std.dev.: 0.1806)
  MultiSource/Benchmarks/Bullet/bullet: 5.76% (35.5296 => 37.5745, std.dev.: 0.6523)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 29.87% (1.8318 => 2.3789, std.dev.: 0.0722)
  MultiSource/Applications/sgefa/sgefa: 28.44% (1.1695 => 1.5021, std.dev.: 0.0159)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 18.02% (6.1372 => 7.2429, std.dev.: 0.1613)
  SingleSource/Benchmarks/Stanford/Puzzle: 15.81% (0.1455 => 0.1685, std.dev.: 0.0085)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.67% (0.9806 => 1.1343, std.dev.: 0.0246)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 12.98% (0.1880 => 0.2124, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.97% (5.2003 => 5.6148, std.dev.: 0.0141)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.43% (3.1853 => 3.3901, std.dev.: 0.0686)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 5.02% (3.2201 => 3.3817, std.dev.: 0.0463)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.65% (4.6639 => 4.8807, std.dev.: 0.0176)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.42% (1.0571 => 1.1038, std.dev.: 0.0031)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.37% (2.8994 => 3.0261, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.81% (5.9362 => 6.1623, std.dev.: 0.0753)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.63% (16.4665 => 17.0643, std.dev.: 0.0453)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.53% (5.2788 => 5.4650, std.dev.: 0.0618)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.81% (4.6379 => 4.7681, std.dev.: 0.0022)
  SingleSource/Regression/C/uint64_to_float: 2.68% (1.6851 => 1.7303, std.dev.: 0.0011)
  SingleSource/Benchmarks/Shootout/methcall: 2.63% (8.3425 => 8.5615, std.dev.: 0.0175)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.40% (21.4874 => 22.0039, std.dev.: 0.0591)
  MultiSource/Applications/spiff/spiff: 2.11% (2.8536 => 2.9139, std.dev.: 0.0178)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.91% (4.3727 => 4.4560, std.dev.: 0.0109)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.70% (5.6582 => 5.7545, std.dev.: 0.0143)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.62% (3.9713 => 4.0357, std.dev.: 0.0105)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -35.67% (0.1113 => 0.0716, std.dev.: 0.0036)
  SingleSource/Benchmarks/Misc/whetstone: -22.06% (0.1097 => 0.0855, std.dev.: 0.0037)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -15.94% (0.0803 => 0.0675, std.dev.: 0.0021)
  SingleSource/UnitTests/Vector/constpool: -15.70% (10.3086 => 8.6901, std.dev.: 0.1695)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.03% (0.1151 => 0.1024, std.dev.: 0.0011)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.00% (0.1646 => 0.1465, std.dev.: 0.0062)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.22% (0.2006 => 0.1801, std.dev.: 0.0010)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -7.85% (0.1886 => 0.1738, std.dev.: 0.0033)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.53% (0.7381 => 0.6899, std.dev.: 0.0031)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -6.46% (0.1563 => 0.1462, std.dev.: 0.0004)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.46% (2.0439 => 1.9323, std.dev.: 0.0359)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -4.44% (0.5748 => 0.5493, std.dev.: 0.0043)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.36% (6.6236 => 6.3346, std.dev.: 0.0082)
  SingleSource/Benchmarks/Linpack/linpack-pc: -3.73% (0.2738 => 0.2636, std.dev.: 0.0030)
  SingleSource/Benchmarks/Shootout-C++/hash: -2.94% (0.4554 => 0.4420, std.dev.: 0.0035)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.85% (1.2911 => 0.7250, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -37.90% (4.4050 => 2.7355, std.dev.: 0.0338)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.08% (4.8986 => 3.8660, std.dev.: 0.0279)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -20.06% (5.7264 => 4.5777, std.dev.: 0.0380)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -18.65% (6.2328 => 5.0705, std.dev.: 0.0168)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -17.06% (3.5000 => 2.9030, std.dev.: 0.0162)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.32% (25.3677 => 21.2286, std.dev.: 0.3117)
  MultiSource/Benchmarks/mafft/pairlocalalign: -13.81% (48.3307 => 41.6565, std.dev.: 0.0294)
  SingleSource/Benchmarks/Misc/salsa20: -13.07% (10.3398 => 8.9886, std.dev.: 0.0026)
  SingleSource/Benchmarks/Shootout-C++/hash: -9.31% (0.7941 => 0.7202, std.dev.: 0.0128)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.66% (1.6679 => 1.5235, std.dev.: 0.0109)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -7.25% (4.5717 => 4.2401, std.dev.: 0.0178)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -6.95% (3.2030 => 2.9803, std.dev.: 0.0613)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.68% (5.5889 => 5.2158, std.dev.: 0.0565)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.93% (9.8728 => 9.2872, std.dev.: 0.0134)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.69% (0.4445 => 0.4192, std.dev.: 0.0054)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.82% (39.1740 => 37.2845, std.dev.: 0.6634)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.82% (5.3184 => 5.0623, std.dev.: 0.0319)
  MultiSource/Applications/sqlite3/sqlite3: -4.58% (4.6358 => 4.4236, std.dev.: 0.0304)
  SingleSource/Benchmarks/Misc/flops: -4.11% (10.2170 => 9.7968, std.dev.: 0.0018)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -3.93% (3.5120 => 3.3739, std.dev.: 0.0378)
  SingleSource/Benchmarks/Shootout/ary3: -3.84% (6.0122 => 5.7812, std.dev.: 0.0627)
  SingleSource/Benchmarks/Misc/flops-7: -3.82% (1.7987 => 1.7299, std.dev.: 0.0035)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.76% (9.1099 => 8.7673, std.dev.: 0.0544)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -3.60% (4.1768 => 4.0263, std.dev.: 0.0262)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.43% (6.3757 => 6.1568, std.dev.: 0.0387)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.40% (5.3276 => 5.1465, std.dev.: 0.0200)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -3.23% (2.8537 => 2.7616, std.dev.: 0.0189)
  SingleSource/Benchmarks/Shootout/sieve: -2.97% (8.0178 => 7.7794, std.dev.: 0.0008)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.86% (3.8665 => 3.7561, std.dev.: 0.0001)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.69% (62.4345 => 60.7533, std.dev.: 0.5655)
  SingleSource/Benchmarks/Shootout/hash: -2.49% (5.3656 => 5.2322, std.dev.: 0.0044)
  MultiSource/Benchmarks/PAQ8p/paq8p: -2.31% (94.2966 => 92.1227, std.dev.: 0.8186)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.21% (4.5094 => 4.4098, std.dev.: 0.0364)
  SingleSource/Benchmarks/Dhrystone/dry: -2.07% (0.5126 => 0.5020, std.dev.: 0.0031)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.97% (8.5243 => 8.3565, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.76% (4.2167 => 4.1425, std.dev.: 0.0202)
  SingleSource/Benchmarks/Shootout-C++/lists1: -1.72% (0.6097 => 0.5992, std.dev.: 0.0016)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.33% (1.0605 => 1.0464, std.dev.: 0.0033)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.33% (12.1841 => 12.0225, std.dev.: 0.0554)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.22% (9.6556 => 9.5376, std.dev.: 0.0384)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.58% (0.1441 => 0.1375, std.dev.: 0.0189)

Report Time: 1.86s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130626/879da36c/attachment.html>


More information about the llvm-testresults mailing list