[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Jun 24 07:00:39 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12706?compare_to=12703&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12706, Order: 184721, Start Time: 2013-06-24 12:12:49, End Time: 2013-06-24 14:01:41
      To: 12703, Order: 184707, Start Time: 2013-06-24 10:01:33, End Time: 2013-06-24 11:50:43
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 19 (34 on baseline)
Performance Improvements: 19 (32 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1069 (1041 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 55.47% (0.0768 => 0.1194, std.dev.: 0.0030)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 41.51% (0.1036 => 0.1466, std.dev.: 0.0124)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 25.79% (1.1291 => 1.4203, std.dev.: 0.0790)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.81% (0.2864 => 0.3460, std.dev.: 0.0138)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 5.55% (1.5072 => 1.5908, std.dev.: 0.0108)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.99% (1.3877 => 1.4570, std.dev.: 0.0111)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Fhourstones/fhourstones: 29.11% (1.2628 => 1.6304, std.dev.: 0.0619)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 24.47% (0.0899 => 0.1119, std.dev.: 0.0073)
  SingleSource/Benchmarks/Linpack/linpack-pc: 16.42% (44.4081 => 51.7004, std.dev.: 0.2983)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.00% (2.1162 => 2.3913, std.dev.: 0.0183)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.38% (1.2832 => 1.4421, std.dev.: 0.0459)
  MultiSource/Benchmarks/llubenchmark/llu: 9.66% (1.9990 => 2.1922, std.dev.: 0.0254)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 4.34% (2.4439 => 2.5500, std.dev.: 0.0198)
  MultiSource/Applications/lua/lua: 3.16% (28.0915 => 28.9786, std.dev.: 0.1226)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.56% (5.3636 => 5.4472, std.dev.: 0.0235)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.49% (9.1634 => 9.2996, std.dev.: 0.0357)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.33% (1.1842 => 1.2000, std.dev.: 0.0060)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.18% (11.4119 => 11.5468, std.dev.: 0.0170)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.11% (6.2330 => 6.3020, std.dev.: 0.0134)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C++/EH/simple_throw: -41.16% (0.0277 => 0.0163, std.dev.: 0.0003)
  SingleSource/UnitTests/2003-10-29-ScalarReplBug: -38.87% (0.0265 => 0.0162, std.dev.: 0.0016)
  SingleSource/Regression/C++/2003-05-14-array-init: -38.70% (0.0261 => 0.0160, std.dev.: 0.0011)
  SingleSource/Regression/C++/fixups: -36.43% (0.0398 => 0.0253, std.dev.: 0.0008)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -34.99% (0.3501 => 0.2276, std.dev.: 0.0013)
  SingleSource/Benchmarks/Dhrystone/fldry: -33.04% (0.0908 => 0.0608, std.dev.: 0.0105)
  SingleSource/Regression/C++/EH/ConditionalExpr: -30.45% (0.0335 => 0.0233, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/Altivec/test1: -13.59% (0.1567 => 0.1354, std.dev.: 0.0007)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: -13.39% (0.2054 => 0.1779, std.dev.: 0.0012)
  SingleSource/UnitTests/Vector/Altivec/casts: -10.06% (0.1441 => 0.1296, std.dev.: 0.0016)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -9.95% (0.1517 => 0.1366, std.dev.: 0.0007)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -6.62% (0.2131 => 0.1990, std.dev.: 0.0016)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -6.06% (0.1914 => 0.1798, std.dev.: 0.0013)
  MultiSource/Applications/d/make_dparser: -3.25% (3.8873 => 3.7611, std.dev.: 0.0437)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/nbench/nbench: -10.68% (22.2567 => 19.8789, std.dev.: 0.5491)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -10.25% (34.3109 => 30.7951, std.dev.: 1.1617)
  SingleSource/Benchmarks/Dhrystone/fldry: -5.97% (0.7024 => 0.6605, std.dev.: 0.0086)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.08% (0.5153 => 0.4943, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.46% (5.1209 => 5.0461, std.dev.: 0.0158)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.39% (0.1371 => 0.1390, std.dev.: 0.0103)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 61.79% (0.0738 => 0.1194, std.dev.: 0.0030)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 37.39% (0.1067 => 0.1466, std.dev.: 0.0124)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 26.89% (1.1193 => 1.4203, std.dev.: 0.0790)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.85% (0.2961 => 0.3460, std.dev.: 0.0138)
  MultiSource/Applications/treecc/treecc: 16.49% (2.3237 => 2.7069, std.dev.: 0.0997)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.12% (1.4991 => 1.5908, std.dev.: 0.0108)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.64% (1.4485 => 1.5302, std.dev.: 0.0304)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.33% (1.3833 => 1.4570, std.dev.: 0.0111)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/sgefa/sgefa: 37.73% (1.1695 => 1.6107, std.dev.: 0.0038)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.63% (0.0920 => 0.1119, std.dev.: 0.0073)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 20.50% (1.3530 => 1.6304, std.dev.: 0.0619)
  SingleSource/Benchmarks/Stanford/Puzzle: 18.01% (0.1455 => 0.1717, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 17.87% (6.1372 => 7.2342, std.dev.: 0.0830)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.64% (1.2579 => 1.4421, std.dev.: 0.0459)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.99% (5.2003 => 5.6156, std.dev.: 0.0162)
  MultiSource/Benchmarks/llubenchmark/llu: 7.33% (2.0425 => 2.1922, std.dev.: 0.0254)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.22% (3.1853 => 3.3835, std.dev.: 0.0229)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 5.31% (3.2201 => 3.3910, std.dev.: 0.0203)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.77% (94.2966 => 98.7955, std.dev.: 1.4073)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.68% (4.6639 => 4.8820, std.dev.: 0.0125)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 3.99% (1.0571 => 1.0993, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 3.93% (2.9004 => 3.0145, std.dev.: 0.0056)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.81% (1.2224 => 1.2690, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.78% (5.9362 => 6.1608, std.dev.: 0.0344)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.55% (5.2788 => 5.4662, std.dev.: 0.0108)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.16% (62.4345 => 64.4076, std.dev.: 0.6612)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.05% (4.8966 => 5.0461, std.dev.: 0.0158)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.99% (5.5010 => 5.6657, std.dev.: 0.0198)
  SingleSource/Benchmarks/Misc/ffbench: 2.93% (1.3696 => 1.4097, std.dev.: 0.0146)
  MultiSource/Applications/lua/lua: 2.58% (28.2496 => 28.9786, std.dev.: 0.1226)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.21% (4.3727 => 4.4693, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.95% (5.6582 => 5.7686, std.dev.: 0.0230)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.94% (1.7925 => 1.8272, std.dev.: 0.0080)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.77% (1.1791 => 1.2000, std.dev.: 0.0060)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.64% (0.1151 => 0.1017, std.dev.: 0.0048)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.37% (0.2006 => 0.1798, std.dev.: 0.0013)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -9.15% (51.0211 => 46.3525, std.dev.: 0.4341)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -8.00% (0.1563 => 0.1438, std.dev.: 0.0021)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.89% (0.7381 => 0.6946, std.dev.: 0.0130)
  MultiSource/Benchmarks/mafft/pairlocalalign: -1.25% (10.7257 => 10.5912, std.dev.: 0.0433)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.42% (1.2911 => 0.7305, std.dev.: 0.0250)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.98% (4.4050 => 3.2165, std.dev.: 0.0201)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -24.57% (6.2328 => 4.7013, std.dev.: 0.0414)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -15.94% (25.3677 => 21.3230, std.dev.: 0.0166)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -14.11% (11.6227 => 9.9830, std.dev.: 0.0449)
  SingleSource/Benchmarks/Misc/salsa20: -12.98% (10.3398 => 8.9981, std.dev.: 0.0040)
  MultiSource/Benchmarks/nbench/nbench: -10.86% (22.3004 => 19.8789, std.dev.: 0.5491)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -10.20% (7.0179 => 6.3020, std.dev.: 0.0134)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.34% (1.6679 => 1.5121, std.dev.: 0.0024)
  MultiSource/Applications/lambda-0_1_3/lambda: -8.64% (9.1099 => 8.3232, std.dev.: 0.0207)
  MultiSource/Applications/siod/siod: -8.59% (3.7240 => 3.4042, std.dev.: 0.0430)
  SingleSource/Benchmarks/Shootout-C++/hash: -7.93% (0.7941 => 0.7311, std.dev.: 0.0218)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.76% (5.5889 => 5.2113, std.dev.: 0.0101)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.03% (48.3307 => 45.4148, std.dev.: 0.2480)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.91% (4.5717 => 4.3017, std.dev.: 0.0137)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.81% (9.8728 => 9.2996, std.dev.: 0.0357)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.47% (3.5327 => 3.3396, std.dev.: 0.0527)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.56% (4.2167 => 4.0245, std.dev.: 0.0420)
  MultiSource/Applications/sqlite3/sqlite3: -4.34% (4.6358 => 4.4348, std.dev.: 0.0353)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.25% (5.3276 => 5.1011, std.dev.: 0.0067)
  SingleSource/Benchmarks/Misc/flops: -4.08% (10.2170 => 9.8005, std.dev.: 0.0257)
  MultiSource/Benchmarks/BitBench/five11/five11: -3.74% (5.7342 => 5.5200, std.dev.: 0.0761)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.89% (1.6980 => 1.6659, std.dev.: 0.0057)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.40% (8.5243 => 8.4052, std.dev.: 0.0259)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.26% (12.1841 => 12.0303, std.dev.: 0.0593)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.20% (9.6556 => 9.5402, std.dev.: 0.0253)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.54% (0.1441 => 0.1390, std.dev.: 0.0103)

Report Time: 1.29s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130624/f8576e27/attachment.html>


More information about the llvm-testresults mailing list