[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Oct 7 18:12:49 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16085?compare_to=16081&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16085, Order: 192139, Start Time: 2013-10-07 23:22:55, End Time: 2013-10-08 01:15:49
      To: 16081, Order: 192128, Start Time: 2013-10-07 21:05:21, End Time: 2013-10-07 22:59:37
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 35 (55 on baseline)
Performance Improvements: 10 (16 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1062 (1036 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/2003-05-21-UnionBitfields: 71.43% (0.0273 => 0.0468, std.dev.: 0.0008)
  SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 65.79% (0.0190 => 0.0315, std.dev.: 0.0010)
  SingleSource/Regression/C++/EH/simple_throw: 57.92% (0.0183 => 0.0289, std.dev.: 0.0028)
  SingleSource/UnitTests/2003-10-29-ScalarReplBug: 57.87% (0.0178 => 0.0281, std.dev.: 0.0006)
  SingleSource/Regression/C/callargs: 53.66% (0.0205 => 0.0315, std.dev.: 0.0021)
  SingleSource/Benchmarks/Shootout-C++/hello: 46.84% (0.1977 => 0.2903, std.dev.: 0.0097)
  MultiSource/Applications/JM/ldecod/ldecod: 18.00% (7.7679 => 9.1660, std.dev.: 0.3781)
  MultiSource/Applications/JM/lencod/lencod: 13.55% (18.0497 => 20.4957, std.dev.: 0.1408)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.36% (1.3211 => 1.4844, std.dev.: 0.0443)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 12.36% (1.3726 => 1.5422, std.dev.: 0.0216)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.30% (1.1240 => 1.2622, std.dev.: 0.0360)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.23% (1.2722 => 1.4151, std.dev.: 0.0437)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.37% (1.2145 => 1.3405, std.dev.: 0.0350)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.27% (1.3240 => 1.4467, std.dev.: 0.0472)
  MultiSource/Applications/oggenc/oggenc: 8.51% (5.5507 => 6.0228, std.dev.: 0.0495)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 8.45% (0.7499 => 0.8133, std.dev.: 0.0196)
  SingleSource/Benchmarks/Misc-C++/bigfib: 6.27% (0.6584 => 0.6997, std.dev.: 0.0077)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 6.02% (45.2673 => 47.9924, std.dev.: 0.5882)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.94% (0.2290 => 0.2426, std.dev.: 0.0046)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 36.59% (2.4082 => 3.2893, std.dev.: 0.0730)
  MultiSource/Applications/SPASS/SPASS: 27.33% (8.5225 => 10.8513, std.dev.: 0.3907)
  SingleSource/Benchmarks/Shootout/ary3: 23.75% (4.7756 => 5.9100, std.dev.: 0.1740)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 22.58% (1.9197 => 2.3532, std.dev.: 0.0471)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 19.61% (4.2429 => 5.0748, std.dev.: 0.1438)
  SingleSource/Benchmarks/Misc/salsa20: 8.85% (7.5104 => 8.1753, std.dev.: 0.0114)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 5.11% (4.5746 => 4.8082, std.dev.: 0.0211)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 4.73% (39.6938 => 41.5696, std.dev.: 0.3184)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.43% (5.9312 => 6.1937, std.dev.: 0.0461)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.20% (5.7931 => 5.9783, std.dev.: 0.0121)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.90% (3.6905 => 3.7977, std.dev.: 0.0294)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 2.68% (1.1770 => 1.2086, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.08% (5.2708 => 5.3805, std.dev.: 0.0292)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.90% (2.3799 => 2.4251, std.dev.: 0.0121)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.75% (3.5604 => 3.6227, std.dev.: 0.0223)
  SingleSource/Benchmarks/Shootout/fib2: 1.05% (3.6042 => 3.6421, std.dev.: 0.0046)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/minisat/minisat: -11.40% (0.8534 => 0.7561, std.dev.: 0.0364)
  SingleSource/Benchmarks/Shootout-C++/wc: -10.12% (0.2678 => 0.2407, std.dev.: 0.0016)
  MultiSource/Benchmarks/McCat/18-imp/imp: -4.82% (0.4131 => 0.3932, std.dev.: 0.0067)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/McGill/chomp: -14.18% (1.1988 => 1.0288, std.dev.: 0.0574)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -12.90% (72.5893 => 63.2287, std.dev.: 2.2478)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -12.44% (47.5964 => 41.6764, std.dev.: 0.2225)
  SingleSource/Benchmarks/Shootout-C++/lists1: -10.28% (0.6760 => 0.6065, std.dev.: 0.0221)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.90% (7.0811 => 6.8051, std.dev.: 0.0591)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.97% (1.5415 => 1.5111, std.dev.: 0.0073)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.10% (4.2168 => 4.1706, std.dev.: 0.0091)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 7.98% (0.1403 => 0.1515, std.dev.: 0.0266)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/2003-05-21-UnionBitfields: 80.00% (0.0260 => 0.0468, std.dev.: 0.0008)
  SingleSource/UnitTests/2003-10-29-ScalarReplBug: 74.53% (0.0161 => 0.0281, std.dev.: 0.0006)
  SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 72.13% (0.0183 => 0.0315, std.dev.: 0.0010)
  SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 71.97% (0.0157 => 0.0270, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout-C++/hello: 62.45% (0.1787 => 0.2903, std.dev.: 0.0097)
  SingleSource/Regression/C++/EH/simple_throw: 60.56% (0.0180 => 0.0289, std.dev.: 0.0028)
  MultiSource/Applications/sgefa/sgefa: 35.71% (0.3848 => 0.5222, std.dev.: 0.0444)
  MultiSource/Applications/JM/ldecod/ldecod: 23.82% (7.4026 => 9.1660, std.dev.: 0.3781)
  MultiSource/Applications/JM/lencod/lencod: 23.54% (16.5902 => 20.4957, std.dev.: 0.1408)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 23.52% (0.3597 => 0.4443, std.dev.: 0.0327)
  MultiSource/Applications/sqlite3/sqlite3: 18.29% (16.2888 => 19.2675, std.dev.: 0.4002)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.43% (1.0935 => 1.2622, std.dev.: 0.0360)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 15.39% (1.3365 => 1.5422, std.dev.: 0.0216)
  MultiSource/Applications/oggenc/oggenc: 12.92% (5.3339 => 6.0228, std.dev.: 0.0495)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.96% (1.2639 => 1.4151, std.dev.: 0.0437)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.58% (1.3303 => 1.4844, std.dev.: 0.0443)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.98% (1.3036 => 1.4467, std.dev.: 0.0472)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.47% (1.2981 => 1.4340, std.dev.: 0.0527)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.31% (1.2152 => 1.3405, std.dev.: 0.0350)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 9.01% (0.7461 => 0.8133, std.dev.: 0.0196)
  SingleSource/Benchmarks/Misc-C++/bigfib: 8.67% (0.6439 => 0.6997, std.dev.: 0.0077)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 8.38% (44.2807 => 47.9924, std.dev.: 0.5882)
  SingleSource/Benchmarks/Shootout-C++/wc: 8.23% (0.2224 => 0.2407, std.dev.: 0.0016)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 7.54% (0.5241 => 0.5636, std.dev.: 0.0067)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.82% (4.0397 => 4.3153, std.dev.: 0.0723)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.62% (0.2297 => 0.2426, std.dev.: 0.0046)
  MultiSource/Benchmarks/McCat/09-vor/vor: 3.85% (0.3480 => 0.3614, std.dev.: 0.0022)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.94% (0.6297 => 0.6482, std.dev.: 0.0011)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.64% (7.6426 => 12.5063, std.dev.: 0.0301)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 56.96% (3.0111 => 4.7263, std.dev.: 0.1228)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 37.00% (2.4010 => 3.2893, std.dev.: 0.0730)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 36.84% (1.7197 => 2.3532, std.dev.: 0.0471)
  MultiSource/Applications/SPASS/SPASS: 31.83% (8.2311 => 10.8513, std.dev.: 0.3907)
  SingleSource/Benchmarks/Shootout-C++/ary: 27.82% (0.0381 => 0.0487, std.dev.: 0.0026)
  SingleSource/Benchmarks/Shootout/ary3: 25.82% (4.6972 => 5.9100, std.dev.: 0.1740)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 23.76% (4.1004 => 5.0748, std.dev.: 0.1438)
  SingleSource/Benchmarks/Shootout-C++/fibo: 10.69% (4.9428 => 5.4710, std.dev.: 0.0143)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 9.74% (1.1013 => 1.2086, std.dev.: 0.0030)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.64% (8.1346 => 8.6748, std.dev.: 0.1563)
  SingleSource/UnitTests/Vector/multiplies: 6.60% (0.5561 => 0.5928, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 5.11% (4.5744 => 4.8082, std.dev.: 0.0211)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.87% (5.9061 => 6.1937, std.dev.: 0.0461)
  SingleSource/Benchmarks/Misc/salsa20: 4.86% (7.7964 => 8.1753, std.dev.: 0.0114)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 4.33% (3.6401 => 3.7977, std.dev.: 0.0294)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 4.05% (39.9519 => 41.5696, std.dev.: 0.3184)
  MultiSource/Applications/siod/siod: 4.02% (3.5310 => 3.6728, std.dev.: 0.0198)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.51% (5.7757 => 5.9783, std.dev.: 0.0121)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.12% (6.5990 => 6.8051, std.dev.: 0.0591)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.76% (40.5588 => 41.6764, std.dev.: 0.2225)
  MultiSource/Benchmarks/Olden/power/power: 2.44% (1.2170 => 1.2467, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.79% (3.5590 => 3.6227, std.dev.: 0.0223)
  SingleSource/Benchmarks/Shootout-C++/sieve: 1.35% (3.4725 => 3.5194, std.dev.: 0.0110)
  SingleSource/Benchmarks/Shootout/fib2: 1.27% (3.5966 => 3.6421, std.dev.: 0.0046)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (3.7874 => 3.8290, std.dev.: 0.0014)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.06% (1.0477 => 1.0588, std.dev.: 0.0010)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -20.63% (0.1483 => 0.1177, std.dev.: 0.0020)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -53.75% (0.5226 => 0.2417, std.dev.: 0.0140)
  MultiSource/Applications/sgefa/sgefa: -42.12% (1.5790 => 0.9139, std.dev.: 0.0019)
  SingleSource/Benchmarks/Linpack/linpack-pc: -24.99% (57.2347 => 42.9309, std.dev.: 3.8421)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -13.88% (15.9508 => 13.7371, std.dev.: 0.2543)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.43% (20.8247 => 18.4436, std.dev.: 0.1187)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.38% (3.4956 => 3.1326, std.dev.: 0.0414)
  MultiSource/Benchmarks/FreeBench/mason/mason: -9.87% (0.3304 => 0.2978, std.dev.: 0.0054)
  MultiSource/Benchmarks/mafft/pairlocalalign: -8.73% (50.0284 => 45.6585, std.dev.: 0.6004)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.33% (4.3592 => 4.1706, std.dev.: 0.0091)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.37% (2.5938 => 2.5064, std.dev.: 0.0173)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.48% (17.1431 => 16.7175, std.dev.: 0.0927)
  SingleSource/Benchmarks/Shootout/lists: -2.45% (7.3703 => 7.1899, std.dev.: 0.0332)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.77% (0.7474 => 0.7342, std.dev.: 0.0034)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.14% (89.7126 => 88.6933, std.dev.: 0.2423)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -1.01% (1.6707 => 1.6539, std.dev.: 0.0038)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 12.39% (0.1348 => 0.1515, std.dev.: 0.0266)

Report Time: 0.70s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131007/2afd7584/attachment.html>


More information about the llvm-testresults mailing list