[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Sep 20 05:10:22 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15485?compare_to=15482&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15485, Order: 191077, Start Time: 2013-09-20 10:29:20, End Time: 2013-09-20 12:13:04
      To: 15482, Order: 191075, Start Time: 2013-09-20 08:23:18, End Time: 2013-09-20 10:08:11
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 24 (49 on baseline)
Performance Improvements: 2 (27 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1081 (1031 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.94% (0.9591 => 0.9777, std.dev.: 0.0067)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.56% (1.3508 => 1.3719, std.dev.: 0.0050)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 35.44% (2.8384 => 3.8442, std.dev.: 0.0502)
  SingleSource/Benchmarks/Shootout/matrix: 18.22% (1.7874 => 2.1131, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.28% (3.5020 => 3.7220, std.dev.: 0.0014)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 5.44% (0.1875 => 0.1977, std.dev.: 0.0010)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.00% (1.2892 => 1.3537, std.dev.: 0.0078)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 4.58% (2.8862 => 3.0183, std.dev.: 0.0182)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 4.12% (2.1253 => 2.2128, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 3.62% (0.4669 => 0.4838, std.dev.: 0.0030)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.50% (1.8342 => 1.8984, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.41% (5.8050 => 6.0029, std.dev.: 0.0082)
  SingleSource/Benchmarks/Misc/fp-convert: 3.38% (7.4853 => 7.7384, std.dev.: 0.0655)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.29% (5.2631 => 5.4362, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout-C++/hash2: 2.75% (3.5857 => 3.6842, std.dev.: 0.0167)
  SingleSource/Benchmarks/Shootout/methcall: 2.67% (8.3786 => 8.6025, std.dev.: 0.0394)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.52% (4.0351 => 4.1369, std.dev.: 0.0089)
  MultiSource/Applications/lambda-0_1_3/lambda: 2.38% (8.1257 => 8.3189, std.dev.: 0.0543)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.44% (3.5336 => 3.5845, std.dev.: 0.0008)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.36% (2.3799 => 2.4123, std.dev.: 0.0062)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.26% (18.4727 => 18.7048, std.dev.: 0.0249)
  SingleSource/Benchmarks/McGill/chomp: 1.15% (1.0131 => 1.0247, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.08% (4.5493 => 4.5984, std.dev.: 0.0140)
  SingleSource/Regression/C/uint64_to_float: 1.04% (1.4648 => 1.4801, std.dev.: 0.0024)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/constpool: -9.64% (10.1461 => 9.1681, std.dev.: 0.1552)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.79% (6.7110 => 6.5236, std.dev.: 0.0018)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.45% (0.1347 => 0.1353, std.dev.: 0.0023)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.56% (0.5705 => 0.5908, std.dev.: 0.0027)
  MultiSource/Applications/Burg/burg: 3.07% (1.3994 => 1.4424, std.dev.: 0.0152)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.98% (0.9494 => 0.9777, std.dev.: 0.0067)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.65% (1.3365 => 1.3719, std.dev.: 0.0050)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.62% (1.1393 => 1.1691, std.dev.: 0.0056)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.22% (9.9903 => 10.2123, std.dev.: 0.0311)
  MultiSource/Benchmarks/Bullet/bullet: 2.08% (32.7552 => 33.4368, std.dev.: 0.1255)
  MultiSource/Applications/lemon/lemon: 2.06% (1.1862 => 1.2106, std.dev.: 0.0007)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.00% (1.8775 => 1.9151, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.95% (1.2932 => 1.3184, std.dev.: 0.0011)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.88% (1.0952 => 1.1158, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.77% (1.2695 => 1.2920, std.dev.: 0.0003)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 1.66% (1.4792 => 1.5037, std.dev.: 0.0037)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 1.60% (44.2807 => 44.9878, std.dev.: 0.1686)
  MultiSource/Applications/minisat/minisat: 1.53% (0.7439 => 0.7553, std.dev.: 0.0040)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.43% (24.6139 => 24.9652, std.dev.: 0.0833)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.30% (1.3499 => 1.3674, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.28% (1.2550 => 1.2711, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.07% (1.2639 => 1.2774, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.06% (1.2948 => 1.3085, std.dev.: 0.0026)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 34.63% (2.8554 => 3.8442, std.dev.: 0.0502)
  SingleSource/Benchmarks/Shootout/matrix: 18.65% (1.7809 => 2.1131, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 14.14% (6.4425 => 7.3533, std.dev.: 0.1230)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.16% (1.2516 => 1.3537, std.dev.: 0.0078)
  SingleSource/UnitTests/Vector/multiplies: 6.38% (0.5561 => 0.5916, std.dev.: 0.0007)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 5.67% (0.1871 => 0.1977, std.dev.: 0.0010)
  MultiSource/Benchmarks/BitBench/five11/five11: 5.24% (5.3716 => 5.6533, std.dev.: 0.0062)
  SingleSource/Benchmarks/McGill/misr: 4.85% (0.3771 => 0.3954, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.43% (3.5642 => 3.7220, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.93% (5.7757 => 6.0029, std.dev.: 0.0082)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.06% (2.1472 => 2.2128, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.96% (4.0181 => 4.1369, std.dev.: 0.0089)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.88% (4.4696 => 4.5984, std.dev.: 0.0140)
  MultiSource/Applications/siod/siod: 2.75% (3.5310 => 3.6281, std.dev.: 0.0172)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.75% (1.7652 => 1.8137, std.dev.: 0.0019)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.51% (1.8519 => 1.8984, std.dev.: 0.0012)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.47% (0.5182 => 0.5310, std.dev.: 0.0006)
  MultiSource/Benchmarks/Olden/power/power: 2.40% (1.2170 => 1.2462, std.dev.: 0.0044)
  MultiSource/Applications/lambda-0_1_3/lambda: 2.27% (8.1346 => 8.3189, std.dev.: 0.0543)
  MultiSource/Applications/sqlite3/sqlite3: 2.11% (4.2733 => 4.3633, std.dev.: 0.0134)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.02% (3.1569 => 3.2207, std.dev.: 0.0003)
  SingleSource/Regression/C/uint64_to_float: 1.88% (1.4528 => 1.4801, std.dev.: 0.0024)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.79% (3.5683 => 3.6323, std.dev.: 0.0159)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.73% (11.9288 => 12.1346, std.dev.: 0.0023)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.70% (1.0477 => 1.0655, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.55% (5.4925 => 5.5776, std.dev.: 0.0223)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.42% (5.3022 => 5.3773, std.dev.: 0.0128)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.36% (2.4920 => 2.5259, std.dev.: 0.0094)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.32% (16.7972 => 17.0181, std.dev.: 0.0143)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -20.77% (0.1483 => 0.1175, std.dev.: 0.0020)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -8.62% (0.1195 => 0.1092, std.dev.: 0.0007)
  SingleSource/Benchmarks/Shootout-C++/matrix: -6.73% (0.2571 => 0.2398, std.dev.: 0.0009)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.40% (0.5226 => 0.2383, std.dev.: 0.0732)
  MultiSource/Applications/sgefa/sgefa: -46.68% (1.5790 => 0.8419, std.dev.: 0.0371)
  SingleSource/Benchmarks/Linpack/linpack-pc: -25.67% (57.2347 => 42.5424, std.dev.: 2.1095)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.80% (15.9508 => 12.9513, std.dev.: 0.1892)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -15.18% (1.7197 => 1.4586, std.dev.: 0.0433)
  MultiSource/Benchmarks/FreeBench/mason/mason: -12.62% (0.3304 => 0.2887, std.dev.: 0.0136)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.26% (3.4956 => 3.1368, std.dev.: 0.0336)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.18% (20.8247 => 18.7048, std.dev.: 0.0249)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -9.45% (4.0006 => 3.6227, std.dev.: 0.0995)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.00% (3.7437 => 3.4816, std.dev.: 0.0684)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.96% (50.0284 => 46.5486, std.dev.: 0.2812)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.74% (0.3501 => 0.3300, std.dev.: 0.0018)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.22% (30.1838 => 28.6084, std.dev.: 0.0491)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.19% (2.5938 => 2.4850, std.dev.: 0.0268)
  SingleSource/Benchmarks/Shootout-C++/lists1: -3.78% (0.5952 => 0.5727, std.dev.: 0.0068)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -3.61% (0.3462 => 0.3337, std.dev.: 0.0024)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -2.20% (4.9022 => 4.7944, std.dev.: 0.0290)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.01% (4.3592 => 4.2717, std.dev.: 0.0243)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -1.98% (9.4586 => 9.2709, std.dev.: 0.0537)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.75% (17.1431 => 16.8439, std.dev.: 0.0072)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.4471 => 2.4123, std.dev.: 0.0062)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.30% (89.7126 => 88.5455, std.dev.: 0.1595)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.20% (3.8582 => 3.8118, std.dev.: 0.0149)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.14% (6.5990 => 6.5236, std.dev.: 0.0018)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.37% (0.1348 => 0.1353, std.dev.: 0.0023)

Report Time: 0.67s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130920/9061b3e7/attachment.html>


More information about the llvm-testresults mailing list