[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Jun 7 14:15:37 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12165?compare_to=12162&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12165, Order: 183546, Start Time: 2013-06-07 19:24:35, End Time: 2013-06-07 21:16:18
      To: 12162, Order: 183533, Start Time: 2013-06-07 17:09:55, End Time: 2013-06-07 19:00:27
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 28 (47 on baseline)
Performance Improvements: 14 (26 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1065 (1034 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/NP/np: 65.44% (0.0217 => 0.0359, std.dev.: 0.0005)
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: 65.37% (0.0722 => 0.1194, std.dev.: 0.0035)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 64.06% (0.0946 => 0.1552, std.dev.: 0.0036)
  MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 60.89% (0.0519 => 0.0835, std.dev.: 0.0032)
  SingleSource/Benchmarks/Misc/flops-4: 58.20% (0.0323 => 0.0511, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc-C++/mandel-text: 51.68% (0.0238 => 0.0361, std.dev.: 0.0015)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 46.80% (0.0812 => 0.1192, std.dev.: 0.0099)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 41.95% (0.0267 => 0.0379, std.dev.: 0.0025)
  SingleSource/Benchmarks/Shootout-C++/lists1: 17.16% (0.3345 => 0.3919, std.dev.: 0.0098)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.87% (1.9144 => 2.0843, std.dev.: 0.0155)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.70% (1.5267 => 1.5832, std.dev.: 0.0115)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 60.11% (5.7804 => 9.2548, std.dev.: 0.6974)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 50.06% (2.9482 => 4.4241, std.dev.: 0.1764)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 37.90% (4.5631 => 6.2924, std.dev.: 0.5239)
  SingleSource/Benchmarks/Shootout-C++/ary: 26.10% (0.0636 => 0.0802, std.dev.: 0.0058)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 19.38% (4.0347 => 4.8166, std.dev.: 0.1139)
  SingleSource/Benchmarks/Shootout-C++/fibo: 17.15% (4.1189 => 4.8253, std.dev.: 0.0187)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 8.38% (9.5655 => 10.3669, std.dev.: 0.2146)
  MultiSource/Benchmarks/Bullet/bullet: 6.28% (6.9300 => 7.3650, std.dev.: 0.0296)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 5.48% (1.0587 => 1.1167, std.dev.: 0.0121)
  SingleSource/Benchmarks/Misc/salsa20: 5.20% (8.5580 => 9.0026, std.dev.: 0.0286)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.06% (94.3436 => 98.1760, std.dev.: 0.7368)
  SingleSource/Benchmarks/Misc/flops: 3.79% (9.5300 => 9.8909, std.dev.: 0.0124)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.48% (2.6998 => 2.7668, std.dev.: 0.0138)
  SingleSource/Benchmarks/Misc/richards_benchmark: 1.98% (1.3506 => 1.3773, std.dev.: 0.0013)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.33% (4.4233 => 4.4822, std.dev.: 0.0178)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.07% (11.5348 => 11.6579, std.dev.: 0.0096)
  SingleSource/Benchmarks/Linpack/linpack-pc: 1.04% (51.3443 => 51.8779, std.dev.: 0.0797)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -31.36% (0.1891 => 0.1298, std.dev.: 0.0093)
  MultiSource/Applications/spiff/spiff: -16.87% (1.1228 => 0.9334, std.dev.: 0.0569)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -13.12% (0.2295 => 0.1994, std.dev.: 0.0089)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -11.43% (5.2328 => 4.6346, std.dev.: 0.0381)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.62% (0.8210 => 0.7338, std.dev.: 0.0265)
  SingleSource/UnitTests/Vector/Altivec/test1: -8.44% (0.1493 => 0.1367, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.49% (1.5800 => 1.4933, std.dev.: 0.0237)
  SingleSource/Benchmarks/Linpack/linpack-pc: -5.33% (0.2760 => 0.2613, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.06% (1.5143 => 1.4528, std.dev.: 0.0231)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/d/make_dparser: -31.17% (0.0555 => 0.0382, std.dev.: 0.0062)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -16.79% (0.0667 => 0.0555, std.dev.: 0.0032)
  MultiSource/Applications/SPASS/SPASS: -10.43% (9.4452 => 8.4598, std.dev.: 0.2806)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.73% (0.1663 => 0.1551, std.dev.: 0.0025)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -1.53% (1.6905 => 1.6647, std.dev.: 0.0048)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 3.13% (0.1439 => 0.1484, std.dev.: 0.0224)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 69.37% (0.0493 => 0.0835, std.dev.: 0.0032)
  MultiSource/Benchmarks/Prolangs-C++/NP/np: 67.76% (0.0214 => 0.0359, std.dev.: 0.0005)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 64.76% (0.0942 => 0.1552, std.dev.: 0.0036)
  SingleSource/Benchmarks/Misc-C++/mandel-text: 60.44% (0.0225 => 0.0361, std.dev.: 0.0015)
  SingleSource/Benchmarks/Misc/flops-4: 57.72% (0.0324 => 0.0511, std.dev.: 0.0017)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 55.61% (0.0766 => 0.1192, std.dev.: 0.0099)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 39.85% (0.0271 => 0.0379, std.dev.: 0.0025)
  SingleSource/Benchmarks/Shootout-C++/lists1: 19.12% (0.3290 => 0.3919, std.dev.: 0.0098)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 14.61% (1.5862 => 1.8180, std.dev.: 0.0837)
  MultiSource/Benchmarks/Bullet/bullet: 12.45% (35.5296 => 39.9533, std.dev.: 1.4906)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.25% (1.9079 => 2.0843, std.dev.: 0.0155)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.64% (25.9348 => 27.9159, std.dev.: 0.1358)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.28% (1.4757 => 1.5832, std.dev.: 0.0115)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 7.25% (1.6563 => 1.7764, std.dev.: 0.0047)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.02% (0.2721 => 0.2912, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.77% (1.3667 => 1.4456, std.dev.: 0.0167)
  SingleSource/Benchmarks/Shootout-C++/ary: 5.75% (0.2747 => 0.2905, std.dev.: 0.0014)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 5.58% (0.2206 => 0.2329, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.08% (1.6299 => 1.7127, std.dev.: 0.0222)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.87% (0.3429 => 0.3596, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 4.47% (1.6881 => 1.7635, std.dev.: 0.0251)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 4.12% (1.5735 => 1.6383, std.dev.: 0.0205)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 53.93% (6.0122 => 9.2548, std.dev.: 0.6974)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 35.46% (4.6452 => 6.2924, std.dev.: 0.5239)
  SingleSource/Benchmarks/Shootout-C++/ary: 26.70% (0.0633 => 0.0802, std.dev.: 0.0058)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 26.40% (3.5000 => 4.4241, std.dev.: 0.1764)
  MultiSource/Applications/sgefa/sgefa: 17.68% (1.1695 => 1.3763, std.dev.: 0.0433)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.77% (6.1372 => 7.1663, std.dev.: 0.0351)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 15.32% (4.1768 => 4.8166, std.dev.: 0.1139)
  SingleSource/Benchmarks/Misc/pi: 9.85% (1.8318 => 2.0123, std.dev.: 0.0531)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.44% (5.2003 => 5.6390, std.dev.: 0.0400)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 5.30% (1.0605 => 1.1167, std.dev.: 0.0121)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 5.15% (4.6639 => 4.9039, std.dev.: 0.0637)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.11% (94.2966 => 98.1760, std.dev.: 0.7368)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.98% (5.2788 => 5.4889, std.dev.: 0.0797)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.61% (5.5010 => 5.6994, std.dev.: 0.0140)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.78% (39.9248 => 41.0351, std.dev.: 0.1964)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.50% (4.3727 => 4.4822, std.dev.: 0.0178)
  MultiSource/Benchmarks/Bullet/bullet: 2.38% (7.1938 => 7.3650, std.dev.: 0.0296)
  SingleSource/Benchmarks/Misc/oourafft: 2.20% (3.7315 => 3.8137, std.dev.: 0.0176)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.92% (21.4874 => 21.9007, std.dev.: 0.1568)
  SingleSource/Benchmarks/Misc/richards_benchmark: 1.92% (1.3514 => 1.3773, std.dev.: 0.0013)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.80% (2.7180 => 2.7668, std.dev.: 0.0138)
  SingleSource/Benchmarks/Shootout/methcall: 1.54% (8.3425 => 8.4706, std.dev.: 0.0251)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.49% (16.4665 => 16.7123, std.dev.: 0.0639)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.38% (11.4990 => 11.6579, std.dev.: 0.0096)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.22% (1.6440 => 1.6641, std.dev.: 0.0017)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -12.25% (0.1322 => 0.1160, std.dev.: 0.0035)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -10.16% (5.1587 => 4.6346, std.dev.: 0.0381)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -9.52% (5.4314 => 4.9146, std.dev.: 0.0771)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.90% (0.7381 => 0.6872, std.dev.: 0.0094)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -5.30% (0.2416 => 0.2288, std.dev.: 0.0018)
  SingleSource/Benchmarks/Linpack/linpack-pc: -4.57% (0.2738 => 0.2613, std.dev.: 0.0042)
  MultiSource/Applications/oggenc/oggenc: -4.20% (5.9886 => 5.7369, std.dev.: 0.0576)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.51% (1.2911 => 0.7294, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.65% (4.4050 => 3.2309, std.dev.: 0.0276)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -19.99% (6.2328 => 4.9867, std.dev.: 0.0275)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.27% (25.3677 => 21.2393, std.dev.: 0.2375)
  SingleSource/Benchmarks/Misc/salsa20: -12.93% (10.3398 => 9.0026, std.dev.: 0.0286)
  MultiSource/Benchmarks/mafft/pairlocalalign: -9.72% (48.3307 => 43.6329, std.dev.: 0.1498)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.37% (1.6679 => 1.5117, std.dev.: 0.0350)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.54% (3.5327 => 3.2665, std.dev.: 0.0522)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -7.17% (9.8728 => 9.1654, std.dev.: 0.1698)
  MultiSource/Applications/sqlite3/sqlite3: -6.31% (4.6358 => 4.3435, std.dev.: 0.0834)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.01% (4.5717 => 4.3426, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.29% (5.3184 => 5.0902, std.dev.: 0.0254)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.86% (9.1099 => 8.7585, std.dev.: 0.0621)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.60% (5.3276 => 5.1359, std.dev.: 0.0480)
  SingleSource/Benchmarks/Misc/flops: -3.19% (10.2170 => 9.8909, std.dev.: 0.0124)
  SingleSource/Benchmarks/Shootout/sieve: -2.76% (8.0178 => 7.7967, std.dev.: 0.0715)
  MultiSource/Applications/JM/lencod/lencod: -2.25% (7.0353 => 6.8768, std.dev.: 0.0506)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.73% (4.5094 => 4.4313, std.dev.: 0.0285)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.43% (2.8573 => 2.8164, std.dev.: 0.0104)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.98% (0.1441 => 0.1484, std.dev.: 0.0224)

Report Time: 1.78s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130607/0d07962b/attachment.html>


More information about the llvm-testresults mailing list