[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Jul 9 06:39:09 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13235?compare_to=13230&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 13235, Order: 185928, Start Time: 2013-07-09 11:48:41, End Time: 2013-07-09 13:40:28
      To: 13230, Order: 185912, Start Time: 2013-07-09 09:32:54, End Time: 2013-07-09 11:24:38
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 29 (58 on baseline)
Performance Improvements: 17 (45 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1061 (1004 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 57.30% (0.0932 => 0.1466, std.dev.: 0.0025)
  SingleSource/Regression/C/sumarraymalloc: 40.36% (0.0441 => 0.0619, std.dev.: 0.0029)
  MultiSource/Benchmarks/Olden/em3d/em3d: 37.75% (0.2066 => 0.2846, std.dev.: 0.0302)
  MultiSource/Benchmarks/McCat/09-vor/vor: 37.29% (0.3604 => 0.4948, std.dev.: 0.0078)
  MultiSource/Benchmarks/McCat/05-eks/eks: 24.70% (0.5607 => 0.6992, std.dev.: 0.0233)
  MultiSource/Applications/obsequi/Obsequi: 21.35% (1.2012 => 1.4577, std.dev.: 0.0600)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.01% (0.4353 => 0.5224, std.dev.: 0.0167)
  MultiSource/Benchmarks/McCat/18-imp/imp: 14.00% (0.4014 => 0.4576, std.dev.: 0.0205)
  MultiSource/Benchmarks/MallocBench/gs/gs: 9.17% (5.9041 => 6.4458, std.dev.: 0.0596)
  MultiSource/Applications/oggenc/oggenc: 7.15% (5.6427 => 6.0461, std.dev.: 0.0765)
  MultiSource/Applications/sqlite3/sqlite3: 6.99% (16.6434 => 17.8060, std.dev.: 0.3902)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.76% (2.6387 => 2.8170, std.dev.: 0.0440)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.75% (0.5284 => 0.5535, std.dev.: 0.0055)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 60.82% (5.8189 => 9.3577, std.dev.: 0.7173)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 59.73% (2.9157 => 4.6572, std.dev.: 0.0176)
  MultiSource/Benchmarks/Olden/mst/mst: 41.22% (0.2045 => 0.2888, std.dev.: 0.0108)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 37.27% (0.0593 => 0.0814, std.dev.: 0.0043)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 29.49% (1.5966 => 2.0674, std.dev.: 0.0343)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 25.30% (0.1182 => 0.1481, std.dev.: 0.0066)
  MultiSource/Applications/SPASS/SPASS: 14.13% (8.1322 => 9.2812, std.dev.: 0.1620)
  MultiSource/Applications/obsequi/Obsequi: 13.76% (2.3274 => 2.6477, std.dev.: 0.0145)
  MultiSource/Applications/minisat/minisat: 12.53% (7.1376 => 8.0322, std.dev.: 0.2860)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 10.98% (36.9857 => 41.0475, std.dev.: 0.5535)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 7.19% (0.8486 => 0.9096, std.dev.: 0.0130)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 6.86% (1.7701 => 1.8916, std.dev.: 0.0173)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.19% (0.3763 => 0.3883, std.dev.: 0.0029)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.92% (62.6227 => 64.4531, std.dev.: 0.5141)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.62% (1.5818 => 1.6075, std.dev.: 0.0027)
  MultiSource/Applications/aha/aha: 1.11% (3.5908 => 3.6308, std.dev.: 0.0121)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -28.47% (0.2469 => 0.1766, std.dev.: 0.0257)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.59% (2.0316 => 1.4711, std.dev.: 0.0687)
  MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -26.01% (0.0719 => 0.0532, std.dev.: 0.0046)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -25.28% (0.1994 => 0.1490, std.dev.: 0.0134)
  SingleSource/UnitTests/SignlessTypes/factor: -23.87% (0.0465 => 0.0354, std.dev.: 0.0038)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -18.26% (2.4166 => 1.9753, std.dev.: 0.1237)
  SingleSource/UnitTests/Vector/Altivec/test1: -14.34% (0.1583 => 0.1356, std.dev.: 0.0002)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: -13.29% (0.4048 => 0.3510, std.dev.: 0.0095)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.15% (0.1220 => 0.1084, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -10.83% (1.8971 => 1.6917, std.dev.: 0.0348)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.83% (1.2740 => 1.1743, std.dev.: 0.0380)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.79% (1.5776 => 1.4705, std.dev.: 0.0380)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.51% (1.5682 => 1.4975, std.dev.: 0.0140)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.77% (0.3897 => 0.3789, std.dev.: 0.0039)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -20.76% (0.4340 => 0.3439, std.dev.: 0.0216)
  SingleSource/Benchmarks/Misc/pi: -12.18% (2.1243 => 1.8656, std.dev.: 0.0948)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.48% (1.6894 => 1.6644, std.dev.: 0.0091)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.79% (0.1327 => 0.1364, std.dev.: 0.0206)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 59.69% (0.0918 => 0.1466, std.dev.: 0.0025)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 53.20% (0.3410 => 0.5224, std.dev.: 0.0167)
  SingleSource/Regression/C/sumarraymalloc: 43.62% (0.0431 => 0.0619, std.dev.: 0.0029)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 43.52% (0.2293 => 0.3291, std.dev.: 0.0365)
  MultiSource/Benchmarks/MallocBench/gs/gs: 36.88% (4.7091 => 6.4458, std.dev.: 0.0596)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 34.71% (4.9917 => 6.7241, std.dev.: 0.1505)
  SingleSource/Benchmarks/Shootout-C++/lists1: 33.04% (0.3290 => 0.4377, std.dev.: 0.0405)
  MultiSource/Benchmarks/McCat/09-vor/vor: 32.90% (0.3723 => 0.4948, std.dev.: 0.0078)
  MultiSource/Benchmarks/Olden/power/power: 29.03% (0.1457 => 0.1880, std.dev.: 0.0135)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 26.47% (5.6424 => 7.1357, std.dev.: 0.2192)
  MultiSource/Applications/obsequi/Obsequi: 24.24% (1.1733 => 1.4577, std.dev.: 0.0600)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 23.72% (0.7918 => 0.9796, std.dev.: 0.0613)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 23.13% (1.0314 => 1.2700, std.dev.: 0.0442)
  MultiSource/Benchmarks/McCat/05-eks/eks: 22.71% (0.5698 => 0.6992, std.dev.: 0.0233)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.63% (1.5014 => 1.8111, std.dev.: 0.0639)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 17.25% (0.4030 => 0.4725, std.dev.: 0.0175)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 16.64% (1.5981 => 1.8641, std.dev.: 0.0322)
  MultiSource/Benchmarks/nbench/nbench: 14.68% (1.2926 => 1.4823, std.dev.: 0.0658)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.03% (2.6076 => 2.8170, std.dev.: 0.0440)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.52% (0.5196 => 0.5535, std.dev.: 0.0055)
  SingleSource/Benchmarks/Shootout-C++/sieve: 5.34% (0.3088 => 0.3253, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.55% (1.6070 => 1.6801, std.dev.: 0.0237)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.98% (1.3833 => 1.4245, std.dev.: 0.0150)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 55.65% (6.0122 => 9.3577, std.dev.: 0.7173)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 37.73% (0.0591 => 0.0814, std.dev.: 0.0043)
  MultiSource/Benchmarks/Olden/mst/mst: 37.59% (0.2099 => 0.2888, std.dev.: 0.0108)
  MultiSource/Applications/viterbi/viterbi: 35.78% (2.5688 => 3.4878, std.dev.: 0.1635)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 33.06% (3.5000 => 4.6572, std.dev.: 0.0176)
  MultiSource/Applications/sgefa/sgefa: 30.50% (1.1695 => 1.5262, std.dev.: 0.0076)
  SingleSource/Benchmarks/Misc/perlin: 26.68% (3.6271 => 4.5949, std.dev.: 0.0257)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 22.60% (0.1208 => 0.1481, std.dev.: 0.0066)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 22.07% (0.0920 => 0.1123, std.dev.: 0.0048)
  MultiSource/Applications/obsequi/Obsequi: 18.21% (2.2398 => 2.6477, std.dev.: 0.0145)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.96% (6.1372 => 7.1779, std.dev.: 0.2369)
  SingleSource/Benchmarks/Misc/mandel: 16.79% (1.0293 => 1.2021, std.dev.: 0.0029)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 13.03% (1.8291 => 2.0674, std.dev.: 0.0343)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 10.47% (4.1768 => 4.6140, std.dev.: 0.1119)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 9.91% (0.8276 => 0.9096, std.dev.: 0.0130)
  MultiSource/Applications/lua/lua: 9.52% (28.2496 => 30.9396, std.dev.: 0.8720)
  SingleSource/Benchmarks/Shootout/strcat: 8.86% (0.1456 => 0.1585, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.82% (5.2003 => 5.6072, std.dev.: 0.0972)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.20% (3.1853 => 3.3827, std.dev.: 0.0310)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.84% (0.4572 => 0.4839, std.dev.: 0.0057)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.51% (1.2224 => 1.2898, std.dev.: 0.0251)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.84% (3.2201 => 3.3760, std.dev.: 0.0042)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 4.78% (39.1740 => 41.0475, std.dev.: 0.5535)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.66% (4.6639 => 4.8814, std.dev.: 0.0035)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.46% (2.8994 => 3.0286, std.dev.: 0.0280)
  SingleSource/Benchmarks/Misc/fbench: 4.46% (4.7508 => 4.9625, std.dev.: 0.0157)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.41% (1.0571 => 1.1037, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.73% (5.9362 => 6.1579, std.dev.: 0.0488)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.23% (62.4345 => 64.4531, std.dev.: 0.5141)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.96% (5.5010 => 5.6641, std.dev.: 0.0427)
  MultiSource/Benchmarks/sim/sim: 2.68% (3.8805 => 3.9846, std.dev.: 0.0217)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.54% (4.6379 => 4.7557, std.dev.: 0.0199)
  SingleSource/Benchmarks/CoyoteBench/almabench: 2.35% (34.3107 => 35.1155, std.dev.: 0.0123)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.16% (4.3727 => 4.4673, std.dev.: 0.0087)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.78% (5.6582 => 5.7591, std.dev.: 0.0034)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -33.24% (0.1113 => 0.0743, std.dev.: 0.0078)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -14.69% (0.0803 => 0.0685, std.dev.: 0.0009)
  MultiSource/Applications/JM/lencod/lencod: -8.49% (18.9387 => 17.3311, std.dev.: 0.4172)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.37% (1.2911 => 0.7312, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -38.07% (4.4050 => 2.7281, std.dev.: 0.0059)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -24.78% (1.6105 => 1.2114, std.dev.: 0.1117)
  MultiSource/Applications/lambda-0_1_3/lambda: -22.58% (9.1099 => 7.0530, std.dev.: 0.0203)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -20.96% (4.8986 => 3.8718, std.dev.: 0.0081)
  SingleSource/Benchmarks/Shootout/hash: -20.83% (5.3656 => 4.2480, std.dev.: 0.1284)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -20.20% (5.7264 => 4.5695, std.dev.: 0.0216)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -18.87% (6.2328 => 5.0568, std.dev.: 0.0172)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.08% (25.3677 => 21.2884, std.dev.: 0.2356)
  SingleSource/Benchmarks/Shootout-C++/hash: -15.67% (0.7941 => 0.6697, std.dev.: 0.0095)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -12.93% (1.6679 => 1.4522, std.dev.: 0.0495)
  SingleSource/Benchmarks/Misc/salsa20: -12.87% (10.3398 => 9.0086, std.dev.: 0.0268)
  MultiSource/Applications/siod/siod: -9.73% (3.7240 => 3.3616, std.dev.: 0.0257)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -9.42% (0.2973 => 0.2693, std.dev.: 0.0091)
  SingleSource/Regression/C/uint64_to_float: -8.52% (1.6851 => 1.5416, std.dev.: 0.0460)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -8.36% (9.8728 => 9.0471, std.dev.: 0.0073)
  MultiSource/Benchmarks/Olden/tsp/tsp: -8.35% (1.6613 => 1.5226, std.dev.: 0.0187)
  MultiSource/Applications/SIBsim4/SIBsim4: -8.33% (3.5327 => 3.2384, std.dev.: 0.0591)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -7.27% (4.5717 => 4.2393, std.dev.: 0.0053)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.17% (3.2030 => 2.9734, std.dev.: 0.0536)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -6.93% (10.2418 => 9.5316, std.dev.: 0.2190)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.77% (5.5889 => 5.2107, std.dev.: 0.0214)
  SingleSource/Benchmarks/Shootout-C++/hash2: -5.97% (3.5939 => 3.3792, std.dev.: 0.0081)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -5.82% (2.4808 => 2.3365, std.dev.: 0.0378)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.92% (6.3757 => 6.0619, std.dev.: 0.0460)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.78% (5.3184 => 5.0642, std.dev.: 0.0088)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -4.58% (2.8537 => 2.7230, std.dev.: 0.0478)
  MultiSource/Applications/sqlite3/sqlite3: -3.62% (4.6358 => 4.4678, std.dev.: 0.0513)
  SingleSource/Benchmarks/Misc/flops: -3.57% (10.2170 => 9.8524, std.dev.: 0.0077)
  SingleSource/Benchmarks/Misc/whetstone: -3.51% (3.5970 => 3.4706, std.dev.: 0.0037)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -3.42% (1.6440 => 1.5878, std.dev.: 0.0058)
  MultiSource/Applications/spiff/spiff: -3.41% (2.8536 => 2.7562, std.dev.: 0.0129)
  MultiSource/Applications/hexxagon/hexxagon: -3.04% (15.4979 => 15.0261, std.dev.: 0.0259)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -2.78% (1.6535 => 1.6075, std.dev.: 0.0027)
  SingleSource/Benchmarks/Shootout/sieve: -2.73% (8.0178 => 7.7987, std.dev.: 0.0072)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.24% (48.3307 => 47.2458, std.dev.: 0.3487)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.22% (4.5094 => 4.4094, std.dev.: 0.0284)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.06% (3.8665 => 3.7869, std.dev.: 0.0047)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.98% (1.6980 => 1.6644, std.dev.: 0.0091)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.43% (1.1791 => 1.1622, std.dev.: 0.0045)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.20% (5.9068 => 5.8360, std.dev.: 0.0202)
  SingleSource/Benchmarks/Shootout/lists: -1.10% (7.2961 => 7.2156, std.dev.: 0.0277)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -5.34% (0.1441 => 0.1364, std.dev.: 0.0206)

Report Time: 0.78s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130709/08a9eb33/attachment.html>


More information about the llvm-testresults mailing list