[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Jun 25 12:56:41 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12749?compare_to=12746&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12749, Order: 184863, Start Time: 2013-06-25 18:07:41, End Time: 2013-06-25 19:57:45
      To: 12746, Order: 184857, Start Time: 2013-06-25 16:01:20, End Time: 2013-06-25 17:45:55
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 46 (51 on baseline)
Performance Improvements: 0 (33 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1061 (1023 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 61.10% (0.3234 => 0.5210, std.dev.: 0.0121)
  MultiSource/Benchmarks/Prolangs-C++/NP/np: 59.90% (0.0197 => 0.0315, std.dev.: 0.0037)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 50.61% (0.9818 => 1.4787, std.dev.: 0.0344)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 49.10% (0.1674 => 0.2496, std.dev.: 0.0213)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 36.26% (0.0946 => 0.1289, std.dev.: 0.0055)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 34.75% (0.1456 => 0.1962, std.dev.: 0.0086)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 31.52% (0.1596 => 0.2099, std.dev.: 0.0149)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 29.08% (5.0464 => 6.5137, std.dev.: 0.3354)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 25.91% (4.9703 => 6.2581, std.dev.: 0.2459)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 23.31% (0.0519 => 0.0640, std.dev.: 0.0044)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.67% (4.6516 => 5.6132, std.dev.: 0.2866)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 18.44% (7.4991 => 8.8823, std.dev.: 0.4173)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 14.74% (14.8190 => 17.0026, std.dev.: 0.3479)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 14.22% (46.5284 => 53.1459, std.dev.: 0.8970)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.85% (0.6889 => 0.7774, std.dev.: 0.0311)
  MultiSource/Benchmarks/mafft/pairlocalalign: 12.38% (10.6291 => 11.9450, std.dev.: 0.2000)
  MultiSource/Benchmarks/Bullet/bullet: 10.77% (35.3773 => 39.1860, std.dev.: 0.8247)
  MultiSource/Applications/kimwitu++/kc: 8.52% (19.3161 => 20.9611, std.dev.: 0.4252)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.22% (1.4444 => 1.5631, std.dev.: 0.0198)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.62% (1.7132 => 1.8437, std.dev.: 0.0230)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 6.97% (1.6880 => 1.8056, std.dev.: 0.0274)
  MultiSource/Benchmarks/PAQ8p/paq8p: 6.25% (2.4717 => 2.6262, std.dev.: 0.0186)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.08% (1.5469 => 1.6409, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.98% (1.3950 => 1.4784, std.dev.: 0.0313)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 5.94% (1.4840 => 1.5721, std.dev.: 0.0202)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.79% (0.3507 => 0.3710, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 5.74% (1.4208 => 1.5023, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.67% (1.3903 => 1.4691, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.84% (1.4302 => 1.4851, std.dev.: 0.0195)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.66% (1.3795 => 1.4300, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.46% (1.6604 => 1.7012, std.dev.: 0.0156)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 1.15% (1.1864 => 1.2000, std.dev.: 0.0025)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 79.48% (0.0385 => 0.0691, std.dev.: 0.0040)
  MultiSource/Benchmarks/Olden/mst/mst: 58.78% (0.1332 => 0.2115, std.dev.: 0.0101)
  MultiSource/Applications/lemon/lemon: 23.98% (0.9125 => 1.1313, std.dev.: 0.0511)
  MultiSource/Applications/minisat/minisat: 19.81% (6.1319 => 7.3465, std.dev.: 0.3315)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.87% (2.5418 => 2.9451, std.dev.: 0.0470)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.80% (2.1109 => 2.4021, std.dev.: 0.0052)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.58% (0.4391 => 0.4636, std.dev.: 0.0066)
  MultiSource/Benchmarks/Bullet/bullet: 5.42% (7.0227 => 7.4032, std.dev.: 0.0277)
  MultiSource/Benchmarks/Olden/em3d/em3d: 4.63% (4.9479 => 5.1772, std.dev.: 0.0251)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.28% (1.0554 => 1.1006, std.dev.: 0.0035)
  SingleSource/Benchmarks/McGill/misr: 3.28% (0.3779 => 0.3903, std.dev.: 0.0039)
  MultiSource/Applications/lua/lua: 2.26% (27.6984 => 28.3236, std.dev.: 0.2072)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.84% (4.5290 => 4.6125, std.dev.: 0.0255)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.46% (5.8513 => 5.9368, std.dev.: 0.0058)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.40% (0.1355 => 0.1374, std.dev.: 0.0229)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 54.23% (0.3378 => 0.5210, std.dev.: 0.0121)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 48.40% (0.9964 => 1.4787, std.dev.: 0.0344)
  MultiSource/Benchmarks/Prolangs-C++/NP/np: 47.20% (0.0214 => 0.0315, std.dev.: 0.0037)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 32.34% (0.1886 => 0.2496, std.dev.: 0.0213)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 30.49% (4.9917 => 6.5137, std.dev.: 0.3354)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 29.81% (0.1617 => 0.2099, std.dev.: 0.0149)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 22.61% (0.0522 => 0.0640, std.dev.: 0.0044)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 19.91% (0.1075 => 0.1289, std.dev.: 0.0055)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.20% (0.1646 => 0.1962, std.dev.: 0.0086)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.22% (5.4314 => 6.2581, std.dev.: 0.2459)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.04% (7.7211 => 8.8823, std.dev.: 0.4173)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.43% (0.2721 => 0.3032, std.dev.: 0.0085)
  MultiSource/Benchmarks/mafft/pairlocalalign: 11.37% (10.7257 => 11.9450, std.dev.: 0.2000)
  MultiSource/Benchmarks/Bullet/bullet: 10.29% (35.5296 => 39.1860, std.dev.: 0.8247)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.78% (1.4238 => 1.5631, std.dev.: 0.0198)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.19% (0.3429 => 0.3710, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.81% (1.7102 => 1.8437, std.dev.: 0.0230)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.87% (1.3833 => 1.4784, std.dev.: 0.0313)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.69% (1.4081 => 1.5023, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.53% (1.4757 => 1.5721, std.dev.: 0.0202)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.36% (15.9860 => 17.0026, std.dev.: 0.3479)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 6.17% (1.7006 => 1.8056, std.dev.: 0.0274)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.16% (1.3838 => 1.4691, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.01% (1.5478 => 1.6409, std.dev.: 0.0015)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.89% (0.2937 => 0.3110, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 5.10% (1.4131 => 1.4851, std.dev.: 0.0195)
  MultiSource/Benchmarks/Prolangs-C++/office/office: 4.92% (0.2295 => 0.2408, std.dev.: 0.0029)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.72% (2.5078 => 2.6262, std.dev.: 0.0186)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 4.63% (1.3667 => 1.4300, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.76% (1.6993 => 1.7292, std.dev.: 0.0102)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 48.60% (0.0465 => 0.0691, std.dev.: 0.0040)
  MultiSource/Applications/sgefa/sgefa: 29.23% (1.1695 => 1.5113, std.dev.: 0.0114)
  SingleSource/Benchmarks/Stanford/Puzzle: 20.07% (0.1455 => 0.1747, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 17.06% (6.1372 => 7.1841, std.dev.: 0.0848)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.70% (0.9806 => 1.1346, std.dev.: 0.0354)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 14.15% (2.5800 => 2.9451, std.dev.: 0.0470)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.20% (5.2003 => 5.6267, std.dev.: 0.0150)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.27% (3.1853 => 3.3849, std.dev.: 0.0135)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.96% (3.2201 => 3.3797, std.dev.: 0.0522)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.71% (4.6639 => 4.8838, std.dev.: 0.0179)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.25% (5.9362 => 6.1886, std.dev.: 0.0090)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.12% (1.0571 => 1.1006, std.dev.: 0.0035)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.06% (2.8994 => 3.0171, std.dev.: 0.0342)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.33% (5.2788 => 5.4548, std.dev.: 0.0254)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.28% (5.5010 => 5.6813, std.dev.: 0.0092)
  MultiSource/Benchmarks/Bullet/bullet: 2.91% (7.1938 => 7.4032, std.dev.: 0.0277)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.88% (4.6379 => 4.7717, std.dev.: 0.0254)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.84% (3.6122 => 3.7148, std.dev.: 0.0396)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.41% (4.3727 => 4.4780, std.dev.: 0.0163)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.09% (5.6582 => 5.7766, std.dev.: 0.0435)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.91% (1.7925 => 1.8267, std.dev.: 0.0078)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc/whetstone: -15.22% (0.1097 => 0.0930, std.dev.: 0.0017)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -8.82% (0.1224 => 0.1116, std.dev.: 0.0015)
  MultiSource/Applications/oggenc/oggenc: -6.14% (5.9886 => 5.6209, std.dev.: 0.1338)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.43% (1.2911 => 0.7304, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -36.84% (4.4050 => 2.7823, std.dev.: 0.1097)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -20.86% (4.8986 => 3.8767, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -20.12% (5.7264 => 4.5744, std.dev.: 0.0103)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -18.72% (6.2328 => 5.0663, std.dev.: 0.0124)
  MultiSource/Applications/lemon/lemon: -16.19% (1.3499 => 1.1313, std.dev.: 0.0511)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.02% (25.3677 => 21.3050, std.dev.: 0.0312)
  MultiSource/Benchmarks/mafft/pairlocalalign: -13.85% (48.3307 => 41.6365, std.dev.: 0.0538)
  SingleSource/Benchmarks/Misc/salsa20: -12.99% (10.3398 => 8.9970, std.dev.: 0.1509)
  SingleSource/Benchmarks/Shootout-C++/hash: -9.23% (0.7941 => 0.7208, std.dev.: 0.0251)
  MultiSource/Applications/siod/siod: -8.94% (3.7240 => 3.3912, std.dev.: 0.0205)
  MultiSource/Benchmarks/nbench/nbench: -7.86% (22.3004 => 20.5475, std.dev.: 0.5784)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -7.80% (2.4808 => 2.2872, std.dev.: 0.0628)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.89% (0.1945 => 0.1811, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.88% (4.5717 => 4.2573, std.dev.: 0.0049)
  MultiSource/Applications/sqlite3/sqlite3: -6.63% (4.6358 => 4.3286, std.dev.: 0.0445)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.55% (9.8728 => 9.2264, std.dev.: 0.0499)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.46% (5.5889 => 5.2279, std.dev.: 0.0498)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.32% (5.3276 => 5.0977, std.dev.: 0.0247)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.29% (5.3184 => 5.0900, std.dev.: 0.0078)
  SingleSource/Benchmarks/Misc/flops: -4.20% (10.2170 => 9.7874, std.dev.: 0.0360)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.88% (9.1099 => 8.7567, std.dev.: 0.0340)
  MultiSource/Applications/hexxagon/hexxagon: -3.33% (15.4979 => 14.9825, std.dev.: 0.1171)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.86% (3.8665 => 3.7559, std.dev.: 0.0042)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.63% (6.3757 => 6.2078, std.dev.: 0.0320)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.14% (4.5094 => 4.4131, std.dev.: 0.0258)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.06% (1.6980 => 1.6631, std.dev.: 0.0119)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.01% (4.2167 => 4.1320, std.dev.: 0.0160)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.45% (5.4801 => 5.4005, std.dev.: 0.0303)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.14% (2.8573 => 2.8248, std.dev.: 0.0106)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.65% (0.1441 => 0.1374, std.dev.: 0.0229)

Report Time: 0.74s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130625/78af23ca/attachment.html>


More information about the llvm-testresults mailing list