[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Jul 2 13:47:10 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13003?compare_to=12999&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 13003, Order: 185454, Start Time: 2013-07-02 18:58:37, End Time: 2013-07-02 20:48:22
      To: 12999, Order: 185439, Start Time: 2013-07-02 16:40:01, End Time: 2013-07-02 18:33:45
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 3 (28 on baseline)
Performance Improvements: 35 (54 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1069 (1025 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 6.36% (1.7655 => 1.8777, std.dev.: 0.0092)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.67% (1.0552 => 1.1045, std.dev.: 0.0048)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.06% (1.0955 => 1.1400, std.dev.: 0.0051)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -31.29% (0.3988 => 0.2740, std.dev.: 0.0134)
  SingleSource/UnitTests/Vector/simple: -30.97% (0.0339 => 0.0234, std.dev.: 0.0020)
  SingleSource/UnitTests/2003-05-31-CastToBool: -30.85% (0.0376 => 0.0260, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc/oourafft: -28.75% (0.3124 => 0.2226, std.dev.: 0.0045)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -22.10% (1.2526 => 0.9758, std.dev.: 0.0257)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -18.59% (12.6270 => 10.2802, std.dev.: 0.7870)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.42% (5.9764 => 4.9951, std.dev.: 0.0669)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -9.08% (1.7837 => 1.6218, std.dev.: 0.0520)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -8.54% (16.4570 => 15.0511, std.dev.: 0.3213)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -7.48% (6.2358 => 5.7695, std.dev.: 0.1032)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.19% (0.2890 => 0.2711, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.60% (1.5953 => 1.5059, std.dev.: 0.0187)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.60% (1.5050 => 1.4207, std.dev.: 0.0204)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.38% (1.2328 => 1.1665, std.dev.: 0.0189)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.02% (1.5335 => 1.4565, std.dev.: 0.0143)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.70% (1.5219 => 1.4503, std.dev.: 0.0226)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.26% (1.6084 => 1.5399, std.dev.: 0.0207)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.89% (0.3293 => 0.3165, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -1.34% (1.4502 => 1.4308, std.dev.: 0.0055)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -23.12% (0.1540 => 0.1184, std.dev.: 0.0038)
  MultiSource/Benchmarks/MallocBench/gs/gs: -19.94% (0.1053 => 0.0843, std.dev.: 0.0040)
  SingleSource/Benchmarks/Shootout-C++/strcat: -18.93% (0.0972 => 0.0788, std.dev.: 0.0036)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -14.62% (3.0088 => 2.5690, std.dev.: 0.0506)
  SingleSource/Benchmarks/Shootout-C++/hash: -13.34% (0.7256 => 0.6288, std.dev.: 0.0254)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -11.31% (0.1123 => 0.0996, std.dev.: 0.0034)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -10.20% (4.5450 => 4.0816, std.dev.: 0.0946)
  MultiSource/Benchmarks/PAQ8p/paq8p: -9.38% (101.1027 => 91.6221, std.dev.: 2.2430)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.74% (0.3770 => 0.3516, std.dev.: 0.0088)
  MultiSource/Applications/JM/lencod/lencod: -4.93% (7.4138 => 7.0482, std.dev.: 0.1087)
  MultiSource/Benchmarks/mafft/pairlocalalign: -4.20% (49.2098 => 47.1418, std.dev.: 0.1249)
  MultiSource/Applications/sqlite3/sqlite3: -3.98% (4.4370 => 4.2602, std.dev.: 0.0397)
  SingleSource/Benchmarks/Shootout/methcall: -2.76% (8.5393 => 8.3034, std.dev.: 0.0872)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -2.73% (1.2715 => 1.2368, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.56% (3.7878 => 3.7287, std.dev.: 0.0106)
  SingleSource/Benchmarks/Misc/oourafft: -1.21% (3.8196 => 3.7735, std.dev.: 0.0163)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1344 => 0.1343, std.dev.: 0.0073)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.44% (1.3832 => 1.4308, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.07% (1.4131 => 1.4565, std.dev.: 0.0143)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.87% (1.5108 => 1.5541, std.dev.: 0.0137)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/viterbi/viterbi: 35.85% (2.5688 => 3.4897, std.dev.: 0.0146)
  MultiSource/Applications/sgefa/sgefa: 30.06% (1.1695 => 1.5210, std.dev.: 0.0006)
  SingleSource/Benchmarks/Misc/perlin: 26.81% (3.6271 => 4.5994, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 17.67% (6.1372 => 7.2217, std.dev.: 0.0797)
  SingleSource/Benchmarks/Misc/mandel: 17.24% (1.0293 => 1.2067, std.dev.: 0.0054)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.26% (0.9806 => 1.1400, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.02% (5.2003 => 5.6174, std.dev.: 0.0132)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.72% (0.4572 => 0.4925, std.dev.: 0.0089)
  MultiSource/Applications/lua/lua: 6.78% (28.2496 => 30.1636, std.dev.: 0.5544)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.04% (3.1853 => 3.3777, std.dev.: 0.0365)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 5.32% (3.2201 => 3.3914, std.dev.: 0.0168)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 5.11% (4.6639 => 4.9024, std.dev.: 0.0184)
  SingleSource/Benchmarks/Misc/fbench: 4.58% (4.7508 => 4.9686, std.dev.: 0.0049)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.48% (1.0571 => 1.1045, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.84% (5.9362 => 6.1640, std.dev.: 0.0240)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.52% (5.2788 => 5.4645, std.dev.: 0.0253)
  MultiSource/Benchmarks/sim/sim: 3.41% (3.8805 => 4.0129, std.dev.: 0.0498)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.00% (4.6379 => 4.7769, std.dev.: 0.0176)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.93% (5.5010 => 5.6621, std.dev.: 0.0265)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (4.3727 => 4.4776, std.dev.: 0.0114)
  SingleSource/Benchmarks/CoyoteBench/almabench: 2.28% (34.3107 => 35.0925, std.dev.: 0.0214)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.80% (5.6582 => 5.7598, std.dev.: 0.0278)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.71% (1.7925 => 1.8231, std.dev.: 0.0073)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.38% (2.5309 => 2.5658, std.dev.: 0.0078)
  SingleSource/Benchmarks/Misc/oourafft: 1.13% (3.7315 => 3.7735, std.dev.: 0.0163)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -34.05% (0.1113 => 0.0734, std.dev.: 0.0079)
  MultiSource/Applications/viterbi/viterbi: -24.39% (0.2431 => 0.1838, std.dev.: 0.0070)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -16.26% (0.1322 => 0.1107, std.dev.: 0.0082)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -11.07% (0.2006 => 0.1784, std.dev.: 0.0040)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.88% (5.1587 => 4.7008, std.dev.: 0.0354)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.79% (1.5932 => 1.4531, std.dev.: 0.0306)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -8.03% (5.4314 => 4.9951, std.dev.: 0.0669)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.21% (0.2416 => 0.2266, std.dev.: 0.0017)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.85% (15.9860 => 15.0511, std.dev.: 0.3213)
  MultiSource/Applications/lemon/lemon: -5.46% (1.3155 => 1.2437, std.dev.: 0.0186)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.60% (0.8649 => 0.8338, std.dev.: 0.0100)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.47% (1.2911 => 0.7298, std.dev.: 0.0199)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -37.98% (4.4050 => 2.7321, std.dev.: 0.0501)
  MultiSource/Applications/lemon/lemon: -27.83% (1.3499 => 0.9742, std.dev.: 0.0920)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -24.17% (1.6105 => 1.2212, std.dev.: 0.1021)
  SingleSource/Benchmarks/Shootout/hash: -21.92% (5.3656 => 4.1897, std.dev.: 0.2616)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -20.90% (4.8986 => 3.8747, std.dev.: 0.0696)
  SingleSource/Benchmarks/Shootout-C++/hash: -20.82% (0.7941 => 0.6288, std.dev.: 0.0254)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -20.08% (5.7264 => 4.5767, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -18.59% (6.2328 => 5.0741, std.dev.: 0.0280)
  MultiSource/Applications/lambda-0_1_3/lambda: -17.81% (9.1099 => 7.4874, std.dev.: 0.0066)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.08% (25.3677 => 21.2897, std.dev.: 0.0722)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -13.36% (1.6679 => 1.4451, std.dev.: 0.0032)
  SingleSource/Benchmarks/Misc/salsa20: -13.05% (10.3398 => 8.9907, std.dev.: 0.0098)
  MultiSource/Benchmarks/Olden/tsp/tsp: -12.92% (1.6613 => 1.4466, std.dev.: 0.0335)
  MultiSource/Applications/siod/siod: -9.73% (3.7240 => 3.3616, std.dev.: 0.0479)
  SingleSource/Regression/C/uint64_to_float: -9.68% (1.6851 => 1.5220, std.dev.: 0.0107)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -8.40% (9.8728 => 9.0432, std.dev.: 0.0692)
  MultiSource/Applications/sqlite3/sqlite3: -8.10% (4.6358 => 4.2602, std.dev.: 0.0397)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -7.93% (10.2418 => 9.4299, std.dev.: 0.1953)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -7.21% (4.5717 => 4.2421, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.69% (5.5889 => 5.2151, std.dev.: 0.0414)
  SingleSource/Benchmarks/Shootout-C++/hash2: -6.09% (3.5939 => 3.3751, std.dev.: 0.0786)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.85% (0.4445 => 0.4185, std.dev.: 0.0097)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -5.47% (1.3084 => 1.2368, std.dev.: 0.0066)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -4.68% (1.6535 => 1.5761, std.dev.: 0.0131)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.32% (5.3184 => 5.0888, std.dev.: 0.0040)
  SingleSource/Benchmarks/Misc/whetstone: -4.06% (3.5970 => 3.4508, std.dev.: 0.0122)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.93% (5.3276 => 5.1182, std.dev.: 0.0348)
  MultiSource/Applications/hexxagon/hexxagon: -3.50% (15.4979 => 14.9560, std.dev.: 0.0515)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -3.44% (1.6440 => 1.5874, std.dev.: 0.0031)
  SingleSource/Benchmarks/Shootout/sieve: -2.87% (8.0178 => 7.7874, std.dev.: 0.0169)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.71% (3.6122 => 3.5142, std.dev.: 0.0178)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.49% (3.8665 => 3.7702, std.dev.: 0.0179)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.46% (48.3307 => 47.1418, std.dev.: 0.1249)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.14% (1.6980 => 1.6616, std.dev.: 0.0090)
  MultiSource/Benchmarks/Olden/power/power: -1.92% (1.2558 => 1.2317, std.dev.: 0.0081)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.77% (4.2167 => 4.1422, std.dev.: 0.0149)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.65% (4.5094 => 4.4351, std.dev.: 0.0032)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.52% (5.9068 => 5.8172, std.dev.: 0.0342)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (6.3757 => 6.2878, std.dev.: 0.0184)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.36% (4.9946 => 4.9265, std.dev.: 0.0067)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.31% (12.1841 => 12.0240, std.dev.: 0.0193)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.19% (2.8573 => 2.8234, std.dev.: 0.0059)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -6.80% (0.1441 => 0.1343, std.dev.: 0.0073)

Report Time: 0.72s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130702/bdc2c235/attachment.html>


More information about the llvm-testresults mailing list