[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sat Nov 2 05:24:10 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16929?compare_to=16925&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16929, Order: 193918, Start Time: 2013-11-02 10:28:40, End Time: 2013-11-02 12:27:40
      To: 16925, Order: 193915, Start Time: 2013-11-02 08:10:05, End Time: 2013-11-02 10:06:51
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 37 (59 on baseline)
Performance Improvements: 2 (19 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1068 (1029 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/BitBench/five11/five11: 99.37% (0.0634 => 0.1264, std.dev.: 0.0164)
  MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 98.29% (0.0526 => 0.1043, std.dev.: 0.0044)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: 64.07% (0.0487 => 0.0799, std.dev.: 0.0104)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 62.74% (0.0993 => 0.1616, std.dev.: 0.0126)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 62.39% (0.1643 => 0.2668, std.dev.: 0.0215)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 58.68% (0.3202 => 0.5081, std.dev.: 0.0287)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 57.85% (0.0484 => 0.0764, std.dev.: 0.0052)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 53.87% (0.9818 => 1.5107, std.dev.: 0.1550)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 45.69% (1.3825 => 2.0142, std.dev.: 0.0238)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 45.42% (1.3645 => 1.9842, std.dev.: 0.1819)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 45.30% (1.4270 => 2.0734, std.dev.: 0.1977)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 39.34% (1.9020 => 2.6503, std.dev.: 0.0779)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 39.13% (1.3203 => 1.8369, std.dev.: 0.0180)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 37.40% (1.3565 => 1.8638, std.dev.: 0.1879)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 34.11% (0.2231 => 0.2992, std.dev.: 0.0256)
  MultiSource/Benchmarks/mafft/pairlocalalign: 34.03% (10.1593 => 13.6169, std.dev.: 0.5156)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.95% (0.6369 => 0.8022, std.dev.: 0.0588)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 25.65% (1.2928 => 1.6244, std.dev.: 0.1154)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.21% (1.3389 => 1.6765, std.dev.: 0.0958)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 16.65% (0.1255 => 0.1464, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.40% (1.3400 => 1.3587, std.dev.: 0.0057)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 107.23% (0.0166 => 0.0344, std.dev.: 0.0048)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 51.36% (2.3888 => 3.6157, std.dev.: 0.3686)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 41.53% (0.1529 => 0.2164, std.dev.: 0.0107)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 39.37% (0.0569 => 0.0793, std.dev.: 0.0075)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 29.29% (1.4885 => 1.9245, std.dev.: 0.0532)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 19.66% (0.1653 => 0.1978, std.dev.: 0.0079)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.06% (12.9520 => 14.5142, std.dev.: 0.4045)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.72% (4.1018 => 4.4593, std.dev.: 0.0258)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 6.57% (1.4150 => 1.5079, std.dev.: 0.0127)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 5.53% (39.4153 => 41.5954, std.dev.: 0.6946)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 5.03% (0.7161 => 0.7521, std.dev.: 0.0058)
  SingleSource/Benchmarks/Shootout-C++/matrix: 2.70% (4.1796 => 4.2924, std.dev.: 0.0023)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.68% (1.6035 => 1.6465, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.31% (6.5589 => 6.7105, std.dev.: 0.0492)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.97% (5.0994 => 5.1998, std.dev.: 0.0164)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.19% (3.1495 => 3.1870, std.dev.: 0.0012)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -3.47% (2.2062 => 2.1297, std.dev.: 0.0150)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -1.28% (23.8577 => 23.5513, std.dev.: 0.1188)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.94% (0.1378 => 0.1365, std.dev.: 0.0028)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/BitBench/five11/five11: 109.62% (0.0603 => 0.1264, std.dev.: 0.0164)
  MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 106.94% (0.0504 => 0.1043, std.dev.: 0.0044)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 64.11% (0.3096 => 0.5081, std.dev.: 0.0287)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 61.89% (0.1648 => 0.2668, std.dev.: 0.0215)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: 60.12% (0.0499 => 0.0799, std.dev.: 0.0104)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 59.12% (0.9494 => 1.5107, std.dev.: 0.1550)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 57.97% (0.1023 => 0.1616, std.dev.: 0.0126)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 54.97% (0.0493 => 0.0764, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 50.71% (1.3365 => 2.0142, std.dev.: 0.0238)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 47.75% (1.4033 => 2.0734, std.dev.: 0.1977)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 46.99% (1.3499 => 1.9842, std.dev.: 0.1819)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 41.51% (1.2981 => 1.8369, std.dev.: 0.0180)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 41.16% (1.8775 => 2.6503, std.dev.: 0.0779)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 40.10% (1.3303 => 1.8638, std.dev.: 0.1879)
  MultiSource/Benchmarks/mafft/pairlocalalign: 36.30% (9.9903 => 13.6169, std.dev.: 0.5156)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 34.23% (0.2229 => 0.2992, std.dev.: 0.0256)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 27.75% (1.3123 => 1.6765, std.dev.: 0.0958)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 27.41% (0.6296 => 0.8022, std.dev.: 0.0588)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 24.30% (1.3068 => 1.6244, std.dev.: 0.1154)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 15.91% (0.1263 => 0.1464, std.dev.: 0.0077)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.17% (1.6047 => 1.7198, std.dev.: 0.0132)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.13% (4.0397 => 4.2873, std.dev.: 0.0148)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.15% (2.6492 => 2.7857, std.dev.: 0.0293)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.64% (1.0756 => 1.1148, std.dev.: 0.0026)
  MultiSource/Applications/lambda-0_1_3/lambda: 3.64% (0.8014 => 0.8306, std.dev.: 0.0022)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 2.80% (0.3822 => 0.3929, std.dev.: 0.0016)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.77% (0.9212 => 0.9467, std.dev.: 0.0036)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.68% (0.4624 => 0.4748, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.66% (1.3235 => 1.3587, std.dev.: 0.0057)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.62% (1.9476 => 1.9987, std.dev.: 0.0030)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.57% (1.1393 => 1.1686, std.dev.: 0.0111)
  MultiSource/Benchmarks/MallocBench/gs/gs: 2.46% (4.5883 => 4.7010, std.dev.: 0.0098)
  MultiSource/Applications/lemon/lemon: 2.44% (1.1862 => 1.2151, std.dev.: 0.0065)
  SingleSource/Benchmarks/Misc-C++/bigfib: 2.33% (0.6439 => 0.6589, std.dev.: 0.0024)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 1.70% (1.4792 => 1.5043, std.dev.: 0.0042)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 61.78% (7.6426 => 12.3639, std.dev.: 0.0262)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 58.15% (4.4696 => 7.0688, std.dev.: 0.0128)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 50.59% (2.4010 => 3.6157, std.dev.: 0.3686)
  SingleSource/Benchmarks/Shootout-C++/matrix: 50.33% (2.8554 => 4.2924, std.dev.: 0.0023)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 45.43% (0.1488 => 0.2164, std.dev.: 0.0107)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 38.53% (4.2391 => 5.8724, std.dev.: 0.1469)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 37.67% (0.0576 => 0.0793, std.dev.: 0.0075)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 31.91% (1.1431 => 1.5079, std.dev.: 0.0127)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 29.77% (1.4830 => 1.9245, std.dev.: 0.0532)
  SingleSource/Benchmarks/McGill/misr: 10.24% (0.3771 => 0.4157, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.73% (4.1011 => 4.4593, std.dev.: 0.0258)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.81% (0.1331 => 0.1435, std.dev.: 0.0008)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.38% (1.2516 => 1.3315, std.dev.: 0.0117)
  SingleSource/UnitTests/Vector/multiplies: 5.39% (0.5561 => 0.5861, std.dev.: 0.0097)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 4.95% (0.7166 => 0.7521, std.dev.: 0.0058)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 3.29% (1.5940 => 1.6465, std.dev.: 0.0030)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.24% (89.7126 => 92.6209, std.dev.: 0.2503)
  MultiSource/Applications/aha/aha: 3.10% (3.5731 => 3.6837, std.dev.: 0.0420)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.58% (0.6563 => 0.6732, std.dev.: 0.0023)
  MultiSource/Applications/sqlite3/sqlite3: 2.09% (4.2733 => 4.3626, std.dev.: 0.0118)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.95% (5.1005 => 5.1998, std.dev.: 0.0164)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.86% (3.1569 => 3.2157, std.dev.: 0.0051)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.74% (6.7429 => 6.8601, std.dev.: 0.0280)
  SingleSource/Benchmarks/Shootout/fib2: 1.53% (3.5966 => 3.6518, std.dev.: 0.0135)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: -7.47% (0.2571 => 0.2379, std.dev.: 0.0009)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.42% (0.5226 => 0.2382, std.dev.: 0.0059)
  MultiSource/Applications/sgefa/sgefa: -42.44% (1.5790 => 0.9089, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -19.73% (4.0181 => 3.2252, std.dev.: 0.2804)
  MultiSource/Benchmarks/FreeBench/mason/mason: -18.13% (0.3304 => 0.2705, std.dev.: 0.0034)
  SingleSource/Benchmarks/Shootout-C++/moments: -15.25% (0.1285 => 0.1089, std.dev.: 0.0005)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -14.64% (20.8247 => 17.7755, std.dev.: 0.4055)
  SingleSource/Benchmarks/Linpack/linpack-pc: -14.37% (57.2347 => 49.0113, std.dev.: 0.9355)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.01% (15.9508 => 14.5142, std.dev.: 0.4045)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -8.83% (3.4956 => 3.1870, std.dev.: 0.0012)
  MultiSource/Applications/lambda-0_1_3/lambda: -6.65% (8.1346 => 7.5937, std.dev.: 0.0267)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -4.53% (3.0561 => 2.9177, std.dev.: 0.0497)
  MultiSource/Benchmarks/Olden/power/power: -2.70% (1.2170 => 1.1841, std.dev.: 0.0044)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.55% (3.7874 => 3.6910, std.dev.: 0.0132)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.32% (2.4471 => 2.3903, std.dev.: 0.0115)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.28% (2.5938 => 2.5347, std.dev.: 0.0004)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.12% (4.3592 => 4.2670, std.dev.: 0.0168)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.03% (17.1431 => 16.7958, std.dev.: 0.0999)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.24% (1.4898 => 1.4714, std.dev.: 0.0044)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.26% (0.1348 => 0.1365, std.dev.: 0.0028)

Report Time: 0.78s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131102/a005b889/attachment.html>


More information about the llvm-testresults mailing list