[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Sep 22 13:51:22 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15565?compare_to=15562&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15565, Order: 191179, Start Time: 2013-09-22 19:10:36, End Time: 2013-09-22 20:54:07
      To: 15562, Order: 191177, Start Time: 2013-09-22 17:00:51, End Time: 2013-09-22 18:45:54
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 26 (61 on baseline)
Performance Improvements: 0 (17 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1081 (1029 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.64% (1.4112 => 1.4343, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.19% (1.3252 => 1.3410, std.dev.: 0.0016)
  MultiSource/Applications/sqlite3/sqlite3: 1.15% (16.6545 => 16.8468, std.dev.: 0.0733)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.02% (1.2619 => 1.2748, std.dev.: 0.0015)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/hexxagon/hexxagon: 7.58% (15.0301 => 16.1690, std.dev.: 0.0137)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 7.57% (1.1183 => 1.2029, std.dev.: 0.0108)
  MultiSource/Applications/obsequi/Obsequi: 6.71% (2.2052 => 2.3531, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.08% (3.6343 => 3.8552, std.dev.: 0.0083)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 4.66% (2.8768 => 3.0110, std.dev.: 0.0215)
  MultiSource/Benchmarks/BitBench/five11/five11: 3.32% (5.4603 => 5.6417, std.dev.: 0.0139)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.31% (1.8382 => 1.8991, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.23% (3.6027 => 3.7192, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.96% (4.4873 => 4.6203, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.80% (4.0332 => 4.1460, std.dev.: 0.0062)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.76% (2.4062 => 2.4725, std.dev.: 0.0093)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.64% (2.5222 => 2.5889, std.dev.: 0.0155)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.22% (5.1405 => 5.2546, std.dev.: 0.0122)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.91% (3.1603 => 3.2208, std.dev.: 0.0006)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 1.88% (9.2572 => 9.4313, std.dev.: 0.0420)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.84% (2.1729 => 2.2129, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.57% (16.5888 => 16.8495, std.dev.: 0.0068)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.38% (2.3913 => 2.4243, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.27% (6.5948 => 6.6787, std.dev.: 0.0315)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.23% (5.3391 => 5.4047, std.dev.: 0.0002)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.21% (1.0564 => 1.0692, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.14% (5.9431 => 6.0106, std.dev.: 0.0018)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.22% (0.1352 => 0.1349, std.dev.: 0.0028)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.37% (0.2335 => 0.2437, std.dev.: 0.0021)
  MultiSource/Applications/lambda-0_1_3/lambda: 4.27% (0.8014 => 0.8356, std.dev.: 0.0007)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.11% (0.4624 => 0.4814, std.dev.: 0.0015)
  MultiSource/Applications/sqlite3/sqlite3: 3.43% (16.2888 => 16.8468, std.dev.: 0.0733)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.06% (0.3822 => 0.3939, std.dev.: 0.0016)
  MultiSource/Applications/JM/lencod/lencod: 2.87% (16.5902 => 17.0663, std.dev.: 0.1744)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.83% (0.8667 => 0.8912, std.dev.: 0.0062)
  MultiSource/Benchmarks/Prolangs-C/football/football: 2.69% (0.9828 => 1.0092, std.dev.: 0.0021)
  MultiSource/Applications/lemon/lemon: 2.52% (1.1862 => 1.2161, std.dev.: 0.0030)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.35% (7.2661 => 7.4370, std.dev.: 0.0225)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 2.31% (44.2807 => 45.3022, std.dev.: 0.1156)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.30% (1.3365 => 1.3672, std.dev.: 0.0013)
  MultiSource/Benchmarks/Bullet/bullet: 2.19% (32.7552 => 33.4716, std.dev.: 0.0566)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.15% (1.4041 => 1.4343, std.dev.: 0.0041)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.10% (1.8775 => 1.9170, std.dev.: 0.0098)
  MultiSource/Benchmarks/McCat/05-eks/eks: 2.10% (0.5185 => 0.5294, std.dev.: 0.0021)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.06% (1.0952 => 1.1178, std.dev.: 0.0016)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.03% (1.4746 => 1.5045, std.dev.: 0.0021)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.99% (9.9903 => 10.1889, std.dev.: 0.0265)
  SingleSource/Benchmarks/Misc-C++/bigfib: 1.97% (0.6439 => 0.6566, std.dev.: 0.0029)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.86% (14.4764 => 14.7460, std.dev.: 0.0506)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.79% (0.6296 => 0.6409, std.dev.: 0.0031)
  MultiSource/Applications/obsequi/Obsequi: 1.75% (1.1551 => 1.1753, std.dev.: 0.0051)
  MultiSource/Applications/lua/lua: 1.74% (4.2242 => 4.2976, std.dev.: 0.0195)
  MultiSource/Benchmarks/nbench/nbench: 1.73% (1.2484 => 1.2700, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.72% (1.2932 => 1.3154, std.dev.: 0.0024)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.43% (1.4033 => 1.4233, std.dev.: 0.0053)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.18% (4.6423 => 4.6970, std.dev.: 0.0169)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.12% (1.2007 => 1.2142, std.dev.: 0.0034)
  MultiSource/Benchmarks/PAQ8p/paq8p: 1.12% (2.5666 => 2.5953, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.03% (1.4599 => 1.4749, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.01% (1.2550 => 1.2677, std.dev.: 0.0015)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 57.55% (1.6574 => 2.6112, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout-C++/matrix: 37.58% (2.8554 => 3.9284, std.dev.: 0.0096)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.50% (0.1374 => 0.1587, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 14.71% (6.4425 => 7.3902, std.dev.: 0.3386)
  MultiSource/Applications/hexxagon/hexxagon: 9.39% (14.7810 => 16.1690, std.dev.: 0.0137)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 9.23% (1.1013 => 1.2029, std.dev.: 0.0108)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.44% (3.5550 => 3.8552, std.dev.: 0.0083)
  MultiSource/Applications/obsequi/Obsequi: 7.53% (2.1884 => 2.3531, std.dev.: 0.0077)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0003)
  SingleSource/Benchmarks/McGill/misr: 5.09% (0.3771 => 0.3963, std.dev.: 0.0063)
  MultiSource/Benchmarks/BitBench/five11/five11: 5.03% (5.3716 => 5.6417, std.dev.: 0.0139)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.35% (3.5642 => 3.7192, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.37% (4.4696 => 4.6203, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.18% (4.0181 => 4.1460, std.dev.: 0.0062)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.06% (2.1472 => 2.2129, std.dev.: 0.0002)
  MultiSource/Applications/siod/siod: 2.91% (3.5310 => 3.6339, std.dev.: 0.0341)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.89% (0.3836 => 0.3947, std.dev.: 0.0027)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.76% (1.7652 => 1.8140, std.dev.: 0.0015)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.55% (1.8519 => 1.8991, std.dev.: 0.0020)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.35% (0.5182 => 0.5304, std.dev.: 0.0003)
  MultiSource/Applications/sqlite3/sqlite3: 2.08% (4.2733 => 4.3622, std.dev.: 0.0030)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.05% (2.5368 => 2.5889, std.dev.: 0.0155)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.02% (3.1569 => 3.2208, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.93% (5.3022 => 5.4047, std.dev.: 0.0002)
  MultiSource/Benchmarks/Olden/power/power: 1.87% (1.2170 => 1.2398, std.dev.: 0.0055)
  SingleSource/Benchmarks/Shootout/fib2: 1.70% (3.5966 => 3.6579, std.dev.: 0.0208)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.44% (5.4925 => 5.5718, std.dev.: 0.0247)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.34% (1.5940 => 1.6154, std.dev.: 0.0068)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (1.6707 => 1.6930, std.dev.: 0.0010)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: -7.70% (0.2571 => 0.2373, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.35% (1.2499 => 1.2330, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.09% (1.3068 => 1.2926, std.dev.: 0.0005)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.29% (0.5226 => 0.2389, std.dev.: 0.0214)
  MultiSource/Applications/sgefa/sgefa: -47.02% (1.5790 => 0.8366, std.dev.: 0.0180)
  SingleSource/Benchmarks/Linpack/linpack-pc: -23.52% (57.2347 => 43.7715, std.dev.: 1.5624)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.41% (15.9508 => 13.0148, std.dev.: 0.1961)
  MultiSource/Benchmarks/FreeBench/mason/mason: -11.77% (0.3304 => 0.2915, std.dev.: 0.0026)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.72% (20.8247 => 18.5914, std.dev.: 0.1109)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.32% (3.4956 => 3.1349, std.dev.: 0.0387)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.18% (50.0284 => 46.4384, std.dev.: 0.3188)
  MultiSource/Applications/SIBsim4/SIBsim4: -4.64% (3.7437 => 3.5699, std.dev.: 0.0253)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.59% (0.6563 => 0.6393, std.dev.: 0.0059)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.03% (2.5938 => 2.5412, std.dev.: 0.0174)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.71% (17.1431 => 16.8495, std.dev.: 0.0068)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.36% (39.9519 => 39.4069, std.dev.: 0.1533)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.20% (3.8582 => 3.8119, std.dev.: 0.0072)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1348 => 0.1349, std.dev.: 0.0028)

Report Time: 0.77s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130922/f714daa9/attachment.html>


More information about the llvm-testresults mailing list