[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Aug 6 22:55:00 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14167?compare_to=14163&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14167, Order: 187862, Start Time: 2013-08-07 04:08:26, End Time: 2013-08-07 05:56:52
      To: 14163, Order: 187842, Start Time: 2013-08-07 01:51:55, End Time: 2013-08-07 03:41:58
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

New Failures: 0 (2 on baseline)
Performance Regressions: 5 (26 on baseline)
Performance Improvements: 6 (41 on baseline)
Existing Failures: 3 (1 on baseline)
Unchanged Tests: 1094 (1038 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.91% (5.0148 => 5.3112, std.dev.: 0.0296)
  SingleSource/Benchmarks/McGill/misr: 5.52% (0.3699 => 0.3903, std.dev.: 0.0002)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.00% (15.9103 => 16.5468, std.dev.: 0.0837)
  SingleSource/Benchmarks/Misc/pi: 2.98% (2.4430 => 2.5159, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.18% (4.9896 => 5.0983, std.dev.: 0.0233)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -1.76% (0.6535 => 0.6420, std.dev.: 0.0033)
  MultiSource/Benchmarks/PAQ8p/paq8p: -1.48% (2.5603 => 2.5223, std.dev.: 0.0127)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/PAQ8p/paq8p: -4.86% (95.3098 => 90.6743, std.dev.: 1.1594)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -2.01% (3.6732 => 3.5992, std.dev.: 0.0209)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.72% (2.5981 => 2.5535, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.35% (6.0138 => 5.9329, std.dev.: 0.0066)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Applications/ClamAV/clamscan: 1.03% (0.1357 => 0.1371, std.dev.: 0.0102)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 0.73% (0.2752 => 0.2772, std.dev.: 0.0467)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.85% (0.0277 => 0.0186, std.dev.: 0.0044)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.46% (0.2813 => 0.2772, std.dev.: 0.0467)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -46.09% (0.0345 => 0.0186, std.dev.: 0.0044)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 67.35% (3.7285 => 6.2396, std.dev.: 0.1330)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.56% (2.8867 => 4.2885, std.dev.: 0.0337)
  SingleSource/Benchmarks/Misc/pi: 26.84% (1.9835 => 2.5159, std.dev.: 0.0080)
  SingleSource/Benchmarks/Shootout/hash: 24.55% (4.1846 => 5.2120, std.dev.: 0.0685)
  SingleSource/Benchmarks/Shootout-C++/hash: 17.79% (0.6295 => 0.7415, std.dev.: 0.0160)
  MultiSource/Applications/lambda-0_1_3/lambda: 13.09% (7.0762 => 8.0025, std.dev.: 0.0222)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.62% (14.9584 => 16.5468, std.dev.: 0.0837)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.52% (5.4910 => 5.9591, std.dev.: 0.0193)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.38% (1.2557 => 1.3609, std.dev.: 0.0238)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.33% (48.3256 => 52.3496, std.dev.: 0.2506)
  SingleSource/Benchmarks/McGill/chomp: 7.58% (1.0051 => 1.0813, std.dev.: 0.0103)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.96% (3.2027 => 3.4256, std.dev.: 0.0046)
  MultiSource/Applications/siod/siod: 6.46% (3.3761 => 3.5942, std.dev.: 0.0312)
  SingleSource/Benchmarks/McGill/misr: 6.23% (0.3674 => 0.3903, std.dev.: 0.0002)
  MultiSource/Benchmarks/Olden/tsp/tsp: 6.09% (1.5339 => 1.6273, std.dev.: 0.0328)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.99% (5.3042 => 5.6221, std.dev.: 0.0417)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.59% (3.4085 => 3.5992, std.dev.: 0.0209)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.46% (5.5008 => 5.8012, std.dev.: 0.0595)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.25% (5.1471 => 5.3659, std.dev.: 0.0119)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.08% (4.3151 => 4.4912, std.dev.: 0.0154)
  SingleSource/Benchmarks/Shootout-C++/hash2: 3.70% (3.3877 => 3.5131, std.dev.: 0.0103)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.61% (3.3384 => 3.4590, std.dev.: 0.0425)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.48% (6.1245 => 6.3375, std.dev.: 0.0082)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.23% (25.0200 => 25.8285, std.dev.: 0.0457)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.75% (1.3104 => 1.3465, std.dev.: 0.0022)
  SingleSource/Benchmarks/McGill/queens: 1.00% (1.6536 => 1.6702, std.dev.: 0.0055)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -33.93% (0.2237 => 0.1478, std.dev.: 0.0154)
  MultiSource/Benchmarks/Olden/bisort/bisort: -31.62% (0.1072 => 0.0733, std.dev.: 0.0037)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: -24.84% (0.0459 => 0.0345, std.dev.: 0.0030)
  MultiSource/Benchmarks/Olden/tsp/tsp: -22.88% (0.1818 => 0.1402, std.dev.: 0.0085)
  MultiSource/Benchmarks/MallocBench/gs/gs: -22.46% (6.0938 => 4.7254, std.dev.: 0.1111)
  MultiSource/Benchmarks/Olden/health/health: -20.92% (0.1993 => 0.1576, std.dev.: 0.0067)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -18.79% (0.3576 => 0.2904, std.dev.: 0.0251)
  MultiSource/Benchmarks/PAQ8p/paq8p: -6.07% (2.6853 => 2.5223, std.dev.: 0.0127)
  MultiSource/Applications/minisat/minisat: -5.79% (0.8278 => 0.7799, std.dev.: 0.0143)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.78% (0.3309 => 0.3184, std.dev.: 0.0011)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.05% (2.1022 => 1.4284, std.dev.: 0.0025)
  MultiSource/Benchmarks/MallocBench/gs/gs: -30.61% (0.1189 => 0.0825, std.dev.: 0.0040)
  MultiSource/Applications/viterbi/viterbi: -27.11% (3.4923 => 2.5454, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.65% (6.9552 => 5.2410, std.dev.: 0.3368)
  MultiSource/Applications/minisat/minisat: -22.64% (8.0162 => 6.2014, std.dev.: 0.6218)
  SingleSource/Benchmarks/Misc/perlin: -21.44% (4.5989 => 3.6129, std.dev.: 0.0219)
  MultiSource/Applications/obsequi/Obsequi: -18.45% (2.6081 => 2.1268, std.dev.: 0.0837)
  SingleSource/Benchmarks/Misc/mandel: -14.65% (1.1996 => 1.0239, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.36% (6.2627 => 5.4884, std.dev.: 0.2135)
  MultiSource/Applications/lua/lua: -11.68% (31.0707 => 27.4417, std.dev.: 0.7168)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.16% (0.5173 => 0.4699, std.dev.: 0.0059)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.96% (3.5791 => 3.2943, std.dev.: 0.0932)
  MultiSource/Benchmarks/Olden/health/health: -6.36% (0.3556 => 0.3330, std.dev.: 0.0065)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.28% (1.7207 => 1.6298, std.dev.: 0.0267)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.69% (3.8119 => 3.6333, std.dev.: 0.0272)
  SingleSource/Benchmarks/Misc/fbench: -4.53% (4.9602 => 4.7355, std.dev.: 0.0126)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.12% (0.7355 => 0.7052, std.dev.: 0.0008)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.73% (21.6864 => 20.8775, std.dev.: 0.2533)
  MultiSource/Benchmarks/mafft/pairlocalalign: -3.70% (47.2250 => 45.4765, std.dev.: 0.5212)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.41% (2.7049 => 2.6127, std.dev.: 0.0268)
  MultiSource/Benchmarks/PAQ8p/paq8p: -3.20% (93.6732 => 90.6743, std.dev.: 1.1594)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.01% (6.1482 => 5.9632, std.dev.: 0.0625)
  MultiSource/Benchmarks/Olden/bh/bh: -2.89% (2.4879 => 2.4160, std.dev.: 0.0256)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.59% (5.2218 => 5.0866, std.dev.: 0.0503)
  SingleSource/Benchmarks/Stanford/FloatMM: -2.37% (0.7806 => 0.7621, std.dev.: 0.0023)
  SingleSource/Benchmarks/Misc/oourafft: -2.22% (3.7891 => 3.7051, std.dev.: 0.0172)
  MultiSource/Applications/sgefa/sgefa: -2.18% (1.4030 => 1.3724, std.dev.: 0.0099)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.05% (34.8438 => 34.1288, std.dev.: 0.0974)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.44% (1.2012 => 1.1839, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.43% (5.8810 => 5.7968, std.dev.: 0.0021)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.41% (1.0964 => 1.0809, std.dev.: 0.0049)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.51% (0.1378 => 0.1371, std.dev.: 0.0102)

Report Time: 0.67s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130807/c74d77c2/attachment.html>


More information about the llvm-testresults mailing list