[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Jul 9 20:29:50 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13257?compare_to=13253&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 13257, Order: 185989, Start Time: 2013-07-10 01:43:34, End Time: 2013-07-10 03:31:11
      To: 13253, Order: 185982, Start Time: 2013-07-09 23:32:14, End Time: 2013-07-10 01:20:50
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 4 (22 on baseline)
Performance Improvements: 2 (53 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1101 (1032 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 9.87% (0.4244 => 0.4663, std.dev.: 0.0114)
  SingleSource/Benchmarks/Misc/fp-convert: 1.71% (7.9233 => 8.0588, std.dev.: 0.0346)
  SingleSource/Benchmarks/Shootout/random: 1.62% (2.4329 => 2.4722, std.dev.: 0.0027)
  SingleSource/Benchmarks/Linpack/linpack-pc: 1.03% (51.4909 => 52.0203, std.dev.: 0.0203)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.45% (1.5084 => 1.4564, std.dev.: 0.0156)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.37% (1.6823 => 1.6593, std.dev.: 0.0088)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 3.68% (0.1276 => 0.1323, std.dev.: 0.0202)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/viterbi/viterbi: 35.87% (2.5688 => 3.4903, std.dev.: 0.0556)
  MultiSource/Applications/sgefa/sgefa: 29.82% (1.1695 => 1.5183, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc/perlin: 26.56% (3.6271 => 4.5906, std.dev.: 0.0046)
  SingleSource/Benchmarks/Stanford/Puzzle: 21.72% (0.1455 => 0.1771, std.dev.: 0.0060)
  SingleSource/Benchmarks/Misc/mandel: 16.43% (1.0293 => 1.1984, std.dev.: 0.0067)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.09% (6.1372 => 7.1245, std.dev.: 0.1601)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.96% (0.9806 => 1.1371, std.dev.: 0.0036)
  SingleSource/Benchmarks/Shootout/strcat: 7.97% (0.1456 => 0.1572, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.81% (5.2003 => 5.6065, std.dev.: 0.0121)
  MultiSource/Applications/lua/lua: 7.25% (28.2496 => 30.2963, std.dev.: 0.7540)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.18% (3.1853 => 3.3820, std.dev.: 0.0304)
  SingleSource/Benchmarks/Misc/fbench: 4.90% (4.7508 => 4.9834, std.dev.: 0.0134)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.83% (3.2201 => 3.3757, std.dev.: 0.0448)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.35% (2.8994 => 3.0255, std.dev.: 0.0183)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.74% (5.9362 => 6.1581, std.dev.: 0.0381)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.87% (5.5010 => 5.6587, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.70% (4.6379 => 4.7631, std.dev.: 0.0003)
  MultiSource/Benchmarks/sim/sim: 2.69% (3.8805 => 3.9849, std.dev.: 0.0131)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.45% (4.3727 => 4.4797, std.dev.: 0.0029)
  SingleSource/Benchmarks/CoyoteBench/almabench: 2.23% (34.3107 => 35.0752, std.dev.: 0.0614)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.97% (5.6582 => 5.7696, std.dev.: 0.0250)
  SingleSource/Benchmarks/Shootout/methcall: 1.58% (8.3425 => 8.4740, std.dev.: 0.0487)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -35.04% (0.1113 => 0.0723, std.dev.: 0.0140)
  MultiSource/Applications/viterbi/viterbi: -24.19% (0.2431 => 0.1843, std.dev.: 0.0187)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -15.07% (0.0803 => 0.0682, std.dev.: 0.0009)
  SingleSource/Benchmarks/Misc/whetstone: -13.86% (0.1097 => 0.0945, std.dev.: 0.0023)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.01% (5.1587 => 4.7457, std.dev.: 0.0366)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.74% (5.4314 => 5.0655, std.dev.: 0.0439)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -5.88% (0.2416 => 0.2274, std.dev.: 0.0054)
  MultiSource/Applications/Burg/burg: -5.39% (1.5375 => 1.4547, std.dev.: 0.0128)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.32% (1.2911 => 0.7318, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -38.31% (4.4050 => 2.7175, std.dev.: 0.0095)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -25.17% (1.6105 => 1.2052, std.dev.: 0.0268)
  MultiSource/Applications/lambda-0_1_3/lambda: -22.76% (9.1099 => 7.0365, std.dev.: 0.0355)
  SingleSource/Benchmarks/Misc/salsa20: -21.68% (10.3398 => 8.0979, std.dev.: 0.4287)
  SingleSource/Benchmarks/Shootout/hash: -21.41% (5.3656 => 4.2167, std.dev.: 0.0339)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -20.98% (4.8986 => 3.8710, std.dev.: 0.1244)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -20.15% (5.7264 => 4.5727, std.dev.: 0.0379)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -19.81% (6.2328 => 4.9978, std.dev.: 0.0430)
  SingleSource/Benchmarks/Shootout-C++/hash: -17.32% (0.7941 => 0.6566, std.dev.: 0.0071)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.18% (25.3677 => 21.2630, std.dev.: 0.4046)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -13.23% (1.6679 => 1.4472, std.dev.: 0.0010)
  MultiSource/Applications/siod/siod: -9.67% (3.7240 => 3.3639, std.dev.: 0.0296)
  MultiSource/Applications/SIBsim4/SIBsim4: -9.56% (3.5327 => 3.1948, std.dev.: 0.0573)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -9.40% (32.4581 => 29.4073, std.dev.: 0.9430)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -9.18% (3.2030 => 2.9091, std.dev.: 0.0753)
  SingleSource/Regression/C/uint64_to_float: -8.74% (1.6851 => 1.5378, std.dev.: 0.0261)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -8.63% (0.3267 => 0.2985, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -8.39% (9.8728 => 9.0441, std.dev.: 0.0140)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -7.20% (4.5717 => 4.2427, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.76% (5.5889 => 5.2113, std.dev.: 0.0071)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.07% (0.4445 => 0.4175, std.dev.: 0.0012)
  MultiSource/Applications/sqlite3/sqlite3: -6.06% (4.6358 => 4.3551, std.dev.: 0.0544)
  SingleSource/Benchmarks/Misc/flops: -5.76% (10.2170 => 9.6288, std.dev.: 0.1026)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.43% (6.3757 => 6.0296, std.dev.: 0.0625)
  SingleSource/Benchmarks/Shootout-C++/hash2: -5.26% (3.5939 => 3.4048, std.dev.: 0.0288)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.82% (5.3184 => 5.0619, std.dev.: 0.0369)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3276 => 5.1020, std.dev.: 0.0082)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -4.12% (1.6535 => 1.5853, std.dev.: 0.0178)
  SingleSource/Benchmarks/Misc/whetstone: -3.57% (3.5970 => 3.4687, std.dev.: 0.0019)
  MultiSource/Applications/spiff/spiff: -3.28% (2.8536 => 2.7601, std.dev.: 0.0071)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.98% (3.6122 => 3.5046, std.dev.: 0.0086)
  SingleSource/Benchmarks/Shootout/sieve: -2.86% (8.0178 => 7.7885, std.dev.: 0.0171)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -2.75% (4.5935 => 4.4673, std.dev.: 0.0189)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.63% (3.8665 => 3.7649, std.dev.: 0.0254)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.28% (1.6980 => 1.6593, std.dev.: 0.0088)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.25% (48.3307 => 47.2425, std.dev.: 0.2571)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.25% (4.5094 => 4.4079, std.dev.: 0.0331)
  MultiSource/Benchmarks/BitBench/five11/five11: -2.11% (5.7342 => 5.6134, std.dev.: 0.0468)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.09% (4.2167 => 4.1286, std.dev.: 0.0024)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.74% (4.9946 => 4.9078, std.dev.: 0.0072)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.38% (2.8573 => 2.8178, std.dev.: 0.0021)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.32% (12.1841 => 12.0234, std.dev.: 0.0198)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.19% (9.6556 => 9.5409, std.dev.: 0.0369)
  MultiSource/Applications/aha/aha: -1.09% (3.6251 => 3.5855, std.dev.: 0.0043)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -8.19% (0.1441 => 0.1323, std.dev.: 0.0202)

Report Time: 0.75s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130709/51c8e7ce/attachment.html>


More information about the llvm-testresults mailing list