[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Nov 4 22:47:28 PST 2013


http://llvm.org/perf/db_default/v4/nts/17006?compare_to=17003&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 17006, Order: 194043, Start Time: 2013-11-05 05:04:37, End Time: 2013-11-05 06:51:01
      To: 17003, Order: 194042, Start Time: 2013-11-05 02:57:40, End Time: 2013-11-05 04:43:25
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 22 (57 on baseline)
Performance Improvements: 1 (25 on baseline)
Added Tests: 0 (2 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1086 (1025 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.75% (1.2208 => 1.2422, std.dev.: 0.0067)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.65% (0.6419 => 0.6525, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.22% (1.1957 => 1.2103, std.dev.: 0.0030)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/matrix: 20.22% (1.7567 => 2.1119, std.dev.: 0.0010)
  SingleSource/Benchmarks/Shootout/sieve: 18.77% (6.8438 => 8.1286, std.dev.: 0.0029)
  MultiSource/Benchmarks/nbench/nbench: 14.09% (21.4871 => 24.5141, std.dev.: 0.6225)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.29% (6.3956 => 6.9895, std.dev.: 0.1253)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.01% (6.6581 => 7.1915, std.dev.: 0.1400)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.14% (6.9668 => 7.4639, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.58% (3.3509 => 3.5379, std.dev.: 0.0053)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.18% (0.4235 => 0.4412, std.dev.: 0.0052)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.04% (0.6467 => 0.6728, std.dev.: 0.0010)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 3.37% (17.9381 => 18.5432, std.dev.: 0.1487)
  SingleSource/Benchmarks/Shootout-C++/methcall: 2.58% (11.1842 => 11.4722, std.dev.: 0.0425)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.38% (5.2828 => 5.4085, std.dev.: 0.0136)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.04% (11.8665 => 12.1085, std.dev.: 0.0136)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 2.00% (2.3768 => 2.4243, std.dev.: 0.0087)
  MultiSource/Applications/SIBsim4/SIBsim4: 1.79% (3.2390 => 3.2971, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.66% (3.7899 => 3.8527, std.dev.: 0.0183)
  SingleSource/Benchmarks/Shootout/fib2: 1.61% (3.5942 => 3.6521, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.36% (5.8961 => 5.9761, std.dev.: 0.0180)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.17% (1.3657 => 1.3817, std.dev.: 0.0021)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/lists: -2.84% (16.1804 => 15.7201, std.dev.: 0.1716)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.22% (0.1383 => 0.1380, std.dev.: 0.0309)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 13.69% (6.0284 => 6.8535, std.dev.: 0.0830)
  SingleSource/Benchmarks/Misc/oourafft: 11.20% (0.2294 => 0.2551, std.dev.: 0.0002)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.10% (0.8802 => 0.9427, std.dev.: 0.0112)
  SingleSource/Benchmarks/Misc-C++/bigfib: 6.83% (0.6439 => 0.6879, std.dev.: 0.0120)
  SingleSource/Benchmarks/Shootout-C++/hash: 6.57% (0.3971 => 0.4232, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.55% (0.3345 => 0.3564, std.dev.: 0.0017)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.47% (4.0397 => 4.3010, std.dev.: 0.0862)
  SingleSource/Benchmarks/Shootout-C++/lists1: 5.90% (0.3087 => 0.3269, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout-C++/ary: 5.46% (0.2474 => 0.2609, std.dev.: 0.0028)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 5.46% (0.3263 => 0.3441, std.dev.: 0.0047)
  SingleSource/Benchmarks/Shootout-C++/ary3: 5.19% (0.2542 => 0.2674, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/sieve: 5.18% (0.2840 => 0.2987, std.dev.: 0.0016)
  SingleSource/Benchmarks/Shootout-C++/ary2: 5.03% (0.2565 => 0.2694, std.dev.: 0.0024)
  MultiSource/Applications/lambda-0_1_3/lambda: 4.33% (0.8014 => 0.8361, std.dev.: 0.0040)
  SingleSource/Benchmarks/Shootout-C++/hash2: 4.21% (0.4369 => 0.4553, std.dev.: 0.0033)
  MultiSource/Benchmarks/McCat/09-vor/vor: 3.82% (0.3480 => 0.3613, std.dev.: 0.0008)
  MultiSource/Applications/minisat/minisat: 3.74% (0.7439 => 0.7717, std.dev.: 0.0080)
  MultiSource/Applications/hbd/hbd: 3.68% (1.5696 => 1.6273, std.dev.: 0.0114)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.62% (0.6297 => 0.6525, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.55% (1.3365 => 1.3840, std.dev.: 0.0076)
  MultiSource/Applications/JM/lencod/lencod: 3.52% (16.5902 => 17.1747, std.dev.: 0.1085)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.33% (1.2553 => 1.2846, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.97% (1.3036 => 1.3293, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.81% (1.2201 => 1.2422, std.dev.: 0.0067)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.79% (1.2981 => 1.3214, std.dev.: 0.0023)
  MultiSource/Applications/hexxagon/hexxagon: 1.74% (1.0276 => 1.0455, std.dev.: 0.0022)
  MultiSource/Benchmarks/MallocBench/gs/gs: 1.61% (4.5883 => 4.6621, std.dev.: 0.0143)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.51% (1.2086 => 1.2269, std.dev.: 0.0023)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 66.99% (4.4696 => 7.4639, std.dev.: 0.0003)
  SingleSource/Benchmarks/Shootout-C++/methcall: 50.11% (7.6426 => 11.4722, std.dev.: 0.0425)
  SingleSource/Benchmarks/Shootout-C++/matrix: 45.64% (2.8554 => 4.1586, std.dev.: 0.0550)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 40.92% (4.2391 => 5.9736, std.dev.: 0.1052)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 31.91% (1.1431 => 1.5079, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout/matrix: 18.59% (1.7809 => 2.1119, std.dev.: 0.0010)
  SingleSource/Benchmarks/Shootout/sieve: 12.50% (7.2254 => 8.1286, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.63% (6.4425 => 7.1915, std.dev.: 0.1400)
  MultiSource/Benchmarks/nbench/nbench: 10.79% (22.1263 => 24.5141, std.dev.: 0.6225)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.64% (0.1331 => 0.1446, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.37% (3.5550 => 3.8527, std.dev.: 0.0183)
  SingleSource/UnitTests/Vector/multiplies: 6.60% (0.5561 => 0.5928, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 5.92% (6.5990 => 6.9895, std.dev.: 0.1253)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.75% (3.1730 => 3.3555, std.dev.: 0.0152)
  MultiSource/Benchmarks/BitBench/five11/five11: 5.30% (5.3716 => 5.6564, std.dev.: 0.0210)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 5.06% (2.5368 => 2.6651, std.dev.: 0.0352)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 4.18% (1.1013 => 1.1473, std.dev.: 0.0054)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.68% (0.3836 => 0.3977, std.dev.: 0.0022)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.62% (0.4258 => 0.4412, std.dev.: 0.0052)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.12% (89.7126 => 92.5075, std.dev.: 0.4301)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.62% (6.1088 => 6.2690, std.dev.: 0.0376)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.51% (0.6563 => 0.6728, std.dev.: 0.0010)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.42% (0.4549 => 0.4659, std.dev.: 0.0002)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 2.10% (1.0477 => 1.0697, std.dev.: 0.0022)
  SingleSource/Regression/C/uint64_to_float: 1.88% (1.4528 => 1.4801, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.81% (3.1569 => 3.2140, std.dev.: 0.0094)
  SingleSource/Benchmarks/Shootout/fib2: 1.54% (3.5966 => 3.6521, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.51% (11.9288 => 12.1085, std.dev.: 0.0136)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.32% (6.6028 => 6.6899, std.dev.: 0.0086)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -21.31% (0.1483 => 0.1167, std.dev.: 0.0064)
  MultiSource/Benchmarks/FreeBench/distray/distray: -13.32% (0.1194 => 0.1035, std.dev.: 0.0032)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Linpack/linpack-pc: -76.50% (57.2347 => 13.4511, std.dev.: 0.0662)
  MultiSource/Benchmarks/FreeBench/neural/neural: -55.03% (0.5226 => 0.2350, std.dev.: 0.0263)
  MultiSource/Applications/sgefa/sgefa: -42.16% (1.5790 => 0.9133, std.dev.: 0.0010)
  SingleSource/Benchmarks/Shootout/heapsort: -19.73% (3.5900 => 2.8816, std.dev.: 0.2117)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.00% (15.9508 => 12.9207, std.dev.: 0.4323)
  SingleSource/Benchmarks/Shootout-C++/ary3: -15.78% (5.0002 => 4.2111, std.dev.: 0.0894)
  SingleSource/Benchmarks/Shootout-C++/moments: -15.33% (0.1285 => 0.1088, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -11.95% (4.0181 => 3.5379, std.dev.: 0.0053)
  MultiSource/Applications/SIBsim4/SIBsim4: -11.93% (3.7437 => 3.2971, std.dev.: 0.0027)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.96% (20.8247 => 18.5432, std.dev.: 0.1487)
  MultiSource/Benchmarks/FreeBench/mason/mason: -9.47% (0.3304 => 0.2991, std.dev.: 0.0026)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -8.82% (3.4956 => 3.1872, std.dev.: 0.0012)
  MultiSource/Applications/lua/lua: -7.64% (29.5202 => 27.2647, std.dev.: 0.7391)
  MultiSource/Applications/lambda-0_1_3/lambda: -4.63% (8.1346 => 7.7578, std.dev.: 0.0600)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.47% (0.7474 => 0.7140, std.dev.: 0.0099)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.72% (3.9552 => 3.8081, std.dev.: 0.0016)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.45% (3.7874 => 3.6567, std.dev.: 0.0172)
  SingleSource/Benchmarks/Shootout-C++/lists: -3.06% (16.2163 => 15.7201, std.dev.: 0.1716)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.88% (4.3592 => 4.2335, std.dev.: 0.0343)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.74% (1.1075 => 1.0772, std.dev.: 0.0040)
  MultiSource/Benchmarks/Olden/power/power: -2.70% (1.2170 => 1.1842, std.dev.: 0.0002)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.31% (2.5938 => 2.5340, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.27% (17.1431 => 16.7533, std.dev.: 0.0176)

Added Tests - Compile Time
--------------------------
  SingleSource/Regression/C/PR10189

Added Tests - Execution Time
----------------------------
  SingleSource/Regression/C/PR10189

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.37% (0.1348 => 0.1380, std.dev.: 0.0309)

Report Time: 1.07s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131105/014b2009/attachment.html>


More information about the llvm-testresults mailing list