[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Oct 25 18:19:08 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16684?compare_to=16681&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16684, Order: 193443, Start Time: 2013-10-25 23:35:25, End Time: 2013-10-26 01:22:30
      To: 16681, Order: 193433, Start Time: 2013-10-25 21:15:39, End Time: 2013-10-25 23:11:22
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 14 (31 on baseline)
Performance Improvements: 27 (24 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1066 (1052 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.05% (1.1043 => 1.1159, std.dev.: 0.0007)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 34.99% (0.0423 => 0.0571, std.dev.: 0.0000)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 34.75% (1.5654 => 2.1093, std.dev.: 0.1271)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 23.24% (0.1601 => 0.1973, std.dev.: 0.0013)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: 15.17% (0.0890 => 0.1025, std.dev.: 0.0005)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.95% (2.8564 => 3.0550, std.dev.: 0.0191)
  MultiSource/Applications/aha/aha: 4.52% (3.6181 => 3.7818, std.dev.: 0.0046)
  MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (43.2998 => 44.7316, std.dev.: 0.4290)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.03% (0.6409 => 0.6603, std.dev.: 0.0025)
  MultiSource/Applications/spiff/spiff: 2.54% (2.9298 => 3.0043, std.dev.: 0.0041)
  SingleSource/Benchmarks/Misc/fp-convert: 2.43% (7.4605 => 7.6417, std.dev.: 0.0575)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.38% (4.5171 => 4.6246, std.dev.: 0.0012)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.38% (2.4742 => 2.5330, std.dev.: 0.0052)
  SingleSource/Benchmarks/Misc/richards_benchmark: 1.18% (1.4122 => 1.4288, std.dev.: 0.0057)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -33.52% (0.1775 => 0.1180, std.dev.: 0.0061)
  SingleSource/Benchmarks/Shootout/objinst: -28.62% (0.0566 => 0.0404, std.dev.: 0.0032)
  SingleSource/Benchmarks/Misc/fbench: -28.31% (0.1042 => 0.0747, std.dev.: 0.0012)
  SingleSource/Benchmarks/Shootout/ary3: -26.54% (0.0456 => 0.0335, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -25.68% (0.2527 => 0.1878, std.dev.: 0.0014)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -23.39% (0.2202 => 0.1687, std.dev.: 0.0037)
  SingleSource/Benchmarks/Shootout-C++/methcall: -22.61% (0.2640 => 0.2043, std.dev.: 0.0207)
  SingleSource/Benchmarks/Shootout-C++/fibo: -21.37% (0.2396 => 0.1884, std.dev.: 0.0097)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -18.29% (1.6492 => 1.3476, std.dev.: 0.0872)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -18.14% (0.3930 => 0.3217, std.dev.: 0.0036)
  SingleSource/Benchmarks/Shootout-C++/hash2: -16.15% (0.5153 => 0.4321, std.dev.: 0.0279)
  SingleSource/Benchmarks/Shootout-C++/lists: -14.19% (0.3010 => 0.2583, std.dev.: 0.0158)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -14.13% (1.6009 => 1.3747, std.dev.: 0.0121)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -13.60% (1.4740 => 1.2736, std.dev.: 0.0747)
  SingleSource/Benchmarks/Shootout-C++/sieve: -13.21% (0.3331 => 0.2891, std.dev.: 0.0159)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -13.16% (0.2401 => 0.2085, std.dev.: 0.0108)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.27% (0.7012 => 0.6362, std.dev.: 0.0154)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -7.70% (0.2298 => 0.2121, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -7.01% (2.0649 => 1.9201, std.dev.: 0.0191)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.98% (0.2390 => 0.2247, std.dev.: 0.0014)
  MultiSource/Applications/treecc/treecc: -3.47% (2.3866 => 2.3037, std.dev.: 0.0296)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary: -35.75% (0.0593 => 0.0381, std.dev.: 0.0062)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -20.29% (35.7352 => 28.4838, std.dev.: 0.4904)
  SingleSource/Benchmarks/Shootout/heapsort: -13.48% (3.4223 => 2.9610, std.dev.: 0.1522)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -7.30% (0.3550 => 0.3291, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -2.29% (5.2314 => 5.1117, std.dev.: 0.0321)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.39% (5.0742 => 5.0036, std.dev.: 0.0091)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.22% (0.1370 => 0.1373, std.dev.: 0.0412)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/oourafft: 7.54% (0.2294 => 0.2467, std.dev.: 0.0052)
  MultiSource/Applications/JM/ldecod/ldecod: 4.80% (7.4026 => 7.7581, std.dev.: 0.0799)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 4.05% (0.3707 => 0.3857, std.dev.: 0.0048)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.91% (0.3096 => 0.3217, std.dev.: 0.0036)
  MultiSource/Benchmarks/Prolangs-C/football/football: 3.46% (0.9828 => 1.0168, std.dev.: 0.0061)
  MultiSource/Applications/SPASS/SPASS: 2.94% (16.1646 => 16.6400, std.dev.: 0.1713)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.88% (7.2661 => 7.4756, std.dev.: 0.0517)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.86% (1.3365 => 1.3747, std.dev.: 0.0121)
  MultiSource/Applications/lua/lua: 2.72% (4.2242 => 4.3392, std.dev.: 0.0243)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.89% (1.0952 => 1.1159, std.dev.: 0.0007)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 60.48% (7.6426 => 12.2646, std.dev.: 0.0621)
  SingleSource/Benchmarks/Shootout-C++/matrix: 45.93% (2.8554 => 4.1668, std.dev.: 0.0569)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.39% (2.4753 => 2.7078, std.dev.: 0.0138)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 9.12% (23.4704 => 25.6101, std.dev.: 0.0666)
  SingleSource/Benchmarks/Shootout-C++/fibo: 8.82% (4.9428 => 5.3789, std.dev.: 0.0181)
  MultiSource/Benchmarks/sim/sim: 6.69% (3.8312 => 4.0876, std.dev.: 0.0366)
  SingleSource/UnitTests/Vector/multiplies: 6.60% (0.5561 => 0.5928, std.dev.: 0.0001)
  MultiSource/Applications/spiff/spiff: 6.56% (2.8194 => 3.0043, std.dev.: 0.0041)
  MultiSource/Applications/aha/aha: 5.84% (3.5731 => 3.7818, std.dev.: 0.0046)
  MultiSource/Benchmarks/BitBench/five11/five11: 5.61% (5.3716 => 5.6732, std.dev.: 0.0287)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 5.45% (0.1871 => 0.1973, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.33% (3.5550 => 3.7446, std.dev.: 0.0553)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.14% (3.1730 => 3.3360, std.dev.: 0.0408)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.47% (4.4696 => 4.6246, std.dev.: 0.0012)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.28% (89.7126 => 92.6507, std.dev.: 0.3722)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.84% (0.3836 => 0.3945, std.dev.: 0.0027)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.18% (1.7652 => 1.8036, std.dev.: 0.0116)
  SingleSource/Benchmarks/Misc/richards_benchmark: 1.97% (1.4012 => 1.4288, std.dev.: 0.0057)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.87% (1.5940 => 1.6238, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.22% (3.1569 => 3.1955, std.dev.: 0.0128)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.08% (16.7972 => 16.9793, std.dev.: 0.0522)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -20.43% (0.1483 => 0.1180, std.dev.: 0.0061)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -53.94% (0.5226 => 0.2407, std.dev.: 0.0562)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -44.00% (0.0400 => 0.0224, std.dev.: 0.0012)
  MultiSource/Applications/sgefa/sgefa: -42.23% (1.5790 => 0.9122, std.dev.: 0.0024)
  SingleSource/Benchmarks/Linpack/linpack-pc: -26.86% (57.2347 => 41.8601, std.dev.: 2.5544)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.62% (15.9508 => 12.8213, std.dev.: 0.3654)
  SingleSource/Benchmarks/Shootout/heapsort: -17.52% (3.5900 => 2.9610, std.dev.: 0.1522)
  SingleSource/Benchmarks/Shootout-C++/moments: -14.94% (0.1285 => 0.1093, std.dev.: 0.0068)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.11% (20.8247 => 18.5119, std.dev.: 0.1211)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.82% (3.4956 => 3.1173, std.dev.: 0.0293)
  MultiSource/Benchmarks/mafft/pairlocalalign: -10.59% (50.0284 => 44.7316, std.dev.: 0.4290)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.40% (1.0695 => 0.9797, std.dev.: 0.0093)
  SingleSource/Benchmarks/Shootout-C++/ary3: -6.76% (5.0002 => 4.6621, std.dev.: 0.0755)
  MultiSource/Applications/lambda-0_1_3/lambda: -6.50% (8.1346 => 7.6057, std.dev.: 0.0763)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.00% (0.3501 => 0.3291, std.dev.: 0.0019)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.63% (30.1838 => 28.4838, std.dev.: 0.4904)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.07% (3.7874 => 3.6710, std.dev.: 0.0093)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.07% (36.8417 => 35.7107, std.dev.: 0.2786)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.68% (1.4898 => 1.4499, std.dev.: 0.0069)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.34% (2.5938 => 2.5330, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.21% (17.1431 => 16.7645, std.dev.: 0.0182)
  SingleSource/Benchmarks/Misc/oourafft: -1.82% (3.7484 => 3.6802, std.dev.: 0.0224)
  SingleSource/Benchmarks/Misc/whetstone: -1.76% (3.6303 => 3.5665, std.dev.: 0.0224)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.71% (4.3592 => 4.2846, std.dev.: 0.0094)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.85% (0.1348 => 0.1373, std.dev.: 0.0412)

Report Time: 0.73s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131025/518372b6/attachment.html>


More information about the llvm-testresults mailing list