[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sat Aug 24 07:29:25 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14742?compare_to=14738&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14742, Order: 189167, Start Time: 2013-08-24 12:40:20, End Time: 2013-08-24 14:31:36
      To: 14738, Order: 189166, Start Time: 2013-08-24 10:17:23, End Time: 2013-08-24 11:58:59
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 36 (47 on baseline)
Performance Improvements: 1 (28 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1070 (1032 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/callargs: 69.70% (0.0165 => 0.0280, std.dev.: 0.0036)
  SingleSource/UnitTests/2003-08-11-VaListArg: 62.90% (0.0283 => 0.0461, std.dev.: 0.0038)
  SingleSource/UnitTests/Vector/simple: 56.90% (0.0239 => 0.0375, std.dev.: 0.0036)
  SingleSource/UnitTests/Vector/divides: 53.00% (0.0200 => 0.0306, std.dev.: 0.0016)
  SingleSource/UnitTests/member-function-pointers: 51.36% (0.0220 => 0.0333, std.dev.: 0.0032)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: 50.73% (0.0205 => 0.0309, std.dev.: 0.0018)
  SingleSource/UnitTests/Vector/constpool: 47.32% (8.4396 => 12.4330, std.dev.: 0.1169)
  SingleSource/Benchmarks/Shootout-C++/hello: 40.93% (0.2035 => 0.2868, std.dev.: 0.0238)
  SingleSource/Regression/C/bigstack: 38.88% (0.0679 => 0.0943, std.dev.: 0.0067)
  SingleSource/Regression/C/test_indvars: 37.33% (0.0300 => 0.0412, std.dev.: 0.0043)
  SingleSource/UnitTests/2006-12-11-LoadConstants: 33.60% (0.1482 => 0.1980, std.dev.: 0.0050)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 25.56% (1.6616 => 2.0863, std.dev.: 0.1293)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 14.52% (6.5333 => 7.4818, std.dev.: 0.0087)
  SingleSource/Benchmarks/Shootout-C++/sieve: 14.18% (0.3174 => 0.3624, std.dev.: 0.0120)
  MultiSource/Benchmarks/mafft/pairlocalalign: 14.00% (10.8984 => 12.4238, std.dev.: 0.2574)
  SingleSource/UnitTests/SignlessTypes/rem: 9.63% (0.1236 => 0.1355, std.dev.: 0.0023)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 9.21% (0.2303 => 0.2515, std.dev.: 0.0074)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: 67.44% (2.9035 => 4.8616, std.dev.: 0.1380)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 19.38% (9.4080 => 11.2311, std.dev.: 0.1482)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 17.13% (29.2671 => 34.2805, std.dev.: 1.0731)
  SingleSource/Benchmarks/Shootout-C++/ary: 16.80% (0.0607 => 0.0709, std.dev.: 0.0031)
  SingleSource/Benchmarks/Shootout-C++/fibo: 16.40% (4.1430 => 4.8225, std.dev.: 0.0031)
  MultiSource/Benchmarks/Olden/em3d/em3d: 9.50% (4.7172 => 5.1652, std.dev.: 0.0199)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 7.81% (0.8343 => 0.8995, std.dev.: 0.0239)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.74% (5.0206 => 5.3086, std.dev.: 0.0238)
  SingleSource/Benchmarks/Misc/ffbench: 5.10% (1.3713 => 1.4413, std.dev.: 0.0226)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 4.07% (6.2309 => 6.4848, std.dev.: 0.0403)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 2.97% (20.8919 => 21.5117, std.dev.: 0.0932)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.48% (1.2596 => 1.2908, std.dev.: 0.0121)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.18% (12.8701 => 13.1510, std.dev.: 0.0943)
  SingleSource/Benchmarks/Misc/lowercase: 2.03% (0.7674 => 0.7830, std.dev.: 0.0011)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.78% (1.0478 => 1.0665, std.dev.: 0.0041)
  SingleSource/Benchmarks/Shootout-C++/sieve: 1.56% (3.4599 => 3.5140, std.dev.: 0.0169)
  SingleSource/Benchmarks/Shootout/lists: 1.28% (7.1284 => 7.2195, std.dev.: 0.0213)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.05% (1.4805 => 1.4961, std.dev.: 0.0009)
  SingleSource/Benchmarks/Misc/flops-6: 1.04% (2.4239 => 2.4490, std.dev.: 0.0051)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/mafft/pairlocalalign: -4.31% (46.3592 => 44.3626, std.dev.: 0.3932)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.79% (0.1339 => 0.1315, std.dev.: 0.0063)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2008-04-20-LoopBug2: 168.06% (0.0072 => 0.0193, std.dev.: 0.0040)
  SingleSource/Regression/C/bigstack: 102.36% (0.0466 => 0.0943, std.dev.: 0.0067)
  SingleSource/UnitTests/Vector/simple: 70.45% (0.0220 => 0.0375, std.dev.: 0.0036)
  SingleSource/UnitTests/member-function-pointers: 57.08% (0.0212 => 0.0333, std.dev.: 0.0032)
  SingleSource/UnitTests/Vector/divides: 54.55% (0.0198 => 0.0306, std.dev.: 0.0016)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: 52.97% (0.0202 => 0.0309, std.dev.: 0.0018)
  SingleSource/UnitTests/2003-08-11-VaListArg: 51.15% (0.0305 => 0.0461, std.dev.: 0.0038)
  SingleSource/UnitTests/Vector/constpool: 40.28% (8.8630 => 12.4330, std.dev.: 0.1169)
  SingleSource/Benchmarks/Shootout-C++/hello: 40.18% (0.2046 => 0.2868, std.dev.: 0.0238)
  SingleSource/Regression/C/test_indvars: 36.88% (0.0301 => 0.0412, std.dev.: 0.0043)
  SingleSource/UnitTests/2006-12-11-LoadConstants: 31.74% (0.1503 => 0.1980, std.dev.: 0.0050)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 25.36% (1.6643 => 2.0863, std.dev.: 0.1293)
  MultiSource/Benchmarks/FreeBench/distray/distray: 21.97% (0.1033 => 0.1260, std.dev.: 0.0079)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 15.14% (6.4979 => 7.4818, std.dev.: 0.0087)
  SingleSource/Benchmarks/Shootout-C++/sieve: 15.12% (0.3148 => 0.3624, std.dev.: 0.0120)
  MultiSource/Benchmarks/mafft/pairlocalalign: 14.46% (10.8541 => 12.4238, std.dev.: 0.2574)
  SingleSource/UnitTests/SignlessTypes/rem: 10.70% (0.1224 => 0.1355, std.dev.: 0.0023)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 10.26% (0.2281 => 0.2515, std.dev.: 0.0074)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.16% (0.6785 => 0.7067, std.dev.: 0.0013)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 73.93% (3.7285 => 6.4848, std.dev.: 0.0403)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 67.45% (2.9033 => 4.8616, std.dev.: 0.1380)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.89% (2.8867 => 4.2979, std.dev.: 0.3440)
  MultiSource/Benchmarks/FreeBench/neural/neural: 37.87% (0.3171 => 0.4372, std.dev.: 0.0352)
  SingleSource/Benchmarks/Shootout/hash: 24.36% (4.1846 => 5.2040, std.dev.: 0.3512)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 22.94% (9.1355 => 11.2311, std.dev.: 0.1482)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 20.53% (0.0526 => 0.0634, std.dev.: 0.0013)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 14.98% (29.8131 => 34.2805, std.dev.: 1.0731)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.76% (7.0762 => 7.8375, std.dev.: 0.0329)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.36% (1.2557 => 1.3607, std.dev.: 0.0365)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.35% (5.4910 => 5.9493, std.dev.: 0.1189)
  MultiSource/Applications/JM/lencod/lencod: 7.06% (7.1799 => 7.6866, std.dev.: 0.1917)
  MultiSource/Benchmarks/FreeBench/mason/mason: 6.22% (0.2799 => 0.2973, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.21% (3.4085 => 3.6202, std.dev.: 0.0230)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.04% (5.3042 => 5.6248, std.dev.: 0.0231)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.57% (5.5008 => 5.8074, std.dev.: 0.0249)
  SingleSource/Benchmarks/Misc/ffbench: 5.37% (1.3679 => 1.4413, std.dev.: 0.0226)
  SingleSource/Benchmarks/Misc/whetstone: 4.76% (3.4559 => 3.6203, std.dev.: 0.0243)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.38% (5.1471 => 5.3723, std.dev.: 0.0153)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.12% (4.3151 => 4.4930, std.dev.: 0.0163)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.71% (6.1245 => 6.3518, std.dev.: 0.0345)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.70% (3.3384 => 3.4619, std.dev.: 0.0450)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.58% (25.0200 => 25.9160, std.dev.: 0.0098)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.06% (4.8739 => 5.0230, std.dev.: 0.0288)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.76% (1.3104 => 1.3466, std.dev.: 0.0115)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.24% (12.8625 => 13.1510, std.dev.: 0.0943)
  SingleSource/Benchmarks/Shootout-C++/sieve: 1.66% (3.4566 => 3.5140, std.dev.: 0.0169)
  SingleSource/Benchmarks/Misc/flops-6: 1.01% (2.4246 => 2.4490, std.dev.: 0.0051)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -33.39% (0.2237 => 0.1490, std.dev.: 0.0236)
  MultiSource/Benchmarks/MallocBench/gs/gs: -21.69% (6.0938 => 4.7722, std.dev.: 0.2412)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -38.97% (1.4194 => 0.8662, std.dev.: 0.1979)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.06% (2.1022 => 1.4282, std.dev.: 0.0051)
  MultiSource/Benchmarks/MallocBench/gs/gs: -29.35% (0.1189 => 0.0840, std.dev.: 0.0058)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -28.68% (0.0816 => 0.0582, std.dev.: 0.0012)
  MultiSource/Applications/viterbi/viterbi: -27.16% (3.4923 => 2.5437, std.dev.: 0.0331)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.65% (6.9552 => 5.2406, std.dev.: 0.0340)
  SingleSource/Benchmarks/Misc/perlin: -21.33% (4.5989 => 3.6179, std.dev.: 0.0171)
  SingleSource/Benchmarks/Misc/mandel: -13.85% (1.1996 => 1.0334, std.dev.: 0.0130)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -12.44% (0.0884 => 0.0774, std.dev.: 0.0015)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.51% (0.5173 => 0.4681, std.dev.: 0.0038)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.99% (3.5791 => 3.2932, std.dev.: 0.0776)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.06% (47.2250 => 44.3626, std.dev.: 0.3932)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.02% (1.7207 => 1.6343, std.dev.: 0.0166)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.70% (3.8119 => 3.6326, std.dev.: 0.0482)
  SingleSource/Benchmarks/Misc/fbench: -4.41% (4.9602 => 4.7413, std.dev.: 0.0069)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.35% (0.7355 => 0.7035, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.43% (6.0444 => 5.8370, std.dev.: 0.0755)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.26% (1.1024 => 1.0665, std.dev.: 0.0041)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -3.03% (0.4783 => 0.4638, std.dev.: 0.0030)
  SingleSource/Benchmarks/Stanford/FloatMM: -2.88% (0.7806 => 0.7581, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.78% (6.1482 => 5.9771, std.dev.: 0.0293)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.28% (5.2218 => 5.1025, std.dev.: 0.0298)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.95% (34.8438 => 34.1649, std.dev.: 0.1189)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.94% (8.6172 => 8.4497, std.dev.: 0.0531)
  SingleSource/Benchmarks/Misc/oourafft: -1.81% (3.7891 => 3.7206, std.dev.: 0.0198)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.73% (5.0180 => 4.9311, std.dev.: 0.0330)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.57% (0.1378 => 0.1315, std.dev.: 0.0063)

Report Time: 0.71s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130824/b1d6cf61/attachment.html>


More information about the llvm-testresults mailing list