[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Fri Aug 9 04:37:40 PDT 2013
http://llvm.org/perf/db_default/v4/nts/14249?compare_to=14245&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15
Comparing:
Run: 14249, Order: 188061, Start Time: 2013-08-09 09:45:26, End Time: 2013-08-09 11:39:34
To: 14245, Order: 188056, Start Time: 2013-08-09 07:28:18, End Time: 2013-08-09 09:19:18
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57
===============
Tests Summary
===============
New Failures: 0 (2 on baseline)
Performance Regressions: 39 (66 on baseline)
Performance Improvements: 8 (29 on baseline)
Existing Failures: 3 (1 on baseline)
Unchanged Tests: 1058 (1010 on baseline)
Total Tests: 1108
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 48.35% (0.5876 => 0.8717, std.dev.: 0.0332)
MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 48.25% (0.9186 => 1.3618, std.dev.: 0.0699)
MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 44.59% (0.0601 => 0.0869, std.dev.: 0.0072)
MultiSource/Benchmarks/SciMark2-C/scimark2: 42.69% (0.3933 => 0.5612, std.dev.: 0.0544)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 40.29% (0.6938 => 0.9733, std.dev.: 0.0775)
MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 35.77% (0.7552 => 1.0253, std.dev.: 0.0789)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 34.45% (1.1828 => 1.5903, std.dev.: 0.0721)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 31.62% (0.2755 => 0.3626, std.dev.: 0.0201)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 25.64% (10.5949 => 13.3111, std.dev.: 0.3391)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 18.16% (1.5867 => 1.8748, std.dev.: 0.0678)
SingleSource/Benchmarks/Misc-C++-EH/spirit: 14.05% (6.5281 => 7.4454, std.dev.: 0.0331)
MultiSource/Applications/SIBsim4/SIBsim4: 13.98% (1.6232 => 1.8501, std.dev.: 0.0413)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 13.64% (26.4792 => 30.0903, std.dev.: 0.0754)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.98% (0.6485 => 0.7132, std.dev.: 0.0051)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.77% (0.8027 => 0.8811, std.dev.: 0.0022)
SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.77% (0.5368 => 0.5839, std.dev.: 0.0028)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.95% (2.7300 => 2.9469, std.dev.: 0.0571)
SingleSource/Benchmarks/Misc-C++/Large/ray: 7.49% (0.3670 => 0.3945, std.dev.: 0.0058)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Shootout/ary3: 81.22% (5.7912 => 10.4950, std.dev.: 0.3123)
SingleSource/Benchmarks/Misc/pi: 48.42% (1.7040 => 2.5291, std.dev.: 0.0062)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 47.62% (4.5088 => 6.6559, std.dev.: 0.1527)
SingleSource/Benchmarks/Shootout/heapsort: 26.70% (3.3652 => 4.2636, std.dev.: 0.3279)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.95% (60.5242 => 71.9907, std.dev.: 0.8239)
SingleSource/Benchmarks/Shootout-C++/ary3: 12.61% (2.0389 => 2.2960, std.dev.: 0.0612)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.47% (2.9005 => 3.2622, std.dev.: 0.0061)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 11.93% (40.7090 => 45.5671, std.dev.: 1.1286)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 10.70% (1.0822 => 1.1980, std.dev.: 0.0184)
SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 9.09% (29.2178 => 31.8749, std.dev.: 0.6549)
MultiSource/Benchmarks/Bullet/bullet: 7.47% (7.0508 => 7.5777, std.dev.: 0.0981)
MultiSource/Benchmarks/PAQ8p/paq8p: 7.47% (91.4099 => 98.2339, std.dev.: 0.7806)
SingleSource/Benchmarks/Misc/himenobmtxpa: 6.62% (4.0424 => 4.3101, std.dev.: 0.0869)
SingleSource/Benchmarks/Misc/flops-7: 6.09% (1.7145 => 1.8189, std.dev.: 0.0373)
SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.90% (1.2925 => 1.3558, std.dev.: 0.0023)
MultiSource/Applications/SIBsim4/SIBsim4: 4.82% (3.2895 => 3.4482, std.dev.: 0.0157)
SingleSource/Benchmarks/Shootout-C++/ackermann: 4.71% (3.2452 => 3.3982, std.dev.: 0.0185)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 4.15% (1.4277 => 1.4869, std.dev.: 0.0113)
SingleSource/Benchmarks/Linpack/linpack-pc: 4.09% (50.1985 => 52.2500, std.dev.: 0.0333)
SingleSource/Regression/C/uint64_to_float: 2.78% (1.4449 => 1.4850, std.dev.: 0.0102)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.87% (1.8648 => 1.8997, std.dev.: 0.0062)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -28.68% (0.3856 => 0.2750, std.dev.: 0.0236)
MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -24.12% (0.3980 => 0.3020, std.dev.: 0.0118)
MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -3.41% (1.4195 => 1.3711, std.dev.: 0.0179)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/Shootout/matrix: -14.97% (2.1072 => 1.7918, std.dev.: 0.0056)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.66% (0.3028 => 0.2796, std.dev.: 0.0028)
MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -3.93% (2.1951 => 2.1088, std.dev.: 0.0087)
MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -2.01% (3.4852 => 3.4150, std.dev.: 0.0092)
MultiSource/Applications/sgefa/sgefa: -1.24% (1.3823 => 1.3651, std.dev.: 0.0019)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
MultiSource/Benchmarks/mediabench/gsm/toast/toast
MultiSource/Applications/ClamAV/clamscan: 1.24% (0.1367 => 0.1384, std.dev.: 0.0219)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.28% (0.2953 => 0.2738, std.dev.: 0.0286)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0279 => 0.0279, std.dev.: 0.0014)
================================
Run-Over-Baseline Changes Detail
================================
New Failures - Execution Time
-----------------------------
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
MultiSource/Benchmarks/mediabench/gsm/toast/toast
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.67% (0.2813 => 0.2738, std.dev.: 0.0286)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.13% (0.0345 => 0.0279, std.dev.: 0.0014)
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 52.19% (0.0571 => 0.0869, std.dev.: 0.0072)
MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 51.06% (0.9015 => 1.3618, std.dev.: 0.0699)
MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 49.14% (0.5845 => 0.8717, std.dev.: 0.0332)
MultiSource/Benchmarks/SciMark2-C/scimark2: 44.90% (0.3873 => 0.5612, std.dev.: 0.0544)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 43.45% (0.6785 => 0.9733, std.dev.: 0.0775)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 40.90% (1.1287 => 1.5903, std.dev.: 0.0721)
MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 36.29% (0.7523 => 1.0253, std.dev.: 0.0789)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 33.26% (0.2721 => 0.3626, std.dev.: 0.0201)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 29.20% (10.3031 => 13.3111, std.dev.: 0.3391)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.61% (1.5544 => 1.8748, std.dev.: 0.0678)
SingleSource/Benchmarks/Misc-C++-EH/spirit: 14.58% (6.4979 => 7.4454, std.dev.: 0.0331)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.05% (6.1631 => 7.0291, std.dev.: 0.3240)
SingleSource/Benchmarks/Shootout-C++/moments: 12.51% (0.4125 => 0.4641, std.dev.: 0.0192)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 11.67% (2.6390 => 2.9469, std.dev.: 0.0571)
SingleSource/Benchmarks/Misc-C++/Large/ray: 11.25% (0.3546 => 0.3945, std.dev.: 0.0058)
SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.34% (0.5292 => 0.5839, std.dev.: 0.0028)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.06% (0.6480 => 0.7132, std.dev.: 0.0051)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.94% (0.8088 => 0.8811, std.dev.: 0.0022)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.86% (27.6418 => 30.0903, std.dev.: 0.0754)
MultiSource/Benchmarks/MallocBench/gs/gs: 8.12% (6.0938 => 6.5886, std.dev.: 0.1413)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Shootout/ary3: 80.46% (5.8158 => 10.4950, std.dev.: 0.3123)
MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 67.49% (3.7285 => 6.2450, std.dev.: 0.1156)
SingleSource/Benchmarks/Shootout-C++/matrix: 48.98% (2.8867 => 4.3005, std.dev.: 0.0184)
SingleSource/Benchmarks/Shootout/heapsort: 46.40% (2.9123 => 4.2636, std.dev.: 0.3279)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 46.23% (4.5517 => 6.6559, std.dev.: 0.1527)
MultiSource/Benchmarks/FreeBench/neural/neural: 41.22% (0.3171 => 0.4478, std.dev.: 0.0325)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 40.18% (0.0341 => 0.0478, std.dev.: 0.0012)
SingleSource/Benchmarks/Shootout/hash: 29.91% (4.1846 => 5.4361, std.dev.: 0.3320)
SingleSource/Benchmarks/Misc/pi: 27.51% (1.9835 => 2.5291, std.dev.: 0.0062)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.39% (1.5030 => 1.8997, std.dev.: 0.0062)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.02% (2.6094 => 3.2622, std.dev.: 0.0061)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 19.29% (60.3477 => 71.9907, std.dev.: 0.8239)
SingleSource/Benchmarks/Shootout-C++/hash: 18.40% (0.6295 => 0.7453, std.dev.: 0.0291)
SingleSource/Benchmarks/Shootout-C++/ackermann: 15.48% (2.9428 => 3.3982, std.dev.: 0.0185)
SingleSource/Benchmarks/Shootout-C++/ary3: 13.50% (2.0229 => 2.2960, std.dev.: 0.0612)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 12.50% (40.5028 => 45.5671, std.dev.: 1.1286)
MultiSource/Applications/JM/lencod/lencod: 11.58% (7.1799 => 8.0112, std.dev.: 0.0710)
MultiSource/Applications/lambda-0_1_3/lambda: 10.82% (7.0762 => 7.8417, std.dev.: 0.0039)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.27% (1.0964 => 1.1980, std.dev.: 0.0184)
SingleSource/Benchmarks/Linpack/linpack-pc: 8.12% (48.3256 => 52.2500, std.dev.: 0.0333)
MultiSource/Benchmarks/Ptrdist/ks/ks: 7.92% (1.2557 => 1.3551, std.dev.: 0.0208)
MultiSource/Benchmarks/Olden/tsp/tsp: 7.82% (1.5339 => 1.6539, std.dev.: 0.0426)
MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.28% (3.2027 => 3.4357, std.dev.: 0.0037)
SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 6.92% (29.8131 => 31.8749, std.dev.: 0.6549)
MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.89% (3.4085 => 3.6434, std.dev.: 0.0212)
MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.31% (5.3042 => 5.6390, std.dev.: 0.0428)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 6.05% (5.5008 => 5.8337, std.dev.: 0.0204)
MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.24% (5.1471 => 5.4168, std.dev.: 0.0461)
MultiSource/Benchmarks/PAQ8p/paq8p: 4.87% (93.6732 => 98.2339, std.dev.: 0.7806)
SingleSource/Benchmarks/Misc/whetstone: 4.54% (3.4559 => 3.6129, std.dev.: 0.0038)
SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.50% (6.1245 => 6.4004, std.dev.: 0.0832)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.39% (4.3151 => 4.5046, std.dev.: 0.0453)
MultiSource/Benchmarks/Bullet/bullet: 3.81% (7.2995 => 7.5777, std.dev.: 0.0981)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 3.78% (1.4327 => 1.4869, std.dev.: 0.0113)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.75% (3.3384 => 3.4637, std.dev.: 0.0329)
SingleSource/Benchmarks/Misc/ffbench: 3.74% (1.3679 => 1.4191, std.dev.: 0.0189)
SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.46% (1.3104 => 1.3558, std.dev.: 0.0023)
SingleSource/Benchmarks/CoyoteBench/huffbench: 3.42% (25.0200 => 25.8747, std.dev.: 0.0197)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.27% (4.8739 => 5.0332, std.dev.: 0.0275)
SingleSource/Benchmarks/Shootout/matrix: 3.23% (1.7358 => 1.7918, std.dev.: 0.0056)
MultiSource/Applications/spiff/spiff: 3.06% (2.7609 => 2.8453, std.dev.: 0.0321)
SingleSource/Benchmarks/Shootout-C++/hash2: 2.88% (3.3877 => 3.4854, std.dev.: 0.0141)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.61% (12.8625 => 13.1979, std.dev.: 0.0269)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.15% (3.0680 => 3.1341, std.dev.: 0.0141)
MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.05% (3.3464 => 3.4150, std.dev.: 0.0092)
SingleSource/Benchmarks/BenchmarkGame/n-body: 1.04% (1.5112 => 1.5269, std.dev.: 0.0048)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Benchmarks/Olden/tsp/tsp: -21.07% (0.1818 => 0.1435, std.dev.: 0.0143)
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -17.52% (0.1518 => 0.1252, std.dev.: 0.0003)
MultiSource/Applications/sgefa/sgefa: -12.04% (0.4809 => 0.4230, std.dev.: 0.0170)
MultiSource/Applications/lambda-0_1_3/lambda: -9.38% (0.9461 => 0.8574, std.dev.: 0.0235)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Applications/lemon/lemon: -35.43% (1.4194 => 0.9165, std.dev.: 0.1923)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -31.56% (2.1022 => 1.4387, std.dev.: 0.0076)
MultiSource/Applications/viterbi/viterbi: -26.40% (3.4923 => 2.5702, std.dev.: 0.0729)
MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.61% (6.9552 => 5.2437, std.dev.: 0.3368)
SingleSource/Benchmarks/Misc/perlin: -21.36% (4.5989 => 3.6164, std.dev.: 0.0280)
MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.36% (6.2627 => 5.3635, std.dev.: 0.0905)
SingleSource/Benchmarks/Misc/mandel: -13.80% (1.1996 => 1.0340, std.dev.: 0.0107)
MultiSource/Benchmarks/Olden/perimeter/perimeter: -10.96% (0.3557 => 0.3167, std.dev.: 0.0094)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.18% (1.7207 => 1.6316, std.dev.: 0.0157)
MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.69% (3.8119 => 3.6332, std.dev.: 0.0128)
SingleSource/Benchmarks/Misc/fbench: -4.22% (4.9602 => 4.7509, std.dev.: 0.0019)
MultiSource/Applications/SIBsim4/SIBsim4: -3.66% (3.5791 => 3.4482, std.dev.: 0.0157)
SingleSource/UnitTests/Vectorizer/gcc-loops: -3.60% (21.6864 => 20.9057, std.dev.: 0.2412)
MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.48% (6.0444 => 5.8338, std.dev.: 0.0512)
SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.10% (0.7355 => 0.7127, std.dev.: 0.0047)
MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.87% (6.1482 => 5.9719, std.dev.: 0.0097)
SingleSource/Benchmarks/Stanford/FloatMM: -2.83% (0.7806 => 0.7585, std.dev.: 0.0054)
MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.74% (5.2218 => 5.0789, std.dev.: 0.0356)
MultiSource/Applications/sgefa/sgefa: -2.70% (1.4030 => 1.3651, std.dev.: 0.0019)
SingleSource/Regression/C/uint64_to_float: -2.20% (1.5184 => 1.4850, std.dev.: 0.0102)
SingleSource/Benchmarks/Misc/oourafft: -1.94% (3.7891 => 3.7156, std.dev.: 0.0173)
SingleSource/Benchmarks/CoyoteBench/almabench: -1.92% (34.8438 => 34.1741, std.dev.: 0.0394)
SingleSource/Benchmarks/Misc/ReedSolomon: -1.51% (8.6172 => 8.4868, std.dev.: 0.0109)
MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.19% (2.1343 => 2.1088, std.dev.: 0.0087)
MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.15% (5.8810 => 5.8132, std.dev.: 0.0175)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: 0.44% (0.1378 => 0.1384, std.dev.: 0.0219)
Report Time: 0.71s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130809/1e020581/attachment.html>
More information about the llvm-testresults
mailing list