[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Tue Jun 4 09:21:10 PDT 2013
http://llvm.org/perf/db_default/v4/nts/12042?compare_to=12038&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13
Comparing:
Run: 12042, Order: 183223, Start Time: 2013-06-04 14:33:04, End Time: 2013-06-04 16:21:51
To: 12038, Order: 183217, Start Time: 2013-06-04 11:00:44, End Time: 2013-06-04 12:43:15
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16
===============
Tests Summary
===============
Performance Regressions: 64 (47 on baseline)
Performance Improvements: 1 (30 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1042 (1030 on baseline)
Total Tests: 1108
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 72.94% (0.0388 => 0.0671, std.dev.: 0.0017)
SingleSource/Regression/C++/EH/exception_spec_test: 72.48% (0.0327 => 0.0564, std.dev.: 0.0012)
SingleSource/Regression/C++/EH/ConditionalExpr: 68.72% (0.0227 => 0.0383, std.dev.: 0.0006)
SingleSource/UnitTests/2003-10-29-ScalarReplBug: 68.15% (0.0157 => 0.0264, std.dev.: 0.0027)
SingleSource/Regression/C++/pointer_method2: 62.40% (0.0258 => 0.0419, std.dev.: 0.0006)
SingleSource/UnitTests/2003-08-11-VaListArg: 61.46% (0.0301 => 0.0486, std.dev.: 0.0025)
SingleSource/Regression/C/globalrefs: 61.17% (0.0206 => 0.0332, std.dev.: 0.0011)
SingleSource/UnitTests/2002-05-02-CastTest2: 58.62% (0.0203 => 0.0322, std.dev.: 0.0026)
SingleSource/Regression/C/sumarray: 57.68% (0.0371 => 0.0585, std.dev.: 0.0022)
SingleSource/Regression/C++/EH/throw_rethrow_test: 56.77% (0.0266 => 0.0417, std.dev.: 0.0029)
SingleSource/Regression/C++/global_ctor: 55.71% (0.0210 => 0.0327, std.dev.: 0.0011)
SingleSource/Regression/C++/EH/ctor_dtor_count: 53.88% (0.0206 => 0.0317, std.dev.: 0.0021)
SingleSource/Regression/C++/EH/ctor_dtor_count-2: 53.31% (0.0242 => 0.0371, std.dev.: 0.0016)
SingleSource/UnitTests/2003-07-06-IntOverflow: 50.70% (0.0213 => 0.0321, std.dev.: 0.0019)
SingleSource/Regression/C/matrixTranspose: 47.66% (0.0256 => 0.0378, std.dev.: 0.0044)
SingleSource/Benchmarks/McGill/misr: 39.23% (0.0673 => 0.0937, std.dev.: 0.0077)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 36.01% (0.9470 => 1.2880, std.dev.: 0.1250)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 28.00% (0.2661 => 0.3406, std.dev.: 0.0170)
MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 23.18% (0.3210 => 0.3954, std.dev.: 0.0216)
MultiSource/Benchmarks/MiBench/security-sha/security-sha: 21.97% (0.1006 => 0.1227, std.dev.: 0.0073)
MultiSource/Benchmarks/7zip/7zip-benchmark: 16.66% (45.7172 => 53.3317, std.dev.: 1.1695)
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 15.74% (0.2262 => 0.2618, std.dev.: 0.0108)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.93% (14.7342 => 16.6392, std.dev.: 0.2649)
SingleSource/Benchmarks/CoyoteBench/lpbench: 12.68% (0.1104 => 0.1244, std.dev.: 0.0052)
MultiSource/Benchmarks/mafft/pairlocalalign: 8.44% (10.4129 => 11.2916, std.dev.: 0.3030)
SingleSource/Benchmarks/CoyoteBench/fftbench: 6.82% (0.4003 => 0.4276, std.dev.: 0.0086)
MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.61% (1.6172 => 1.7241, std.dev.: 0.0068)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.38% (1.4145 => 1.5048, std.dev.: 0.0163)
MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.74% (1.8118 => 1.8977, std.dev.: 0.0166)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.33% (25.4092 => 26.5097, std.dev.: 0.3216)
MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 3.66% (1.5333 => 1.5894, std.dev.: 0.0158)
SingleSource/Benchmarks/Misc-C++/bigfib: 3.41% (0.6976 => 0.7214, std.dev.: 0.0077)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.74% (0.7778 => 0.7913, std.dev.: 0.0037)
MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.26% (1.5959 => 1.6160, std.dev.: 0.0051)
MultiSource/Applications/obsequi/Obsequi: 1.10% (1.1580 => 1.1707, std.dev.: 0.0032)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/MiBench/security-sha/security-sha: 63.04% (0.0184 => 0.0300, std.dev.: 0.0015)
SingleSource/Benchmarks/Shootout/ary3: 62.99% (5.7820 => 9.4241, std.dev.: 0.2391)
SingleSource/Benchmarks/Stanford/Queens: 58.91% (0.0258 => 0.0410, std.dev.: 0.0015)
SingleSource/Benchmarks/CoyoteBench/fftbench: 40.20% (1.5175 => 2.1275, std.dev.: 0.0458)
SingleSource/Benchmarks/Shootout-C++/heapsort: 37.67% (2.9354 => 4.0411, std.dev.: 0.3599)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.59% (1.4787 => 1.8866, std.dev.: 0.0165)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 27.49% (4.5344 => 5.7810, std.dev.: 0.2312)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.81% (0.2633 => 0.3260, std.dev.: 0.0166)
SingleSource/Benchmarks/Shootout-C++/fibo: 16.83% (4.1409 => 4.8377, std.dev.: 0.0195)
MultiSource/Benchmarks/7zip/7zip-benchmark: 16.24% (9.1888 => 10.6811, std.dev.: 0.0327)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 15.52% (3.5895 => 4.1467, std.dev.: 0.0219)
SingleSource/Benchmarks/Stanford/Treesort: 15.33% (0.0724 => 0.0835, std.dev.: 0.0023)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 14.19% (2.5406 => 2.9011, std.dev.: 0.0722)
SingleSource/Benchmarks/Misc/pi: 13.15% (1.8288 => 2.0692, std.dev.: 0.0596)
MultiSource/Benchmarks/FreeBench/neural/neural: 12.41% (0.3328 => 0.3741, std.dev.: 0.0065)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.67% (15.0501 => 16.8059, std.dev.: 0.2148)
MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.59% (4.6498 => 5.0026, std.dev.: 0.0513)
SingleSource/Benchmarks/McGill/chomp: 6.39% (1.0111 => 1.0757, std.dev.: 0.0247)
MultiSource/Benchmarks/PAQ8p/paq8p: 6.12% (91.3879 => 96.9836, std.dev.: 0.4286)
MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 6.02% (5.0903 => 5.3968, std.dev.: 0.0754)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.54% (60.8095 => 64.1793, std.dev.: 0.1874)
MultiSource/Benchmarks/mafft/pairlocalalign: 4.84% (41.5301 => 43.5400, std.dev.: 0.0670)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.89% (4.7349 => 4.9192, std.dev.: 0.0160)
SingleSource/Benchmarks/Dhrystone/fldry: 2.69% (0.6623 => 0.6801, std.dev.: 0.0041)
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.41% (39.6403 => 40.5943, std.dev.: 0.2684)
SingleSource/Regression/C/uint64_to_float: 2.30% (1.6942 => 1.7331, std.dev.: 0.0036)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.14% (9.0829 => 9.2772, std.dev.: 0.0116)
SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.41% (1.4761 => 1.4969, std.dev.: 0.0036)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.06% (1.7010 => 1.7191, std.dev.: 0.0059)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.07% (3.6792 => 3.6029, std.dev.: 0.0285)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: 1.46% (0.1439 => 0.1460, std.dev.: 0.0180)
================================
Run-Over-Baseline Changes Detail
================================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Regression/C++/pointer_method2: 66.27% (0.0252 => 0.0419, std.dev.: 0.0006)
SingleSource/Regression/C++/EH/ConditionalExpr: 64.38% (0.0233 => 0.0383, std.dev.: 0.0006)
SingleSource/Regression/C++/EH/ctor_dtor_count-2: 59.23% (0.0233 => 0.0371, std.dev.: 0.0016)
SingleSource/Regression/C/globalrefs: 58.10% (0.0210 => 0.0332, std.dev.: 0.0011)
SingleSource/Regression/C/sumarray: 55.17% (0.0377 => 0.0585, std.dev.: 0.0022)
SingleSource/UnitTests/2003-08-11-VaListArg: 51.87% (0.0320 => 0.0486, std.dev.: 0.0025)
SingleSource/Regression/C++/EH/exception_spec_test: 50.80% (0.0374 => 0.0564, std.dev.: 0.0012)
SingleSource/UnitTests/2002-05-02-CastTest2: 49.77% (0.0215 => 0.0322, std.dev.: 0.0026)
SingleSource/Regression/C++/EH/ctor_dtor_count: 47.44% (0.0215 => 0.0317, std.dev.: 0.0021)
SingleSource/Regression/C++/global_ctor: 47.30% (0.0222 => 0.0327, std.dev.: 0.0011)
SingleSource/Regression/C++/EH/throw_rethrow_test: 46.32% (0.0285 => 0.0417, std.dev.: 0.0029)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 44.30% (0.0465 => 0.0671, std.dev.: 0.0017)
SingleSource/Benchmarks/McGill/misr: 32.72% (0.0706 => 0.0937, std.dev.: 0.0077)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.05% (0.2768 => 0.3406, std.dev.: 0.0170)
MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 17.05% (0.3378 => 0.3954, std.dev.: 0.0216)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.23% (1.4165 => 1.5048, std.dev.: 0.0163)
MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.82% (1.6292 => 1.7241, std.dev.: 0.0068)
MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.94% (1.8435 => 1.8977, std.dev.: 0.0166)
MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.69% (1.5478 => 1.5894, std.dev.: 0.0158)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.57% (0.7791 => 0.7913, std.dev.: 0.0037)
MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.10% (1.5984 => 1.6160, std.dev.: 0.0051)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Shootout/ary3: 56.75% (6.0122 => 9.4241, std.dev.: 0.2391)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.45% (4.6452 => 5.7810, std.dev.: 0.2312)
MultiSource/Applications/sgefa/sgefa: 18.34% (1.1695 => 1.3840, std.dev.: 0.0020)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 17.39% (0.2777 => 0.3260, std.dev.: 0.0166)
MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.32% (6.1372 => 7.1386, std.dev.: 0.0729)
SingleSource/Benchmarks/CoyoteBench/fftbench: 16.31% (1.8291 => 2.1275, std.dev.: 0.0458)
SingleSource/Benchmarks/Stanford/Treesort: 14.23% (0.0731 => 0.0835, std.dev.: 0.0023)
SingleSource/Benchmarks/Misc/pi: 12.96% (1.8318 => 2.0692, std.dev.: 0.0596)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.45% (2.5800 => 2.9011, std.dev.: 0.0722)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.08% (5.2003 => 5.6204, std.dev.: 0.0158)
MultiSource/Benchmarks/FreeBench/neural/neural: 6.49% (0.3513 => 0.3741, std.dev.: 0.0065)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.88% (3.2201 => 3.3772, std.dev.: 0.0229)
MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.84% (4.6639 => 4.8895, std.dev.: 0.0019)
MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.79% (3.1853 => 3.3380, std.dev.: 0.0411)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.47% (1.0571 => 1.1043, std.dev.: 0.0027)
MultiSource/Benchmarks/7zip/7zip-benchmark: 4.29% (10.2418 => 10.6811, std.dev.: 0.0327)
MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.85% (5.9362 => 6.1646, std.dev.: 0.0179)
MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.51% (5.2788 => 5.4639, std.dev.: 0.0248)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.94% (5.5010 => 5.6630, std.dev.: 0.0317)
SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.89% (3.9713 => 4.0860, std.dev.: 0.0118)
MultiSource/Benchmarks/PAQ8p/paq8p: 2.85% (94.2966 => 96.9836, std.dev.: 0.4286)
SingleSource/Regression/C/uint64_to_float: 2.85% (1.6851 => 1.7331, std.dev.: 0.0036)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.79% (62.4345 => 64.1793, std.dev.: 0.1874)
SingleSource/Benchmarks/Dhrystone/fldry: 2.75% (0.6619 => 0.6801, std.dev.: 0.0041)
SingleSource/Benchmarks/Shootout/methcall: 2.22% (8.3425 => 8.5276, std.dev.: 0.0448)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.24% (1.6980 => 1.7191, std.dev.: 0.0059)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Benchmarks/Prolangs-C++/garage/garage: -37.29% (0.1113 => 0.0698, std.dev.: 0.0053)
MultiSource/Applications/viterbi/viterbi: -25.92% (0.2431 => 0.1801, std.dev.: 0.0031)
SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.12% (0.2006 => 0.1803, std.dev.: 0.0020)
MultiSource/Applications/SIBsim4/SIBsim4: -6.85% (1.6793 => 1.5642, std.dev.: 0.0138)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.30% (1.2911 => 0.7320, std.dev.: 0.0031)
MultiSource/Applications/lemon/lemon: -35.28% (1.3499 => 0.8736, std.dev.: 0.0823)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.90% (4.4050 => 3.2202, std.dev.: 0.0155)
SingleSource/Benchmarks/Misc/salsa20: -21.92% (10.3398 => 8.0732, std.dev.: 0.4448)
MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -19.74% (6.2328 => 5.0026, std.dev.: 0.0513)
SingleSource/UnitTests/Vectorizer/gcc-loops: -16.23% (25.3677 => 21.2495, std.dev.: 0.0658)
MultiSource/Benchmarks/mafft/pairlocalalign: -9.91% (48.3307 => 43.5400, std.dev.: 0.0670)
MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.43% (1.6679 => 1.5106, std.dev.: 0.0094)
MultiSource/Applications/SIBsim4/SIBsim4: -9.18% (3.5327 => 3.2083, std.dev.: 0.0234)
MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.73% (5.5889 => 5.2126, std.dev.: 0.0045)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.03% (9.8728 => 9.2772, std.dev.: 0.0116)
MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.76% (0.4445 => 0.4189, std.dev.: 0.0064)
MultiSource/Applications/sqlite3/sqlite3: -5.64% (4.6358 => 4.3745, std.dev.: 0.0691)
MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.39% (4.5717 => 4.3251, std.dev.: 0.0146)
MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.50% (5.3184 => 5.0792, std.dev.: 0.0166)
MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.05% (5.3276 => 5.1120, std.dev.: 0.0093)
MultiSource/Applications/hexxagon/hexxagon: -4.02% (15.4979 => 14.8750, std.dev.: 0.0504)
MultiSource/Applications/lambda-0_1_3/lambda: -3.96% (9.1099 => 8.7493, std.dev.: 0.0321)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -3.66% (2.4808 => 2.3900, std.dev.: 0.0267)
SingleSource/Benchmarks/Misc/flops: -3.47% (10.2170 => 9.8624, std.dev.: 0.0186)
SingleSource/Benchmarks/Shootout-C++/hash: -3.30% (0.7941 => 0.7679, std.dev.: 0.0095)
SingleSource/Benchmarks/Shootout/sieve: -2.75% (8.0178 => 7.7974, std.dev.: 0.0627)
SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.71% (3.8665 => 3.7616, std.dev.: 0.0269)
MultiSource/Applications/JM/lencod/lencod: -2.49% (7.0353 => 6.8598, std.dev.: 0.0127)
MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.19% (4.5094 => 4.4107, std.dev.: 0.0221)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.66% (4.2167 => 4.1467, std.dev.: 0.0219)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: 1.32% (0.1441 => 0.1460, std.dev.: 0.0180)
Report Time: 0.68s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130604/24b15fcc/attachment.html>
More information about the llvm-testresults
mailing list