[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Fri Aug 9 02:17:25 PDT 2013
http://llvm.org/perf/db_default/v4/nts/14245?compare_to=14241&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15
Comparing:
Run: 14245, Order: 188056, Start Time: 2013-08-09 07:28:18, End Time: 2013-08-09 09:19:18
To: 14241, Order: 188051, Start Time: 2013-08-09 05:14:06, End Time: 2013-08-09 07:07:08
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57
===============
Tests Summary
===============
New Failures: 0 (2 on baseline)
Performance Regressions: 21 (37 on baseline)
Performance Improvements: 11 (24 on baseline)
Existing Failures: 3 (1 on baseline)
Unchanged Tests: 1073 (1044 on baseline)
Total Tests: 1108
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 35.65% (0.2934 => 0.3980, std.dev.: 0.0345)
MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 35.35% (0.2849 => 0.3856, std.dev.: 0.0244)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 33.62% (1.0091 => 1.3484, std.dev.: 0.0487)
MultiSource/Benchmarks/MallocBench/gs/gs: 30.45% (5.1024 => 6.6559, std.dev.: 0.3473)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 24.33% (0.7397 => 0.9197, std.dev.: 0.0302)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 20.21% (7.6711 => 9.2212, std.dev.: 0.5971)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 19.45% (6.0082 => 7.1769, std.dev.: 0.4394)
MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.04% (0.0855 => 0.0975, std.dev.: 0.0029)
MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 13.47% (1.3939 => 1.5817, std.dev.: 0.0592)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.43% (1.4136 => 1.5611, std.dev.: 0.0217)
MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.09% (1.5164 => 1.6543, std.dev.: 0.0490)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.41% (1.4870 => 1.8648, std.dev.: 0.0384)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 22.28% (2.7001 => 3.3018, std.dev.: 0.0808)
MultiSource/Benchmarks/llubenchmark/llu: 20.10% (2.0136 => 2.4183, std.dev.: 0.0478)
SingleSource/Benchmarks/Shootout/matrix: 18.83% (1.7733 => 2.1072, std.dev.: 0.0009)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.85% (2.6893 => 2.9005, std.dev.: 0.0677)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.12% (0.4918 => 0.5170, std.dev.: 0.0035)
MultiSource/Applications/lua/lua: 4.37% (29.7231 => 31.0209, std.dev.: 0.2541)
MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.37% (4.9665 => 5.0841, std.dev.: 0.0335)
MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.00% (3.4169 => 3.4852, std.dev.: 0.0147)
MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.05% (4.8547 => 4.9056, std.dev.: 0.0088)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/UnitTests/SignlessTypes/div: -35.75% (0.0551 => 0.0354, std.dev.: 0.0022)
SingleSource/Benchmarks/Shootout/hash: -23.75% (0.0800 => 0.0610, std.dev.: 0.0017)
SingleSource/Benchmarks/Shootout/objinst: -21.29% (0.0587 => 0.0462, std.dev.: 0.0001)
SingleSource/Benchmarks/Shootout-C++/wc: -11.13% (0.2839 => 0.2523, std.dev.: 0.0111)
SingleSource/Benchmarks/CoyoteBench/huffbench: -10.02% (0.1257 => 0.1131, std.dev.: 0.0020)
SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -7.10% (0.2183 => 0.2028, std.dev.: 0.0045)
MultiSource/Applications/hexxagon/hexxagon: -3.97% (1.1724 => 1.1258, std.dev.: 0.0081)
MultiSource/Applications/hbd/hbd: -2.95% (1.7647 => 1.7126, std.dev.: 0.0014)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/Shootout-C++/strcat: -13.06% (0.0873 => 0.0759, std.dev.: 0.0025)
MultiSource/Benchmarks/BitBench/drop3/drop3: -5.01% (0.4895 => 0.4650, std.dev.: 0.0041)
SingleSource/Benchmarks/BenchmarkGame/n-body: -2.58% (1.5530 => 1.5129, std.dev.: 0.0055)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
MultiSource/Benchmarks/mediabench/gsm/toast/toast
MultiSource/Applications/ClamAV/clamscan: -0.36% (0.1372 => 0.1367, std.dev.: 0.0139)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.89% (0.2737 => 0.2953, std.dev.: 0.0357)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0279 => 0.0279, std.dev.: 0.0064)
================================
Run-Over-Baseline Changes Detail
================================
New Failures - Execution Time
-----------------------------
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
MultiSource/Benchmarks/mediabench/gsm/toast/toast
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.98% (0.2813 => 0.2953, std.dev.: 0.0357)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.13% (0.0345 => 0.0279, std.dev.: 0.0064)
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 43.99% (0.2678 => 0.3856, std.dev.: 0.0244)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 43.34% (0.9407 => 1.3484, std.dev.: 0.0487)
SingleSource/Regression/C/bigstack: 37.12% (0.0466 => 0.0639, std.dev.: 0.0033)
MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 37.01% (0.2905 => 0.3980, std.dev.: 0.0345)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 22.84% (0.7487 => 0.9197, std.dev.: 0.0302)
MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.55% (1.4179 => 1.5817, std.dev.: 0.0592)
MultiSource/Benchmarks/FreeBench/neural/neural: 6.71% (0.2071 => 0.2210, std.dev.: 0.0020)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 4.49% (1.4940 => 1.5611, std.dev.: 0.0217)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 74.20% (3.7285 => 6.4950, std.dev.: 0.0550)
SingleSource/Benchmarks/Shootout-C++/matrix: 48.40% (2.8867 => 4.2840, std.dev.: 0.0287)
MultiSource/Benchmarks/FreeBench/neural/neural: 35.60% (0.3171 => 0.4300, std.dev.: 0.0194)
SingleSource/Benchmarks/Shootout/hash: 26.38% (4.1846 => 5.2885, std.dev.: 0.0462)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 24.07% (1.5030 => 1.8648, std.dev.: 0.0384)
SingleSource/Benchmarks/Shootout-C++/hash: 22.57% (0.6295 => 0.7716, std.dev.: 0.0242)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 22.33% (2.6992 => 3.3018, std.dev.: 0.0808)
SingleSource/Benchmarks/Shootout/matrix: 21.40% (1.7358 => 2.1072, std.dev.: 0.0009)
MultiSource/Benchmarks/llubenchmark/llu: 19.79% (2.0187 => 2.4183, std.dev.: 0.0478)
MultiSource/Applications/JM/lencod/lencod: 12.31% (7.1799 => 8.0637, std.dev.: 0.2288)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.16% (2.6094 => 2.9005, std.dev.: 0.0677)
MultiSource/Applications/lambda-0_1_3/lambda: 10.91% (7.0762 => 7.8485, std.dev.: 0.0113)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.83% (14.9584 => 16.2786, std.dev.: 0.3085)
MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.31% (5.4910 => 5.9473, std.dev.: 0.0305)
MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.14% (3.2027 => 3.4315, std.dev.: 0.0327)
MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.99% (5.3042 => 5.6221, std.dev.: 0.0194)
MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.65% (3.4085 => 3.6012, std.dev.: 0.0346)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.45% (5.5008 => 5.8008, std.dev.: 0.0718)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.72% (4.3151 => 4.5189, std.dev.: 0.0417)
MultiSource/Applications/siod/siod: 4.37% (3.3761 => 3.5236, std.dev.: 0.0363)
MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.15% (3.3464 => 3.4852, std.dev.: 0.0147)
SingleSource/Benchmarks/Misc/whetstone: 3.71% (3.4559 => 3.5842, std.dev.: 0.0178)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.67% (3.3384 => 3.4610, std.dev.: 0.0408)
SingleSource/Benchmarks/CoyoteBench/huffbench: 3.30% (25.0200 => 25.8447, std.dev.: 0.0884)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.12% (4.8739 => 5.0260, std.dev.: 0.0288)
SingleSource/Benchmarks/Shootout-C++/hash2: 2.81% (3.3877 => 3.4828, std.dev.: 0.0308)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.33% (12.8625 => 13.1619, std.dev.: 0.0376)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.13% (3.5351 => 3.6105, std.dev.: 0.0208)
SingleSource/Benchmarks/Shootout/methcall: 1.02% (8.4614 => 8.5479, std.dev.: 0.0176)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: -32.35% (0.0439 => 0.0297, std.dev.: 0.0047)
MultiSource/Benchmarks/Olden/bisort/bisort: -32.09% (0.1072 => 0.0728, std.dev.: 0.0080)
MultiSource/Applications/hexxagon/hexxagon: -15.26% (1.3285 => 1.1258, std.dev.: 0.0081)
MultiSource/Applications/hbd/hbd: -15.19% (2.0193 => 1.7126, std.dev.: 0.0014)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.02% (2.1022 => 1.4290, std.dev.: 0.0092)
MultiSource/Applications/viterbi/viterbi: -26.65% (3.4923 => 2.5615, std.dev.: 0.0153)
MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.34% (6.9552 => 5.2620, std.dev.: 0.0672)
SingleSource/Benchmarks/Misc/perlin: -21.37% (4.5989 => 3.6160, std.dev.: 0.0092)
SingleSource/Benchmarks/Misc/mandel: -14.43% (1.1996 => 1.0265, std.dev.: 0.0277)
MultiSource/Applications/SIBsim4/SIBsim4: -8.09% (3.5791 => 3.2895, std.dev.: 0.0987)
SingleSource/Benchmarks/Misc/fbench: -4.75% (4.9602 => 4.7247, std.dev.: 0.0354)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.59% (1.1024 => 1.0518, std.dev.: 0.0037)
MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.29% (3.8119 => 3.6482, std.dev.: 0.0268)
MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.32% (6.0444 => 5.8437, std.dev.: 0.0253)
SingleSource/Benchmarks/Stanford/FloatMM: -3.16% (0.7806 => 0.7559, std.dev.: 0.0054)
MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.03% (6.1482 => 5.9618, std.dev.: 0.0336)
SingleSource/UnitTests/Vectorizer/gcc-loops: -2.83% (21.6864 => 21.0716, std.dev.: 0.1841)
MultiSource/Benchmarks/BitBench/drop3/drop3: -2.78% (0.4783 => 0.4650, std.dev.: 0.0041)
MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.59% (5.2218 => 5.0868, std.dev.: 0.0391)
MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.57% (1.8144 => 1.7678, std.dev.: 0.0070)
SingleSource/Benchmarks/Misc/ReedSolomon: -2.43% (8.6172 => 8.4081, std.dev.: 0.0355)
SingleSource/Benchmarks/Misc/oourafft: -2.10% (3.7891 => 3.7094, std.dev.: 0.0073)
SingleSource/Benchmarks/CoyoteBench/almabench: -2.01% (34.8438 => 34.1419, std.dev.: 0.0359)
MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -1.33% (1.6737 => 1.6514, std.dev.: 0.0052)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: -0.80% (0.1378 => 0.1367, std.dev.: 0.0139)
Report Time: 2.30s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130809/f9214768/attachment.html>
More information about the llvm-testresults
mailing list