[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Thu Aug 8 10:29:12 PDT 2013
http://llvm.org/perf/db_default/v4/nts/14220?compare_to=14216&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15
Comparing:
Run: 14220, Order: 187979, Start Time: 2013-08-08 15:36:37, End Time: 2013-08-08 17:31:04
To: 14216, Order: 187977, Start Time: 2013-08-08 13:30:04, End Time: 2013-08-08 15:13:45
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57
===============
Tests Summary
===============
New Failures: 0 (2 on baseline)
Performance Regressions: 45 (59 on baseline)
Performance Improvements: 6 (29 on baseline)
Existing Failures: 3 (1 on baseline)
Unchanged Tests: 1054 (1017 on baseline)
Total Tests: 1108
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 70.19% (0.0862 => 0.1467, std.dev.: 0.0044)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 67.87% (0.0856 => 0.1437, std.dev.: 0.0042)
MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 31.65% (0.2468 => 0.3249, std.dev.: 0.0247)
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 21.51% (0.0530 => 0.0644, std.dev.: 0.0042)
MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 19.63% (0.7556 => 0.9039, std.dev.: 0.0404)
MultiSource/Benchmarks/Prolangs-C/football/football: 17.01% (1.0252 => 1.1996, std.dev.: 0.0493)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.63% (7.6619 => 8.9360, std.dev.: 0.1181)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 13.92% (0.0869 => 0.0990, std.dev.: 0.0017)
SingleSource/Benchmarks/Misc-C++-EH/spirit: 13.20% (6.5037 => 7.3621, std.dev.: 0.0536)
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.82% (0.1428 => 0.1611, std.dev.: 0.0057)
MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 12.52% (1.4557 => 1.6379, std.dev.: 0.0463)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.43% (4.2360 => 4.7625, std.dev.: 0.1033)
MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 12.25% (1.4453 => 1.6224, std.dev.: 0.0398)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 12.17% (1.4048 => 1.5758, std.dev.: 0.0231)
MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 11.61% (1.3722 => 1.5315, std.dev.: 0.0586)
SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.73% (0.5342 => 0.5915, std.dev.: 0.0132)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.00% (1.3961 => 1.5357, std.dev.: 0.0490)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.78% (0.4793 => 0.5214, std.dev.: 0.0055)
MultiSource/Benchmarks/PAQ8p/paq8p: 5.97% (2.5205 => 2.6710, std.dev.: 0.0569)
MultiSource/Benchmarks/sim/sim: 3.86% (0.3786 => 0.3932, std.dev.: 0.0023)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/Ptrdist/ft/ft: 61.74% (0.7587 => 1.2271, std.dev.: 0.0721)
SingleSource/Benchmarks/Misc/pi: 51.29% (1.6497 => 2.4959, std.dev.: 0.0238)
MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 31.71% (0.0678 => 0.0893, std.dev.: 0.0043)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 30.48% (0.2917 => 0.3806, std.dev.: 0.0105)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.50% (36.7013 => 46.7926, std.dev.: 2.7475)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 17.80% (1.4806 => 1.7442, std.dev.: 0.0709)
SingleSource/Benchmarks/Shootout-C++/ackermann: 17.26% (3.1514 => 3.6952, std.dev.: 0.0581)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.38% (21.3299 => 24.6109, std.dev.: 0.8050)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 9.79% (2.9244 => 3.2106, std.dev.: 0.0311)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.48% (15.3923 => 16.5434, std.dev.: 0.1925)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.98% (3.9568 => 4.1936, std.dev.: 0.0536)
MultiSource/Benchmarks/PAQ8p/paq8p: 5.57% (89.8562 => 94.8585, std.dev.: 1.6759)
MultiSource/Applications/lua/lua: 4.99% (29.4965 => 30.9682, std.dev.: 0.3258)
SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.67% (1.2922 => 1.3526, std.dev.: 0.0080)
SingleSource/Benchmarks/Misc/flops: 4.40% (9.4126 => 9.8269, std.dev.: 0.0776)
MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 4.20% (6.2320 => 6.4935, std.dev.: 0.0101)
MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.51% (4.9634 => 5.1374, std.dev.: 0.0084)
SingleSource/Benchmarks/Misc/ffbench: 2.75% (1.3784 => 1.4163, std.dev.: 0.0074)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 2.57% (5.8449 => 5.9951, std.dev.: 0.0500)
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 2.40% (2.8174 => 2.8849, std.dev.: 0.0083)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.01% (1.6290 => 1.6618, std.dev.: 0.0092)
MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.98% (4.9411 => 5.0391, std.dev.: 0.0225)
MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.88% (5.0563 => 5.1516, std.dev.: 0.0183)
MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.11% (5.7939 => 5.8581, std.dev.: 0.0105)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.00% (3.7713 => 3.8091, std.dev.: 0.0111)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -15.07% (5.4700 => 4.6455, std.dev.: 0.0219)
SingleSource/Benchmarks/Misc/lowercase: -5.90% (0.8304 => 0.7814, std.dev.: 0.0056)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.04% (3.2651 => 3.1006, std.dev.: 0.0155)
MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.81% (5.1034 => 4.8581, std.dev.: 0.0238)
MultiSource/Benchmarks/mafft/pairlocalalign: -2.69% (46.4774 => 45.2274, std.dev.: 0.4651)
SingleSource/Benchmarks/McGill/queens: -2.06% (1.6819 => 1.6473, std.dev.: 0.0030)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
MultiSource/Benchmarks/mediabench/gsm/toast/toast
MultiSource/Applications/ClamAV/clamscan: 3.80% (0.1317 => 0.1367, std.dev.: 0.0184)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 0.58% (0.2749 => 0.2765, std.dev.: 0.0576)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0278 => 0.0278, std.dev.: 0.0082)
================================
Run-Over-Baseline Changes Detail
================================
New Failures - Execution Time
-----------------------------
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
MultiSource/Benchmarks/mediabench/gsm/toast/toast
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.71% (0.2813 => 0.2765, std.dev.: 0.0576)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.42% (0.0345 => 0.0278, std.dev.: 0.0082)
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 68.04% (0.0873 => 0.1467, std.dev.: 0.0044)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 63.85% (0.0877 => 0.1437, std.dev.: 0.0042)
SingleSource/Regression/C/bigstack: 41.63% (0.0466 => 0.0660, std.dev.: 0.0057)
MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 32.18% (0.2458 => 0.3249, std.dev.: 0.0247)
MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 20.15% (0.7523 => 0.9039, std.dev.: 0.0404)
MultiSource/Benchmarks/FreeBench/distray/distray: 18.68% (0.1033 => 0.1226, std.dev.: 0.0047)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.00% (7.7035 => 8.9360, std.dev.: 0.1181)
MultiSource/Benchmarks/Prolangs-C/football/football: 15.80% (1.0359 => 1.1996, std.dev.: 0.0493)
SingleSource/Benchmarks/Misc-C++-EH/spirit: 13.30% (6.4979 => 7.3621, std.dev.: 0.0536)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.21% (4.2444 => 4.7625, std.dev.: 0.1033)
SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.77% (0.5292 => 0.5915, std.dev.: 0.0132)
MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.99% (1.4750 => 1.6224, std.dev.: 0.0398)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.09% (0.4869 => 0.5214, std.dev.: 0.0055)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.05% (1.5144 => 1.5758, std.dev.: 0.0231)
MultiSource/Benchmarks/sim/sim: 3.26% (0.3808 => 0.3932, std.dev.: 0.0023)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 74.16% (3.7285 => 6.4935, std.dev.: 0.0101)
SingleSource/Benchmarks/Shootout-C++/matrix: 48.53% (2.8867 => 4.2875, std.dev.: 0.0336)
MultiSource/Benchmarks/FreeBench/neural/neural: 42.23% (0.3171 => 0.4510, std.dev.: 0.0326)
MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 30.17% (0.0686 => 0.0893, std.dev.: 0.0043)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 29.90% (0.2930 => 0.3806, std.dev.: 0.0105)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 26.84% (36.8900 => 46.7926, std.dev.: 2.7475)
SingleSource/Benchmarks/Misc/pi: 25.83% (1.9835 => 2.4959, std.dev.: 0.0238)
SingleSource/Benchmarks/Shootout-C++/ackermann: 25.57% (2.9428 => 3.6952, std.dev.: 0.0581)
SingleSource/Benchmarks/Shootout/hash: 22.64% (4.1846 => 5.1319, std.dev.: 0.3347)
SingleSource/Benchmarks/Shootout-C++/hash: 17.97% (0.6295 => 0.7426, std.dev.: 0.0318)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 16.05% (1.5030 => 1.7442, std.dev.: 0.0709)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 14.17% (21.5567 => 24.6109, std.dev.: 0.8050)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 13.15% (60.3477 => 68.2820, std.dev.: 2.9959)
MultiSource/Applications/lambda-0_1_3/lambda: 11.11% (7.0762 => 7.8623, std.dev.: 0.0576)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.60% (14.9584 => 16.5434, std.dev.: 0.1925)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 8.58% (2.9568 => 3.2106, std.dev.: 0.0311)
MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.40% (5.4910 => 5.9522, std.dev.: 0.0206)
SingleSource/Benchmarks/Linpack/linpack-pc: 8.19% (48.3256 => 52.2832, std.dev.: 0.3488)
MultiSource/Benchmarks/Ptrdist/ks/ks: 8.01% (1.2557 => 1.3563, std.dev.: 0.0092)
MultiSource/Applications/JM/lencod/lencod: 7.67% (7.1799 => 7.7304, std.dev.: 0.1467)
SingleSource/Benchmarks/McGill/chomp: 7.18% (1.0051 => 1.0773, std.dev.: 0.0055)
MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.96% (3.2027 => 3.4256, std.dev.: 0.0348)
MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.74% (3.4085 => 3.6382, std.dev.: 0.0789)
MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.05% (5.3042 => 5.6251, std.dev.: 0.0602)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.76% (5.5008 => 5.8178, std.dev.: 0.0890)
MultiSource/Applications/spiff/spiff: 4.78% (2.7609 => 2.8930, std.dev.: 0.0298)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 4.64% (4.0075 => 4.1936, std.dev.: 0.0536)
MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.58% (5.1471 => 5.3829, std.dev.: 0.0110)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.47% (4.3151 => 4.5082, std.dev.: 0.0277)
SingleSource/Benchmarks/Shootout-C++/hash2: 4.40% (3.3877 => 3.5368, std.dev.: 0.0334)
MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 4.07% (1.4398 => 1.4984, std.dev.: 0.0179)
SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.99% (6.1245 => 6.3687, std.dev.: 0.0413)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.74% (3.3384 => 3.4633, std.dev.: 0.0217)
SingleSource/Benchmarks/Misc/ffbench: 3.54% (1.3679 => 1.4163, std.dev.: 0.0074)
SingleSource/Benchmarks/Misc/whetstone: 3.24% (3.4559 => 3.5679, std.dev.: 0.0199)
SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.22% (1.3104 => 1.3526, std.dev.: 0.0080)
SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 3.15% (4.4624 => 4.6029, std.dev.: 0.0543)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.10% (4.8739 => 5.0250, std.dev.: 0.0108)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 2.67% (5.8390 => 5.9951, std.dev.: 0.0500)
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 2.46% (2.8156 => 2.8849, std.dev.: 0.0083)
MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.25% (3.3464 => 3.4217, std.dev.: 0.0226)
MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.90% (5.0417 => 5.1374, std.dev.: 0.0084)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.32% (3.7593 => 3.8091, std.dev.: 0.0111)
MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.06% (9.7023 => 9.8053, std.dev.: 0.0182)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Benchmarks/Olden/power/power: -32.59% (0.2237 => 0.1508, std.dev.: 0.0277)
MultiSource/Benchmarks/Olden/bisort/bisort: -29.57% (0.1072 => 0.0755, std.dev.: 0.0038)
MultiSource/Applications/hexxagon/hexxagon: -15.28% (1.3285 => 1.1255, std.dev.: 0.0636)
MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -9.97% (1.7797 => 1.6023, std.dev.: 0.0205)
MultiSource/Applications/lambda-0_1_3/lambda: -9.57% (0.9461 => 0.8556, std.dev.: 0.0337)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Applications/lemon/lemon: -34.35% (1.4194 => 0.9318, std.dev.: 0.0806)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.08% (2.1022 => 1.4279, std.dev.: 0.0044)
MultiSource/Applications/viterbi/viterbi: -27.22% (3.4923 => 2.5416, std.dev.: 0.0141)
MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.66% (6.9552 => 5.2403, std.dev.: 0.0344)
SingleSource/Benchmarks/Misc/perlin: -21.26% (4.5989 => 3.6212, std.dev.: 0.0062)
SingleSource/Benchmarks/Misc/mandel: -13.93% (1.1996 => 1.0325, std.dev.: 0.0101)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.67% (0.5173 => 0.4673, std.dev.: 0.0124)
MultiSource/Applications/SIBsim4/SIBsim4: -5.89% (3.5791 => 3.3682, std.dev.: 0.0454)
MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.64% (3.8119 => 3.6349, std.dev.: 0.0414)
SingleSource/Benchmarks/Misc/fbench: -4.28% (4.9602 => 4.7481, std.dev.: 0.0294)
MultiSource/Benchmarks/mafft/pairlocalalign: -4.23% (47.2250 => 45.2274, std.dev.: 0.4651)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.13% (1.1032 => 1.0576, std.dev.: 0.0020)
SingleSource/Benchmarks/Shootout-C++/EH/except: -3.94% (0.4969 => 0.4773, std.dev.: 0.0030)
SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.79% (0.7355 => 0.7076, std.dev.: 0.0072)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.72% (1.1024 => 1.0614, std.dev.: 0.0042)
SingleSource/Regression/C/uint64_to_float: -3.54% (1.5184 => 1.4646, std.dev.: 0.0172)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.42% (1.7207 => 1.6618, std.dev.: 0.0092)
SingleSource/Benchmarks/Stanford/FloatMM: -2.57% (0.7806 => 0.7605, std.dev.: 0.0024)
SingleSource/UnitTests/Vectorizer/gcc-loops: -2.35% (21.6864 => 21.1757, std.dev.: 0.1522)
SingleSource/Benchmarks/CoyoteBench/almabench: -2.01% (34.8438 => 34.1429, std.dev.: 0.0964)
MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.93% (6.1482 => 6.0298, std.dev.: 0.0319)
MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.34% (5.2218 => 5.1516, std.dev.: 0.0183)
MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.32% (4.9231 => 4.8581, std.dev.: 0.0238)
MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.17% (2.1343 => 2.1094, std.dev.: 0.0024)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: -0.80% (0.1378 => 0.1367, std.dev.: 0.0184)
Report Time: 2.04s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130808/f107ba8f/attachment.html>
More information about the llvm-testresults
mailing list