[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Tue Aug 6 20:40:07 PDT 2013
http://llvm.org/perf/db_default/v4/nts/14163?compare_to=14159&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15
Comparing:
Run: 14163, Order: 187842, Start Time: 2013-08-07 01:51:55, End Time: 2013-08-07 03:41:58
To: 14159, Order: 187827, Start Time: 2013-08-06 23:30:04, End Time: 2013-08-07 01:25:02
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57
===============
Tests Summary
===============
New Failures: 0 (2 on baseline)
Performance Regressions: 6 (28 on baseline)
Performance Improvements: 68 (45 on baseline)
Existing Failures: 3 (1 on baseline)
Unchanged Tests: 1031 (1032 on baseline)
Total Tests: 1108
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.61% (5.4430 => 5.6396, std.dev.: 0.0569)
MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.38% (4.9416 => 5.0593, std.dev.: 0.0222)
SingleSource/Benchmarks/Misc/fp-convert: 1.90% (7.9125 => 8.0625, std.dev.: 0.0443)
MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.64% (3.6140 => 3.6732, std.dev.: 0.0060)
MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.45% (5.9277 => 6.0138, std.dev.: 0.0294)
SingleSource/Benchmarks/Linpack/linpack-pc: 1.14% (52.3412 => 52.9396, std.dev.: 0.0603)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/Regression/C++/2003-06-13-Crasher: -62.23% (0.0188 => 0.0071, std.dev.: 0.0027)
SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: -49.21% (0.0252 => 0.0128, std.dev.: 0.0038)
SingleSource/Regression/C++/EH/simple_throw: -42.70% (0.0281 => 0.0161, std.dev.: 0.0031)
SingleSource/Regression/C/test_indvars: -42.03% (0.0521 => 0.0302, std.dev.: 0.0042)
SingleSource/Regression/C++/EH/dead_try_block: -41.27% (0.0252 => 0.0148, std.dev.: 0.0026)
SingleSource/Regression/C/sumarraymalloc: -41.19% (0.0738 => 0.0434, std.dev.: 0.0046)
SingleSource/Regression/C++/2003-05-14-array-init: -40.94% (0.0276 => 0.0163, std.dev.: 0.0023)
SingleSource/Regression/C/ConstructorDestructorAttributes: -39.10% (0.0266 => 0.0162, std.dev.: 0.0015)
SingleSource/Regression/C++/EH/exception_spec_test: -37.14% (0.0560 => 0.0352, std.dev.: 0.0015)
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -31.96% (0.1815 => 0.1235, std.dev.: 0.0020)
SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: -31.91% (0.0329 => 0.0224, std.dev.: 0.0035)
SingleSource/Benchmarks/CoyoteBench/almabench: -29.65% (0.1130 => 0.0795, std.dev.: 0.0112)
MultiSource/Applications/viterbi/viterbi: -25.25% (0.2570 => 0.1921, std.dev.: 0.0014)
MultiSource/Applications/Burg/burg: -22.74% (1.8923 => 1.4619, std.dev.: 0.0842)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -22.09% (0.7958 => 0.6200, std.dev.: 0.0115)
MultiSource/Applications/treecc/treecc: -20.50% (2.9273 => 2.3271, std.dev.: 0.0102)
MultiSource/Applications/spiff/spiff: -16.48% (1.1262 => 0.9406, std.dev.: 0.0088)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -16.27% (1.6643 => 1.3935, std.dev.: 0.0831)
MultiSource/Applications/SPASS/SPASS: -15.47% (20.3059 => 17.1651, std.dev.: 0.7234)
MultiSource/Applications/aha/aha: -15.32% (0.1514 => 0.1282, std.dev.: 0.0079)
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -15.21% (0.1131 => 0.0959, std.dev.: 0.0008)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -15.18% (0.1034 => 0.0877, std.dev.: 0.0009)
SingleSource/UnitTests/Vectorizer/gcc-loops: -15.17% (0.6670 => 0.5658, std.dev.: 0.0275)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -14.09% (0.0866 => 0.0744, std.dev.: 0.0004)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -13.12% (1.6696 => 1.4505, std.dev.: 0.0052)
MultiSource/Applications/d/make_dparser: -12.91% (4.2616 => 3.7114, std.dev.: 0.0722)
SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -12.81% (0.1077 => 0.0939, std.dev.: 0.0026)
SingleSource/Benchmarks/SmallPT/smallpt: -12.41% (0.1652 => 0.1447, std.dev.: 0.0027)
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -11.97% (0.2581 => 0.2272, std.dev.: 0.0059)
MultiSource/Applications/siod/siod: -11.83% (2.8619 => 2.5233, std.dev.: 0.0643)
MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -11.62% (1.6098 => 1.4228, std.dev.: 0.0698)
MultiSource/Applications/ClamAV/clamscan: -11.24% (19.4809 => 17.2906, std.dev.: 0.6385)
MultiSource/Applications/SIBsim4/SIBsim4: -11.04% (1.8310 => 1.6288, std.dev.: 0.0285)
SingleSource/Benchmarks/Shootout-C++/fibo: -10.98% (0.2377 => 0.2116, std.dev.: 0.0090)
MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -10.84% (1.5861 => 1.4141, std.dev.: 0.0244)
MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -10.40% (1.6590 => 1.4865, std.dev.: 0.0411)
MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -10.14% (1.6238 => 1.4592, std.dev.: 0.0137)
MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -9.63% (1.5329 => 1.3853, std.dev.: 0.0509)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -9.62% (0.1112 => 0.1005, std.dev.: 0.0017)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -9.51% (16.8821 => 15.2771, std.dev.: 0.1062)
MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -9.44% (1.5650 => 1.4173, std.dev.: 0.0124)
SingleSource/Benchmarks/Shootout-C++/lists1: -9.28% (0.3761 => 0.3412, std.dev.: 0.0134)
MultiSource/Applications/JM/lencod/lencod: -9.17% (19.0801 => 17.3296, std.dev.: 0.0988)
MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -9.04% (0.1902 => 0.1730, std.dev.: 0.0022)
MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -8.48% (1.6967 => 1.5529, std.dev.: 0.0341)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -7.86% (2.1238 => 1.9569, std.dev.: 0.0051)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.99% (5.1618 => 4.8012, std.dev.: 0.0130)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.22% (0.7203 => 0.6899, std.dev.: 0.0052)
MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.29% (0.3401 => 0.3289, std.dev.: 0.0028)
MultiSource/Benchmarks/Ptrdist/bc/bc: -2.93% (1.3674 => 1.3273, std.dev.: 0.0047)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/BitBench/uuencode/uuencode: -57.84% (0.0408 => 0.0172, std.dev.: 0.0033)
MultiSource/Benchmarks/BitBench/uudecode/uudecode: -36.84% (0.1360 => 0.0859, std.dev.: 0.0007)
MultiSource/Applications/SPASS/SPASS: -28.26% (11.4999 => 8.2502, std.dev.: 0.9186)
SingleSource/Benchmarks/Shootout/nestedloop: -19.56% (0.1718 => 0.1382, std.dev.: 0.0034)
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -13.58% (0.1708 => 0.1476, std.dev.: 0.0019)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -11.97% (0.3325 => 0.2927, std.dev.: 0.0003)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.86% (0.3544 => 0.3159, std.dev.: 0.0014)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -8.20% (40.2867 => 36.9841, std.dev.: 0.6174)
MultiSource/Benchmarks/BitBench/drop3/drop3: -6.58% (0.4966 => 0.4639, std.dev.: 0.0011)
SingleSource/Benchmarks/Dhrystone/fldry: -5.66% (0.7063 => 0.6663, std.dev.: 0.0064)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -4.47% (2.5102 => 2.3979, std.dev.: 0.0390)
SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -3.30% (1.6667 => 1.6117, std.dev.: 0.0035)
MultiSource/Applications/aha/aha: -2.32% (3.6536 => 3.5688, std.dev.: 0.0100)
MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.31% (5.1076 => 4.9896, std.dev.: 0.0391)
MultiSource/Benchmarks/BitBench/five11/five11: -1.65% (5.7151 => 5.6210, std.dev.: 0.0047)
MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.56% (5.0937 => 5.0144, std.dev.: 0.0207)
MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.30% (6.0538 => 5.9751, std.dev.: 0.0101)
MultiSource/Applications/spiff/spiff: -1.05% (2.8677 => 2.8376, std.dev.: 0.0057)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
MultiSource/Benchmarks/mediabench/gsm/toast/toast
MultiSource/Applications/ClamAV/clamscan: 1.27% (0.1340 => 0.1357, std.dev.: 0.0055)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -0.04% (0.2753 => 0.2752, std.dev.: 0.0002)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.36% (0.0278 => 0.0277, std.dev.: 0.0065)
================================
Run-Over-Baseline Changes Detail
================================
New Failures - Execution Time
-----------------------------
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
MultiSource/Benchmarks/mediabench/gsm/toast/toast
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.17% (0.2813 => 0.2752, std.dev.: 0.0002)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.71% (0.0345 => 0.0277, std.dev.: 0.0065)
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Benchmarks/FreeBench/distray/distray: 15.20% (0.1033 => 0.1190, std.dev.: 0.0022)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 67.32% (3.7285 => 6.2385, std.dev.: 0.1463)
SingleSource/Benchmarks/Shootout-C++/matrix: 48.20% (2.8867 => 4.2781, std.dev.: 0.0675)
MultiSource/Benchmarks/FreeBench/neural/neural: 38.54% (0.3171 => 0.4393, std.dev.: 0.0333)
MultiSource/Benchmarks/Prolangs-C++/city/city: 27.32% (0.0366 => 0.0466, std.dev.: 0.0006)
SingleSource/Benchmarks/Shootout/hash: 23.80% (4.1846 => 5.1807, std.dev.: 0.3558)
SingleSource/Benchmarks/Misc/pi: 23.17% (1.9835 => 2.4430, std.dev.: 0.0349)
MultiSource/Applications/lambda-0_1_3/lambda: 12.73% (7.0762 => 7.9770, std.dev.: 0.0390)
SingleSource/Benchmarks/Linpack/linpack-pc: 9.55% (48.3256 => 52.9396, std.dev.: 0.0603)
MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.82% (5.4910 => 5.9751, std.dev.: 0.0101)
MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.77% (3.4085 => 3.6732, std.dev.: 0.0060)
MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.37% (3.2027 => 3.4388, std.dev.: 0.0172)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 6.84% (5.5008 => 5.8768, std.dev.: 0.0650)
MultiSource/Benchmarks/FreeBench/mason/mason: 6.40% (0.2799 => 0.2978, std.dev.: 0.0062)
MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.07% (5.1471 => 5.4079, std.dev.: 0.0908)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.19% (4.3151 => 4.4960, std.dev.: 0.0492)
SingleSource/Benchmarks/Misc/whetstone: 3.98% (3.4559 => 3.5936, std.dev.: 0.0122)
SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.54% (6.1245 => 6.3414, std.dev.: 0.0485)
SingleSource/Benchmarks/CoyoteBench/huffbench: 3.23% (25.0200 => 25.8273, std.dev.: 0.0903)
SingleSource/Benchmarks/Shootout-C++/hash2: 2.99% (3.3877 => 3.4891, std.dev.: 0.0251)
MultiSource/Applications/spiff/spiff: 2.78% (2.7609 => 2.8376, std.dev.: 0.0057)
SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.75% (1.3104 => 1.3465, std.dev.: 0.0107)
SingleSource/Benchmarks/Shootout/matrix: 2.24% (1.7358 => 1.7747, std.dev.: 0.0103)
MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.40% (5.9307 => 6.0138, std.dev.: 0.0294)
MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.38% (4.9040 => 4.9719, std.dev.: 0.0073)
SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.27% (1.5957 => 1.6160, std.dev.: 0.0057)
MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.10% (1.4398 => 1.4557, std.dev.: 0.0040)
SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.01% (1.5956 => 1.6117, std.dev.: 0.0035)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Benchmarks/Olden/power/power: -34.11% (0.2237 => 0.1474, std.dev.: 0.0163)
MultiSource/Benchmarks/Olden/bisort/bisort: -31.72% (0.1072 => 0.0732, std.dev.: 0.0016)
MultiSource/Benchmarks/Olden/perimeter/perimeter: -21.01% (0.1114 => 0.0880, std.dev.: 0.0035)
MultiSource/Benchmarks/Olden/health/health: -20.42% (0.1993 => 0.1586, std.dev.: 0.0014)
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -18.64% (0.1518 => 0.1235, std.dev.: 0.0020)
MultiSource/Benchmarks/Olden/voronoi/voronoi: -18.18% (0.3576 => 0.2926, std.dev.: 0.0120)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -12.57% (0.7091 => 0.6200, std.dev.: 0.0115)
MultiSource/Applications/JM/ldecod/ldecod: -11.62% (8.6720 => 7.6641, std.dev.: 0.1269)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -11.34% (0.1870 => 0.1658, std.dev.: 0.0069)
MultiSource/Applications/ClamAV/clamscan: -10.94% (19.4145 => 17.2906, std.dev.: 0.6385)
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -10.90% (0.3073 => 0.2738, std.dev.: 0.0086)
MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -10.01% (0.3655 => 0.3289, std.dev.: 0.0028)
MultiSource/Applications/siod/siod: -7.06% (2.7150 => 2.5233, std.dev.: 0.0643)
MultiSource/Applications/SIBsim4/SIBsim4: -6.72% (1.7461 => 1.6288, std.dev.: 0.0285)
MultiSource/Applications/JM/lencod/lencod: -6.34% (18.5029 => 17.3296, std.dev.: 0.0988)
MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.34% (1.4783 => 1.4141, std.dev.: 0.0244)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.03% (0.7189 => 0.6899, std.dev.: 0.0052)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -3.74% (5.2851 => 5.0873, std.dev.: 0.0142)
MultiSource/Benchmarks/Ptrdist/bc/bc: -3.68% (1.3780 => 1.3273, std.dev.: 0.0047)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.91% (1.4940 => 1.4505, std.dev.: 0.0052)
MultiSource/Applications/treecc/treecc: -1.61% (2.3651 => 2.3271, std.dev.: 0.0102)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.01% (2.1022 => 1.4293, std.dev.: 0.0226)
MultiSource/Benchmarks/MallocBench/gs/gs: -29.44% (0.1189 => 0.0839, std.dev.: 0.0077)
MultiSource/Benchmarks/Olden/bisort/bisort: -29.21% (0.9545 => 0.6757, std.dev.: 0.0335)
MultiSource/Applications/viterbi/viterbi: -27.37% (3.4923 => 2.5365, std.dev.: 0.0305)
MultiSource/Applications/JM/ldecod/ldecod: -27.01% (0.0859 => 0.0627, std.dev.: 0.0015)
MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.60% (6.9552 => 5.2442, std.dev.: 0.3451)
SingleSource/Benchmarks/Misc/perlin: -21.43% (4.5989 => 3.6133, std.dev.: 0.0459)
SingleSource/Benchmarks/Misc/mandel: -14.15% (1.1996 => 1.0298, std.dev.: 0.0250)
MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.43% (0.3557 => 0.3115, std.dev.: 0.0041)
MultiSource/Applications/lua/lua: -11.86% (31.0707 => 27.3853, std.dev.: 0.9711)
MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -9.95% (6.2627 => 5.6396, std.dev.: 0.0569)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.34% (0.5173 => 0.4690, std.dev.: 0.0016)
MultiSource/Benchmarks/Olden/health/health: -7.17% (0.3556 => 0.3301, std.dev.: 0.0066)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.29% (1.7207 => 1.6297, std.dev.: 0.0190)
MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.28% (0.3479 => 0.3330, std.dev.: 0.0009)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.14% (1.1024 => 1.0568, std.dev.: 0.0052)
SingleSource/Benchmarks/Misc/fbench: -4.03% (4.9602 => 4.7602, std.dev.: 0.0083)
MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.88% (2.7049 => 2.5999, std.dev.: 0.0346)
MultiSource/Benchmarks/BitBench/drop3/drop3: -3.01% (0.4783 => 0.4639, std.dev.: 0.0011)
MultiSource/Applications/sgefa/sgefa: -2.83% (1.4030 => 1.3633, std.dev.: 0.0067)
SingleSource/Benchmarks/Misc/ReedSolomon: -2.26% (8.6172 => 8.4227, std.dev.: 0.0201)
SingleSource/Benchmarks/CoyoteBench/almabench: -2.03% (34.8438 => 34.1382, std.dev.: 0.0984)
MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.02% (6.1482 => 6.0240, std.dev.: 0.0044)
MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.56% (1.2012 => 1.1825, std.dev.: 0.0002)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: -1.52% (0.1378 => 0.1357, std.dev.: 0.0055)
Report Time: 0.67s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130806/31eb032a/attachment.html>
More information about the llvm-testresults
mailing list