[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Fri Sep 27 11:12:38 PDT 2013
http://llvm.org/perf/db_default/v4/nts/15733?compare_to=15730&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16
Comparing:
Run: 15733, Order: 191526, Start Time: 2013-09-27 16:24:53, End Time: 2013-09-27 18:15:27
To: 15730, Order: 191521, Start Time: 2013-09-27 14:11:32, End Time: 2013-09-27 15:59:28
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18
===============
Tests Summary
===============
Performance Regressions: 56 (61 on baseline)
Performance Improvements: 11 (20 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1040 (1026 on baseline)
Total Tests: 1108
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Benchmarks/Misc/pi: 73.56% (0.0208 => 0.0361, std.dev.: 0.0019)
SingleSource/Benchmarks/Shootout/heapsort: 60.13% (0.0449 => 0.0719, std.dev.: 0.0101)
SingleSource/Benchmarks/Shootout/nestedloop: 58.39% (0.0322 => 0.0510, std.dev.: 0.0051)
SingleSource/Benchmarks/Shootout/ackermann: 54.04% (0.0235 => 0.0362, std.dev.: 0.0042)
SingleSource/Benchmarks/Misc/lowercase: 48.98% (0.0245 => 0.0365, std.dev.: 0.0038)
MultiSource/Applications/spiff/spiff: 47.85% (0.9305 => 1.3757, std.dev.: 0.0310)
MultiSource/Applications/ALAC/decode/alacconvert-decode: 42.74% (1.1998 => 1.7126, std.dev.: 0.0500)
MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 35.81% (0.2262 => 0.3072, std.dev.: 0.0190)
MultiSource/Applications/treecc/treecc: 26.14% (2.3175 => 2.9232, std.dev.: 0.1795)
MultiSource/Applications/ALAC/encode/alacconvert-encode: 25.11% (1.1983 => 1.4992, std.dev.: 0.1003)
MultiSource/Applications/SPASS/SPASS: 18.10% (16.7793 => 19.8160, std.dev.: 0.2021)
MultiSource/Applications/JM/lencod/lencod: 18.08% (17.1598 => 20.2618, std.dev.: 0.0447)
MultiSource/Applications/d/make_dparser: 17.76% (3.6077 => 4.2485, std.dev.: 0.1233)
MultiSource/Applications/aha/aha: 16.07% (0.1282 => 0.1488, std.dev.: 0.0032)
SingleSource/Benchmarks/Shootout-C++/ary3: 16.03% (0.2557 => 0.2967, std.dev.: 0.0019)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.52% (1.3201 => 1.5118, std.dev.: 0.0596)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.07% (1.2574 => 1.4343, std.dev.: 0.0115)
MultiSource/Applications/ClamAV/clamscan: 13.89% (16.9255 => 19.2763, std.dev.: 0.6284)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 13.88% (1.2360 => 1.4076, std.dev.: 0.0326)
MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.50% (1.4567 => 1.6533, std.dev.: 0.0354)
MultiSource/Applications/siod/siod: 13.45% (2.5749 => 2.9213, std.dev.: 0.0522)
MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.54% (1.2553 => 1.4002, std.dev.: 0.0086)
MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.53% (1.3135 => 1.4649, std.dev.: 0.0422)
MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.17% (1.3683 => 1.5212, std.dev.: 0.0031)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.75% (1.2704 => 1.4070, std.dev.: 0.0310)
MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.43% (1.3199 => 1.4575, std.dev.: 0.0020)
SingleSource/Benchmarks/Shootout-C++/EH/except: 9.45% (0.2106 => 0.2305, std.dev.: 0.0016)
MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.97% (1.2446 => 1.3563, std.dev.: 0.0093)
SingleSource/Benchmarks/Shootout-C++/ackermann: 8.56% (0.1916 => 0.2080, std.dev.: 0.0010)
SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.63% (0.1954 => 0.2103, std.dev.: 0.0041)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.74% (25.3583 => 27.0686, std.dev.: 0.5349)
SingleSource/Benchmarks/Linpack/linpack-pc: 3.78% (0.2987 => 0.3100, std.dev.: 0.0031)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Shootout/ackermann: 464.00% (0.0025 => 0.0141, std.dev.: 0.0006)
SingleSource/Benchmarks/Shootout-C++/ary2: 79.69% (0.0128 => 0.0230, std.dev.: 0.0034)
SingleSource/Benchmarks/Linpack/linpack-pc: 76.41% (28.9867 => 51.1362, std.dev.: 1.1676)
SingleSource/Benchmarks/Shootout/heapsort: 68.63% (2.9449 => 4.9659, std.dev.: 0.0113)
SingleSource/Benchmarks/Shootout/ary3: 24.57% (4.6828 => 5.8335, std.dev.: 0.1343)
SingleSource/Benchmarks/Shootout-C++/fibo: 11.05% (4.9264 => 5.4709, std.dev.: 0.0428)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 10.96% (40.7890 => 45.2605, std.dev.: 0.2284)
SingleSource/Benchmarks/Shootout/hash: 10.70% (5.1582 => 5.7103, std.dev.: 0.0410)
MultiSource/Benchmarks/BitBench/drop3/drop3: 9.55% (0.4555 => 0.4990, std.dev.: 0.0036)
MultiSource/Applications/sgefa/sgefa: 7.30% (0.8408 => 0.9022, std.dev.: 0.0065)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.68% (60.7377 => 64.1886, std.dev.: 0.7100)
MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.53% (6.5569 => 6.8538, std.dev.: 0.1033)
MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.93% (2.1240 => 2.2074, std.dev.: 0.0029)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.61% (5.0929 => 5.2770, std.dev.: 0.0101)
SingleSource/Benchmarks/Misc/himenobmtxpa: 3.51% (4.0716 => 4.2146, std.dev.: 0.0118)
MultiSource/Applications/siod/siod: 2.46% (3.6311 => 3.7204, std.dev.: 0.0181)
SingleSource/Benchmarks/Misc/flops: 2.40% (9.3504 => 9.5745, std.dev.: 0.0284)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.32% (5.7764 => 5.9103, std.dev.: 0.0385)
SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.40% (1.5970 => 1.6194, std.dev.: 0.0010)
MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.39% (5.7907 => 5.8714, std.dev.: 0.0031)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.36% (2.3857 => 2.4182, std.dev.: 0.0108)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.36% (2.4610 => 2.4945, std.dev.: 0.0113)
SingleSource/Benchmarks/CoyoteBench/almabench: 1.13% (35.0996 => 35.4950, std.dev.: 0.0301)
SingleSource/Benchmarks/Shootout-C++/sieve: 1.01% (3.4717 => 3.5067, std.dev.: 0.0080)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Benchmarks/Fhourstones/fhourstones: -10.85% (0.1927 => 0.1718, std.dev.: 0.0036)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/Misc/pi: -36.08% (2.6108 => 1.6689, std.dev.: 0.0168)
SingleSource/Benchmarks/Shootout/matrix: -16.53% (2.1116 => 1.7626, std.dev.: 0.0423)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.39% (0.3070 => 0.2843, std.dev.: 0.0002)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -7.31% (0.3993 => 0.3701, std.dev.: 0.0112)
SingleSource/Benchmarks/Shootout/lists: -4.41% (7.5105 => 7.1792, std.dev.: 0.0117)
MultiSource/Applications/spiff/spiff: -4.29% (2.9823 => 2.8545, std.dev.: 0.0466)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.13% (4.3255 => 4.1900, std.dev.: 0.0525)
SingleSource/Benchmarks/Shootout/sieve: -3.03% (7.2736 => 7.0531, std.dev.: 0.0384)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.98% (1.4967 => 1.4671, std.dev.: 0.0053)
MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.18% (6.6516 => 6.5732, std.dev.: 0.0115)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: 0.96% (0.1358 => 0.1371, std.dev.: 0.0146)
================================
Run-Over-Baseline Changes Detail
================================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Benchmarks/Misc/pi: 76.96% (0.0204 => 0.0361, std.dev.: 0.0019)
MultiSource/Applications/spiff/spiff: 54.38% (0.8911 => 1.3757, std.dev.: 0.0310)
SingleSource/Benchmarks/Shootout/nestedloop: 50.89% (0.0338 => 0.0510, std.dev.: 0.0051)
MultiSource/Applications/ALAC/decode/alacconvert-decode: 50.32% (1.1393 => 1.7126, std.dev.: 0.0500)
SingleSource/Benchmarks/Misc/lowercase: 50.21% (0.0243 => 0.0365, std.dev.: 0.0038)
SingleSource/Benchmarks/Shootout/ackermann: 47.15% (0.0246 => 0.0362, std.dev.: 0.0042)
MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 37.82% (0.2229 => 0.3072, std.dev.: 0.0190)
MultiSource/Applications/treecc/treecc: 29.83% (2.2516 => 2.9232, std.dev.: 0.1795)
MultiSource/Applications/ALAC/encode/alacconvert-encode: 29.46% (1.1580 => 1.4992, std.dev.: 0.1003)
MultiSource/Applications/SPASS/SPASS: 22.59% (16.1646 => 19.8160, std.dev.: 0.2021)
MultiSource/Applications/JM/lencod/lencod: 22.13% (16.5902 => 20.2618, std.dev.: 0.0447)
MultiSource/Applications/d/make_dparser: 21.52% (3.4962 => 4.2485, std.dev.: 0.1233)
MultiSource/Applications/siod/siod: 19.33% (2.4480 => 2.9213, std.dev.: 0.0522)
SingleSource/Benchmarks/Shootout-C++/ary3: 16.72% (0.2542 => 0.2967, std.dev.: 0.0019)
MultiSource/Applications/ClamAV/clamscan: 16.54% (16.5398 => 19.2763, std.dev.: 0.6284)
MultiSource/Applications/aha/aha: 16.34% (0.1279 => 0.1488, std.dev.: 0.0032)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 15.92% (1.3042 => 1.5118, std.dev.: 0.0596)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 14.91% (1.2250 => 1.4076, std.dev.: 0.0326)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 13.48% (1.2639 => 1.4343, std.dev.: 0.0115)
MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.25% (1.4599 => 1.6533, std.dev.: 0.0354)
MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.14% (1.2948 => 1.4649, std.dev.: 0.0422)
MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 12.70% (1.2932 => 1.4575, std.dev.: 0.0020)
MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.69% (1.3499 => 1.5212, std.dev.: 0.0031)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 12.35% (1.2523 => 1.4070, std.dev.: 0.0310)
MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 11.30% (1.3278 => 1.4779, std.dev.: 0.0510)
MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 11.16% (1.2201 => 1.3563, std.dev.: 0.0093)
MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.86% (1.2630 => 1.4002, std.dev.: 0.0086)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.97% (24.6139 => 27.0686, std.dev.: 0.5349)
SingleSource/Benchmarks/Shootout-C++/ackermann: 9.19% (0.1905 => 0.2080, std.dev.: 0.0010)
MultiSource/Benchmarks/Bullet/bullet: 8.87% (32.7552 => 35.6617, std.dev.: 0.8979)
SingleSource/Benchmarks/Shootout-C++/EH/except: 8.57% (0.2123 => 0.2305, std.dev.: 0.0016)
MultiSource/Benchmarks/Olden/tsp/tsp: 8.10% (0.1297 => 0.1402, std.dev.: 0.0016)
SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.85% (0.1950 => 0.2103, std.dev.: 0.0041)
MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.98% (1.3498 => 1.4440, std.dev.: 0.0350)
SingleSource/Benchmarks/Linpack/linpack-pc: 5.12% (0.2949 => 0.3100, std.dev.: 0.0031)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.37% (7.2661 => 7.4383, std.dev.: 0.0205)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.59% (1.0952 => 1.1126, std.dev.: 0.0038)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Shootout/ackermann: 642.11% (0.0019 => 0.0141, std.dev.: 0.0006)
SingleSource/Benchmarks/Shootout-C++/ary2: 78.29% (0.0129 => 0.0230, std.dev.: 0.0034)
SingleSource/Benchmarks/Shootout-C++/methcall: 63.53% (7.6426 => 12.4983, std.dev.: 0.0144)
SingleSource/Benchmarks/Shootout/heapsort: 38.33% (3.5900 => 4.9659, std.dev.: 0.0113)
SingleSource/Benchmarks/Shootout/ary3: 24.19% (4.6972 => 5.8335, std.dev.: 0.1343)
MultiSource/Benchmarks/FreeBench/pifft/pifft: 19.29% (0.1374 => 0.1639, std.dev.: 0.0023)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 11.59% (40.5588 => 45.2605, std.dev.: 0.2284)
SingleSource/Benchmarks/Shootout-C++/fibo: 10.68% (4.9428 => 5.4709, std.dev.: 0.0428)
SingleSource/Benchmarks/Shootout/hash: 9.79% (5.2009 => 5.7103, std.dev.: 0.0410)
SingleSource/UnitTests/Vector/multiplies: 6.71% (0.5561 => 0.5934, std.dev.: 0.0027)
MultiSource/Applications/lambda-0_1_3/lambda: 6.24% (8.1346 => 8.6420, std.dev.: 0.0253)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.73% (60.7119 => 64.1886, std.dev.: 0.7100)
MultiSource/Applications/siod/siod: 5.36% (3.5310 => 3.7204, std.dev.: 0.0181)
SingleSource/Benchmarks/Misc/himenobmtxpa: 3.82% (4.0596 => 4.2146, std.dev.: 0.0118)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.51% (5.0980 => 5.2770, std.dev.: 0.0101)
MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.80% (2.1472 => 2.2074, std.dev.: 0.0029)
MultiSource/Applications/hexxagon/hexxagon: 2.63% (14.7810 => 15.1697, std.dev.: 0.0649)
MultiSource/Benchmarks/Olden/power/power: 2.39% (1.2170 => 1.2461, std.dev.: 0.0017)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.33% (5.7757 => 5.9103, std.dev.: 0.0385)
SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.92% (3.8582 => 3.9322, std.dev.: 0.0019)
SingleSource/Benchmarks/SmallPT/smallpt: 1.61% (16.7972 => 17.0678, std.dev.: 0.0748)
MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.43% (5.7884 => 5.8714, std.dev.: 0.0031)
SingleSource/Benchmarks/Misc/flops: 1.39% (9.4433 => 9.5745, std.dev.: 0.0284)
SingleSource/Benchmarks/Misc/flops-8: 1.03% (2.5214 => 2.5474, std.dev.: 0.0094)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/UnitTests/Vector/Altivec/casts: -21.31% (0.1483 => 0.1167, std.dev.: 0.0019)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/FreeBench/neural/neural: -54.65% (0.5226 => 0.2370, std.dev.: 0.1061)
MultiSource/Applications/sgefa/sgefa: -42.86% (1.5790 => 0.9022, std.dev.: 0.0065)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -39.25% (0.0400 => 0.0243, std.dev.: 0.0030)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.99% (15.9508 => 13.2401, std.dev.: 0.2585)
SingleSource/UnitTests/Vectorizer/gcc-loops: -13.43% (20.8247 => 18.0279, std.dev.: 0.1953)
SingleSource/Benchmarks/Linpack/linpack-pc: -10.66% (57.2347 => 51.1362, std.dev.: 1.1676)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -9.94% (3.4956 => 3.1483, std.dev.: 0.0331)
MultiSource/Benchmarks/mafft/pairlocalalign: -7.60% (50.0284 => 46.2266, std.dev.: 0.3106)
MultiSource/Applications/JM/lencod/lencod: -5.12% (8.1785 => 7.7601, std.dev.: 0.0191)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.88% (4.3592 => 4.1900, std.dev.: 0.0525)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.55% (2.5938 => 2.5017, std.dev.: 0.0193)
MultiSource/Applications/SIBsim4/SIBsim4: -2.82% (3.7437 => 3.6383, std.dev.: 0.0083)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.73% (17.1431 => 16.6758, std.dev.: 0.0313)
SingleSource/Benchmarks/Shootout/lists: -2.59% (7.3703 => 7.1792, std.dev.: 0.0117)
SingleSource/Benchmarks/Shootout/sieve: -2.38% (7.2254 => 7.0531, std.dev.: 0.0384)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.52% (1.4898 => 1.4671, std.dev.: 0.0053)
MultiSource/Benchmarks/SciMark2-C/scimark2: -1.34% (89.7126 => 88.5060, std.dev.: 0.2921)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.4471 => 2.4182, std.dev.: 0.0108)
SingleSource/Benchmarks/Shootout-C++/hash2: -1.05% (3.6646 => 3.6263, std.dev.: 0.0109)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: 1.71% (0.1348 => 0.1371, std.dev.: 0.0146)
Report Time: 0.67s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130927/59d7369b/attachment.html>
More information about the llvm-testresults
mailing list