[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Fri Sep 20 16:06:50 PDT 2013
http://llvm.org/perf/db_default/v4/nts/15504?compare_to=15500&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16
Comparing:
Run: 15504, Order: 191105, Start Time: 2013-09-20 21:16:51, End Time: 2013-09-20 23:09:32
To: 15500, Order: 191100, Start Time: 2013-09-20 19:03:56, End Time: 2013-09-20 20:48:40
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18
===============
Tests Summary
===============
Performance Regressions: 62 (65 on baseline)
Performance Improvements: 11 (13 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1034 (1029 on baseline)
Total Tests: 1108
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Benchmarks/McGill/misr: 81.63% (0.0675 => 0.1226, std.dev.: 0.0018)
SingleSource/Benchmarks/Misc/flops-6: 76.92% (0.0312 => 0.0552, std.dev.: 0.0033)
SingleSource/Benchmarks/Misc/flops-3: 76.17% (0.0298 => 0.0525, std.dev.: 0.0016)
MultiSource/Benchmarks/Prolangs-C++/family/family: 69.87% (0.0458 => 0.0778, std.dev.: 0.0079)
SingleSource/Benchmarks/Misc/mandel-2: 66.97% (0.0333 => 0.0556, std.dev.: 0.0045)
SingleSource/Benchmarks/Misc/whetstone: 65.63% (0.0896 => 0.1484, std.dev.: 0.0125)
SingleSource/Benchmarks/Shootout-C++/strcat: 53.22% (0.2048 => 0.3138, std.dev.: 0.0120)
SingleSource/Benchmarks/Misc/himenobmtxpa: 43.18% (0.2038 => 0.2918, std.dev.: 0.0181)
SingleSource/Benchmarks/Stanford/RealMM: 42.20% (0.0455 => 0.0647, std.dev.: 0.0074)
SingleSource/Benchmarks/Shootout-C++/matrix: 34.55% (0.2388 => 0.3213, std.dev.: 0.0313)
SingleSource/Benchmarks/Misc/oourafft: 28.03% (0.2355 => 0.3015, std.dev.: 0.0103)
SingleSource/Benchmarks/Stanford/Treesort: 25.97% (0.0462 => 0.0582, std.dev.: 0.0033)
MultiSource/Benchmarks/Prolangs-C++/city/city: 20.26% (1.4963 => 1.7995, std.dev.: 0.0888)
SingleSource/Benchmarks/Misc/perlin: 19.10% (0.0597 => 0.0711, std.dev.: 0.0039)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 16.22% (1.3017 => 1.5129, std.dev.: 0.0388)
MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.99% (1.2329 => 1.4300, std.dev.: 0.0379)
SingleSource/Benchmarks/Misc-C++-EH/spirit: 13.31% (6.1634 => 6.9836, std.dev.: 0.0574)
SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 12.12% (0.0833 => 0.0934, std.dev.: 0.0007)
SingleSource/Benchmarks/McGill/exptree: 11.70% (0.0949 => 0.1060, std.dev.: 0.0008)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.62% (1.2910 => 1.4410, std.dev.: 0.0424)
MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.43% (1.1998 => 1.3369, std.dev.: 0.0499)
MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 11.39% (1.2770 => 1.4225, std.dev.: 0.0426)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.30% (1.2704 => 1.4139, std.dev.: 0.0107)
MultiSource/Benchmarks/PAQ8p/paq8p: 11.29% (2.5788 => 2.8700, std.dev.: 0.0415)
MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.25% (1.3186 => 1.4670, std.dev.: 0.0419)
MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 11.19% (1.3408 => 1.4908, std.dev.: 0.0386)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.96% (25.2599 => 28.0293, std.dev.: 0.4430)
SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.85% (0.3807 => 0.4220, std.dev.: 0.0069)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.79% (4.1802 => 4.6314, std.dev.: 0.0382)
MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.45% (1.3097 => 1.4465, std.dev.: 0.0296)
MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.09% (1.2603 => 1.3875, std.dev.: 0.0114)
MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.78% (0.2944 => 0.3232, std.dev.: 0.0048)
SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.62% (0.3388 => 0.3714, std.dev.: 0.0013)
SingleSource/Benchmarks/Shootout-C++/objinst: 9.47% (0.2132 => 0.2334, std.dev.: 0.0022)
SingleSource/Benchmarks/Shootout-C++/heapsort: 8.99% (0.2136 => 0.2328, std.dev.: 0.0033)
SingleSource/Benchmarks/Misc/ReedSolomon: 8.38% (0.2219 => 0.2405, std.dev.: 0.0025)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.04% (0.9035 => 0.9581, std.dev.: 0.0196)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Stanford/Bubblesort: 73.99% (0.0296 => 0.0515, std.dev.: 0.0027)
SingleSource/Benchmarks/Shootout-C++/heapsort: 65.22% (2.8443 => 4.6993, std.dev.: 0.0923)
SingleSource/Benchmarks/Stanford/Quicksort: 48.93% (0.0233 => 0.0347, std.dev.: 0.0029)
SingleSource/Benchmarks/CoyoteBench/lpbench: 29.44% (4.0558 => 5.2500, std.dev.: 0.0904)
SingleSource/Benchmarks/Shootout-C++/ackermann: 17.00% (3.4972 => 4.0918, std.dev.: 0.2046)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 15.03% (1.0723 => 1.2335, std.dev.: 0.0357)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 14.11% (2.1106 => 2.4085, std.dev.: 0.0515)
SingleSource/Benchmarks/Shootout-C++/lists1: 13.80% (0.5886 => 0.6698, std.dev.: 0.0086)
SingleSource/Benchmarks/BenchmarkGame/recursive: 10.46% (2.2960 => 2.5362, std.dev.: 0.0330)
SingleSource/Benchmarks/McGill/chomp: 9.76% (1.0229 => 1.1227, std.dev.: 0.0333)
SingleSource/Benchmarks/Misc/salsa20: 9.35% (7.4941 => 8.1947, std.dev.: 0.0350)
MultiSource/Benchmarks/Ptrdist/anagram/anagram: 9.12% (1.2500 => 1.3640, std.dev.: 0.0397)
SingleSource/Benchmarks/Linpack/linpack-pc: 8.90% (46.9492 => 51.1300, std.dev.: 1.3371)
SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 7.50% (2.6576 => 2.8569, std.dev.: 0.0256)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.86% (2.9407 => 3.1425, std.dev.: 0.0350)
MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.68% (5.9013 => 6.2365, std.dev.: 0.0526)
SingleSource/Benchmarks/Misc/ffbench: 5.17% (1.3988 => 1.4711, std.dev.: 0.0159)
MultiSource/Benchmarks/PAQ8p/paq8p: 4.44% (98.5990 => 102.9762, std.dev.: 1.0096)
SingleSource/Benchmarks/Misc/himenobmtxpa: 4.03% (4.0522 => 4.2155, std.dev.: 0.0080)
SingleSource/Benchmarks/McGill/queens: 3.53% (1.7409 => 1.8023, std.dev.: 0.0061)
MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.46% (6.6084 => 6.8372, std.dev.: 0.0201)
SingleSource/Benchmarks/Misc/flops: 3.01% (9.3596 => 9.6413, std.dev.: 0.0199)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.54% (5.0928 => 5.2221, std.dev.: 0.0147)
SingleSource/Benchmarks/Misc/fbench: 2.24% (4.9081 => 5.0178, std.dev.: 0.0182)
MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.05% (5.7891 => 5.8498, std.dev.: 0.0193)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/Misc/pi: -34.62% (2.6111 => 1.7072, std.dev.: 0.2516)
SingleSource/Benchmarks/Shootout-C++/matrix: -9.01% (3.1381 => 2.8555, std.dev.: 0.0414)
SingleSource/Benchmarks/Misc/ReedSolomon: -4.96% (8.9593 => 8.5151, std.dev.: 0.0123)
MultiSource/Benchmarks/mafft/pairlocalalign: -4.29% (46.2945 => 44.3074, std.dev.: 0.4655)
MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.53% (5.4368 => 5.2447, std.dev.: 0.0338)
MultiSource/Applications/hexxagon/hexxagon: -3.28% (15.1109 => 14.6148, std.dev.: 0.1036)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.82% (5.9963 => 5.8273, std.dev.: 0.0551)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -2.22% (3.2167 => 3.1452, std.dev.: 0.0158)
MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.20% (5.2509 => 5.1356, std.dev.: 0.0413)
MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.76% (12.1382 => 11.9248, std.dev.: 0.0220)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -1.07% (6.7764 => 6.7036, std.dev.: 0.0105)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: -4.29% (0.1353 => 0.1295, std.dev.: 0.0027)
================================
Run-Over-Baseline Changes Detail
================================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Benchmarks/McGill/misr: 81.36% (0.0676 => 0.1226, std.dev.: 0.0018)
SingleSource/Benchmarks/Misc/flops-3: 81.03% (0.0290 => 0.0525, std.dev.: 0.0016)
SingleSource/Benchmarks/Misc/flops-6: 75.24% (0.0315 => 0.0552, std.dev.: 0.0033)
MultiSource/Benchmarks/Prolangs-C++/family/family: 72.12% (0.0452 => 0.0778, std.dev.: 0.0079)
SingleSource/Benchmarks/Misc/whetstone: 69.79% (0.0874 => 0.1484, std.dev.: 0.0125)
SingleSource/Benchmarks/Misc/mandel-2: 64.99% (0.0337 => 0.0556, std.dev.: 0.0045)
SingleSource/Benchmarks/Shootout-C++/strcat: 55.27% (0.2021 => 0.3138, std.dev.: 0.0120)
SingleSource/Benchmarks/Misc/himenobmtxpa: 46.71% (0.1989 => 0.2918, std.dev.: 0.0181)
SingleSource/Benchmarks/Stanford/RealMM: 43.78% (0.0450 => 0.0647, std.dev.: 0.0074)
SingleSource/Benchmarks/Misc/oourafft: 31.43% (0.2294 => 0.3015, std.dev.: 0.0103)
SingleSource/Benchmarks/Stanford/Treesort: 28.19% (0.0454 => 0.0582, std.dev.: 0.0033)
SingleSource/Benchmarks/Misc/perlin: 23.01% (0.0578 => 0.0711, std.dev.: 0.0039)
MultiSource/Benchmarks/Prolangs-C++/city/city: 21.65% (1.4792 => 1.7995, std.dev.: 0.0888)
MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 18.32% (1.2086 => 1.4300, std.dev.: 0.0379)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 16.00% (1.3042 => 1.5129, std.dev.: 0.0388)
SingleSource/Benchmarks/Misc-C++-EH/spirit: 15.85% (6.0284 => 6.9836, std.dev.: 0.0574)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 14.65% (4.0397 => 4.6314, std.dev.: 0.0382)
SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 13.90% (0.0820 => 0.0934, std.dev.: 0.0007)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 13.88% (24.6139 => 28.0293, std.dev.: 0.4430)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.51% (1.2695 => 1.4410, std.dev.: 0.0424)
MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 13.44% (1.2932 => 1.4670, std.dev.: 0.0419)
MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 12.36% (1.2660 => 1.4225, std.dev.: 0.0426)
MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 12.28% (1.3278 => 1.4908, std.dev.: 0.0386)
SingleSource/Benchmarks/McGill/exptree: 11.93% (0.0947 => 0.1060, std.dev.: 0.0008)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.87% (1.2639 => 1.4139, std.dev.: 0.0107)
MultiSource/Benchmarks/PAQ8p/paq8p: 11.82% (2.5666 => 2.8700, std.dev.: 0.0415)
SingleSource/Benchmarks/Shootout-C++/heapsort: 11.76% (0.2083 => 0.2328, std.dev.: 0.0033)
MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.72% (1.2948 => 1.4465, std.dev.: 0.0296)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 11.45% (1.2523 => 1.3957, std.dev.: 0.0515)
MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.34% (1.2007 => 1.3369, std.dev.: 0.0499)
MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.14% (0.2908 => 0.3232, std.dev.: 0.0048)
MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 11.05% (1.2494 => 1.3875, std.dev.: 0.0114)
SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.03% (0.3345 => 0.3714, std.dev.: 0.0013)
MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.95% (1.3499 => 1.4977, std.dev.: 0.0529)
SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.19% (0.5046 => 0.5560, std.dev.: 0.0178)
SingleSource/Benchmarks/Misc/ReedSolomon: 10.17% (0.2183 => 0.2405, std.dev.: 0.0025)
SingleSource/Benchmarks/Shootout-C++/objinst: 10.15% (0.2119 => 0.2334, std.dev.: 0.0022)
SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.98% (0.3837 => 0.4220, std.dev.: 0.0069)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.85% (0.8802 => 0.9581, std.dev.: 0.0196)
MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.24% (1.2981 => 1.3661, std.dev.: 0.0246)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.47% (1.0952 => 1.1223, std.dev.: 0.0052)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Stanford/Bubblesort: 84.59% (0.0279 => 0.0515, std.dev.: 0.0027)
SingleSource/Benchmarks/Shootout-C++/heapsort: 56.07% (3.0111 => 4.6993, std.dev.: 0.0923)
SingleSource/Benchmarks/CoyoteBench/lpbench: 28.04% (4.1004 => 5.2500, std.dev.: 0.0904)
MultiSource/Benchmarks/Prolangs-C++/primes/primes: 14.23% (0.8273 => 0.9450, std.dev.: 0.0421)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 14.09% (2.1111 => 2.4085, std.dev.: 0.0515)
SingleSource/Benchmarks/Shootout-C++/lists1: 12.53% (0.5952 => 0.6698, std.dev.: 0.0086)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 11.38% (1.1075 => 1.2335, std.dev.: 0.0357)
SingleSource/Benchmarks/McGill/chomp: 10.49% (1.0161 => 1.1227, std.dev.: 0.0333)
MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.98% (1.2516 => 1.3640, std.dev.: 0.0397)
SingleSource/Benchmarks/BenchmarkGame/recursive: 8.55% (2.3365 => 2.5362, std.dev.: 0.0330)
SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 7.49% (2.6579 => 2.8569, std.dev.: 0.0256)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.99% (2.9372 => 3.1425, std.dev.: 0.0350)
MultiSource/Benchmarks/PAQ8p/paq8p: 6.40% (96.7834 => 102.9762, std.dev.: 1.0096)
MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.59% (5.9061 => 6.2365, std.dev.: 0.0526)
SingleSource/Benchmarks/Misc/salsa20: 5.11% (7.7964 => 8.1947, std.dev.: 0.0350)
SingleSource/Benchmarks/Misc/ffbench: 4.85% (1.4030 => 1.4711, std.dev.: 0.0159)
SingleSource/Benchmarks/Misc/himenobmtxpa: 3.84% (4.0596 => 4.2155, std.dev.: 0.0080)
MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.61% (6.5990 => 6.8372, std.dev.: 0.0201)
SingleSource/Benchmarks/McGill/queens: 3.27% (1.7452 => 1.8023, std.dev.: 0.0061)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.79% (0.3836 => 0.3943, std.dev.: 0.0017)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.43% (5.0980 => 5.2221, std.dev.: 0.0147)
SingleSource/Benchmarks/Misc/flops: 2.10% (9.4433 => 9.6413, std.dev.: 0.0199)
SingleSource/Benchmarks/Misc/fbench: 1.34% (4.9516 => 5.0178, std.dev.: 0.0182)
MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.06% (5.7884 => 5.8498, std.dev.: 0.0193)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/UnitTests/Vector/Altivec/casts: -20.23% (0.1483 => 0.1183, std.dev.: 0.0057)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/FreeBench/neural/neural: -54.36% (0.5226 => 0.2385, std.dev.: 0.0096)
MultiSource/Applications/sgefa/sgefa: -47.05% (1.5790 => 0.8361, std.dev.: 0.0422)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.73% (15.9508 => 13.2817, std.dev.: 0.1633)
MultiSource/Benchmarks/mafft/pairlocalalign: -11.44% (50.0284 => 44.3074, std.dev.: 0.4655)
SingleSource/UnitTests/Vectorizer/gcc-loops: -10.94% (20.8247 => 18.5467, std.dev.: 0.1938)
SingleSource/Benchmarks/Linpack/linpack-pc: -10.67% (57.2347 => 51.1300, std.dev.: 1.3371)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.02% (3.4956 => 3.1452, std.dev.: 0.0158)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.81% (4.3592 => 4.1930, std.dev.: 0.0153)
MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.72% (5.4473 => 5.2447, std.dev.: 0.0338)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.77% (17.1431 => 16.6677, std.dev.: 0.0241)
MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.03% (5.2422 => 5.1356, std.dev.: 0.0413)
SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.62% (3.8582 => 3.7956, std.dev.: 0.0219)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: -3.93% (0.1348 => 0.1295, std.dev.: 0.0027)
Report Time: 0.70s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130920/841f7098/attachment.html>
More information about the llvm-testresults
mailing list