[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Thu Oct 24 16:39:37 PDT 2013
http://llvm.org/perf/db_default/v4/nts/16646?compare_to=16631&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16
Comparing:
Run: 16646, Order: 193371, Start Time: 2013-10-24 21:43:24, End Time: 2013-10-24 23:42:57
To: 16631, Order: 193313, Start Time: 2013-10-24 08:24:07, End Time: 2013-10-24 10:22:45
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18
===============
Tests Summary
===============
Performance Regressions: 55 (70 on baseline)
Performance Improvements: 15 (12 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1037 (1025 on baseline)
Total Tests: 1108
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 75.44% (0.0517 => 0.0907, std.dev.: 0.0044)
MultiSource/Benchmarks/Ptrdist/ft/ft: 69.42% (0.2371 => 0.4017, std.dev.: 0.0207)
MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 68.17% (0.0575 => 0.0967, std.dev.: 0.0101)
MultiSource/Benchmarks/Olden/em3d/em3d: 59.73% (0.2041 => 0.3260, std.dev.: 0.0244)
MultiSource/Benchmarks/FreeBench/neural/neural: 56.87% (0.1862 => 0.2921, std.dev.: 0.0120)
MultiSource/Benchmarks/MallocBench/gs/gs: 55.70% (4.7229 => 7.3536, std.dev.: 0.3437)
SingleSource/Benchmarks/Misc/perlin: 54.61% (0.0597 => 0.0923, std.dev.: 0.0040)
MultiSource/Benchmarks/Olden/treeadd/treeadd: 53.63% (0.0537 => 0.0825, std.dev.: 0.0058)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 52.77% (0.9686 => 1.4797, std.dev.: 0.0130)
SingleSource/Benchmarks/BenchmarkGame/recursive: 52.42% (0.0351 => 0.0535, std.dev.: 0.0031)
MultiSource/Benchmarks/SciMark2-C/scimark2: 50.32% (0.3802 => 0.5715, std.dev.: 0.0220)
SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 50.00% (0.0564 => 0.0846, std.dev.: 0.0066)
SingleSource/Benchmarks/Shootout/ackermann: 48.47% (0.0229 => 0.0340, std.dev.: 0.0026)
MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 45.24% (0.5809 => 0.8437, std.dev.: 0.0656)
MultiSource/Benchmarks/McCat/05-eks/eks: 44.27% (0.5430 => 0.7834, std.dev.: 0.0382)
MultiSource/Benchmarks/McCat/18-imp/imp: 40.65% (0.3983 => 0.5602, std.dev.: 0.0164)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 40.29% (0.3941 => 0.5529, std.dev.: 0.0186)
MultiSource/Benchmarks/McCat/09-vor/vor: 39.30% (0.3690 => 0.5140, std.dev.: 0.0414)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 27.91% (5.6133 => 7.1797, std.dev.: 0.2894)
MultiSource/Benchmarks/Ptrdist/bc/bc: 25.16% (1.3198 => 1.6518, std.dev.: 0.1020)
MultiSource/Benchmarks/mafft/pairlocalalign: 14.97% (10.8784 => 12.5073, std.dev.: 0.2396)
MultiSource/Applications/kimwitu++/kc: 14.25% (18.7968 => 21.4746, std.dev.: 0.9333)
MultiSource/Benchmarks/7zip/7zip-benchmark: 14.04% (51.9411 => 59.2313, std.dev.: 1.1281)
MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.85% (1.1055 => 1.2586, std.dev.: 0.0048)
MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.22% (1.2885 => 1.4589, std.dev.: 0.0461)
SingleSource/Benchmarks/Misc/ReedSolomon: 9.50% (0.2242 => 0.2455, std.dev.: 0.0067)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/Olden/mst/mst: 125.04% (0.1370 => 0.3083, std.dev.: 0.0126)
MultiSource/Benchmarks/Ptrdist/ft/ft: 98.45% (0.7732 => 1.5344, std.dev.: 0.1026)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 63.02% (0.0557 => 0.0908, std.dev.: 0.0027)
SingleSource/Benchmarks/Shootout/heapsort: 62.39% (2.9596 => 4.8061, std.dev.: 0.6454)
MultiSource/Benchmarks/Olden/bisort/bisort: 51.85% (0.6719 => 1.0203, std.dev.: 0.0321)
SingleSource/Benchmarks/Linpack/linpack-pc: 43.68% (25.2595 => 36.2922, std.dev.: 3.9535)
MultiSource/Benchmarks/McCat/17-bintr/bintr: 42.00% (0.0862 => 0.1224, std.dev.: 0.0111)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: 34.95% (0.4257 => 0.5745, std.dev.: 0.0497)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 23.41% (0.1606 => 0.1982, std.dev.: 0.0002)
MultiSource/Benchmarks/llubenchmark/llu: 23.19% (2.0173 => 2.4852, std.dev.: 0.1115)
MultiSource/Benchmarks/FreeBench/pifft/pifft: 21.33% (0.1388 => 0.1684, std.dev.: 0.0099)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 16.32% (45.0619 => 52.4177, std.dev.: 1.0654)
MultiSource/Benchmarks/Olden/health/health: 14.53% (0.3399 => 0.3893, std.dev.: 0.0174)
SingleSource/Benchmarks/Shootout-C++/fibo: 10.30% (4.9650 => 5.4763, std.dev.: 0.0977)
MultiSource/Applications/JM/lencod/lencod: 10.08% (7.2280 => 7.9566, std.dev.: 0.1368)
MultiSource/Benchmarks/Olden/tsp/tsp: 9.50% (1.5477 => 1.6947, std.dev.: 0.0191)
MultiSource/Benchmarks/Olden/bh/bh: 9.12% (2.3791 => 2.5960, std.dev.: 0.0060)
SingleSource/Benchmarks/Shootout/matrix: 7.78% (1.7724 => 1.9103, std.dev.: 0.0261)
SingleSource/Benchmarks/Misc/salsa20: 6.66% (7.6481 => 8.1578, std.dev.: 0.0244)
MultiSource/Applications/lua/lua: 5.91% (28.7527 => 30.4517, std.dev.: 0.3736)
MultiSource/Benchmarks/PAQ8p/paq8p: 5.29% (101.1122 => 106.4656, std.dev.: 0.5505)
SingleSource/Benchmarks/Stanford/FloatMM: 4.98% (0.6947 => 0.7293, std.dev.: 0.0004)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.60% (2.3736 => 2.4827, std.dev.: 0.0383)
SingleSource/Benchmarks/Misc/himenobmtxpa: 4.06% (4.1119 => 4.2788, std.dev.: 0.0202)
SingleSource/Benchmarks/Misc/flops: 3.86% (9.2823 => 9.6409, std.dev.: 0.0097)
SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.66% (1.2697 => 1.2908, std.dev.: 0.0042)
SingleSource/Benchmarks/Shootout-C++/hash2: 1.25% (3.6183 => 3.6634, std.dev.: 0.0105)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.21% (2.3985 => 2.4275, std.dev.: 0.0009)
MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.10% (8.9024 => 9.0006, std.dev.: 0.0024)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -38.59% (0.1516 => 0.0931, std.dev.: 0.0212)
SingleSource/Benchmarks/Shootout-C++/wordfreq: -18.48% (0.4166 => 0.3396, std.dev.: 0.0079)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -14.13% (1.4942 => 1.2831, std.dev.: 0.0092)
SingleSource/Benchmarks/Shootout-C++/hash2: -9.85% (0.5037 => 0.4541, std.dev.: 0.0159)
SingleSource/Benchmarks/Shootout-C++/spellcheck: -9.27% (0.4293 => 0.3895, std.dev.: 0.0056)
SingleSource/Benchmarks/Shootout-C++/ary2: -8.56% (0.2816 => 0.2575, std.dev.: 0.0054)
SingleSource/Benchmarks/Linpack/linpack-pc: -8.17% (0.3305 => 0.3035, std.dev.: 0.0045)
SingleSource/Benchmarks/Shootout-C++/lists1: -5.82% (0.3370 => 0.3174, std.dev.: 0.0064)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/Stanford/Bubblesort: -34.70% (0.0464 => 0.0303, std.dev.: 0.0030)
SingleSource/Benchmarks/Misc/pi: -25.29% (2.2009 => 1.6442, std.dev.: 0.0037)
SingleSource/Benchmarks/Shootout-C++/ackermann: -11.95% (4.3480 => 3.8284, std.dev.: 0.1631)
SingleSource/Benchmarks/Shootout-C++/lists1: -8.11% (0.6452 => 0.5929, std.dev.: 0.0102)
MultiSource/Benchmarks/Prolangs-C++/life/life: -2.36% (2.5877 => 2.5267, std.dev.: 0.0167)
SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.89% (1.6483 => 1.6172, std.dev.: 0.0120)
SingleSource/UnitTests/Vectorizer/gcc-loops: -1.65% (18.7827 => 18.4725, std.dev.: 0.0128)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: 0.37% (0.1364 => 0.1369, std.dev.: 0.0025)
================================
Run-Over-Baseline Changes Detail
================================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Benchmarks/BenchmarkGame/recursive: 81.36% (0.0295 => 0.0535, std.dev.: 0.0031)
MultiSource/Benchmarks/Ptrdist/ft/ft: 77.82% (0.2259 => 0.4017, std.dev.: 0.0207)
MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 70.25% (0.0568 => 0.0967, std.dev.: 0.0101)
SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 67.19% (0.0506 => 0.0846, std.dev.: 0.0066)
MultiSource/Benchmarks/Olden/em3d/em3d: 65.31% (0.1972 => 0.3260, std.dev.: 0.0244)
MultiSource/Benchmarks/Olden/treeadd/treeadd: 63.69% (0.0504 => 0.0825, std.dev.: 0.0058)
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 61.39% (0.0562 => 0.0907, std.dev.: 0.0044)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 60.63% (0.9212 => 1.4797, std.dev.: 0.0130)
MultiSource/Benchmarks/MallocBench/gs/gs: 60.27% (4.5883 => 7.3536, std.dev.: 0.3437)
SingleSource/Benchmarks/Misc/perlin: 59.69% (0.0578 => 0.0923, std.dev.: 0.0040)
MultiSource/Benchmarks/FreeBench/neural/neural: 55.21% (0.1882 => 0.2921, std.dev.: 0.0120)
MultiSource/Benchmarks/SciMark2-C/scimark2: 54.17% (0.3707 => 0.5715, std.dev.: 0.0220)
MultiSource/Benchmarks/McCat/05-eks/eks: 51.09% (0.5185 => 0.7834, std.dev.: 0.0382)
MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 50.42% (0.5609 => 0.8437, std.dev.: 0.0656)
MultiSource/Benchmarks/McCat/09-vor/vor: 47.70% (0.3480 => 0.5140, std.dev.: 0.0414)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 44.66% (0.3822 => 0.5529, std.dev.: 0.0186)
MultiSource/Benchmarks/McCat/18-imp/imp: 44.20% (0.3885 => 0.5602, std.dev.: 0.0164)
MultiSource/Benchmarks/Olden/tsp/tsp: 42.95% (0.1297 => 0.1854, std.dev.: 0.0200)
MultiSource/Benchmarks/7zip/7zip-benchmark: 33.76% (44.2807 => 59.2313, std.dev.: 1.1281)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 30.51% (5.5014 => 7.1797, std.dev.: 0.2894)
MultiSource/Benchmarks/Ptrdist/bc/bc: 29.78% (1.2728 => 1.6518, std.dev.: 0.1020)
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 28.03% (0.2686 => 0.3439, std.dev.: 0.0268)
MultiSource/Benchmarks/mafft/pairlocalalign: 25.19% (9.9903 => 12.5073, std.dev.: 0.2396)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.66% (4.0397 => 5.0360, std.dev.: 0.0241)
SingleSource/Benchmarks/Misc-C++-EH/spirit: 21.22% (6.0284 => 7.3078, std.dev.: 0.1067)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 20.62% (24.6139 => 29.6887, std.dev.: 1.3231)
MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.01% (1.0756 => 1.2586, std.dev.: 0.0048)
MultiSource/Applications/kimwitu++/kc: 16.96% (18.3608 => 21.4746, std.dev.: 0.9333)
MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 16.25% (1.2550 => 1.4589, std.dev.: 0.0461)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 15.70% (0.0930 => 0.1076, std.dev.: 0.0055)
SingleSource/Benchmarks/Misc/ReedSolomon: 12.46% (0.2183 => 0.2455, std.dev.: 0.0067)
MultiSource/Applications/oggenc/oggenc: 6.06% (5.3339 => 5.6569, std.dev.: 0.0319)
SingleSource/Benchmarks/Shootout-C++/hash: 4.28% (0.3971 => 0.4141, std.dev.: 0.0064)
MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.65% (1.2652 => 1.2987, std.dev.: 0.0097)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.46% (1.2523 => 1.2831, std.dev.: 0.0092)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/Olden/mst/mst: 123.89% (0.1377 => 0.3083, std.dev.: 0.0126)
MultiSource/Benchmarks/Ptrdist/ft/ft: 107.07% (0.7410 => 1.5344, std.dev.: 0.1026)
SingleSource/Benchmarks/Shootout-C++/methcall: 63.10% (7.6426 => 12.4651, std.dev.: 0.0784)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 60.42% (0.0566 => 0.0908, std.dev.: 0.0027)
MultiSource/Benchmarks/Olden/bisort/bisort: 53.50% (0.6647 => 1.0203, std.dev.: 0.0321)
MultiSource/Benchmarks/McCat/17-bintr/bintr: 41.83% (0.0863 => 0.1224, std.dev.: 0.0111)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: 34.92% (0.4258 => 0.5745, std.dev.: 0.0497)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.24% (40.5588 => 52.4177, std.dev.: 1.0654)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 28.09% (60.7119 => 77.7640, std.dev.: 1.6835)
MultiSource/Benchmarks/llubenchmark/llu: 24.95% (1.9889 => 2.4852, std.dev.: 0.1115)
MultiSource/Benchmarks/Ptrdist/ks/ks: 22.97% (1.1431 => 1.4057, std.dev.: 0.0366)
MultiSource/Benchmarks/FreeBench/pifft/pifft: 22.56% (0.1374 => 0.1684, std.dev.: 0.0099)
MultiSource/Benchmarks/Olden/health/health: 14.80% (0.3391 => 0.3893, std.dev.: 0.0174)
SingleSource/Benchmarks/Shootout-C++/fibo: 10.79% (4.9428 => 5.4763, std.dev.: 0.0977)
MultiSource/Benchmarks/PAQ8p/paq8p: 10.00% (96.7834 => 106.4656, std.dev.: 0.5505)
SingleSource/Benchmarks/CoyoteBench/huffbench: 9.71% (23.4704 => 25.7503, std.dev.: 0.3284)
SingleSource/Benchmarks/McGill/misr: 9.10% (0.3771 => 0.4114, std.dev.: 0.0020)
MultiSource/Benchmarks/Olden/tsp/tsp: 8.96% (1.5553 => 1.6947, std.dev.: 0.0191)
MultiSource/Benchmarks/Olden/bh/bh: 8.35% (2.3959 => 2.5960, std.dev.: 0.0060)
SingleSource/Benchmarks/BenchmarkGame/recursive: 7.79% (2.3365 => 2.5186, std.dev.: 0.0342)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 7.55% (2.3084 => 2.4827, std.dev.: 0.0383)
SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.34% (6.1088 => 6.5574, std.dev.: 0.0766)
SingleSource/Benchmarks/Shootout/matrix: 7.27% (1.7809 => 1.9103, std.dev.: 0.0261)
SingleSource/UnitTests/Vector/multiplies: 6.78% (0.5561 => 0.5938, std.dev.: 0.0052)
SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 6.03% (2.6579 => 2.8183, std.dev.: 0.0496)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 5.93% (0.1871 => 0.1982, std.dev.: 0.0002)
SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.76% (3.1730 => 3.3557, std.dev.: 0.0686)
MultiSource/Benchmarks/sim/sim: 5.55% (3.8312 => 4.0437, std.dev.: 0.0706)
SingleSource/Benchmarks/Misc/himenobmtxpa: 5.40% (4.0596 => 4.2788, std.dev.: 0.0202)
SingleSource/Benchmarks/Misc/salsa20: 4.64% (7.7964 => 8.1578, std.dev.: 0.0244)
MultiSource/Benchmarks/SciMark2-C/scimark2: 3.48% (89.7126 => 92.8383, std.dev.: 0.0413)
SingleSource/Benchmarks/Misc/flops: 2.09% (9.4433 => 9.6409, std.dev.: 0.0097)
SingleSource/Benchmarks/SmallPT/smallpt: 1.74% (16.7972 => 17.0896, std.dev.: 0.0341)
MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.36% (8.8798 => 9.0006, std.dev.: 0.0024)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.27% (3.5683 => 3.6136, std.dev.: 0.0077)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/FreeBench/neural/neural: -50.67% (0.5226 => 0.2578, std.dev.: 0.0213)
MultiSource/Applications/sgefa/sgefa: -42.02% (1.5790 => 0.9155, std.dev.: 0.0050)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -37.25% (0.0400 => 0.0251, std.dev.: 0.0051)
SingleSource/Benchmarks/Linpack/linpack-pc: -36.59% (57.2347 => 36.2922, std.dev.: 3.9535)
MultiSource/Benchmarks/mafft/pairlocalalign: -13.49% (50.0284 => 43.2777, std.dev.: 0.9376)
SingleSource/UnitTests/Vectorizer/gcc-loops: -11.30% (20.8247 => 18.4725, std.dev.: 0.0128)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.48% (3.4956 => 3.1292, std.dev.: 0.0313)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.39% (2.5938 => 2.4800, std.dev.: 0.0124)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -3.07% (17.1431 => 16.6174, std.dev.: 0.0236)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.66% (3.7874 => 3.6868, std.dev.: 0.0057)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.90% (4.3592 => 4.2762, std.dev.: 0.0039)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.05% (3.9552 => 3.9138, std.dev.: 0.0120)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: 1.56% (0.1348 => 0.1369, std.dev.: 0.0025)
Report Time: 0.81s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131024/a9f7e2af/attachment.html>
More information about the llvm-testresults
mailing list