[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Oct 8 11:42:26 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16111?compare_to=16107&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16111, Order: 192185, Start Time: 2013-10-08 16:50:39, End Time: 2013-10-08 18:45:27
      To: 16107, Order: 192181, Start Time: 2013-10-08 14:37:40, End Time: 2013-10-08 16:24:51
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 57 (75 on baseline)
Performance Improvements: 3 (18 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1047 (1014 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/2003-05-21-UnionTest: 130.21% (0.0096 => 0.0221, std.dev.: 0.0031)
  SingleSource/Regression/C++/BuiltinTypeInfo: 107.61% (0.0184 => 0.0382, std.dev.: 0.0004)
  SingleSource/Regression/C/ConstructorDestructorAttributes: 87.26% (0.0157 => 0.0294, std.dev.: 0.0010)
  SingleSource/Regression/C/badidx: 86.67% (0.0255 => 0.0476, std.dev.: 0.0008)
  SingleSource/Regression/C/compare: 81.82% (0.0220 => 0.0400, std.dev.: 0.0023)
  SingleSource/Regression/C/2004-02-03-AggregateCopy: 80.85% (0.0141 => 0.0255, std.dev.: 0.0016)
  SingleSource/Regression/C/PR1386: 74.68% (0.0158 => 0.0276, std.dev.: 0.0007)
  SingleSource/Benchmarks/Misc/mandel: 74.25% (0.0466 => 0.0812, std.dev.: 0.0060)
  SingleSource/Regression/C/bigstack: 73.44% (0.0640 => 0.1110, std.dev.: 0.0053)
  SingleSource/Regression/C++/pointer_method2: 72.55% (0.0255 => 0.0440, std.dev.: 0.0002)
  SingleSource/Regression/C/globalrefs: 68.88% (0.0196 => 0.0331, std.dev.: 0.0018)
  SingleSource/Regression/C/matrixTranspose: 68.40% (0.0269 => 0.0453, std.dev.: 0.0034)
  SingleSource/Regression/C/uint64_to_float: 64.35% (0.0418 => 0.0687, std.dev.: 0.0045)
  SingleSource/Regression/C++/2011-03-28-Bitfield: 55.61% (0.0187 => 0.0291, std.dev.: 0.0031)
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 48.42% (0.0349 => 0.0518, std.dev.: 0.0056)
  SingleSource/Benchmarks/Stanford/Queens: 46.35% (0.0438 => 0.0641, std.dev.: 0.0064)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 41.72% (0.0580 => 0.0822, std.dev.: 0.0077)
  MultiSource/Applications/obsequi/Obsequi: 35.22% (1.2043 => 1.6285, std.dev.: 0.1473)
  SingleSource/Benchmarks/Shootout-C++/ary2: 27.56% (0.2522 => 0.3217, std.dev.: 0.0174)
  MultiSource/Applications/hbd/hbd: 25.35% (1.5868 => 1.9891, std.dev.: 0.0727)
  MultiSource/Applications/treecc/treecc: 22.49% (2.3197 => 2.8414, std.dev.: 0.1013)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 19.73% (0.3309 => 0.3962, std.dev.: 0.0044)
  MultiSource/Applications/JM/lencod/lencod: 19.42% (17.0925 => 20.4118, std.dev.: 0.7150)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.48% (1.2124 => 1.4122, std.dev.: 0.0712)
  MultiSource/Applications/SPASS/SPASS: 16.33% (16.6392 => 19.3556, std.dev.: 0.4681)
  MultiSource/Benchmarks/MallocBench/gs/gs: 16.07% (4.7703 => 5.5367, std.dev.: 0.1407)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.69% (1.4884 => 1.6922, std.dev.: 0.0695)
  SingleSource/Benchmarks/Shootout-C++/lists: 12.39% (0.2583 => 0.2903, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.22% (1.4360 => 1.5971, std.dev.: 0.0403)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.20% (25.2950 => 28.1282, std.dev.: 0.3158)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.94% (1.3364 => 1.4826, std.dev.: 0.0328)
  MultiSource/Applications/oggenc/oggenc: 10.37% (5.4406 => 6.0047, std.dev.: 0.1482)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.86% (9.9594 => 10.9409, std.dev.: 0.2141)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.88% (1.2607 => 1.3727, std.dev.: 0.0174)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 8.83% (0.3930 => 0.4277, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.10% (1.2256 => 1.3126, std.dev.: 0.0240)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 6.69% (1.2677 => 1.3525, std.dev.: 0.0300)
  SingleSource/Benchmarks/Misc-C++/bigfib: 2.93% (0.6611 => 0.6805, std.dev.: 0.0015)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: 67.27% (1.4654 => 2.4512, std.dev.: 0.0851)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 27.76% (4.0157 => 5.1303, std.dev.: 0.1893)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 21.71% (35.7661 => 43.5311, std.dev.: 0.3745)
  SingleSource/Benchmarks/Dhrystone/dry: 19.51% (0.4865 => 0.5814, std.dev.: 0.0159)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 18.81% (28.6528 => 34.0437, std.dev.: 1.2879)
  MultiSource/Applications/obsequi/Obsequi: 17.12% (2.2395 => 2.6228, std.dev.: 0.0331)
  MultiSource/Benchmarks/llubenchmark/llu: 16.90% (2.0361 => 2.3803, std.dev.: 0.0961)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 16.60% (9.4190 => 10.9822, std.dev.: 0.2006)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 9.63% (2.3268 => 2.5509, std.dev.: 0.0160)
  SingleSource/Benchmarks/Shootout-C++/fibo: 8.94% (4.9730 => 5.4175, std.dev.: 0.0411)
  SingleSource/Benchmarks/Misc/flops-8: 3.61% (2.5363 => 2.6279, std.dev.: 0.0126)
  SingleSource/Benchmarks/Shootout-C++/lists: 2.95% (15.9328 => 16.4029, std.dev.: 0.0668)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.20% (5.7051 => 5.8305, std.dev.: 0.0388)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.99% (5.0966 => 5.1979, std.dev.: 0.0109)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.72% (1.4857 => 1.5113, std.dev.: 0.0085)
  SingleSource/Benchmarks/Shootout-C++/sieve: 1.49% (3.4609 => 3.5125, std.dev.: 0.0167)
  SingleSource/Benchmarks/Misc/flops: 1.49% (9.4644 => 9.6052, std.dev.: 0.0115)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.45% (1.5899 => 1.6129, std.dev.: 0.0035)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.26% (2.5415 => 2.5734, std.dev.: 0.0052)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/lists: -2.98% (7.4037 => 7.1828, std.dev.: 0.0367)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -2.75% (6.7456 => 6.5602, std.dev.: 0.0656)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -1.85% (1.1591 => 1.1377, std.dev.: 0.0037)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.74% (0.1349 => 0.1359, std.dev.: 0.0058)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/BuiltinTypeInfo: 85.44% (0.0206 => 0.0382, std.dev.: 0.0004)
  SingleSource/Regression/C/ConstructorDestructorAttributes: 81.48% (0.0162 => 0.0294, std.dev.: 0.0010)
  SingleSource/Regression/C/badidx: 80.99% (0.0263 => 0.0476, std.dev.: 0.0008)
  SingleSource/Regression/C/bigstack: 80.49% (0.0615 => 0.1110, std.dev.: 0.0053)
  SingleSource/Benchmarks/Misc/mandel: 78.85% (0.0454 => 0.0812, std.dev.: 0.0060)
  SingleSource/Regression/C/PR1386: 76.92% (0.0156 => 0.0276, std.dev.: 0.0007)
  SingleSource/Regression/C/2004-02-03-AggregateCopy: 68.87% (0.0151 => 0.0255, std.dev.: 0.0016)
  SingleSource/Regression/C/uint64_to_float: 67.56% (0.0410 => 0.0687, std.dev.: 0.0045)
  SingleSource/Regression/C++/pointer_method2: 66.67% (0.0264 => 0.0440, std.dev.: 0.0002)
  SingleSource/Regression/C/matrixTranspose: 64.13% (0.0276 => 0.0453, std.dev.: 0.0034)
  SingleSource/Regression/C/compare: 63.27% (0.0245 => 0.0400, std.dev.: 0.0023)
  SingleSource/Regression/C/globalrefs: 60.68% (0.0206 => 0.0331, std.dev.: 0.0018)
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 56.50% (0.0331 => 0.0518, std.dev.: 0.0056)
  SingleSource/Benchmarks/Stanford/Queens: 46.35% (0.0438 => 0.0641, std.dev.: 0.0064)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 44.72% (0.0568 => 0.0822, std.dev.: 0.0077)
  MultiSource/Applications/obsequi/Obsequi: 40.98% (1.1551 => 1.6285, std.dev.: 0.1473)
  MultiSource/Applications/hbd/hbd: 26.73% (1.5696 => 1.9891, std.dev.: 0.0727)
  MultiSource/Applications/treecc/treecc: 26.19% (2.2516 => 2.8414, std.dev.: 0.1013)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 25.59% (4.9293 => 6.1908, std.dev.: 0.4432)
  SingleSource/Benchmarks/Shootout-C++/ary2: 25.42% (0.2565 => 0.3217, std.dev.: 0.0174)
  MultiSource/Applications/JM/lencod/lencod: 23.04% (16.5902 => 20.4118, std.dev.: 0.7150)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 21.42% (0.3263 => 0.3962, std.dev.: 0.0044)
  MultiSource/Benchmarks/MallocBench/gs/gs: 20.67% (4.5883 => 5.5367, std.dev.: 0.1407)
  MultiSource/Applications/SPASS/SPASS: 19.74% (16.1646 => 19.3556, std.dev.: 0.4681)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 17.61% (1.2007 => 1.4122, std.dev.: 0.0712)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 15.91% (1.4599 => 1.6922, std.dev.: 0.0695)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.28% (24.6139 => 28.1282, std.dev.: 0.3158)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 12.98% (1.3123 => 1.4826, std.dev.: 0.0328)
  SingleSource/Benchmarks/Shootout-C++/lists: 12.65% (0.2577 => 0.2903, std.dev.: 0.0042)
  MultiSource/Applications/oggenc/oggenc: 12.58% (5.3339 => 6.0047, std.dev.: 0.1482)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 12.38% (9.7354 => 10.9409, std.dev.: 0.2141)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 12.30% (1.2201 => 1.3702, std.dev.: 0.0386)
  MultiSource/Applications/siod/siod: 11.89% (2.4480 => 2.7390, std.dev.: 0.0885)
  MultiSource/Applications/kimwitu++/kc: 11.84% (18.3608 => 20.5353, std.dev.: 0.5878)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.65% (1.4304 => 1.5971, std.dev.: 0.0403)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.84% (1.2553 => 1.3914, std.dev.: 0.0363)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.54% (1.2235 => 1.3525, std.dev.: 0.0300)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.14% (0.1597 => 0.1759, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.61% (1.2523 => 1.3727, std.dev.: 0.0174)
  MultiSource/Benchmarks/sim/sim: 9.49% (0.3732 => 0.4086, std.dev.: 0.0108)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 8.78% (44.2807 => 48.1664, std.dev.: 1.2388)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 8.72% (0.3934 => 0.4277, std.dev.: 0.0039)
  SingleSource/Benchmarks/McGill/chomp: 8.40% (0.2202 => 0.2387, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.34% (1.2116 => 1.3126, std.dev.: 0.0240)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.27% (1.3036 => 1.3854, std.dev.: 0.0307)
  SingleSource/Benchmarks/Misc-C++/bigfib: 5.68% (0.6439 => 0.6805, std.dev.: 0.0015)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 66.88% (0.1377 => 0.2298, std.dev.: 0.0348)
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.67% (7.6426 => 12.5090, std.dev.: 0.0375)
  SingleSource/Benchmarks/Stanford/Queens: 57.68% (0.0241 => 0.0380, std.dev.: 0.0028)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 42.54% (1.7197 => 2.4512, std.dev.: 0.0851)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 25.12% (4.1004 => 5.1303, std.dev.: 0.1893)
  MultiSource/Applications/obsequi/Obsequi: 19.85% (2.1884 => 2.6228, std.dev.: 0.0331)
  MultiSource/Benchmarks/llubenchmark/llu: 19.68% (1.9889 => 2.3803, std.dev.: 0.0961)
  SingleSource/Benchmarks/Dhrystone/dry: 19.31% (0.4873 => 0.5814, std.dev.: 0.0159)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.16% (36.8417 => 43.5311, std.dev.: 0.3745)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 16.11% (9.4586 => 10.9822, std.dev.: 0.2006)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 12.79% (30.1838 => 34.0437, std.dev.: 1.2879)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 10.51% (2.3084 => 2.5509, std.dev.: 0.0160)
  SingleSource/Benchmarks/Shootout-C++/fibo: 9.60% (4.9428 => 5.4175, std.dev.: 0.0411)
  SingleSource/UnitTests/Vector/multiplies: 6.74% (0.5561 => 0.5936, std.dev.: 0.0032)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.59% (8.1346 => 8.6705, std.dev.: 0.0505)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 5.10% (4.1011 => 4.3102, std.dev.: 0.0214)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.71% (6.5990 => 6.9099, std.dev.: 0.0744)
  SingleSource/Benchmarks/Misc/flops-8: 4.22% (2.5214 => 2.6279, std.dev.: 0.0126)
  MultiSource/Applications/spiff/spiff: 3.32% (2.8194 => 2.9129, std.dev.: 0.0302)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.27% (2.4920 => 2.5734, std.dev.: 0.0052)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.55% (1.7652 => 1.8102, std.dev.: 0.0155)
  MultiSource/Applications/hexxagon/hexxagon: 2.52% (14.7810 => 15.1528, std.dev.: 0.1115)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.38% (5.6951 => 5.8305, std.dev.: 0.0388)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.09% (5.7757 => 5.8965, std.dev.: 0.0284)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.96% (5.0980 => 5.1979, std.dev.: 0.0109)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.91% (1.4830 => 1.5113, std.dev.: 0.0085)
  SingleSource/Benchmarks/Misc/flops: 1.71% (9.4433 => 9.6052, std.dev.: 0.0115)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.19% (1.5940 => 1.6129, std.dev.: 0.0035)
  SingleSource/Benchmarks/Shootout-C++/lists: 1.15% (16.2163 => 16.4029, std.dev.: 0.0668)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Linpack/linpack-pc: -58.56% (57.2347 => 23.7165, std.dev.: 12.3115)
  MultiSource/Benchmarks/FreeBench/neural/neural: -48.49% (0.5226 => 0.2692, std.dev.: 0.0643)
  MultiSource/Applications/sgefa/sgefa: -46.65% (1.5790 => 0.8424, std.dev.: 0.0294)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -31.75% (0.0400 => 0.0273, std.dev.: 0.0042)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -17.10% (0.1871 => 0.1551, std.dev.: 0.0075)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.56% (15.9508 => 13.3087, std.dev.: 0.2744)
  MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.3304 => 0.2904, std.dev.: 0.0106)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.15% (20.8247 => 18.5022, std.dev.: 0.1602)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.54% (3.4956 => 3.1270, std.dev.: 0.0402)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.55% (50.0284 => 46.7540, std.dev.: 0.2991)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.11% (3.7437 => 3.5523, std.dev.: 0.0705)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.00% (2.5938 => 2.4900, std.dev.: 0.0209)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.83% (4.3592 => 4.1922, std.dev.: 0.0620)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.55% (2.4471 => 2.3848, std.dev.: 0.0181)
  SingleSource/Benchmarks/Shootout/lists: -2.54% (7.3703 => 7.1828, std.dev.: 0.0367)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.36% (17.1431 => 16.7377, std.dev.: 0.1194)
  SingleSource/Benchmarks/Shootout/sieve: -1.89% (7.2254 => 7.0885, std.dev.: 0.0245)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.13% (89.7126 => 88.6985, std.dev.: 0.0719)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.82% (0.1348 => 0.1359, std.dev.: 0.0058)

Report Time: 1.04s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131008/d5763789/attachment.html>


More information about the llvm-testresults mailing list