[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Sep 30 20:39:36 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15840?compare_to=15836&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15840, Order: 191721, Start Time: 2013-10-01 01:51:27, End Time: 2013-10-01 03:42:28
      To: 15836, Order: 191707, Start Time: 2013-09-30 23:33:15, End Time: 2013-10-01 01:27:56
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 25 (53 on baseline)
Performance Improvements: 19 (17 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1063 (1037 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/treecc/treecc: 27.37% (2.3098 => 2.9421, std.dev.: 0.2150)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.14% (0.6174 => 0.7479, std.dev.: 0.0328)
  MultiSource/Applications/lua/lua: 16.38% (4.4903 => 5.2258, std.dev.: 0.1921)
  MultiSource/Applications/JM/ldecod/ldecod: 15.08% (7.7714 => 8.9434, std.dev.: 0.1681)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 13.68% (1.6033 => 1.8226, std.dev.: 0.0277)
  MultiSource/Applications/sqlite3/sqlite3: 9.33% (17.6212 => 19.2654, std.dev.: 0.1666)
  MultiSource/Applications/oggenc/oggenc: 7.01% (5.6641 => 6.0612, std.dev.: 0.0264)
  MultiSource/Applications/ClamAV/clamscan: 6.47% (20.1276 => 21.4297, std.dev.: 0.3170)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 5.81% (1.4909 => 1.5775, std.dev.: 0.0025)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.00% (26.0479 => 27.3503, std.dev.: 0.1392)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.20% (14.8257 => 15.4483, std.dev.: 0.0915)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/JM/ldecod/ldecod: 38.19% (0.0686 => 0.0948, std.dev.: 0.0094)
  MultiSource/Applications/sqlite3/sqlite3: 6.19% (4.1707 => 4.4287, std.dev.: 0.0472)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.07% (21.6025 => 22.9134, std.dev.: 0.3950)
  MultiSource/Applications/sgefa/sgefa: 5.94% (0.8582 => 0.9092, std.dev.: 0.0081)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 4.75% (3.9990 => 4.1890, std.dev.: 0.0406)
  MultiSource/Applications/SIBsim4/SIBsim4: 3.40% (3.5455 => 3.6662, std.dev.: 0.0349)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.98% (13.3018 => 13.6978, std.dev.: 0.0447)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.86% (3.1284 => 3.2179, std.dev.: 0.0012)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.83% (0.6573 => 0.6759, std.dev.: 0.0029)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.33% (4.2021 => 4.2998, std.dev.: 0.0128)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.09% (5.7303 => 5.8498, std.dev.: 0.0156)
  MultiSource/Applications/viterbi/viterbi: 1.78% (2.6397 => 2.6867, std.dev.: 0.0182)
  SingleSource/Benchmarks/Shootout-C++/lists: 1.76% (15.9789 => 16.2603, std.dev.: 0.0699)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.24% (3.8855 => 3.9335, std.dev.: 0.0015)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/2003-05-21-BitfieldHandling: -45.02% (0.0291 => 0.0160, std.dev.: 0.0028)
  SingleSource/UnitTests/2008-04-18-LoopBug: -44.18% (0.0292 => 0.0163, std.dev.: 0.0050)
  SingleSource/UnitTests/2002-05-02-ManyArguments: -38.03% (0.0284 => 0.0176, std.dev.: 0.0032)
  MultiSource/Applications/Burg/burg: -28.12% (2.0212 => 1.4528, std.dev.: 0.1649)
  SingleSource/Benchmarks/Shootout-C++/hash2: -12.89% (0.5020 => 0.4373, std.dev.: 0.0225)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -12.78% (1.4518 => 1.2663, std.dev.: 0.0593)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -10.14% (1.4780 => 1.3282, std.dev.: 0.0394)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -9.23% (0.1246 => 0.1131, std.dev.: 0.0041)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -8.08% (1.8081 => 1.6620, std.dev.: 0.0565)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.07% (2.8452 => 2.7294, std.dev.: 0.0199)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: -41.93% (0.2447 => 0.1421, std.dev.: 0.0269)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -28.41% (0.0887 => 0.0635, std.dev.: 0.0020)
  MultiSource/Applications/obsequi/Obsequi: -13.75% (2.6877 => 2.3182, std.dev.: 0.0643)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -9.14% (0.3753 => 0.3410, std.dev.: 0.0118)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -8.41% (69.2871 => 63.4597, std.dev.: 1.1699)
  SingleSource/Benchmarks/Shootout/strcat: -7.59% (0.1594 => 0.1473, std.dev.: 0.0038)
  MultiSource/Benchmarks/BitBench/five11/five11: -4.01% (5.5389 => 5.3167, std.dev.: 0.0811)
  MultiSource/Applications/lua/lua: -1.87% (31.0140 => 30.4331, std.dev.: 0.1600)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.12% (5.0181 => 4.9618, std.dev.: 0.0165)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.17% (0.1438 => 0.1378, std.dev.: 0.0320)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 31.10% (0.5705 => 0.7479, std.dev.: 0.0328)
  MultiSource/Applications/treecc/treecc: 30.67% (2.2516 => 2.9421, std.dev.: 0.2150)
  MultiSource/Applications/ClamAV/clamscan: 29.56% (16.5398 => 21.4297, std.dev.: 0.3170)
  MultiSource/Applications/sgefa/sgefa: 27.94% (0.3848 => 0.4923, std.dev.: 0.0337)
  MultiSource/Applications/lua/lua: 23.71% (4.2242 => 5.2258, std.dev.: 0.1921)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 23.22% (1.4792 => 1.8226, std.dev.: 0.0277)
  MultiSource/Applications/JM/ldecod/ldecod: 20.81% (7.4026 => 8.9434, std.dev.: 0.1681)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.07% (1.3249 => 1.5775, std.dev.: 0.0025)
  MultiSource/Applications/sqlite3/sqlite3: 18.27% (16.2888 => 19.2654, std.dev.: 0.1666)
  MultiSource/Applications/siod/siod: 17.08% (2.4480 => 2.8660, std.dev.: 0.1048)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 14.13% (1.3123 => 1.4977, std.dev.: 0.0621)
  MultiSource/Applications/oggenc/oggenc: 13.64% (5.3339 => 6.0612, std.dev.: 0.0264)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.19% (0.2335 => 0.2643, std.dev.: 0.0112)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 12.41% (1.2235 => 1.3753, std.dev.: 0.0322)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 12.40% (1.2201 => 1.3714, std.dev.: 0.0269)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 12.39% (1.2639 => 1.4205, std.dev.: 0.0593)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.11% (1.4599 => 1.6367, std.dev.: 0.0672)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.06% (4.9293 => 5.5236, std.dev.: 0.0579)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 11.72% (0.0930 => 0.1039, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.67% (1.3499 => 1.5074, std.dev.: 0.0482)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.65% (1.3303 => 1.4853, std.dev.: 0.0344)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 11.28% (1.4041 => 1.5625, std.dev.: 0.0571)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.12% (24.6139 => 27.3503, std.dev.: 0.1392)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.81% (1.3278 => 1.4714, std.dev.: 0.0411)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.43% (1.2948 => 1.4299, std.dev.: 0.0460)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.41% (1.3036 => 1.4393, std.dev.: 0.0453)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.40% (1.3498 => 1.4902, std.dev.: 0.0127)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.35% (1.2660 => 1.3590, std.dev.: 0.0319)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.15% (0.3328 => 0.3566, std.dev.: 0.0048)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.71% (14.4764 => 15.4483, std.dev.: 0.0915)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.51% (0.2847 => 0.3004, std.dev.: 0.0030)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.03% (2.6492 => 2.7294, std.dev.: 0.0199)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.62% (7.6426 => 12.5046, std.dev.: 0.0702)
  MultiSource/Applications/JM/ldecod/ldecod: 45.62% (0.0651 => 0.0948, std.dev.: 0.0094)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 28.01% (1.1431 => 1.4633, std.dev.: 0.0131)
  MultiSource/Applications/SPASS/SPASS: 20.87% (8.2311 => 9.9491, std.dev.: 0.6284)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.49% (0.1374 => 0.1628, std.dev.: 0.0033)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0024)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.55% (8.1346 => 8.6671, std.dev.: 0.0532)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.50% (40.5588 => 43.1950, std.dev.: 0.8548)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.47% (21.5217 => 22.9134, std.dev.: 0.3950)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 5.75% (4.1011 => 4.3369, std.dev.: 0.0580)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.10% (3.9856 => 4.1890, std.dev.: 0.0406)
  MultiSource/Applications/siod/siod: 4.18% (3.5310 => 3.6786, std.dev.: 0.0091)
  MultiSource/Applications/sqlite3/sqlite3: 3.64% (4.2733 => 4.4287, std.dev.: 0.0472)
  MultiSource/Applications/lua/lua: 3.09% (29.5202 => 30.4331, std.dev.: 0.1600)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.99% (0.6563 => 0.6759, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.72% (5.6951 => 5.8498, std.dev.: 0.0156)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.22% (5.0980 => 5.2110, std.dev.: 0.0128)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.8582 => 3.9335, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.75% (5.7757 => 5.8770, std.dev.: 0.0292)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.62% (2.4920 => 2.5323, std.dev.: 0.0097)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.55% (16.7972 => 17.0579, std.dev.: 0.0486)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -21.71% (0.1483 => 0.1161, std.dev.: 0.0007)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.19% (0.5226 => 0.2394, std.dev.: 0.0077)
  MultiSource/Applications/sgefa/sgefa: -42.42% (1.5790 => 0.9092, std.dev.: 0.0081)
  SingleSource/Benchmarks/Linpack/linpack-pc: -19.87% (57.2347 => 45.8619, std.dev.: 3.3328)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.12% (15.9508 => 13.6978, std.dev.: 0.0447)
  MultiSource/Benchmarks/mafft/pairlocalalign: -13.28% (50.0284 => 43.3853, std.dev.: 1.0073)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.29% (20.8247 => 18.4737, std.dev.: 0.1902)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -7.94% (3.4956 => 3.2179, std.dev.: 0.0012)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.25% (1.1075 => 1.0604, std.dev.: 0.0163)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.65% (2.5938 => 2.4991, std.dev.: 0.0209)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.38% (5.2422 => 5.0648, std.dev.: 0.0347)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.73% (17.1431 => 16.6743, std.dev.: 0.0566)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.71% (2.4471 => 2.3809, std.dev.: 0.0186)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.38% (2.1472 => 2.1176, std.dev.: 0.0115)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.36% (4.3592 => 4.2998, std.dev.: 0.0128)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.15% (6.0128 => 5.9434, std.dev.: 0.0207)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.01% (89.7126 => 88.8103, std.dev.: 0.1834)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.23% (0.1348 => 0.1378, std.dev.: 0.0320)

Report Time: 0.97s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130930/ec27213f/attachment.html>


More information about the llvm-testresults mailing list