[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Sep 24 18:37:23 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15635?compare_to=15631&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15635, Order: 191339, Start Time: 2013-09-24 23:46:48, End Time: 2013-09-25 01:40:09
      To: 15631, Order: 191334, Start Time: 2013-09-24 21:32:19, End Time: 2013-09-24 23:22:08
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 37 (44 on baseline)
Performance Improvements: 16 (16 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1054 (1047 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 49.02% (0.0765 => 0.1140, std.dev.: 0.0111)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 39.64% (0.0845 => 0.1180, std.dev.: 0.0123)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.78% (1.2556 => 1.4161, std.dev.: 0.0260)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 12.14% (2.7496 => 3.0833, std.dev.: 0.0118)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.44% (4.1864 => 4.6652, std.dev.: 0.0348)
  SingleSource/Benchmarks/Shootout-C++/objinst: 11.17% (0.2113 => 0.2349, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.88% (1.4824 => 1.6437, std.dev.: 0.0264)
  MultiSource/Applications/JM/lencod/lencod: 10.63% (17.1032 => 18.9209, std.dev.: 0.5273)
  MultiSource/Applications/lemon/lemon: 9.57% (1.2365 => 1.3548, std.dev.: 0.0318)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.59% (25.6198 => 27.8207, std.dev.: 0.4577)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 8.25% (0.1892 => 0.2048, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.39% (1.2945 => 1.3902, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 7.14% (1.2731 => 1.3640, std.dev.: 0.0277)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.26% (1.3012 => 1.3827, std.dev.: 0.0289)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.96% (1.2725 => 1.3484, std.dev.: 0.0111)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 5.69% (1.5086 => 1.5945, std.dev.: 0.0207)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 5.38% (1.3610 => 1.4342, std.dev.: 0.0269)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 157.52% (0.0153 => 0.0394, std.dev.: 0.0031)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 42.62% (2.8267 => 4.0315, std.dev.: 0.4564)
  SingleSource/Benchmarks/Linpack/linpack-pc: 34.19% (32.5559 => 43.6876, std.dev.: 3.4546)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 24.49% (28.4849 => 35.4599, std.dev.: 0.2877)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 16.55% (40.2733 => 46.9397, std.dev.: 1.8525)
  MultiSource/Applications/lemon/lemon: 13.37% (0.9294 => 1.0537, std.dev.: 0.0312)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 13.06% (60.8308 => 68.7769, std.dev.: 1.1029)
  MultiSource/Benchmarks/nbench/nbench: 12.30% (21.8073 => 24.4889, std.dev.: 0.5238)
  SingleSource/Benchmarks/Shootout-C++/lists1: 9.11% (0.5853 => 0.6386, std.dev.: 0.0146)
  MultiSource/Applications/sgefa/sgefa: 7.29% (0.8387 => 0.8998, std.dev.: 0.0037)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.86% (2.9577 => 3.1605, std.dev.: 0.0102)
  MultiSource/Applications/sqlite3/sqlite3: 3.40% (4.2731 => 4.4184, std.dev.: 0.0349)
  MultiSource/Applications/SIBsim4/SIBsim4: 3.34% (3.5230 => 3.6406, std.dev.: 0.0125)
  SingleSource/Benchmarks/Misc/flops: 2.78% (9.3353 => 9.5949, std.dev.: 0.0258)
  MultiSource/Applications/siod/siod: 2.40% (3.6300 => 3.7170, std.dev.: 0.0210)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.07% (40.2629 => 41.0961, std.dev.: 0.2697)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 2.07% (4.0695 => 4.1536, std.dev.: 0.0196)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.55% (5.7666 => 5.8557, std.dev.: 0.0333)
  SingleSource/Benchmarks/Misc/fbench: 1.26% (4.9038 => 4.9657, std.dev.: 0.0119)
  SingleSource/Benchmarks/Shootout/fib2: 1.07% (3.5968 => 3.6354, std.dev.: 0.0115)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/sim/sim: -16.32% (0.4523 => 0.3785, std.dev.: 0.0133)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -11.81% (1.5556 => 1.3719, std.dev.: 0.0704)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -10.92% (1.4846 => 1.3225, std.dev.: 0.0507)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.32% (0.3509 => 0.2866, std.dev.: 0.0104)
  MultiSource/Applications/obsequi/Obsequi: -5.73% (2.4620 => 2.3209, std.dev.: 0.0252)
  MultiSource/Applications/aha/aha: -5.03% (3.7751 => 3.5854, std.dev.: 0.0320)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.26% (6.0005 => 5.8046, std.dev.: 0.0272)
  SingleSource/Benchmarks/Shootout-C++/hash2: -2.59% (3.6816 => 3.5862, std.dev.: 0.0365)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.49% (4.3045 => 4.1973, std.dev.: 0.0174)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -2.47% (3.2164 => 3.1371, std.dev.: 0.0296)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -2.18% (6.7216 => 6.5754, std.dev.: 0.0346)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -1.68% (6.8211 => 6.7065, std.dev.: 0.0074)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.62% (1.8165 => 1.7871, std.dev.: 0.0060)
  SingleSource/Benchmarks/Shootout-C++/methcall: -1.61% (12.6579 => 12.4545, std.dev.: 0.0224)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.57% (1.6140 => 1.5887, std.dev.: 0.0062)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -1.37% (1.6754 => 1.6524, std.dev.: 0.0081)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 4.21% (0.1354 => 0.1411, std.dev.: 0.0064)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 54.68% (0.0737 => 0.1140, std.dev.: 0.0111)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 46.03% (0.3096 => 0.4521, std.dev.: 0.0237)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 43.90% (0.0820 => 0.1180, std.dev.: 0.0123)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 38.23% (0.1219 => 0.1685, std.dev.: 0.0175)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 16.39% (2.6492 => 3.0833, std.dev.: 0.0118)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 15.48% (4.0397 => 4.6652, std.dev.: 0.0348)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 14.91% (1.4304 => 1.6437, std.dev.: 0.0264)
  MultiSource/Applications/lemon/lemon: 14.21% (1.1862 => 1.3548, std.dev.: 0.0318)
  MultiSource/Applications/JM/lencod/lencod: 14.05% (16.5902 => 18.9209, std.dev.: 0.5273)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 13.30% (1.2499 => 1.4161, std.dev.: 0.0260)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 13.03% (24.6139 => 27.8207, std.dev.: 0.4577)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.2250 => 1.3640, std.dev.: 0.0277)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.90% (1.2932 => 1.4342, std.dev.: 0.0269)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.90% (1.2468 => 1.3827, std.dev.: 0.0289)
  SingleSource/Benchmarks/Shootout-C++/objinst: 10.85% (0.2119 => 0.2349, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.78% (1.3499 => 1.4954, std.dev.: 0.0412)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.77% (1.2550 => 1.3902, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.52% (1.2201 => 1.3484, std.dev.: 0.0111)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 9.22% (1.4599 => 1.5945, std.dev.: 0.0207)
  MultiSource/Applications/minisat/minisat: 8.93% (0.7439 => 0.8103, std.dev.: 0.0170)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.24% (1.2007 => 1.2276, std.dev.: 0.0040)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 62.96% (7.6426 => 12.4545, std.dev.: 0.0224)
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 59.51% (0.0247 => 0.0394, std.dev.: 0.0031)
  MultiSource/Applications/lemon/lemon: 23.59% (0.8526 => 1.0537, std.dev.: 0.0312)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 17.48% (30.1838 => 35.4599, std.dev.: 0.2877)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 15.73% (40.5588 => 46.9397, std.dev.: 1.8525)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 13.28% (60.7119 => 68.7769, std.dev.: 1.1029)
  MultiSource/Benchmarks/nbench/nbench: 10.68% (22.1263 => 24.4889, std.dev.: 0.5238)
  MultiSource/Applications/lambda-0_1_3/lambda: 8.23% (8.1346 => 8.8037, std.dev.: 0.0781)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 7.60% (2.9372 => 3.1605, std.dev.: 0.0102)
  SingleSource/Benchmarks/Shootout-C++/lists1: 7.29% (0.5952 => 0.6386, std.dev.: 0.0146)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.18% (6.5990 => 7.0726, std.dev.: 0.0816)
  MultiSource/Applications/obsequi/Obsequi: 6.05% (2.1884 => 2.3209, std.dev.: 0.0252)
  MultiSource/Applications/siod/siod: 5.27% (3.5310 => 3.7170, std.dev.: 0.0210)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.68% (4.5744 => 4.7885, std.dev.: 0.0585)
  MultiSource/Applications/hexxagon/hexxagon: 3.87% (14.7810 => 15.3535, std.dev.: 0.1178)
  MultiSource/Applications/sqlite3/sqlite3: 3.40% (4.2733 => 4.4184, std.dev.: 0.0349)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.86% (39.9519 => 41.0961, std.dev.: 0.2697)
  MultiSource/Benchmarks/Olden/power/power: 2.40% (1.2170 => 1.2462, std.dev.: 0.0073)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 2.32% (4.0596 => 4.1536, std.dev.: 0.0196)
  SingleSource/Benchmarks/Misc/flops: 1.61% (9.4433 => 9.5949, std.dev.: 0.0258)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.42% (16.7972 => 17.0349, std.dev.: 0.0342)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.24% (1.7652 => 1.7871, std.dev.: 0.0060)
  SingleSource/Benchmarks/Shootout/fib2: 1.08% (3.5966 => 3.6354, std.dev.: 0.0115)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.94% (0.5226 => 0.2355, std.dev.: 0.0446)
  MultiSource/Applications/sgefa/sgefa: -43.01% (1.5790 => 0.8998, std.dev.: 0.0037)
  SingleSource/Benchmarks/Linpack/linpack-pc: -23.67% (57.2347 => 43.6876, std.dev.: 3.4546)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.99% (15.9508 => 13.2403, std.dev.: 0.3151)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.23% (20.8247 => 18.4854, std.dev.: 0.2102)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.26% (3.4956 => 3.1371, std.dev.: 0.0296)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.21% (50.0284 => 46.4209, std.dev.: 0.1152)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.71% (3.0561 => 2.8510, std.dev.: 0.0207)
  MultiSource/Applications/JM/lencod/lencod: -5.61% (8.1785 => 7.7195, std.dev.: 0.0926)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.71% (4.3592 => 4.1973, std.dev.: 0.0174)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.62% (2.5938 => 2.4999, std.dev.: 0.0342)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -3.02% (2.4471 => 2.3733, std.dev.: 0.0238)
  MultiSource/Applications/SIBsim4/SIBsim4: -2.75% (3.7437 => 3.6406, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.59% (5.2422 => 5.1065, std.dev.: 0.0191)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.15% (2.1472 => 2.1226, std.dev.: 0.0016)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.04% (89.7126 => 88.7796, std.dev.: 0.3025)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 4.67% (0.1348 => 0.1411, std.dev.: 0.0064)

Report Time: 0.71s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130924/58aa9a33/attachment.html>


More information about the llvm-testresults mailing list