[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Jun 7 16:31:12 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12168?compare_to=12165&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12168, Order: 183572, Start Time: 2013-06-07 21:41:30, End Time: 2013-06-07 23:31:55
      To: 12165, Order: 183546, Start Time: 2013-06-07 19:24:35, End Time: 2013-06-07 21:16:18
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 39 (45 on baseline)
Performance Improvements: 24 (24 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1044 (1038 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2007-01-04-KNR-Args: 143.70% (0.0135 => 0.0329, std.dev.: 0.0010)
  SingleSource/UnitTests/2005-11-29-LongSwitch: 124.58% (0.0118 => 0.0265, std.dev.: 0.0025)
  SingleSource/UnitTests/2002-10-13-BadLoad: 113.48% (0.0089 => 0.0190, std.dev.: 0.0007)
  SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 73.29% (0.0161 => 0.0279, std.dev.: 0.0017)
  SingleSource/Regression/C++/EH/dead_try_block: 67.79% (0.0149 => 0.0250, std.dev.: 0.0029)
  SingleSource/Regression/C/casts: 66.92% (0.0396 => 0.0661, std.dev.: 0.0019)
  SingleSource/Regression/C++/BuiltinTypeInfo: 64.55% (0.0189 => 0.0311, std.dev.: 0.0016)
  SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 64.32% (0.0185 => 0.0304, std.dev.: 0.0033)
  SingleSource/UnitTests/2008-04-20-LoopBug2: 63.19% (0.0163 => 0.0266, std.dev.: 0.0023)
  SingleSource/Regression/C++/EH/function_try_block: 60.62% (0.0325 => 0.0522, std.dev.: 0.0005)
  SingleSource/Regression/C/DuffsDevice: 59.12% (0.0274 => 0.0436, std.dev.: 0.0010)
  SingleSource/Regression/C/uint64_to_float: 58.76% (0.0434 => 0.0689, std.dev.: 0.0031)
  SingleSource/UnitTests/2003-07-06-IntOverflow: 58.49% (0.0212 => 0.0336, std.dev.: 0.0011)
  SingleSource/UnitTests/Vector/divides: 56.92% (0.0195 => 0.0306, std.dev.: 0.0026)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 55.37% (0.1994 => 0.3098, std.dev.: 0.0072)
  SingleSource/UnitTests/2003-05-07-VarArgs: 54.58% (0.0284 => 0.0439, std.dev.: 0.0012)
  SingleSource/Benchmarks/Dhrystone/dry: 52.82% (0.0585 => 0.0894, std.dev.: 0.0078)
  SingleSource/Regression/C++/EH/recursive-throw: 50.19% (0.0265 => 0.0398, std.dev.: 0.0026)
  SingleSource/UnitTests/Vector/build2: 49.61% (0.0383 => 0.0573, std.dev.: 0.0026)
  SingleSource/Regression/C/sumarraymalloc: 43.08% (0.0441 => 0.0631, std.dev.: 0.0025)
  SingleSource/UnitTests/2003-05-26-Shorts: 42.35% (0.0255 => 0.0363, std.dev.: 0.0019)
  SingleSource/UnitTests/Vector/constpool: 37.26% (9.1793 => 12.5998, std.dev.: 0.3909)
  MultiSource/Applications/ClamAV/clamscan: 4.73% (16.8659 => 17.6634, std.dev.: 0.2190)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.89% (4.3908 => 4.5177, std.dev.: 0.0348)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.17% (1.4549 => 1.4719, std.dev.: 0.0040)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: 28.56% (1.7698 => 2.2753, std.dev.: 0.0957)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 14.37% (3.6298 => 4.1513, std.dev.: 0.0160)
  SingleSource/Benchmarks/Shootout/ary3: 11.29% (9.2548 => 10.2994, std.dev.: 0.3726)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 10.86% (37.2959 => 41.3447, std.dev.: 1.3441)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 10.27% (31.4310 => 34.6588, std.dev.: 0.1844)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 5.98% (1.0482 => 1.1109, std.dev.: 0.0143)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 5.68% (1.1158 => 1.1792, std.dev.: 0.0196)
  SingleSource/Benchmarks/McGill/chomp: 5.44% (1.0086 => 1.0635, std.dev.: 0.0155)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.61% (5.9167 => 6.1892, std.dev.: 0.0738)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 4.29% (4.0787 => 4.2537, std.dev.: 0.0227)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.52% (40.9755 => 42.4183, std.dev.: 0.4430)
  MultiSource/Applications/sqlite3/sqlite3: 2.30% (4.3435 => 4.4432, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.91% (4.9867 => 5.0817, std.dev.: 0.0191)
  MultiSource/Applications/JM/lencod/lencod: 1.52% (6.8768 => 6.9815, std.dev.: 0.0214)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/NP/np: -42.62% (0.0359 => 0.0206, std.dev.: 0.0029)
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -42.55% (0.1194 => 0.0686, std.dev.: 0.0017)
  MultiSource/Benchmarks/Prolangs-C++/life/life: -39.82% (0.1552 => 0.0934, std.dev.: 0.0020)
  MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: -39.16% (0.0835 => 0.0508, std.dev.: 0.0125)
  SingleSource/Benchmarks/Misc-C++/mandel-text: -37.12% (0.0361 => 0.0227, std.dev.: 0.0013)
  SingleSource/Benchmarks/Misc/flops-4: -36.01% (0.0511 => 0.0327, std.dev.: 0.0026)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: -27.70% (0.0379 => 0.0274, std.dev.: 0.0012)
  SingleSource/Benchmarks/Shootout-C++/lists1: -14.34% (0.3919 => 0.3357, std.dev.: 0.0113)
  SingleSource/Benchmarks/Shootout-C++/methcall: -12.86% (0.2559 => 0.2230, std.dev.: 0.0070)
  MultiSource/Benchmarks/Prolangs-C++/city/city: -10.26% (1.8180 => 1.6315, std.dev.: 0.0621)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: -8.47% (0.4618 => 0.4227, std.dev.: 0.0027)
  SingleSource/Benchmarks/Shootout-C++/strcat: -7.43% (0.2410 => 0.2231, std.dev.: 0.0015)
  MultiSource/Benchmarks/PAQ8p/paq8p: -7.14% (2.6854 => 2.4936, std.dev.: 0.0324)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.37% (1.5137 => 1.4173, std.dev.: 0.0298)
  SingleSource/Benchmarks/Shootout-C++/objinst: -6.30% (0.2476 => 0.2320, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.69% (1.7528 => 1.6531, std.dev.: 0.0246)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -3.41% (1.4456 => 1.3963, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.67% (1.7504 => 1.7211, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.38% (1.5224 => 1.5014, std.dev.: 0.0068)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -23.47% (6.2924 => 4.8153, std.dev.: 0.5635)
  SingleSource/Benchmarks/Shootout-C++/hash: -6.75% (0.7792 => 0.7266, std.dev.: 0.0105)
  MultiSource/Benchmarks/PAQ8p/paq8p: -5.73% (98.1760 => 92.5498, std.dev.: 0.8140)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.83% (2.7668 => 2.6885, std.dev.: 0.0239)
  SingleSource/Benchmarks/Misc/flops-6: -1.16% (2.4733 => 2.4446, std.dev.: 0.0057)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.08% (0.1484 => 0.1468, std.dev.: 0.0046)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-05-07-VarArgs: 70.16% (0.0258 => 0.0439, std.dev.: 0.0012)
  SingleSource/Regression/C++/EH/dead_try_block: 68.92% (0.0148 => 0.0250, std.dev.: 0.0029)
  SingleSource/UnitTests/2007-01-04-KNR-Args: 66.16% (0.0198 => 0.0329, std.dev.: 0.0010)
  SingleSource/Regression/C/casts: 64.84% (0.0401 => 0.0661, std.dev.: 0.0019)
  SingleSource/Regression/C/uint64_to_float: 63.66% (0.0421 => 0.0689, std.dev.: 0.0031)
  SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 62.57% (0.0187 => 0.0304, std.dev.: 0.0033)
  SingleSource/UnitTests/2007-03-02-VaCopy: 62.50% (0.0168 => 0.0273, std.dev.: 0.0016)
  SingleSource/Regression/C/DuffsDevice: 58.55% (0.0275 => 0.0436, std.dev.: 0.0010)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 57.10% (0.1972 => 0.3098, std.dev.: 0.0072)
  SingleSource/Regression/C++/EH/function_try_block: 56.29% (0.0334 => 0.0522, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/build2: 56.13% (0.0367 => 0.0573, std.dev.: 0.0026)
  SingleSource/UnitTests/2003-05-26-Shorts: 53.81% (0.0236 => 0.0363, std.dev.: 0.0019)
  SingleSource/Regression/C++/BuiltinTypeInfo: 53.20% (0.0203 => 0.0311, std.dev.: 0.0016)
  SingleSource/Benchmarks/Dhrystone/dry: 48.01% (0.0604 => 0.0894, std.dev.: 0.0078)
  SingleSource/Regression/C/sumarraymalloc: 46.40% (0.0431 => 0.0631, std.dev.: 0.0025)
  SingleSource/UnitTests/Vector/constpool: 22.23% (10.3086 => 12.5998, std.dev.: 0.3909)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.25% (4.1734 => 4.5177, std.dev.: 0.0348)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.06% (0.2721 => 0.2913, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.94% (1.5108 => 1.6157, std.dev.: 0.0251)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.63% (1.4081 => 1.5014, std.dev.: 0.0068)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.60% (2.6076 => 2.7797, std.dev.: 0.0665)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.22% (1.5727 => 1.6391, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.38% (1.4238 => 1.4719, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.17% (1.3667 => 1.3963, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.42% (1.5478 => 1.5698, std.dev.: 0.0051)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 71.31% (6.0122 => 10.2994, std.dev.: 0.3726)
  SingleSource/Benchmarks/Stanford/Puzzle: 29.48% (0.1455 => 0.1884, std.dev.: 0.0149)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 24.39% (1.8291 => 2.2753, std.dev.: 0.0957)
  SingleSource/Benchmarks/Shootout-C++/ary: 20.85% (0.0633 => 0.0765, std.dev.: 0.0014)
  MultiSource/Applications/sgefa/sgefa: 18.27% (1.1695 => 1.3832, std.dev.: 0.0180)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 18.02% (6.1372 => 7.2430, std.dev.: 0.0298)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.17% (5.2003 => 5.6253, std.dev.: 0.0312)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 6.78% (32.4581 => 34.6588, std.dev.: 0.1844)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.96% (3.1853 => 3.3752, std.dev.: 0.0142)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.93% (4.0156 => 4.2537, std.dev.: 0.0227)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 5.09% (1.0571 => 1.1109, std.dev.: 0.0143)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.89% (3.2201 => 3.3777, std.dev.: 0.0040)
  SingleSource/Benchmarks/McGill/chomp: 4.63% (1.0164 => 1.0635, std.dev.: 0.0155)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.44% (5.2788 => 5.5131, std.dev.: 0.0815)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.43% (40.6198 => 42.4183, std.dev.: 0.4430)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.26% (5.9362 => 6.1892, std.dev.: 0.0738)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.06% (5.5010 => 5.6695, std.dev.: 0.0292)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.45% (4.3727 => 4.4799, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.63% (5.6582 => 5.7504, std.dev.: 0.0180)
  SingleSource/Benchmarks/Shootout/methcall: 1.40% (8.3425 => 8.4592, std.dev.: 0.0364)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -38.36% (0.1113 => 0.0686, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc/whetstone: -15.04% (0.1097 => 0.0932, std.dev.: 0.0017)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -6.61% (0.1861 => 0.1738, std.dev.: 0.0015)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.16% (1.2911 => 0.7338, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.39% (4.4050 => 3.2424, std.dev.: 0.1423)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -18.47% (6.2328 => 5.0817, std.dev.: 0.0191)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -15.84% (25.3677 => 21.3495, std.dev.: 0.1974)
  SingleSource/Benchmarks/Misc/salsa20: -12.91% (10.3398 => 9.0054, std.dev.: 0.1568)
  MultiSource/Benchmarks/mafft/pairlocalalign: -10.13% (48.3307 => 43.4357, std.dev.: 0.0766)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.92% (1.6679 => 1.5024, std.dev.: 0.0154)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -9.10% (9.8728 => 8.9743, std.dev.: 0.1882)
  SingleSource/Benchmarks/Shootout-C++/hash: -8.50% (0.7941 => 0.7266, std.dev.: 0.0105)
  MultiSource/Benchmarks/nbench/nbench: -6.81% (22.3004 => 20.7823, std.dev.: 0.4783)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.68% (5.5889 => 5.2155, std.dev.: 0.0427)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.59% (5.3184 => 5.0742, std.dev.: 0.0123)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.29% (5.3276 => 5.0989, std.dev.: 0.0129)
  MultiSource/Applications/sqlite3/sqlite3: -4.15% (4.6358 => 4.4432, std.dev.: 0.0084)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.81% (9.1099 => 8.7631, std.dev.: 0.0086)
  MultiSource/Applications/hexxagon/hexxagon: -3.78% (15.4979 => 14.9122, std.dev.: 0.0352)
  SingleSource/Benchmarks/Misc/flops: -3.08% (10.2170 => 9.9025, std.dev.: 0.0268)
  SingleSource/Benchmarks/Shootout/sieve: -2.68% (8.0178 => 7.8031, std.dev.: 0.0054)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.67% (3.8665 => 3.7634, std.dev.: 0.0308)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (4.2167 => 4.1513, std.dev.: 0.0160)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.30% (12.1841 => 12.0260, std.dev.: 0.0519)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.87% (0.1441 => 0.1468, std.dev.: 0.0046)

Report Time: 1.88s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130607/5640f9b2/attachment.html>


More information about the llvm-testresults mailing list