[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Sep 24 11:51:00 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15623?compare_to=15620&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15623, Order: 191308, Start Time: 2013-09-24 16:59:10, End Time: 2013-09-24 18:53:47
      To: 15620, Order: 191301, Start Time: 2013-09-24 14:47:05, End Time: 2013-09-24 16:35:51
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 46 (55 on baseline)
Performance Improvements: 9 (12 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1052 (1040 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Threads/2010-12-08-tls: 93.21% (0.0162 => 0.0313, std.dev.: 0.0002)
  SingleSource/UnitTests/2008-04-18-LoopBug: 90.36% (0.0166 => 0.0316, std.dev.: 0.0007)
  SingleSource/UnitTests/Threads/tls: 85.36% (0.0239 => 0.0443, std.dev.: 0.0012)
  SingleSource/UnitTests/stmtexpr: 79.10% (0.0201 => 0.0360, std.dev.: 0.0009)
  SingleSource/UnitTests/2003-04-22-Switch: 74.73% (0.0186 => 0.0325, std.dev.: 0.0019)
  SingleSource/UnitTests/2003-09-18-BitFieldTest: 74.39% (0.0164 => 0.0286, std.dev.: 0.0028)
  SingleSource/UnitTests/SignlessTypes/ccc: 73.95% (0.0261 => 0.0454, std.dev.: 0.0017)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 66.72% (0.1866 => 0.3111, std.dev.: 0.0272)
  SingleSource/UnitTests/conditional-gnu-ext-cxx: 66.67% (0.0177 => 0.0295, std.dev.: 0.0025)
  SingleSource/UnitTests/2003-05-02-DependentPHI: 65.71% (0.0175 => 0.0290, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 58.52% (0.0446 => 0.0707, std.dev.: 0.0024)
  SingleSource/Benchmarks/Stanford/Treesort: 21.83% (0.0513 => 0.0625, std.dev.: 0.0033)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 21.00% (0.0519 => 0.0628, std.dev.: 0.0011)
  MultiSource/Benchmarks/nbench/nbench: 20.05% (1.2710 => 1.5258, std.dev.: 0.0309)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.17% (14.9029 => 16.8650, std.dev.: 0.5211)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.70% (0.7139 => 0.8046, std.dev.: 0.0257)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 11.06% (45.0789 => 50.0643, std.dev.: 1.7277)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 10.76% (1.4707 => 1.6289, std.dev.: 0.0414)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.56% (1.2578 => 1.3906, std.dev.: 0.0165)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.32% (25.2435 => 27.8482, std.dev.: 0.5558)
  SingleSource/Benchmarks/Shootout-C++/hash: 6.92% (0.4049 => 0.4329, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.69% (1.3378 => 1.4273, std.dev.: 0.0331)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.08% (1.2823 => 1.3603, std.dev.: 0.0192)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.95% (0.3628 => 0.3844, std.dev.: 0.0036)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/bisort/bisort: 49.82% (0.6632 => 0.9936, std.dev.: 0.0905)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 41.11% (0.0270 => 0.0381, std.dev.: 0.0036)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 37.70% (0.0512 => 0.0705, std.dev.: 0.0039)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.79% (2.4009 => 3.0202, std.dev.: 0.1369)
  MultiSource/Applications/SPASS/SPASS: 24.27% (8.7780 => 10.9081, std.dev.: 0.2707)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 21.40% (1.4819 => 1.7991, std.dev.: 0.0491)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 18.15% (29.7067 => 35.0991, std.dev.: 0.5443)
  SingleSource/Benchmarks/McGill/chomp: 11.34% (1.0427 => 1.1609, std.dev.: 0.0124)
  SingleSource/Benchmarks/Linpack/linpack-pc: 10.31% (43.5281 => 48.0156, std.dev.: 1.5693)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 7.71% (2.6691 => 2.8750, std.dev.: 0.0029)
  MultiSource/Applications/minisat/minisat: 6.98% (6.3157 => 6.7567, std.dev.: 0.1424)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.61% (1.0123 => 1.0792, std.dev.: 0.0191)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 6.23% (2.5349 => 2.6927, std.dev.: 0.0284)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.15% (13.1060 => 13.7810, std.dev.: 0.1503)
  SingleSource/Benchmarks/Shootout/matrix: 4.98% (1.7575 => 1.8450, std.dev.: 0.0121)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.94% (5.9034 => 6.1950, std.dev.: 0.0798)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 4.85% (4.0202 => 4.2150, std.dev.: 0.0292)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.71% (4.1023 => 4.2954, std.dev.: 0.0236)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 3.06% (4.4235 => 4.5590, std.dev.: 0.0223)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 2.98% (5.8281 => 6.0019, std.dev.: 0.0598)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 2.74% (4.1140 => 4.2266, std.dev.: 0.0184)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.03% (5.1612 => 5.2661, std.dev.: 0.0263)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc/flops-3: -44.72% (0.0568 => 0.0314, std.dev.: 0.0044)
  SingleSource/Benchmarks/Shootout/methcall: -43.45% (0.0626 => 0.0354, std.dev.: 0.0060)
  SingleSource/Benchmarks/Stanford/Queens: -35.29% (0.0850 => 0.0550, std.dev.: 0.0108)
  MultiSource/Benchmarks/Prolangs-C++/simul/simul: -13.46% (0.0951 => 0.0823, std.dev.: 0.0048)
  MultiSource/Applications/obsequi/Obsequi: -1.35% (1.1989 => 1.1827, std.dev.: 0.0062)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/nestedloop: -17.28% (0.1898 => 0.1570, std.dev.: 0.0091)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.96% (5.9833 => 5.8062, std.dev.: 0.0132)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.18% (5.6254 => 5.5029, std.dev.: 0.0304)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -2.05% (6.5166 => 6.3832, std.dev.: 0.0394)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.44% (0.1366 => 0.1372, std.dev.: 0.0100)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Threads/2010-12-08-tls: 96.86% (0.0159 => 0.0313, std.dev.: 0.0002)
  SingleSource/UnitTests/Threads/tls: 90.95% (0.0232 => 0.0443, std.dev.: 0.0012)
  SingleSource/UnitTests/2008-04-18-LoopBug: 90.36% (0.0166 => 0.0316, std.dev.: 0.0007)
  SingleSource/UnitTests/SignlessTypes/ccc: 84.55% (0.0246 => 0.0454, std.dev.: 0.0017)
  SingleSource/UnitTests/2003-09-18-BitFieldTest: 83.33% (0.0156 => 0.0286, std.dev.: 0.0028)
  SingleSource/UnitTests/StructModifyTest: 80.47% (0.0128 => 0.0231, std.dev.: 0.0008)
  SingleSource/UnitTests/stmtexpr: 80.00% (0.0200 => 0.0360, std.dev.: 0.0009)
  SingleSource/UnitTests/2003-04-22-Switch: 77.60% (0.0183 => 0.0325, std.dev.: 0.0019)
  SingleSource/UnitTests/conditional-gnu-ext-cxx: 74.56% (0.0169 => 0.0295, std.dev.: 0.0025)
  SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 68.33% (0.0420 => 0.0707, std.dev.: 0.0024)
  SingleSource/UnitTests/2003-05-02-DependentPHI: 67.63% (0.0173 => 0.0290, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-03-02-VaCopy: 63.75% (0.0160 => 0.0262, std.dev.: 0.0022)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 59.05% (0.1956 => 0.3111, std.dev.: 0.0272)
  SingleSource/Benchmarks/Stanford/Treesort: 37.67% (0.0454 => 0.0625, std.dev.: 0.0033)
  MultiSource/Benchmarks/nbench/nbench: 22.22% (1.2484 => 1.5258, std.dev.: 0.0309)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.50% (14.4764 => 16.8650, std.dev.: 0.5211)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 13.14% (24.6139 => 27.8482, std.dev.: 0.5558)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 13.06% (44.2807 => 50.0643, std.dev.: 1.7277)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.00% (0.7184 => 0.8046, std.dev.: 0.0257)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 11.58% (1.4599 => 1.6289, std.dev.: 0.0414)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 11.30% (1.2494 => 1.3906, std.dev.: 0.0165)
  SingleSource/Benchmarks/Misc/flops: 9.77% (0.1034 => 0.1135, std.dev.: 0.0027)
  SingleSource/Benchmarks/Shootout-C++/hash: 9.02% (0.3971 => 0.4329, std.dev.: 0.0065)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.26% (0.1950 => 0.2111, std.dev.: 0.0045)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.83% (0.3565 => 0.3844, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.77% (1.2622 => 1.3603, std.dev.: 0.0192)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.29% (1.3303 => 1.4273, std.dev.: 0.0331)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 5.63% (0.1989 => 0.2101, std.dev.: 0.0005)
  MultiSource/Applications/kimwitu++/kc: 4.41% (18.3608 => 19.1708, std.dev.: 0.1355)
  MultiSource/Applications/obsequi/Obsequi: 2.39% (1.1551 => 1.1827, std.dev.: 0.0062)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/bisort/bisort: 49.48% (0.6647 => 0.9936, std.dev.: 0.0905)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 41.85% (0.0497 => 0.0705, std.dev.: 0.0039)
  MultiSource/Applications/SPASS/SPASS: 32.52% (8.2311 => 10.9081, std.dev.: 0.2707)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.79% (2.4010 => 3.0202, std.dev.: 0.1369)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 21.31% (1.4830 => 1.7991, std.dev.: 0.0491)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.78% (0.1374 => 0.1632, std.dev.: 0.0055)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 16.28% (30.1838 => 35.0991, std.dev.: 0.5443)
  SingleSource/Benchmarks/McGill/chomp: 14.25% (1.0161 => 1.1609, std.dev.: 0.0124)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.40% (0.3501 => 0.3795, std.dev.: 0.0108)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 8.17% (2.6579 => 2.8750, std.dev.: 0.0029)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 7.89% (60.7119 => 65.5019, std.dev.: 1.6463)
  MultiSource/Applications/minisat/minisat: 7.66% (6.2760 => 6.7567, std.dev.: 0.1424)
  SingleSource/UnitTests/Vector/multiplies: 6.22% (0.5561 => 0.5907, std.dev.: 0.0033)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 6.15% (2.5368 => 2.6927, std.dev.: 0.0284)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.76% (3.9856 => 4.2150, std.dev.: 0.0292)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.89% (5.9061 => 6.1950, std.dev.: 0.0798)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.74% (4.1011 => 4.2954, std.dev.: 0.0236)
  SingleSource/Benchmarks/Shootout-C++/methcall: 4.48% (7.6426 => 7.9850, std.dev.: 0.1315)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 4.11% (4.0596 => 4.2266, std.dev.: 0.0184)
  SingleSource/Benchmarks/Shootout/matrix: 3.60% (1.7809 => 1.8450, std.dev.: 0.0121)
  MultiSource/Benchmarks/Olden/power/power: 2.25% (1.2170 => 1.2444, std.dev.: 0.0069)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.17% (39.9519 => 40.8173, std.dev.: 0.2489)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.99% (3.1569 => 3.2198, std.dev.: 0.0172)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.40% (16.7972 => 17.0317, std.dev.: 0.0245)
  SingleSource/Benchmarks/Shootout/methcall: 1.21% (8.5434 => 8.6467, std.dev.: 0.0378)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.15% (0.5226 => 0.2396, std.dev.: 0.0285)
  MultiSource/Applications/sgefa/sgefa: -46.95% (1.5790 => 0.8376, std.dev.: 0.0309)
  SingleSource/Benchmarks/Linpack/linpack-pc: -16.11% (57.2347 => 48.0156, std.dev.: 1.5693)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -13.60% (15.9508 => 13.7810, std.dev.: 0.1503)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.47% (20.8247 => 18.4370, std.dev.: 0.1923)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.60% (3.4956 => 3.1252, std.dev.: 0.0386)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.65% (50.0284 => 46.2021, std.dev.: 0.3925)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.94% (4.3592 => 4.1873, std.dev.: 0.0483)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.49% (2.5938 => 2.5032, std.dev.: 0.0184)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.36% (5.4473 => 5.2640, std.dev.: 0.0030)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.68% (2.4471 => 2.3814, std.dev.: 0.0193)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.74% (3.8582 => 3.7911, std.dev.: 0.0079)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.78% (0.1348 => 0.1372, std.dev.: 0.0100)

Report Time: 0.68s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130924/8d33e6d1/attachment.html>


More information about the llvm-testresults mailing list