[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Oct 9 12:05:05 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16149?compare_to=16146&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16149, Order: 192300, Start Time: 2013-10-09 17:17:30, End Time: 2013-10-09 19:08:07
      To: 16146, Order: 192294, Start Time: 2013-10-09 15:06:41, End Time: 2013-10-09 16:54:08
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 25 (38 on baseline)
Performance Improvements: 8 (17 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1074 (1052 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 57.96% (0.0509 => 0.0804, std.dev.: 0.0080)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 54.52% (0.2192 => 0.3387, std.dev.: 0.0139)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.87% (0.1038 => 0.1483, std.dev.: 0.0033)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 42.78% (0.9679 => 1.3820, std.dev.: 0.1118)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 34.60% (1.4140 => 1.9032, std.dev.: 0.0861)
  MultiSource/Applications/obsequi/Obsequi: 33.10% (1.1531 => 1.5348, std.dev.: 0.0049)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.47% (0.2643 => 0.3237, std.dev.: 0.0112)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 13.86% (1.3164 => 1.4988, std.dev.: 0.0301)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 12.62% (1.3639 => 1.5360, std.dev.: 0.0375)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 11.01% (1.3583 => 1.5078, std.dev.: 0.0388)
  MultiSource/Benchmarks/Bullet/bullet: 7.94% (33.4264 => 36.0809, std.dev.: 0.8094)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.79% (0.3609 => 0.3782, std.dev.: 0.0028)
  MultiSource/Applications/kimwitu++/kc: 3.75% (18.6934 => 19.3949, std.dev.: 0.1870)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 104.66% (0.0193 => 0.0395, std.dev.: 0.0030)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 36.13% (2.3967 => 3.2627, std.dev.: 0.0242)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.62% (1.4829 => 1.8776, std.dev.: 0.0057)
  MultiSource/Applications/obsequi/Obsequi: 16.45% (2.2690 => 2.6422, std.dev.: 0.0203)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.33% (12.8709 => 13.8147, std.dev.: 0.0409)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 6.35% (2.5602 => 2.7229, std.dev.: 0.0363)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 6.21% (1.1438 => 1.2148, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 5.69% (4.1019 => 4.3355, std.dev.: 0.0616)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 5.22% (4.5738 => 4.8126, std.dev.: 0.0873)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 4.13% (39.5421 => 41.1749, std.dev.: 0.3420)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 1.65% (1.1244 => 1.1430, std.dev.: 0.0009)
  MultiSource/Benchmarks/NPB-serial/is/is: 1.14% (12.1651 => 12.3032, std.dev.: 0.0391)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -17.10% (0.0924 => 0.0766, std.dev.: 0.0004)
  MultiSource/Benchmarks/McCat/08-main/main: -6.00% (0.3083 => 0.2898, std.dev.: 0.0027)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: -30.29% (12.5154 => 8.7245, std.dev.: 0.0847)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.11% (8.6615 => 8.3922, std.dev.: 0.0420)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -2.12% (6.6637 => 6.5225, std.dev.: 0.0212)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.97% (12.0431 => 11.8058, std.dev.: 0.0239)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.77% (2.4243 => 2.3813, std.dev.: 0.0133)
  MultiSource/Benchmarks/Olden/em3d/em3d: -1.53% (5.1115 => 5.0333, std.dev.: 0.0015)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: - (0.1351 => 0.1351, std.dev.: 0.0033)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 59.52% (0.0504 => 0.0804, std.dev.: 0.0080)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 51.95% (0.2229 => 0.3387, std.dev.: 0.0139)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 45.57% (0.9494 => 1.3820, std.dev.: 0.1118)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 35.93% (0.1091 => 0.1483, std.dev.: 0.0033)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 35.62% (1.4033 => 1.9032, std.dev.: 0.0861)
  MultiSource/Applications/obsequi/Obsequi: 32.87% (1.1551 => 1.5348, std.dev.: 0.0049)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 24.45% (0.2601 => 0.3237, std.dev.: 0.0112)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 14.93% (1.3365 => 1.5360, std.dev.: 0.0375)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.67% (1.3303 => 1.4988, std.dev.: 0.0301)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 11.71% (1.3498 => 1.5078, std.dev.: 0.0388)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.65% (1.2652 => 1.3999, std.dev.: 0.0503)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.50% (1.2235 => 1.3520, std.dev.: 0.0490)
  MultiSource/Benchmarks/Bullet/bullet: 10.15% (32.7552 => 36.0809, std.dev.: 0.8094)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.09% (0.3565 => 0.3782, std.dev.: 0.0028)
  MultiSource/Applications/kimwitu++/kc: 5.63% (18.3608 => 19.3949, std.dev.: 0.1870)
  MultiSource/Benchmarks/McCat/05-eks/eks: 3.14% (0.5185 => 0.5348, std.dev.: 0.0061)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 59.92% (0.0247 => 0.0395, std.dev.: 0.0030)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 35.89% (2.4010 => 3.2627, std.dev.: 0.0242)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.61% (1.4830 => 1.8776, std.dev.: 0.0057)
  MultiSource/Applications/obsequi/Obsequi: 20.74% (2.1884 => 2.6422, std.dev.: 0.0203)
  SingleSource/Benchmarks/Shootout-C++/methcall: 14.16% (7.6426 => 8.7245, std.dev.: 0.0847)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 10.31% (1.1013 => 1.2148, std.dev.: 0.0014)
  MultiSource/Benchmarks/Bullet/bullet: 7.71% (7.0333 => 7.5756, std.dev.: 0.1993)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 7.34% (2.5368 => 2.7229, std.dev.: 0.0363)
  SingleSource/UnitTests/Vector/multiplies: 6.62% (0.5561 => 0.5929, std.dev.: 0.0091)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 5.72% (4.1011 => 4.3355, std.dev.: 0.0616)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 5.21% (4.5744 => 4.8126, std.dev.: 0.0873)
  MultiSource/Benchmarks/BitBench/five11/five11: 3.77% (5.3716 => 5.5743, std.dev.: 0.0326)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.32% (6.5990 => 6.8178, std.dev.: 0.0205)
  MultiSource/Applications/lambda-0_1_3/lambda: 3.17% (8.1346 => 8.3922, std.dev.: 0.0420)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.11% (0.5182 => 0.5343, std.dev.: 0.0045)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.06% (39.9519 => 41.1749, std.dev.: 0.3420)
  MultiSource/Applications/siod/siod: 2.91% (3.5310 => 3.6336, std.dev.: 0.0266)
  MultiSource/Benchmarks/Olden/power/power: 2.42% (1.2170 => 1.2465, std.dev.: 0.0005)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.64% (1.0477 => 1.0649, std.dev.: 0.0018)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.49% (16.7972 => 17.0483, std.dev.: 0.0211)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.22% (3.1730 => 3.2117, std.dev.: 0.0013)
  MultiSource/Benchmarks/Olden/tsp/tsp: 1.19% (1.5553 => 1.5738, std.dev.: 0.0069)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -20.77% (0.1483 => 0.1175, std.dev.: 0.0036)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.32% (0.5226 => 0.2387, std.dev.: 0.0695)
  MultiSource/Applications/sgefa/sgefa: -47.04% (1.5790 => 0.8362, std.dev.: 0.0322)
  SingleSource/Benchmarks/Linpack/linpack-pc: -39.73% (57.2347 => 34.4938, std.dev.: 7.0985)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -13.39% (15.9508 => 13.8147, std.dev.: 0.0409)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.65% (20.8247 => 18.6076, std.dev.: 0.0395)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -7.98% (3.4956 => 3.2165, std.dev.: 0.0704)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.89% (50.0284 => 46.0835, std.dev.: 0.4736)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -5.37% (3.0561 => 2.8920, std.dev.: 0.0118)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.63% (4.3592 => 4.2009, std.dev.: 0.0589)
  SingleSource/Benchmarks/Misc/salsa20: -3.58% (7.7964 => 7.5169, std.dev.: 0.0349)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.97% (17.1431 => 16.6335, std.dev.: 0.1367)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.69% (2.4471 => 2.3813, std.dev.: 0.0133)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.27% (2.5938 => 2.5350, std.dev.: 0.0041)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.25% (2.1472 => 2.1203, std.dev.: 0.0039)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.22% (89.7126 => 88.6163, std.dev.: 0.3524)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.22% (6.6028 => 6.5225, std.dev.: 0.0212)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.22% (0.1348 => 0.1351, std.dev.: 0.0033)

Report Time: 1.25s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131009/fbf15a97/attachment.html>


More information about the llvm-testresults mailing list