[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Aug 15 14:03:16 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14449?compare_to=14446&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14449, Order: 188468, Start Time: 2013-08-15 19:14:59, End Time: 2013-08-15 21:05:17
      To: 14446, Order: 188467, Start Time: 2013-08-15 17:04:41, End Time: 2013-08-15 18:48:41
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 23 (36 on baseline)
Performance Improvements: 5 (29 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1079 (1042 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 31.86% (0.9518 => 1.2550, std.dev.: 0.0700)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 20.92% (5.7929 => 7.0050, std.dev.: 0.1180)
  MultiSource/Benchmarks/NPB-serial/is/is: 14.10% (0.0759 => 0.0866, std.dev.: 0.0036)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.27% (1.0160 => 1.1203, std.dev.: 0.0084)
  MultiSource/Applications/kimwitu++/kc: 10.13% (19.4851 => 21.4589, std.dev.: 0.4714)
  MultiSource/Benchmarks/FreeBench/neural/neural: 8.37% (0.2067 => 0.2240, std.dev.: 0.0017)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.11% (0.6434 => 0.6634, std.dev.: 0.0017)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 34.59% (0.0688 => 0.0926, std.dev.: 0.0029)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.50% (1.4777 => 1.8841, std.dev.: 0.0059)
  MultiSource/Benchmarks/llubenchmark/llu: 18.90% (1.9835 => 2.3583, std.dev.: 0.0077)
  SingleSource/Benchmarks/Shootout-C++/fibo: 17.00% (4.1308 => 4.8331, std.dev.: 0.0042)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 11.53% (0.4301 => 0.4797, std.dev.: 0.0117)
  MultiSource/Benchmarks/Olden/em3d/em3d: 10.14% (4.7080 => 5.1853, std.dev.: 0.0054)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 6.33% (0.8572 => 0.9115, std.dev.: 0.0110)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.15% (5.0157 => 5.3241, std.dev.: 0.0954)
  MultiSource/Applications/lua/lua: 4.41% (29.6336 => 30.9418, std.dev.: 0.0506)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.12% (6.3080 => 6.5051, std.dev.: 0.0509)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.95% (1.6290 => 1.6608, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.78% (5.0364 => 5.1262, std.dev.: 0.0181)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.66% (2.9331 => 2.9817, std.dev.: 0.0102)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.14% (4.9585 => 5.0151, std.dev.: 0.0216)
  SingleSource/Benchmarks/BenchmarkGame/n-body: 1.12% (1.5085 => 1.5254, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.08% (5.9616 => 6.0262, std.dev.: 0.0126)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -12.82% (2.0398 => 1.7782, std.dev.: 0.0037)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.15% (2.1988 => 2.1075, std.dev.: 0.0131)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -3.45% (2.9168 => 2.8162, std.dev.: 0.0073)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.60% (0.4726 => 0.4603, std.dev.: 0.0036)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.51% (2.6205 => 2.5810, std.dev.: 0.0112)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.68% (0.1307 => 0.1342, std.dev.: 0.0218)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 33.41% (0.9407 => 1.2550, std.dev.: 0.0700)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.66% (6.1631 => 7.0050, std.dev.: 0.1180)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.69% (0.9941 => 1.1203, std.dev.: 0.0084)
  MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.2071 => 0.2240, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc/oourafft: 4.42% (0.2284 => 0.2385, std.dev.: 0.0010)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.38% (0.6480 => 0.6634, std.dev.: 0.0017)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 74.47% (3.7285 => 6.5051, std.dev.: 0.0509)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.54% (2.8867 => 4.2879, std.dev.: 0.0247)
  MultiSource/Benchmarks/FreeBench/neural/neural: 37.05% (0.3171 => 0.4346, std.dev.: 0.0126)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 34.99% (0.0686 => 0.0926, std.dev.: 0.0029)
  SingleSource/Benchmarks/Shootout/hash: 27.81% (4.1846 => 5.3483, std.dev.: 0.3515)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.36% (1.5030 => 1.8841, std.dev.: 0.0059)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 20.15% (0.0526 => 0.0632, std.dev.: 0.0026)
  SingleSource/Benchmarks/Shootout/nestedloop: 18.62% (0.1364 => 0.1618, std.dev.: 0.0098)
  MultiSource/Benchmarks/llubenchmark/llu: 16.82% (2.0187 => 2.3583, std.dev.: 0.0077)
  SingleSource/Benchmarks/Shootout-C++/hash: 16.81% (0.6295 => 0.7353, std.dev.: 0.0305)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 12.98% (0.4246 => 0.4797, std.dev.: 0.0117)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.39% (0.1348 => 0.1515, std.dev.: 0.0035)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.97% (7.0762 => 7.8523, std.dev.: 0.0473)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.20% (5.4910 => 5.9959, std.dev.: 0.0596)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 9.18% (1.2557 => 1.3710, std.dev.: 0.0142)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.93% (48.3256 => 52.1564, std.dev.: 0.1028)
  MultiSource/Applications/JM/lencod/lencod: 7.11% (7.1799 => 7.6906, std.dev.: 0.1910)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.92% (3.2027 => 3.4243, std.dev.: 0.0203)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 6.67% (3.3384 => 3.5610, std.dev.: 0.0545)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.00% (5.3042 => 5.6223, std.dev.: 0.0164)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.68% (3.4085 => 3.6020, std.dev.: 0.0322)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.34% (4.3151 => 4.5022, std.dev.: 0.0180)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.24% (5.1471 => 5.3655, std.dev.: 0.0648)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.76% (25.0200 => 25.9601, std.dev.: 0.0931)
  SingleSource/Benchmarks/Misc/whetstone: 3.66% (3.4559 => 3.5823, std.dev.: 0.0172)
  SingleSource/Benchmarks/McGill/misr: 3.32% (0.3674 => 0.3796, std.dev.: 0.0047)
  SingleSource/Benchmarks/Shootout-C++/hash2: 3.19% (3.3877 => 3.4959, std.dev.: 0.0291)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.27% (4.9040 => 5.0151, std.dev.: 0.0216)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.68% (5.0417 => 5.1262, std.dev.: 0.0181)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.19% (2.9467 => 2.9817, std.dev.: 0.0102)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/bisort/bisort: -31.25% (0.1072 => 0.0737, std.dev.: 0.0064)
  MultiSource/Benchmarks/Olden/power/power: -28.92% (0.2237 => 0.1590, std.dev.: 0.0236)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -17.52% (0.1518 => 0.1252, std.dev.: 0.0098)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -10.70% (0.1870 => 0.1670, std.dev.: 0.0015)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -8.98% (1.1012 => 1.0023, std.dev.: 0.0334)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -8.79% (0.3073 => 0.2803, std.dev.: 0.0040)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.67% (2.1022 => 1.4155, std.dev.: 0.0089)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -30.02% (0.0816 => 0.0571, std.dev.: 0.0010)
  MultiSource/Applications/viterbi/viterbi: -27.41% (3.4923 => 2.5349, std.dev.: 0.0364)
  MultiSource/Applications/JM/ldecod/ldecod: -24.91% (0.0859 => 0.0645, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.61% (6.9552 => 5.2434, std.dev.: 0.0281)
  SingleSource/Benchmarks/Misc/perlin: -21.44% (4.5989 => 3.6131, std.dev.: 0.0140)
  SingleSource/Benchmarks/Misc/mandel: -13.94% (1.1996 => 1.0324, std.dev.: 0.0149)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -11.02% (0.5173 => 0.4603, std.dev.: 0.0036)
  MultiSource/Applications/obsequi/Obsequi: -9.69% (2.6081 => 2.3554, std.dev.: 0.0975)
  MultiSource/Applications/SIBsim4/SIBsim4: -8.01% (3.5791 => 3.2925, std.dev.: 0.0893)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -5.67% (0.7355 => 0.6938, std.dev.: 0.0056)
  MultiSource/Benchmarks/mafft/pairlocalalign: -5.29% (47.2250 => 44.7280, std.dev.: 0.7204)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.66% (3.8119 => 3.6342, std.dev.: 0.0429)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.58% (2.7049 => 2.5810, std.dev.: 0.0112)
  SingleSource/Benchmarks/Misc/fbench: -4.27% (4.9602 => 4.7484, std.dev.: 0.0052)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.04% (0.2849 => 0.2734, std.dev.: 0.0044)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.48% (1.7207 => 1.6608, std.dev.: 0.0004)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.27% (21.6864 => 20.9770, std.dev.: 0.2312)
  SingleSource/Benchmarks/Misc/oourafft: -2.08% (3.7891 => 3.7103, std.dev.: 0.0204)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.02% (34.8438 => 34.1406, std.dev.: 0.0998)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.00% (1.8144 => 1.7782, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.98% (6.1482 => 6.0262, std.dev.: 0.0126)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.44% (5.8810 => 5.7964, std.dev.: 0.0285)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.61% (0.1378 => 0.1342, std.dev.: 0.0218)

Report Time: 0.68s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130815/ad3c71dc/attachment.html>


More information about the llvm-testresults mailing list