[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sat Jun 8 12:57:19 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12195?compare_to=12192&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12195, Order: 183614, Start Time: 2013-06-08 18:12:46, End Time: 2013-06-08 19:58:03
      To: 12192, Order: 183613, Start Time: 2013-06-08 16:10:14, End Time: 2013-06-08 17:52:05
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 51 (40 on baseline)
Performance Improvements: 2 (53 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1054 (1014 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 53.73% (0.9602 => 1.4761, std.dev.: 0.0252)
  MultiSource/Benchmarks/Olden/mst/mst: 51.91% (0.1358 => 0.2063, std.dev.: 0.0095)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 48.95% (0.0948 => 0.1412, std.dev.: 0.0079)
  MultiSource/Benchmarks/Olden/bisort/bisort: 48.66% (0.0707 => 0.1051, std.dev.: 0.0064)
  MultiSource/Benchmarks/Olden/power/power: 34.60% (0.1422 => 0.1914, std.dev.: 0.0099)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 27.74% (1.4147 => 1.8071, std.dev.: 0.1374)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 21.27% (9.8715 => 11.9713, std.dev.: 0.3420)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.47% (0.6701 => 0.7939, std.dev.: 0.0466)
  MultiSource/Benchmarks/Prolangs-C/football/football: 11.73% (1.0187 => 1.1382, std.dev.: 0.0437)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.36% (14.8664 => 16.2579, std.dev.: 0.3361)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.42% (0.1650 => 0.1789, std.dev.: 0.0040)
  MultiSource/Benchmarks/MallocBench/gs/gs: 8.03% (4.6541 => 5.0280, std.dev.: 0.1052)
  MultiSource/Applications/kimwitu++/kc: 6.88% (19.0548 => 20.3665, std.dev.: 0.3429)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 5.40% (1.4408 => 1.5186, std.dev.: 0.0133)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.86% (1.6251 => 1.7041, std.dev.: 0.0108)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.27% (1.5115 => 1.5760, std.dev.: 0.0102)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.21% (1.6289 => 1.6975, std.dev.: 0.0217)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.19% (1.3940 => 1.4524, std.dev.: 0.0132)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 4.14% (1.5904 => 1.6563, std.dev.: 0.0164)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.33% (1.4301 => 1.4777, std.dev.: 0.0126)
  MultiSource/Applications/minisat/minisat: 2.61% (0.7666 => 0.7866, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.52% (1.4773 => 1.5146, std.dev.: 0.0107)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.28% (1.6868 => 1.7084, std.dev.: 0.0049)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 54.94% (0.1578 => 0.2445, std.dev.: 0.0137)
  MultiSource/Benchmarks/Olden/bisort/bisort: 37.63% (0.6726 => 0.9257, std.dev.: 0.0113)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.75% (2.3221 => 2.9665, std.dev.: 0.0401)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.68% (1.4760 => 1.8698, std.dev.: 0.0145)
  SingleSource/Benchmarks/Misc/fp-convert: 16.30% (6.9071 => 8.0333, std.dev.: 0.0251)
  SingleSource/Benchmarks/Misc/salsa20: 12.74% (7.9726 => 8.9887, std.dev.: 0.0049)
  MultiSource/Applications/obsequi/Obsequi: 11.99% (2.1962 => 2.4596, std.dev.: 0.0612)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.87% (0.3371 => 0.3771, std.dev.: 0.0042)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 7.63% (0.8537 => 0.9188, std.dev.: 0.0127)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 6.09% (1.1142 => 1.1820, std.dev.: 0.0213)
  SingleSource/Benchmarks/Misc/flops-4: 5.68% (1.5346 => 1.6218, std.dev.: 0.0040)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 4.71% (8.9842 => 9.4078, std.dev.: 0.0974)
  MultiSource/Benchmarks/Olden/tsp/tsp: 3.64% (1.5998 => 1.6580, std.dev.: 0.0208)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 3.50% (3.9130 => 4.0498, std.dev.: 0.0024)
  SingleSource/Benchmarks/Misc/flops: 3.25% (9.5357 => 9.8452, std.dev.: 0.0042)
  SingleSource/Benchmarks/Linpack/linpack-pc: 3.21% (50.2162 => 51.8284, std.dev.: 0.0408)
  SingleSource/Benchmarks/Shootout-C++/hash2: 2.12% (3.5932 => 3.6694, std.dev.: 0.0056)
  SingleSource/Benchmarks/Misc/pi: 2.06% (2.3496 => 2.3981, std.dev.: 0.0132)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.97% (2.6713 => 2.7240, std.dev.: 0.0171)
  MultiSource/Benchmarks/Olden/power/power: 1.56% (1.2430 => 1.2624, std.dev.: 0.0032)
  MultiSource/Benchmarks/Olden/bh/bh: 1.51% (2.4208 => 2.4574, std.dev.: 0.0104)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.48% (42.8525 => 43.4861, std.dev.: 0.0244)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.43% (4.2649 => 4.3259, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.33% (5.3509 => 5.4219, std.dev.: 0.0227)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.24% (5.6867 => 5.7572, std.dev.: 0.0100)
  MultiSource/Applications/siod/siod: 1.14% (3.7337 => 3.7762, std.dev.: 0.0023)
  SingleSource/Benchmarks/BenchmarkGame/n-body: 1.03% (1.4811 => 1.4964, std.dev.: 0.0047)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.02% (1.6990 => 1.7164, std.dev.: 0.0039)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.07% (9.3371 => 9.1438, std.dev.: 0.0737)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.82% (7.2355 => 7.1037, std.dev.: 0.0289)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.16% (0.1436 => 0.1467, std.dev.: 0.0141)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Olden/bisort/bisort: 50.14% (0.0700 => 0.1051, std.dev.: 0.0064)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 48.14% (0.9964 => 1.4761, std.dev.: 0.0252)
  MultiSource/Benchmarks/Olden/mst/mst: 46.83% (0.1405 => 0.2063, std.dev.: 0.0095)
  MultiSource/Benchmarks/Olden/power/power: 31.37% (0.1457 => 0.1914, std.dev.: 0.0099)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 31.35% (0.1075 => 0.1412, std.dev.: 0.0079)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 26.79% (1.4253 => 1.8071, std.dev.: 0.1374)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.83% (10.1602 => 11.9713, std.dev.: 0.3420)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.93% (1.4202 => 1.5186, std.dev.: 0.0133)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.91% (1.3667 => 1.4611, std.dev.: 0.0317)
  MultiSource/Benchmarks/MallocBench/gs/gs: 6.77% (4.7091 => 5.0280, std.dev.: 0.1052)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 6.04% (1.6070 => 1.7041, std.dev.: 0.0108)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.38% (0.2937 => 0.3095, std.dev.: 0.0047)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 5.26% (1.5735 => 1.6563, std.dev.: 0.0164)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.07% (1.4999 => 1.5760, std.dev.: 0.0102)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.00% (1.3833 => 1.4524, std.dev.: 0.0132)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 4.47% (0.2238 => 0.2338, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.32% (1.4165 => 1.4777, std.dev.: 0.0126)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.19% (1.6292 => 1.6975, std.dev.: 0.0217)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.96% (1.4757 => 1.5342, std.dev.: 0.0155)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.54% (1.4771 => 1.5146, std.dev.: 0.0107)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 30.91% (1.8318 => 2.3981, std.dev.: 0.0132)
  MultiSource/Applications/sgefa/sgefa: 17.75% (1.1695 => 1.3771, std.dev.: 0.0033)
  SingleSource/Benchmarks/Stanford/Puzzle: 17.59% (0.1455 => 0.1711, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.75% (6.1372 => 7.1037, std.dev.: 0.0289)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 14.98% (2.5800 => 2.9665, std.dev.: 0.0401)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 11.02% (0.8276 => 0.9188, std.dev.: 0.0127)
  MultiSource/Applications/obsequi/Obsequi: 9.81% (2.2398 => 2.4596, std.dev.: 0.0612)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.09% (5.2003 => 5.6209, std.dev.: 0.0358)
  MultiSource/Benchmarks/Olden/bisort/bisort: 7.56% (0.8606 => 0.9257, std.dev.: 0.0113)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.31% (3.1853 => 3.3862, std.dev.: 0.0145)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.93% (4.6639 => 4.8938, std.dev.: 0.0222)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.88% (5.9362 => 6.1664, std.dev.: 0.0163)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.60% (5.2788 => 5.4689, std.dev.: 0.0501)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.95% (5.5010 => 5.6632, std.dev.: 0.0076)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.31% (4.3727 => 4.4739, std.dev.: 0.0049)
  SingleSource/Benchmarks/Shootout-C++/hash2: 2.10% (3.5939 => 3.6694, std.dev.: 0.0056)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.06% (3.9713 => 4.0532, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.93% (5.6582 => 5.7673, std.dev.: 0.0021)
  MultiSource/Applications/siod/siod: 1.40% (3.7240 => 3.7762, std.dev.: 0.0023)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.08% (1.6980 => 1.7164, std.dev.: 0.0039)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/DefaultInitDynArrays: -58.14% (0.0172 => 0.0072, std.dev.: 0.0025)
  SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: -55.12% (0.0205 => 0.0092, std.dev.: 0.0031)
  SingleSource/UnitTests/2002-05-19-DivTest: -47.30% (0.0222 => 0.0117, std.dev.: 0.0014)
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -34.23% (0.1113 => 0.0732, std.dev.: 0.0046)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -15.94% (0.0803 => 0.0675, std.dev.: 0.0005)
  SingleSource/Benchmarks/Misc/whetstone: -15.13% (0.1097 => 0.0931, std.dev.: 0.0003)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -11.42% (0.1322 => 0.1171, std.dev.: 0.0022)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.62% (0.2006 => 0.1793, std.dev.: 0.0059)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -9.75% (51.0211 => 46.0466, std.dev.: 1.2000)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -9.34% (0.1563 => 0.1417, std.dev.: 0.0021)
  SingleSource/Benchmarks/Linpack/linpack-pc: -4.27% (0.2738 => 0.2621, std.dev.: 0.0036)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.18% (6.6236 => 6.3465, std.dev.: 0.0097)
  SingleSource/Benchmarks/Shootout-C++/hash: -2.28% (0.4554 => 0.4450, std.dev.: 0.0027)
  MultiSource/Applications/spiff/spiff: -2.00% (0.9365 => 0.9178, std.dev.: 0.0060)
  MultiSource/Applications/d/make_dparser: -1.54% (3.7330 => 3.6754, std.dev.: 0.0159)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.54% (1.2911 => 0.7289, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.63% (4.4050 => 3.2320, std.dev.: 0.0251)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -19.87% (6.2328 => 4.9944, std.dev.: 0.0390)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -17.00% (1.8291 => 1.5181, std.dev.: 0.0615)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.22% (25.3677 => 21.2533, std.dev.: 0.1381)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -15.76% (3.5000 => 2.9484, std.dev.: 0.0208)
  SingleSource/Benchmarks/Misc/salsa20: -13.07% (10.3398 => 8.9887, std.dev.: 0.0049)
  MultiSource/Benchmarks/mafft/pairlocalalign: -10.02% (48.3307 => 43.4861, std.dev.: 0.0244)
  SingleSource/Benchmarks/Shootout-C++/hash: -9.23% (0.7941 => 0.7208, std.dev.: 0.0268)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -8.14% (10.2418 => 9.4078, std.dev.: 0.0974)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -7.97% (0.2973 => 0.2736, std.dev.: 0.0034)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.53% (3.2030 => 2.9617, std.dev.: 0.0263)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -7.46% (2.4808 => 2.2958, std.dev.: 0.0661)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -7.38% (9.8728 => 9.1438, std.dev.: 0.0737)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.18% (3.5327 => 3.2792, std.dev.: 0.0318)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.72% (5.5889 => 5.2132, std.dev.: 0.0215)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.27% (0.1945 => 0.1823, std.dev.: 0.0044)
  MultiSource/Applications/sqlite3/sqlite3: -5.90% (4.6358 => 4.3621, std.dev.: 0.0535)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.38% (4.5717 => 4.3259, std.dev.: 0.0070)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -5.12% (4.2334 => 4.0167, std.dev.: 0.0592)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.76% (5.3184 => 5.0655, std.dev.: 0.0158)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.17% (5.3276 => 5.1056, std.dev.: 0.0731)
  MultiSource/Benchmarks/Bullet/bullet: -4.08% (7.1938 => 6.9006, std.dev.: 0.0622)
  MultiSource/Applications/hexxagon/hexxagon: -4.00% (15.4979 => 14.8778, std.dev.: 0.0553)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.98% (9.1099 => 8.7469, std.dev.: 0.0391)
  SingleSource/Benchmarks/Misc/flops-7: -3.84% (1.7987 => 1.7297, std.dev.: 0.0103)
  SingleSource/Benchmarks/Misc/flops: -3.64% (10.2170 => 9.8452, std.dev.: 0.0042)
  SingleSource/Benchmarks/Shootout/ary3: -3.47% (6.0122 => 5.8036, std.dev.: 0.0066)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -3.08% (2.8537 => 2.7659, std.dev.: 0.0259)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -3.04% (4.1768 => 4.0498, std.dev.: 0.0024)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.01% (3.8665 => 3.7503, std.dev.: 0.0028)
  SingleSource/Benchmarks/Shootout/sieve: -2.98% (8.0178 => 7.7787, std.dev.: 0.0011)
  SingleSource/Benchmarks/Shootout/hash: -2.79% (5.3656 => 5.2158, std.dev.: 0.0270)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.29% (62.4345 => 61.0056, std.dev.: 0.5370)
  SingleSource/Benchmarks/Dhrystone/dry: -2.13% (0.5126 => 0.5017, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.10% (4.5094 => 4.4147, std.dev.: 0.0278)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.94% (4.6452 => 4.5550, std.dev.: 0.0186)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.86% (8.5243 => 8.3657, std.dev.: 0.0082)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.80% (0.1441 => 0.1467, std.dev.: 0.0141)

Report Time: 0.66s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130608/5e7ad1c8/attachment.html>


More information about the llvm-testresults mailing list