[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sat Jul 27 16:45:53 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13833?compare_to=13830&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 13833, Order: 187310, Start Time: 2013-07-27 21:59:57, End Time: 2013-07-27 23:47:33
      To: 13830, Order: 187309, Start Time: 2013-07-27 19:54:31, End Time: 2013-07-27 21:38:53
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

New Failures: 0 (2 on baseline)
Performance Regressions: 13 (23 on baseline)
Performance Improvements: 0 (54 on baseline)
Existing Failures: 3 (1 on baseline)
Unchanged Tests: 1092 (1028 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.29% (0.1619 => 0.1737, std.dev.: 0.0016)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.12% (0.9954 => 1.0065, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.06% (1.3467 => 1.3610, std.dev.: 0.0053)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: 30.84% (0.3978 => 0.5205, std.dev.: 0.0004)
  SingleSource/Benchmarks/Misc/fp-convert: 16.69% (6.9167 => 8.0709, std.dev.: 0.1642)
  SingleSource/Benchmarks/Shootout-C++/fibo: 16.56% (4.1345 => 4.8191, std.dev.: 0.0146)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.24% (0.4227 => 0.4660, std.dev.: 0.0002)
  MultiSource/Benchmarks/mafft/pairlocalalign: 7.50% (41.9174 => 45.0604, std.dev.: 0.2373)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.70% (3.5091 => 3.6742, std.dev.: 0.0176)
  MultiSource/Benchmarks/FreeBench/mason/mason: 4.19% (0.2890 => 0.3011, std.dev.: 0.0018)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.37% (2.4068 => 2.4880, std.dev.: 0.0062)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.19% (2.5297 => 2.5851, std.dev.: 0.0142)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.67% (1.0701 => 1.0880, std.dev.: 0.0041)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Applications/sqlite3/sqlite3: -0.09% (18.3878 => 18.3711, std.dev.: 1.5758)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Applications/ClamAV/clamscan: 1.82% (0.1320 => 0.1344, std.dev.: 0.0265)
  MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Compile Time
---------------------------
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Applications/sqlite3/sqlite3: -4.13% (19.1635 => 18.3711, std.dev.: 1.5758)

New Failures - Execution Time
-----------------------------
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Applications/sqlite3/sqlite3: -100.00% (4.3833 => 0.0000, std.dev.: 0.0000)

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.25% (0.9941 => 1.0065, std.dev.: 0.0025)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: 64.14% (0.3171 => 0.5205, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.54% (2.8867 => 4.2880, std.dev.: 0.0171)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 25.33% (0.0458 => 0.0574)
  MultiSource/Applications/siod/siod: 14.52% (3.3761 => 3.8663, std.dev.: 0.0562)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.23% (0.1348 => 0.1459, std.dev.: 0.0002)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.05% (0.4313 => 0.4660, std.dev.: 0.0002)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.01% (48.3256 => 52.1948, std.dev.: 0.3151)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 7.93% (1.2557 => 1.3553, std.dev.: 0.0100)
  MultiSource/Benchmarks/FreeBench/mason/mason: 7.57% (0.2799 => 0.3011, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.73% (3.2027 => 3.4182, std.dev.: 0.0104)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.10% (5.3042 => 5.6277, std.dev.: 0.0656)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.79% (3.4085 => 3.6060, std.dev.: 0.0341)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.73% (5.5008 => 5.8159, std.dev.: 0.0909)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.25% (5.1471 => 5.3658, std.dev.: 0.0213)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.12% (4.3151 => 4.4928, std.dev.: 0.0025)
  SingleSource/Benchmarks/McGill/misr: 3.57% (0.3674 => 0.3805, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.11% (4.8739 => 5.0257, std.dev.: 0.0198)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.07% (2.5081 => 2.5851, std.dev.: 0.0142)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.66% (3.5791 => 3.6742, std.dev.: 0.0176)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.82% (3.3464 => 3.4074, std.dev.: 0.0132)
  SingleSource/Benchmarks/Misc/flops: 1.57% (9.7664 => 9.9200, std.dev.: 0.0404)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.21% (9.7023 => 9.8195, std.dev.: 0.0339)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -36.70% (0.2237 => 0.1416, std.dev.: 0.0023)
  MultiSource/Benchmarks/Olden/bisort/bisort: -32.65% (0.1072 => 0.0722, std.dev.: 0.0004)
  MultiSource/Benchmarks/Olden/tsp/tsp: -24.53% (0.1818 => 0.1372, std.dev.: 0.0006)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -23.85% (0.0675 => 0.0514, std.dev.: 0.0005)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -23.34% (0.1114 => 0.0854, std.dev.: 0.0012)
  MultiSource/Benchmarks/MallocBench/gs/gs: -22.45% (6.0938 => 4.7260, std.dev.: 0.0327)
  MultiSource/Benchmarks/Olden/health/health: -20.92% (0.1993 => 0.1576, std.dev.: 0.0011)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -19.50% (0.1518 => 0.1222, std.dev.: 0.0042)
  MultiSource/Benchmarks/Olden/em3d/em3d: -13.69% (0.2367 => 0.2043, std.dev.: 0.0019)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -12.89% (0.1870 => 0.1629, std.dev.: 0.0024)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -11.31% (0.1141 => 0.1012, std.dev.: 0.0014)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -10.61% (0.3073 => 0.2747, std.dev.: 0.0026)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -10.59% (0.3655 => 0.3268, std.dev.: 0.0038)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.66% (6.1631 => 5.8143, std.dev.: 0.0216)
  MultiSource/Benchmarks/Olden/bh/bh: -5.27% (0.3603 => 0.3413, std.dev.: 0.0040)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.55% (1.5376 => 1.4676, std.dev.: 0.0052)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -4.48% (5.2851 => 5.0484, std.dev.: 0.0361)
  MultiSource/Benchmarks/nbench/nbench: -4.41% (1.3677 => 1.3074, std.dev.: 0.0043)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -4.27% (5.3476 => 5.1191, std.dev.: 0.0225)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.92% (1.4166 => 1.3610, std.dev.: 0.0053)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.87% (0.7189 => 0.6911, std.dev.: 0.0050)
  MultiSource/Benchmarks/McCat/18-imp/imp: -3.30% (0.4153 => 0.4016, std.dev.: 0.0028)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -2.65% (0.7523 => 0.7324, std.dev.: 0.0021)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -2.35% (1.5544 => 1.5178, std.dev.: 0.0054)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -2.27% (10.3031 => 10.0688, std.dev.: 0.0286)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.82% (1.4932 => 1.4660, std.dev.: 0.0083)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.28% (1.6686 => 1.6472, std.dev.: 0.0079)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: -36.13% (0.2134 => 0.1363, std.dev.: 0.0119)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -35.29% (0.0816 => 0.0528, std.dev.: 0.0030)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.12% (2.1022 => 1.4269, std.dev.: 0.0089)
  MultiSource/Benchmarks/Olden/bisort/bisort: -29.22% (0.9545 => 0.6756, std.dev.: 0.0075)
  MultiSource/Benchmarks/MallocBench/gs/gs: -28.68% (0.1189 => 0.0848, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.61% (6.9552 => 5.2433, std.dev.: 0.0259)
  MultiSource/Applications/JM/ldecod/ldecod: -23.17% (0.0859 => 0.0660, std.dev.: 0.0076)
  MultiSource/Applications/sgefa/sgefa: -13.26% (1.4030 => 1.2170, std.dev.: 0.0029)
  MultiSource/Applications/SPASS/SPASS: -12.69% (9.2220 => 8.0516, std.dev.: 0.1067)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -11.95% (0.3557 => 0.3132, std.dev.: 0.0033)
  MultiSource/Applications/lua/lua: -7.91% (31.0707 => 28.6143, std.dev.: 0.5080)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -7.82% (2.6992 => 2.4880, std.dev.: 0.0062)
  MultiSource/Benchmarks/Olden/health/health: -6.47% (0.3556 => 0.3326, std.dev.: 0.0066)
  MultiSource/Benchmarks/Olden/tsp/tsp: -6.45% (1.5339 => 1.4350, std.dev.: 0.0137)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.49% (1.7207 => 1.6263, std.dev.: 0.0098)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.62% (0.5173 => 0.4934, std.dev.: 0.0020)
  MultiSource/Benchmarks/mafft/pairlocalalign: -4.58% (47.2250 => 45.0604, std.dev.: 0.2373)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.20% (0.2854 => 0.2734, std.dev.: 0.0011)
  MultiSource/Benchmarks/Olden/bh/bh: -4.08% (2.4879 => 2.3864, std.dev.: 0.0162)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -4.06% (0.3773 => 0.3620, std.dev.: 0.0053)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.26% (6.0444 => 5.8476, std.dev.: 0.0381)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.66% (5.2218 => 5.0831, std.dev.: 0.0363)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.18% (6.1482 => 6.0139, std.dev.: 0.0219)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.47% (2.9962 => 2.9521, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.39% (5.8810 => 5.7994, std.dev.: 0.0149)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.35% (4.9231 => 4.8564, std.dev.: 0.0191)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.31% (1.1024 => 1.0880, std.dev.: 0.0041)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.47% (0.1378 => 0.1344, std.dev.: 0.0265)

Report Time: 0.65s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130727/d08a1c57/attachment.html>


More information about the llvm-testresults mailing list