[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue May 28 01:28:03 PDT 2013 

http://llvm.org/perf/db_default/v4/nts/11793?compare_to=11791&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 11793, Order: 182753, Start Time: 2013-05-28 06:45:36, End Time: 2013-05-28 08:28:35
      To: 11791, Order: 182750, Start Time: 2013-05-28 04:43:40, End Time: 2013-05-28 06:25:43
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 14 (9 on baseline)
Performance Improvements: 1 (85 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1092 (1013 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.18% (0.6879 => 0.7235, std.dev.: 0.0056)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.16% (0.6805 => 0.6952, std.dev.: 0.0001)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.76% (0.7141 => 0.7267, std.dev.: 0.0036)
  MultiSource/Benchmarks/PAQ8p/paq8p: 1.16% (2.5017 => 2.5308, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.03% (1.4996 => 1.5151, std.dev.: 0.0030)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/matrix: 14.12% (1.7367 => 1.9820, std.dev.: 0.0313)
  SingleSource/Benchmarks/Shootout/nestedloop: 14.09% (0.1384 => 0.1579, std.dev.: 0.0018)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 9.26% (3.2285 => 3.5273, std.dev.: 0.1160)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.78% (6.9794 => 7.3826, std.dev.: 0.0813)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.34% (0.4249 => 0.4476, std.dev.: 0.0051)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 4.18% (2.9683 => 3.0924, std.dev.: 0.0217)
  MultiSource/Benchmarks/nbench/nbench: 4.17% (20.9262 => 21.7992, std.dev.: 0.0974)
  MultiSource/Benchmarks/PAQ8p/paq8p: 3.17% (91.4957 => 94.3965, std.dev.: 1.0140)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.42% (2.7067 => 2.7722, std.dev.: 0.0188)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.32% (2.4906 => 2.4080, std.dev.: 0.0151)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.85% (0.1404 => 0.1416, std.dev.: 0.0016)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.75% (1.3833 => 1.4075, std.dev.: 0.0087)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.01% (1.4999 => 1.5151, std.dev.: 0.0030)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/matrix: 14.20% (1.7355 => 1.9820, std.dev.: 0.0313)
  SingleSource/Benchmarks/Shootout/nestedloop: 12.07% (0.1409 => 0.1579, std.dev.: 0.0018)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.47% (0.9806 => 1.0931, std.dev.: 0.0160)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.73% (6.1372 => 6.6727, std.dev.: 0.1495)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.20% (7.0179 => 7.3826, std.dev.: 0.0813)
  SingleSource/Benchmarks/Shootout/methcall: 2.56% (8.3425 => 8.5560, std.dev.: 0.0156)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.28% (3.0234 => 3.0924, std.dev.: 0.0217)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/viterbi/viterbi: -26.33% (0.2431 => 0.1791, std.dev.: 0.0057)
  SingleSource/Benchmarks/Misc/whetstone: -15.59% (0.1097 => 0.0926, std.dev.: 0.0051)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.68% (0.1151 => 0.1005, std.dev.: 0.0009)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.27% (0.1646 => 0.1444, std.dev.: 0.0011)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -12.20% (0.7918 => 0.6952, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -11.44% (0.1075 => 0.0952, std.dev.: 0.0005)
  MultiSource/Applications/JM/lencod/lencod: -11.16% (18.9387 => 16.8256, std.dev.: 0.6586)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.60% (1.5932 => 1.4244, std.dev.: 0.0078)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.42% (0.2006 => 0.1797, std.dev.: 0.0030)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -9.98% (0.1322 => 0.1190, std.dev.: 0.0008)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -9.71% (1.0314 => 0.9313, std.dev.: 0.0095)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.51% (5.1587 => 4.6681, std.dev.: 0.0137)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.45% (0.8025 => 0.7267, std.dev.: 0.0036)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -9.44% (1.7804 => 1.6124, std.dev.: 0.0063)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -8.98% (5.4314 => 4.9438, std.dev.: 0.0315)
  MultiSource/Benchmarks/Olden/em3d/em3d: -7.89% (0.2117 => 0.1950, std.dev.: 0.0023)
  MultiSource/Applications/aha/aha: -7.82% (0.1407 => 0.1297, std.dev.: 0.0012)
  MultiSource/Benchmarks/McCat/18-imp/imp: -7.76% (0.4199 => 0.3873, std.dev.: 0.0048)
  MultiSource/Applications/lemon/lemon: -7.62% (1.3155 => 1.2153, std.dev.: 0.0056)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -7.35% (15.9860 => 14.8106, std.dev.: 0.0512)
  MultiSource/Applications/Burg/burg: -7.07% (1.5375 => 1.4288, std.dev.: 0.0295)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -7.05% (0.1886 => 0.1753, std.dev.: 0.0017)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.87% (0.7381 => 0.6874, std.dev.: 0.0098)
  MultiSource/Applications/oggenc/oggenc: -6.63% (5.9886 => 5.5914, std.dev.: 0.1343)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -6.42% (0.1853 => 0.1734, std.dev.: 0.0024)
  MultiSource/Applications/kimwitu++/kc: -6.36% (20.1855 => 18.9025, std.dev.: 0.0955)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.22% (2.0439 => 1.9168, std.dev.: 0.0135)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.15% (1.6793 => 1.5761, std.dev.: 0.0276)
  MultiSource/Benchmarks/McCat/09-vor/vor: -6.02% (0.3723 => 0.3499, std.dev.: 0.0019)
  MultiSource/Benchmarks/McCat/05-eks/eks: -5.95% (0.5698 => 0.5359, std.dev.: 0.0043)
  MultiSource/Applications/lambda-0_1_3/lambda: -5.85% (0.8649 => 0.8143, std.dev.: 0.0037)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.70% (0.2753 => 0.2596, std.dev.: 0.0017)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -5.40% (1.3686 => 1.2947, std.dev.: 0.0031)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -5.01% (0.2416 => 0.2295, std.dev.: 0.0027)
  MultiSource/Applications/SPASS/SPASS: -4.99% (17.6379 => 16.7569, std.dev.: 0.2279)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.80% (0.2961 => 0.2819, std.dev.: 0.0012)
  MultiSource/Benchmarks/McCat/08-main/main: -4.67% (0.3040 => 0.2898, std.dev.: 0.0035)
  SingleSource/Benchmarks/Linpack/linpack-pc: -4.38% (0.2738 => 0.2618, std.dev.: 0.0034)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -4.14% (0.5887 => 0.5643, std.dev.: 0.0072)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.05% (7.7211 => 7.4084, std.dev.: 0.0255)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.93% (0.4861 => 0.4670, std.dev.: 0.0040)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -3.87% (10.1602 => 9.7673, std.dev.: 0.0567)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.53% (0.3853 => 0.3717, std.dev.: 0.0025)
  MultiSource/Benchmarks/Olden/bh/bh: -3.30% (0.3429 => 0.3316, std.dev.: 0.0008)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.93% (0.9957 => 0.9665, std.dev.: 0.0062)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -2.86% (1.2006 => 1.1663, std.dev.: 0.0045)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -2.58% (0.4030 => 0.3926, std.dev.: 0.0026)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -2.43% (1.1954 => 1.1664, std.dev.: 0.0065)
  MultiSource/Applications/spiff/spiff: -2.41% (0.9365 => 0.9139, std.dev.: 0.0080)
  MultiSource/Applications/d/make_dparser: -2.37% (3.7330 => 3.6444, std.dev.: 0.0187)
  MultiSource/Applications/sqlite3/sqlite3: -2.32% (16.9719 => 16.5778, std.dev.: 0.0419)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.88% (0.7334 => 0.7196, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.70% (1.8435 => 1.8121, std.dev.: 0.0018)
  MultiSource/Applications/obsequi/Obsequi: -1.52% (1.1733 => 1.1555, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.40% (1.6804 => 1.6568, std.dev.: 0.0026)
  MultiSource/Applications/lua/lua: -1.30% (4.3359 => 4.2794, std.dev.: 0.0146)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -44.03% (0.0243 => 0.0136, std.dev.: 0.0040)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.43% (1.2911 => 0.7304, std.dev.: 0.0153)
  MultiSource/Benchmarks/Olden/mst/mst: -37.40% (0.2099 => 0.1314, std.dev.: 0.0121)
  MultiSource/Applications/lemon/lemon: -32.57% (1.3499 => 0.9102, std.dev.: 0.0326)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.59% (4.4050 => 3.2335, std.dev.: 0.1434)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -26.55% (1.0251 => 0.7529, std.dev.: 0.0585)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -25.30% (6.2328 => 4.6560, std.dev.: 0.1852)
  MultiSource/Benchmarks/Olden/bisort/bisort: -21.74% (0.8606 => 0.6735, std.dev.: 0.0082)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.10% (25.3677 => 21.2824, std.dev.: 0.3375)
  MultiSource/Applications/minisat/minisat: -15.06% (7.3703 => 6.2604, std.dev.: 0.0301)
  SingleSource/Benchmarks/Misc/salsa20: -13.04% (10.3398 => 8.9912, std.dev.: 0.0809)
  MultiSource/Applications/SIBsim4/SIBsim4: -11.95% (3.5327 => 3.1105, std.dev.: 0.1145)
  MultiSource/Benchmarks/FreeBench/neural/neural: -7.80% (0.3513 => 0.3239, std.dev.: 0.0099)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.67% (4.5717 => 4.2668, std.dev.: 0.0236)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.53% (0.1945 => 0.1818, std.dev.: 0.0021)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -6.28% (4.1768 => 3.9144, std.dev.: 0.0987)
  MultiSource/Benchmarks/FreeBench/distray/distray: -5.23% (0.2332 => 0.2210, std.dev.: 0.0045)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.07% (2.5366 => 2.4080, std.dev.: 0.0151)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -4.85% (4.2334 => 4.0281, std.dev.: 0.0687)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.54% (0.2777 => 0.2651, std.dev.: 0.0034)
  MultiSource/Applications/sqlite3/sqlite3: -3.62% (4.6358 => 4.4682, std.dev.: 0.0039)
  SingleSource/Benchmarks/Misc/flops: -3.53% (10.2170 => 9.8559, std.dev.: 0.0666)
  MultiSource/Benchmarks/Olden/tsp/tsp: -3.39% (1.6613 => 1.6049, std.dev.: 0.0054)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.19% (2.7180 => 2.6312, std.dev.: 0.0288)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.12% (4.8986 => 4.7459, std.dev.: 0.0106)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -2.86% (2.8537 => 2.7722, std.dev.: 0.0188)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -2.71% (1.6679 => 1.6227, std.dev.: 0.0090)
  MultiSource/Benchmarks/nbench/nbench: -2.25% (22.3004 => 21.7992, std.dev.: 0.0974)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -1.07% (1.6105 => 1.5932, std.dev.: 0.0037)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.73% (0.1441 => 0.1416, std.dev.: 0.0016)

Report Time: 0.62s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130528/978d32c8/attachment.html>

More information about the llvm-testresults mailing list