[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Jul 28 18:53:14 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13867?compare_to=13863&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 13867, Order: 187335, Start Time: 2013-07-29 00:11:34, End Time: 2013-07-29 01:54:56
      To: 13863, Order: 187333, Start Time: 2013-07-28 22:00:29, End Time: 2013-07-28 23:47:21
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 9 (21 on baseline)
Performance Improvements: 4 (105 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1094 (981 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: 1.07% (17.4004 => 17.5863, std.dev.: 0.0229)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/city/city: 29.70% (0.0367 => 0.0476, std.dev.: 0.0004)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 7.48% (0.8511 => 0.9148, std.dev.: 0.0094)
  MultiSource/Applications/hexxagon/hexxagon: 6.18% (15.7366 => 16.7087, std.dev.: 0.2104)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.58% (5.0199 => 5.3000, std.dev.: 0.0297)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.57% (20.8866 => 21.6316, std.dev.: 0.1155)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.06% (12.7148 => 12.9763, std.dev.: 0.0541)
  SingleSource/Benchmarks/McGill/queens: 1.85% (1.6549 => 1.6855, std.dev.: 0.0015)
  MultiSource/Applications/sqlite3/sqlite3: 1.11% (4.3739 => 4.4224, std.dev.: 0.0070)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/spiff/spiff: -1.37% (0.9504 => 0.9374, std.dev.: 0.0040)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.92% (16.7066 => 15.3827, std.dev.: 0.4405)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.91% (0.2861 => 0.2692, std.dev.: 0.0021)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.48% (1.6127 => 1.5889, std.dev.: 0.0080)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 3.34% (0.1317 => 0.1361, std.dev.: 0.0022)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 50.02% (2.8867 => 4.3306, std.dev.: 0.0184)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 30.05% (0.0366 => 0.0476, std.dev.: 0.0004)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.20% (1.5030 => 1.8817, std.dev.: 0.0109)
  MultiSource/Applications/siod/siod: 13.55% (3.3761 => 3.8335, std.dev.: 0.0134)
  MultiSource/Benchmarks/FreeBench/mason/mason: 8.86% (0.2799 => 0.3047, std.dev.: 0.0000)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.31% (5.4910 => 5.9474, std.dev.: 0.0481)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.94% (48.3256 => 52.1622, std.dev.: 0.0133)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 7.92% (1.2557 => 1.3552, std.dev.: 0.0026)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.86% (0.1348 => 0.1454, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.88% (3.2027 => 3.4230, std.dev.: 0.0085)
  MultiSource/Applications/hexxagon/hexxagon: 6.76% (15.6513 => 16.7087, std.dev.: 0.2104)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.81% (5.3042 => 5.6126, std.dev.: 0.0617)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.67% (3.4085 => 3.6017, std.dev.: 0.0117)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.44% (5.5008 => 5.8003, std.dev.: 0.0684)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.25% (5.1471 => 5.3660, std.dev.: 0.0263)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.20% (4.3151 => 4.4962, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.74% (3.3384 => 3.4633, std.dev.: 0.0432)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 3.13% (2.3894 => 2.4641, std.dev.: 0.0177)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.96% (4.8739 => 5.0184, std.dev.: 0.0237)
  SingleSource/Benchmarks/McGill/queens: 1.93% (1.6536 => 1.6855, std.dev.: 0.0015)
  SingleSource/Benchmarks/Misc/flops: 1.45% (9.7664 => 9.9085, std.dev.: 0.0413)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -35.94% (0.2237 => 0.1433, std.dev.: 0.0010)
  MultiSource/Benchmarks/Olden/bisort/bisort: -35.17% (0.1072 => 0.0695, std.dev.: 0.0020)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -25.04% (0.1114 => 0.0835, std.dev.: 0.0028)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -24.00% (0.0675 => 0.0513, std.dev.: 0.0013)
  MultiSource/Benchmarks/Olden/tsp/tsp: -23.87% (0.1818 => 0.1384, std.dev.: 0.0007)
  MultiSource/Benchmarks/MallocBench/gs/gs: -22.26% (6.0938 => 4.7372, std.dev.: 0.0101)
  MultiSource/Benchmarks/Olden/health/health: -21.02% (0.1993 => 0.1574, std.dev.: 0.0029)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -20.67% (1.5228 => 1.2080, std.dev.: 0.0019)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -19.60% (0.3576 => 0.2875, std.dev.: 0.0009)
  MultiSource/Applications/obsequi/Obsequi: -19.56% (1.4685 => 1.1813, std.dev.: 0.0076)
  MultiSource/Applications/lua/lua: -17.97% (5.3200 => 4.3639, std.dev.: 0.0367)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -17.79% (0.1518 => 0.1248, std.dev.: 0.0003)
  MultiSource/Applications/hbd/hbd: -17.77% (2.0193 => 1.6605, std.dev.: 0.0025)
  MultiSource/Benchmarks/Olden/em3d/em3d: -16.01% (0.2367 => 0.1988, std.dev.: 0.0070)
  MultiSource/Applications/hexxagon/hexxagon: -15.10% (1.3285 => 1.1279, std.dev.: 0.0049)
  MultiSource/Applications/sgefa/sgefa: -14.39% (0.4809 => 0.4117, std.dev.: 0.0048)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -13.97% (1.3985 => 1.2031, std.dev.: 0.0056)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -12.95% (0.7091 => 0.6173, std.dev.: 0.0062)
  MultiSource/Applications/ClamAV/clamscan: -12.18% (19.4145 => 17.0505, std.dev.: 0.0226)
  MultiSource/Applications/JM/ldecod/ldecod: -11.80% (8.6720 => 7.6487, std.dev.: 0.0172)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -11.76% (0.1870 => 0.1650, std.dev.: 0.0000)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -11.71% (0.1947 => 0.1719, std.dev.: 0.0045)
  MultiSource/Applications/lambda-0_1_3/lambda: -11.34% (0.9461 => 0.8388, std.dev.: 0.0040)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -10.54% (0.3073 => 0.2749, std.dev.: 0.0048)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -10.40% (0.3655 => 0.3275, std.dev.: 0.0002)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -9.78% (1.1012 => 0.9935, std.dev.: 0.0006)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -9.55% (0.1141 => 0.1032, std.dev.: 0.0014)
  MultiSource/Applications/sqlite3/sqlite3: -8.23% (19.1635 => 17.5863, std.dev.: 0.0229)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -7.65% (0.2498 => 0.2307, std.dev.: 0.0009)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.46% (1.7461 => 1.6158, std.dev.: 0.0075)
  MultiSource/Applications/siod/siod: -7.28% (2.7150 => 2.5174, std.dev.: 0.0276)
  MultiSource/Applications/Burg/burg: -7.21% (1.5733 => 1.4599, std.dev.: 0.0063)
  MultiSource/Applications/kimwitu++/kc: -6.89% (21.0770 => 19.6251, std.dev.: 0.0206)
  MultiSource/Applications/oggenc/oggenc: -6.64% (6.1121 => 5.7065, std.dev.: 0.0336)
  MultiSource/Applications/JM/lencod/lencod: -6.42% (18.5029 => 17.3145, std.dev.: 0.0459)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.32% (6.1631 => 5.7738, std.dev.: 0.0142)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -5.80% (0.2432 => 0.2291, std.dev.: 0.0025)
  MultiSource/Applications/minisat/minisat: -5.76% (0.8278 => 0.7801, std.dev.: 0.0035)
  MultiSource/Benchmarks/Olden/bh/bh: -5.69% (0.3603 => 0.3398, std.dev.: 0.0033)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.16% (1.5376 => 1.4582, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.01% (1.5361 => 1.4591, std.dev.: 0.0288)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.00% (5.3476 => 5.0800, std.dev.: 0.0374)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.85% (1.4853 => 1.4133, std.dev.: 0.0269)
  MultiSource/Applications/SPASS/SPASS: -4.65% (17.9111 => 17.0782, std.dev.: 0.0849)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -4.35% (5.2851 => 5.0551, std.dev.: 0.0070)
  MultiSource/Benchmarks/nbench/nbench: -4.33% (1.3677 => 1.3085, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -3.88% (1.4947 => 1.4367, std.dev.: 0.0217)
  MultiSource/Applications/lemon/lemon: -3.72% (1.2976 => 1.2493, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.55% (1.5479 => 1.4929, std.dev.: 0.0176)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.34% (0.7189 => 0.6949, std.dev.: 0.0008)
  MultiSource/Benchmarks/McCat/18-imp/imp: -3.30% (0.4153 => 0.4016, std.dev.: 0.0045)
  MultiSource/Benchmarks/McCat/09-vor/vor: -3.27% (0.3670 => 0.3550, std.dev.: 0.0046)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.63% (15.5498 => 15.1401, std.dev.: 0.0439)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -2.63% (1.3780 => 1.3417, std.dev.: 0.0031)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -2.58% (10.3031 => 10.0374, std.dev.: 0.0500)
  MultiSource/Applications/spiff/spiff: -2.13% (0.9578 => 0.9374, std.dev.: 0.0040)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.98% (0.7487 => 0.7339, std.dev.: 0.0034)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.97% (1.4932 => 1.4638, std.dev.: 0.0087)
  MultiSource/Benchmarks/McCat/05-eks/eks: -1.95% (0.5634 => 0.5524, std.dev.: 0.0018)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -1.72% (1.5544 => 1.5276, std.dev.: 0.0074)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.47% (1.6686 => 1.6441, std.dev.: 0.0053)
  MultiSource/Applications/d/make_dparser: -1.42% (3.7722 => 3.7185, std.dev.: 0.0038)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -51.90% (0.0316 => 0.0152, std.dev.: 0.0044)
  MultiSource/Benchmarks/Olden/mst/mst: -37.35% (0.2134 => 0.1337, std.dev.: 0.0006)
  MultiSource/Applications/lemon/lemon: -35.18% (1.4194 => 0.9201, std.dev.: 0.0164)
  MultiSource/Benchmarks/MallocBench/gs/gs: -35.16% (0.1189 => 0.0771, std.dev.: 0.0042)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -33.33% (0.0816 => 0.0544, std.dev.: 0.0012)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.37% (2.1022 => 1.4218, std.dev.: 0.0043)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -30.79% (1.0962 => 0.7587, std.dev.: 0.0525)
  MultiSource/Benchmarks/Olden/bisort/bisort: -29.53% (0.9545 => 0.6726, std.dev.: 0.0109)
  MultiSource/Applications/JM/ldecod/ldecod: -25.96% (0.0859 => 0.0636, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.63% (6.9552 => 5.2418, std.dev.: 0.1437)
  MultiSource/Applications/minisat/minisat: -21.36% (8.0162 => 6.3040, std.dev.: 0.3135)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.51% (6.2627 => 5.3542, std.dev.: 0.2757)
  MultiSource/Applications/obsequi/Obsequi: -13.52% (2.6081 => 2.2556, std.dev.: 0.0609)
  MultiSource/Applications/SPASS/SPASS: -12.90% (9.2220 => 8.0325, std.dev.: 0.0522)
  MultiSource/Applications/sgefa/sgefa: -12.82% (1.4030 => 1.2232, std.dev.: 0.0010)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.20% (0.3557 => 0.3123, std.dev.: 0.0062)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.34% (2.6094 => 2.3395, std.dev.: 0.1021)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -10.03% (0.3649 => 0.3283, std.dev.: 0.0123)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -9.53% (3.9978 => 3.6170, std.dev.: 0.0570)
  MultiSource/Applications/lua/lua: -8.16% (31.0707 => 28.5366, std.dev.: 0.5077)
  MultiSource/Benchmarks/Olden/health/health: -6.86% (0.3556 => 0.3312, std.dev.: 0.0072)
  MultiSource/Benchmarks/Olden/tsp/tsp: -6.63% (1.5339 => 1.4322, std.dev.: 0.0249)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.51% (0.2849 => 0.2692, std.dev.: 0.0021)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.32% (1.7207 => 1.6291, std.dev.: 0.0132)
  MultiSource/Benchmarks/mafft/pairlocalalign: -5.26% (47.2250 => 44.7408, std.dev.: 0.1498)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.93% (0.5173 => 0.4918, std.dev.: 0.0023)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.80% (0.2854 => 0.2717, std.dev.: 0.0020)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.36% (0.7355 => 0.7034, std.dev.: 0.0008)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -4.29% (0.3773 => 0.3611, std.dev.: 0.0059)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.25% (2.7049 => 2.5900, std.dev.: 0.0326)
  MultiSource/Benchmarks/Olden/bh/bh: -3.98% (2.4879 => 2.3889, std.dev.: 0.0090)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.91% (0.2813 => 0.2703, std.dev.: 0.0024)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.54% (21.6864 => 20.9179, std.dev.: 0.2437)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.43% (6.0444 => 5.8368, std.dev.: 0.0574)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.10% (0.3479 => 0.3371, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.02% (6.1482 => 5.9627, std.dev.: 0.0116)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -2.99% (0.4783 => 0.4640, std.dev.: 0.0006)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.93% (1.1024 => 1.0701, std.dev.: 0.0114)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.81% (5.2218 => 5.0749, std.dev.: 0.0555)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.64% (2.9962 => 2.9471, std.dev.: 0.0092)
  MultiSource/Applications/SIBsim4/SIBsim4: -1.63% (3.5791 => 3.5208, std.dev.: 0.0005)
  MultiSource/Benchmarks/llubenchmark/llu: -1.22% (2.0187 => 1.9940, std.dev.: 0.0085)
  SingleSource/Benchmarks/Misc/oourafft: -1.17% (3.7891 => 3.7449, std.dev.: 0.0119)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.23% (0.1378 => 0.1361, std.dev.: 0.0022)

Report Time: 0.76s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130728/e3c55c2d/attachment.html>


More information about the llvm-testresults mailing list