[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Aug 12 07:28:51 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14329?compare_to=14326&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14329, Order: 188171, Start Time: 2013-08-12 12:39:27, End Time: 2013-08-12 14:30:49
      To: 14326, Order: 188158, Start Time: 2013-08-12 10:19:09, End Time: 2013-08-12 12:13:42
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 19 (38 on baseline)
Performance Improvements: 20 (42 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1068 (1027 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 29.71% (0.9652 => 1.2520, std.dev.: 0.0603)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 28.10% (0.4110 => 0.5265, std.dev.: 0.0288)
  MultiSource/Applications/lua/lua: 23.97% (4.3801 => 5.4298, std.dev.: 0.1081)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 21.24% (1.1976 => 1.4520, std.dev.: 0.0661)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 13.08% (0.1139 => 0.1288, std.dev.: 0.0055)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.83% (1.0237 => 1.1550, std.dev.: 0.0237)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 10.95% (0.2338 => 0.2594, std.dev.: 0.0071)
  SingleSource/Benchmarks/Shootout-C++/hash: 10.30% (0.4575 => 0.5046, std.dev.: 0.0042)
  MultiSource/Applications/oggenc/oggenc: 7.54% (5.7238 => 6.1555, std.dev.: 0.1660)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 69.80% (2.9095 => 4.9404, std.dev.: 0.1256)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 33.15% (3.9906 => 5.3134, std.dev.: 0.3560)
  MultiSource/Applications/obsequi/Obsequi: 18.13% (2.1449 => 2.5337, std.dev.: 0.0181)
  SingleSource/Benchmarks/Shootout-C++/hash: 10.75% (0.7281 => 0.8064, std.dev.: 0.0042)
  SingleSource/Benchmarks/Shootout/strcat: 7.73% (0.1461 => 0.1574, std.dev.: 0.0036)
  MultiSource/Applications/sqlite3/sqlite3: 5.24% (4.2858 => 4.5103, std.dev.: 0.0036)
  SingleSource/Benchmarks/Shootout-C++/sieve: 2.19% (3.4823 => 3.5587, std.dev.: 0.0177)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.77% (12.8778 => 13.1061, std.dev.: 0.0330)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.76% (6.3498 => 6.4613, std.dev.: 0.0121)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.21% (1.6304 => 1.6502, std.dev.: 0.0056)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -42.13% (0.2580 => 0.1493, std.dev.: 0.0075)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: -35.60% (0.2180 => 0.1404, std.dev.: 0.0264)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -31.29% (0.3493 => 0.2400, std.dev.: 0.0359)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -15.40% (9.0095 => 7.6221, std.dev.: 0.0554)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -12.02% (1.7023 => 1.4976, std.dev.: 0.0554)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -10.85% (1.6434 => 1.4651, std.dev.: 0.0267)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -10.20% (1.5571 => 1.3983, std.dev.: 0.0158)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -9.24% (1.4982 => 1.3597, std.dev.: 0.0504)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -5.09% (0.2477 => 0.2351, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.62% (1.4453 => 1.3785, std.dev.: 0.0160)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.96% (1.5606 => 1.4988, std.dev.: 0.0120)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -22.21% (3.4509 => 2.6846, std.dev.: 0.1991)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -19.27% (3.1780 => 2.5656, std.dev.: 0.0764)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -11.44% (0.5837 => 0.5169, std.dev.: 0.0028)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: -4.64% (0.9426 => 0.8989, std.dev.: 0.0006)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.32% (16.9063 => 16.3447, std.dev.: 0.0168)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.94% (4.7362 => 4.6444, std.dev.: 0.0142)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.31% (5.1415 => 5.0740, std.dev.: 0.0137)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.11% (4.9943 => 4.9391, std.dev.: 0.0177)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.02% (5.8601 => 5.8003, std.dev.: 0.0016)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.65% (0.1312 => 0.1251, std.dev.: 0.0188)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/SciMark2-C/scimark2: 35.94% (0.3873 => 0.5265, std.dev.: 0.0288)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 33.09% (0.9407 => 1.2520, std.dev.: 0.0603)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.19% (0.9941 => 1.1550, std.dev.: 0.0237)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 14.80% (0.1122 => 0.1288, std.dev.: 0.0055)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 11.91% (0.2318 => 0.2594, std.dev.: 0.0071)
  SingleSource/Benchmarks/Shootout-C++/hash: 11.29% (0.4534 => 0.5046, std.dev.: 0.0042)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.16% (0.3592 => 0.3993, std.dev.: 0.0133)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 69.64% (2.9123 => 4.9404, std.dev.: 0.1256)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 68.23% (3.7285 => 6.2725, std.dev.: 0.1484)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.79% (2.8867 => 4.2951, std.dev.: 0.0136)
  MultiSource/Benchmarks/FreeBench/neural/neural: 37.87% (0.3171 => 0.4372, std.dev.: 0.0024)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 32.91% (3.9978 => 5.3134, std.dev.: 0.3560)
  SingleSource/Benchmarks/Shootout-C++/hash: 28.10% (0.6295 => 0.8064, std.dev.: 0.0042)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.48% (1.5030 => 1.8859, std.dev.: 0.0069)
  SingleSource/Benchmarks/Misc/pi: 25.27% (1.9835 => 2.4848, std.dev.: 0.0317)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.27% (14.9584 => 16.3447, std.dev.: 0.0168)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.46% (1.2557 => 1.3619, std.dev.: 0.0230)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.30% (5.4910 => 5.9465, std.dev.: 0.0059)
  MultiSource/Applications/JM/lencod/lencod: 8.23% (7.1799 => 7.7707, std.dev.: 0.1388)
  SingleSource/Benchmarks/Linpack/linpack-pc: 6.71% (48.3256 => 51.5664, std.dev.: 0.3231)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.98% (5.3042 => 5.6214, std.dev.: 0.0286)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.71% (3.4085 => 3.6031, std.dev.: 0.0218)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.50% (6.1245 => 6.4613, std.dev.: 0.0121)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.44% (5.5008 => 5.8003, std.dev.: 0.0016)
  SingleSource/Benchmarks/Shootout-C++/hash2: 5.11% (3.3877 => 3.5609, std.dev.: 0.0075)
  SingleSource/Benchmarks/Misc/whetstone: 4.72% (3.4559 => 3.6190, std.dev.: 0.0162)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.32% (4.3151 => 4.5015, std.dev.: 0.0602)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.25% (5.1471 => 5.3658, std.dev.: 0.0172)
  SingleSource/Benchmarks/Misc/ffbench: 3.85% (1.3679 => 1.4205, std.dev.: 0.0191)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.67% (3.3384 => 3.4608, std.dev.: 0.0173)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.59% (25.0200 => 25.9174, std.dev.: 0.0907)
  SingleSource/Benchmarks/Shootout-C++/sieve: 2.95% (3.4566 => 3.5587, std.dev.: 0.0177)
  MultiSource/Applications/sqlite3/sqlite3: 2.90% (4.3833 => 4.5103, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.89% (12.8625 => 13.1061, std.dev.: 0.0330)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.53% (3.3464 => 3.3977, std.dev.: 0.0185)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.51% (1.1618 => 1.1794, std.dev.: 0.0039)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.34% (11.5371 => 11.6920, std.dev.: 0.0072)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.21% (1.4398 => 1.4572, std.dev.: 0.0040)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -12.13% (0.7091 => 0.6231, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -10.91% (1.7797 => 1.5855, std.dev.: 0.0217)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -9.36% (0.3655 => 0.3313, std.dev.: 0.0025)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -7.82% (1.1012 => 1.0151, std.dev.: 0.0078)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -7.67% (1.5144 => 1.3983, std.dev.: 0.0158)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -7.62% (1.5345 => 1.4175, std.dev.: 0.0336)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.82% (1.4794 => 1.3785, std.dev.: 0.0160)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.44% (1.5239 => 1.4257, std.dev.: 0.0144)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.43% (1.4333 => 1.3411, std.dev.: 0.0070)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.35% (0.7189 => 0.6948, std.dev.: 0.0048)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.24% (1.9671 => 1.9427, std.dev.: 0.0073)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -31.96% (2.1022 => 1.4304, std.dev.: 0.0135)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -30.39% (0.0816 => 0.0568, std.dev.: 0.0002)
  MultiSource/Applications/viterbi/viterbi: -27.42% (3.4923 => 2.5347, std.dev.: 0.0516)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.66% (6.9552 => 5.2402, std.dev.: 0.0178)
  SingleSource/Benchmarks/Misc/perlin: -21.26% (4.5989 => 3.6210, std.dev.: 0.0219)
  MultiSource/Applications/JM/ldecod/ldecod: -18.39% (0.0859 => 0.0701, std.dev.: 0.0039)
  SingleSource/Benchmarks/Misc/mandel: -13.95% (1.1996 => 1.0323, std.dev.: 0.0613)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.66% (0.5173 => 0.4725, std.dev.: 0.0164)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.24% (3.5791 => 3.3557, std.dev.: 0.0640)
  MultiSource/Benchmarks/mafft/pairlocalalign: -5.06% (47.2250 => 44.8355, std.dev.: 0.7030)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.24% (0.7355 => 0.7043, std.dev.: 0.0047)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.20% (2.7049 => 2.5912, std.dev.: 0.0161)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.14% (1.1024 => 1.0568, std.dev.: 0.0025)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -4.10% (1.7207 => 1.6502, std.dev.: 0.0056)
  SingleSource/Benchmarks/Misc/fbench: -3.95% (4.9602 => 4.7643, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.47% (6.0444 => 5.8349, std.dev.: 0.0096)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.17% (6.1482 => 5.9530, std.dev.: 0.0281)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.16% (21.6864 => 21.0003, std.dev.: 0.2274)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -3.03% (0.4783 => 0.4638, std.dev.: 0.0015)
  MultiSource/Applications/obsequi/Obsequi: -2.85% (2.6081 => 2.5337, std.dev.: 0.0181)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.83% (5.2218 => 5.0740, std.dev.: 0.0137)
  MultiSource/Applications/sgefa/sgefa: -2.47% (1.4030 => 1.3683, std.dev.: 0.0054)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.29% (8.6172 => 8.4201, std.dev.: 0.0633)
  SingleSource/Benchmarks/Misc/oourafft: -2.07% (3.7891 => 3.7107, std.dev.: 0.0251)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.92% (1.8144 => 1.7795, std.dev.: 0.0025)
  MultiSource/Benchmarks/BitBench/five11/five11: -1.65% (5.6678 => 5.5744, std.dev.: 0.0297)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.62% (2.1343 => 2.0998, std.dev.: 0.0047)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.57% (5.0180 => 4.9391, std.dev.: 0.0177)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.51% (34.8438 => 34.3167, std.dev.: 0.0207)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.45% (5.8810 => 5.7958, std.dev.: 0.0258)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -1.21% (1.6737 => 1.6534, std.dev.: 0.0054)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -9.22% (0.1378 => 0.1251, std.dev.: 0.0188)

Report Time: 0.81s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130812/dc0fa0a1/attachment.html>


More information about the llvm-testresults mailing list