[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Aug 18 01:16:11 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14521?compare_to=14518&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14521, Order: 188622, Start Time: 2013-08-18 06:33:34, End Time: 2013-08-18 08:18:15
      To: 14518, Order: 188621, Start Time: 2013-08-18 04:26:16, End Time: 2013-08-18 06:11:55
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 5 (35 on baseline)
Performance Improvements: 5 (91 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1097 (981 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 7.29% (0.8366 => 0.8976, std.dev.: 0.0104)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.24% (5.0159 => 5.3288, std.dev.: 0.0278)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.87% (15.8919 => 16.5075, std.dev.: 0.2269)
  SingleSource/Benchmarks/Shootout/methcall: 2.65% (8.3549 => 8.5763, std.dev.: 0.0091)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.04% (1.6313 => 1.6645, std.dev.: 0.0069)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/Burg/burg: -2.93% (1.4976 => 1.4537, std.dev.: 0.0166)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -1.42% (1.2223 => 1.2050, std.dev.: 0.0033)
  MultiSource/Benchmarks/Prolangs-C++/city/city: -1.19% (1.6877 => 1.6676, std.dev.: 0.0078)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Fhourstones/fhourstones: -5.41% (1.3254 => 1.2537, std.dev.: 0.0223)
  MultiSource/Applications/spiff/spiff: -1.88% (2.9019 => 2.8474, std.dev.: 0.0127)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.46% (0.1301 => 0.1307, std.dev.: 0.0015)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/distray/distray: 16.46% (0.1033 => 0.1203, std.dev.: 0.0031)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.93% (0.9941 => 1.0232, std.dev.: 0.0062)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.90% (0.9761 => 0.9946, std.dev.: 0.0042)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 73.27% (3.7285 => 6.4603, std.dev.: 0.0542)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.30% (2.8867 => 4.2809, std.dev.: 0.0193)
  MultiSource/Benchmarks/FreeBench/neural/neural: 30.37% (0.3171 => 0.4134, std.dev.: 0.0137)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.85% (7.0762 => 7.8443, std.dev.: 0.0294)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.36% (14.9584 => 16.5075, std.dev.: 0.2269)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.30% (0.1678 => 0.1834, std.dev.: 0.0040)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.38% (1.2557 => 1.3609, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.32% (5.4910 => 5.9477, std.dev.: 0.0542)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.92% (48.3256 => 52.1522, std.dev.: 0.3572)
  MultiSource/Applications/JM/lencod/lencod: 7.19% (7.1799 => 7.6961, std.dev.: 0.0087)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.91% (3.2027 => 3.4240, std.dev.: 0.0447)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.99% (5.3042 => 5.6218, std.dev.: 0.0452)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.75% (3.4085 => 3.6044, std.dev.: 0.0448)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.44% (5.5008 => 5.8000, std.dev.: 0.0671)
  MultiSource/Benchmarks/Olden/tsp/tsp: 4.84% (1.5339 => 1.6081, std.dev.: 0.0033)
  MultiSource/Applications/siod/siod: 4.61% (3.3761 => 3.5318, std.dev.: 0.0308)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.28% (5.1471 => 5.3672, std.dev.: 0.0588)
  MultiSource/Benchmarks/FreeBench/mason/mason: 3.97% (0.2799 => 0.2910, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.73% (3.3384 => 3.4630, std.dev.: 0.0425)
  SingleSource/Benchmarks/Misc/whetstone: 3.52% (3.4559 => 3.5774, std.dev.: 0.0124)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.32% (6.1245 => 6.3276, std.dev.: 0.0115)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.28% (25.0200 => 25.8399, std.dev.: 0.0626)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.15% (4.8739 => 5.0276, std.dev.: 0.0432)
  MultiSource/Applications/spiff/spiff: 3.13% (2.7609 => 2.8474, std.dev.: 0.0127)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.79% (1.3104 => 1.3470, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.60% (12.8625 => 13.1971, std.dev.: 0.0202)
  SingleSource/Benchmarks/Shootout/matrix: 1.86% (1.7358 => 1.7680, std.dev.: 0.0110)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.83% (3.3464 => 3.4076, std.dev.: 0.0206)
  SingleSource/Benchmarks/Shootout/methcall: 1.36% (8.4614 => 8.5763, std.dev.: 0.0091)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.31% (1.1618 => 1.1770, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.27% (3.0680 => 3.1070, std.dev.: 0.0127)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.19% (3.5351 => 3.5772, std.dev.: 0.0100)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -33.88% (0.2237 => 0.1479, std.dev.: 0.0007)
  MultiSource/Benchmarks/Olden/bisort/bisort: -30.97% (0.1072 => 0.0740, std.dev.: 0.0013)
  MultiSource/Benchmarks/Olden/tsp/tsp: -24.70% (0.1818 => 0.1369, std.dev.: 0.0022)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -24.30% (0.0675 => 0.0511, std.dev.: 0.0008)
  MultiSource/Benchmarks/MallocBench/gs/gs: -22.07% (6.0938 => 4.7487, std.dev.: 0.0666)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -20.87% (1.5228 => 1.2050, std.dev.: 0.0040)
  MultiSource/Benchmarks/Olden/health/health: -20.82% (0.1993 => 0.1578, std.dev.: 0.0016)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -20.47% (0.1114 => 0.0886, std.dev.: 0.0005)
  MultiSource/Applications/obsequi/Obsequi: -18.92% (1.4685 => 1.1906, std.dev.: 0.0034)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -18.79% (0.3576 => 0.2904, std.dev.: 0.0021)
  MultiSource/Applications/hbd/hbd: -17.26% (2.0193 => 1.6708, std.dev.: 0.0057)
  MultiSource/Applications/lua/lua: -17.11% (5.3200 => 4.4098, std.dev.: 0.0117)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -16.74% (0.1141 => 0.0950, std.dev.: 0.0043)
  MultiSource/Applications/hexxagon/hexxagon: -15.70% (1.3285 => 1.1199, std.dev.: 0.0054)
  MultiSource/Benchmarks/Olden/em3d/em3d: -15.63% (0.2367 => 0.1997, std.dev.: 0.0018)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -13.84% (1.3985 => 1.2050, std.dev.: 0.0033)
  MultiSource/Applications/sgefa/sgefa: -12.60% (0.4809 => 0.4203, std.dev.: 0.0039)
  MultiSource/Applications/JM/ldecod/ldecod: -11.54% (8.6720 => 7.6710, std.dev.: 0.0177)
  MultiSource/Applications/lambda-0_1_3/lambda: -11.30% (0.9461 => 0.8392, std.dev.: 0.0017)
  MultiSource/Applications/ClamAV/clamscan: -11.08% (19.4145 => 17.2634, std.dev.: 0.0531)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -10.64% (0.1870 => 0.1671, std.dev.: 0.0034)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -10.51% (0.3073 => 0.2750, std.dev.: 0.0094)
  MultiSource/Applications/sqlite3/sqlite3: -8.78% (19.1635 => 17.4805, std.dev.: 0.0082)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -8.47% (0.1947 => 0.1782, std.dev.: 0.0010)
  MultiSource/Applications/Burg/burg: -7.60% (1.5733 => 1.4537, std.dev.: 0.0166)
  MultiSource/Applications/kimwitu++/kc: -6.75% (21.0770 => 19.6539, std.dev.: 0.0697)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.53% (1.7461 => 1.6321, std.dev.: 0.0017)
  MultiSource/Applications/JM/lencod/lencod: -6.16% (18.5029 => 17.3634, std.dev.: 0.0455)
  MultiSource/Applications/siod/siod: -6.15% (2.7150 => 2.5479, std.dev.: 0.0159)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.77% (6.1631 => 5.8074, std.dev.: 0.0288)
  MultiSource/Applications/oggenc/oggenc: -5.40% (6.1121 => 5.7823, std.dev.: 0.0049)
  MultiSource/Benchmarks/Olden/bh/bh: -5.22% (0.3603 => 0.3415, std.dev.: 0.0034)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -5.02% (0.2432 => 0.2310, std.dev.: 0.0004)
  MultiSource/Benchmarks/PAQ8p/paq8p: -4.87% (2.6853 => 2.5545, std.dev.: 0.0174)
  MultiSource/Applications/minisat/minisat: -4.86% (0.8278 => 0.7876, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.67% (1.4166 => 1.3505, std.dev.: 0.0223)
  MultiSource/Applications/lemon/lemon: -4.07% (1.2976 => 1.2448, std.dev.: 0.0007)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.82% (1.5376 => 1.4789, std.dev.: 0.0184)
  MultiSource/Applications/SPASS/SPASS: -3.42% (17.9111 => 17.2984, std.dev.: 0.0463)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.05% (0.3309 => 0.3208, std.dev.: 0.0019)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -3.03% (1.3780 => 1.3362, std.dev.: 0.0008)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -2.36% (10.3031 => 10.0600, std.dev.: 0.0221)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.62% (0.7487 => 0.7366, std.dev.: 0.0015)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -39.10% (1.4194 => 0.8644, std.dev.: 0.0115)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.97% (0.0816 => 0.0498, std.dev.: 0.0039)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -37.39% (0.0345 => 0.0216, std.dev.: 0.0039)
  MultiSource/Benchmarks/Olden/mst/mst: -36.88% (0.2134 => 0.1347, std.dev.: 0.0068)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.41% (2.1022 => 1.4209, std.dev.: 0.0375)
  MultiSource/Benchmarks/MallocBench/gs/gs: -31.96% (0.1189 => 0.0809, std.dev.: 0.0015)
  MultiSource/Benchmarks/Olden/bisort/bisort: -29.46% (0.9545 => 0.6733, std.dev.: 0.0017)
  MultiSource/Applications/viterbi/viterbi: -27.36% (3.4923 => 2.5369, std.dev.: 0.0073)
  MultiSource/Applications/JM/ldecod/ldecod: -26.66% (0.0859 => 0.0630, std.dev.: 0.0008)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -25.71% (1.0962 => 0.8144, std.dev.: 0.0248)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.62% (6.9552 => 5.2430, std.dev.: 0.0474)
  MultiSource/Applications/minisat/minisat: -22.82% (8.0162 => 6.1866, std.dev.: 0.1756)
  SingleSource/Benchmarks/Misc/perlin: -21.34% (4.5989 => 3.6173, std.dev.: 0.0024)
  MultiSource/Applications/obsequi/Obsequi: -19.11% (2.6081 => 2.1098, std.dev.: 0.0047)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.65% (0.0884 => 0.0728, std.dev.: 0.0023)
  SingleSource/Benchmarks/Misc/mandel: -14.35% (1.1996 => 1.0274, std.dev.: 0.0060)
  MultiSource/Applications/SPASS/SPASS: -13.24% (9.2220 => 8.0010, std.dev.: 0.1038)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.79% (0.3557 => 0.3102, std.dev.: 0.0011)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -11.00% (0.5173 => 0.4604, std.dev.: 0.0059)
  SingleSource/Benchmarks/Shootout/strcat: -8.98% (0.1593 => 0.1450, std.dev.: 0.0039)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -8.94% (1.6121 => 1.4679, std.dev.: 0.0410)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.97% (3.5791 => 3.2937, std.dev.: 0.0284)
  MultiSource/Benchmarks/Olden/health/health: -7.06% (0.3556 => 0.3305, std.dev.: 0.0066)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.16% (1.3148 => 1.2338, std.dev.: 0.0256)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -5.27% (0.3773 => 0.3574, std.dev.: 0.0007)
  MultiSource/Benchmarks/mafft/pairlocalalign: -5.15% (47.2250 => 44.7914, std.dev.: 0.6881)
  MultiSource/Applications/lua/lua: -4.77% (31.0707 => 29.5874, std.dev.: 0.1361)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.69% (3.8119 => 3.6331, std.dev.: 0.0620)
  SingleSource/Benchmarks/Misc/fbench: -4.68% (4.9602 => 4.7282, std.dev.: 0.0051)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.61% (1.1024 => 1.0516, std.dev.: 0.0024)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.40% (0.3479 => 0.3326, std.dev.: 0.0005)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.30% (0.7355 => 0.7039, std.dev.: 0.0040)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.95% (1.1032 => 1.0596, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.39% (6.0444 => 5.8392, std.dev.: 0.0635)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.27% (1.7207 => 1.6645, std.dev.: 0.0069)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -3.09% (0.4783 => 0.4635, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.02% (6.1482 => 5.9628, std.dev.: 0.0661)
  SingleSource/Benchmarks/Stanford/FloatMM: -2.97% (0.7806 => 0.7574, std.dev.: 0.0040)
  MultiSource/Applications/sqlite3/sqlite3: -2.87% (4.3833 => 4.2573, std.dev.: 0.0019)
  MultiSource/Benchmarks/Olden/bh/bh: -2.86% (2.4879 => 2.4168, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.81% (5.2218 => 5.0752, std.dev.: 0.0513)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.65% (2.7049 => 2.6331, std.dev.: 0.0241)
  SingleSource/Benchmarks/Misc/oourafft: -2.24% (3.7891 => 3.7044, std.dev.: 0.0164)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.03% (34.8438 => 34.1382, std.dev.: 0.0668)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.62% (1.2012 => 1.1817, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.39% (5.8810 => 5.7990, std.dev.: 0.0267)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.35% (2.9568 => 2.9170, std.dev.: 0.0023)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.22% (2.1343 => 2.1082, std.dev.: 0.0060)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -5.15% (0.1378 => 0.1307, std.dev.: 0.0015)

Report Time: 0.77s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130818/fa5c24a3/attachment.html>


More information about the llvm-testresults mailing list