[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Aug 7 05:41:29 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14176?compare_to=14173&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14176, Order: 187879, Start Time: 2013-08-07 10:53:32, End Time: 2013-08-07 12:43:19
      To: 14173, Order: 187869, Start Time: 2013-08-07 08:41:59, End Time: 2013-08-07 10:30:30
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

New Failures: 0 (2 on baseline)
Performance Regressions: 11 (30 on baseline)
Performance Improvements: 0 (60 on baseline)
Existing Failures: 3 (1 on baseline)
Unchanged Tests: 1094 (1015 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 1.75% (1.2023 => 1.2233, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.43% (1.4371 => 1.4576, std.dev.: 0.0060)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/fibo: 17.30% (4.1192 => 4.8320, std.dev.: 0.0184)
  SingleSource/Benchmarks/Misc/flops: 16.08% (8.4609 => 9.8215, std.dev.: 0.0472)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 14.16% (0.2471 => 0.2821, std.dev.: 0.0046)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 12.45% (0.7661 => 0.8615, std.dev.: 0.0307)
  MultiSource/Benchmarks/FreeBench/neural/neural: 4.74% (0.4287 => 0.4490, std.dev.: 0.0029)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 3.85% (4.4677 => 4.6397, std.dev.: 0.0479)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.27% (5.9336 => 6.0681, std.dev.: 0.0072)
  SingleSource/Benchmarks/Shootout/random: 2.06% (2.4253 => 2.4753, std.dev.: 0.0025)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.15% (11.5124 => 11.6444, std.dev.: 0.0224)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Applications/ClamAV/clamscan: -4.04% (0.1411 => 0.1354, std.dev.: 0.0098)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.38% (0.2754 => 0.2716, std.dev.: 0.0431)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.36% (0.0277 => 0.0276, std.dev.: 0.0107)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.45% (0.2813 => 0.2716, std.dev.: 0.0431)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.00% (0.0345 => 0.0276, std.dev.: 0.0107)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/bigstack: 39.91% (0.0466 => 0.0652, std.dev.: 0.0022)
  MultiSource/Benchmarks/FreeBench/distray/distray: 17.04% (0.1033 => 0.1209, std.dev.: 0.0006)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 73.94% (3.7285 => 6.4855, std.dev.: 0.0300)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.38% (2.8867 => 4.2832, std.dev.: 0.0185)
  MultiSource/Benchmarks/FreeBench/neural/neural: 41.60% (0.3171 => 0.4490, std.dev.: 0.0029)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.23% (1.5030 => 1.8973, std.dev.: 0.0072)
  SingleSource/Benchmarks/Shootout/hash: 23.18% (4.1846 => 5.1547, std.dev.: 0.3475)
  MultiSource/Applications/lambda-0_1_3/lambda: 12.62% (7.0762 => 7.9690, std.dev.: 0.0407)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.30% (0.1678 => 0.1834, std.dev.: 0.0003)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.94% (14.9584 => 16.2959, std.dev.: 0.4186)
  MultiSource/Applications/JM/lencod/lencod: 8.51% (7.1799 => 7.7910, std.dev.: 0.1693)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.33% (5.4910 => 5.9482, std.dev.: 0.0201)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.17% (1.2557 => 1.3583, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.93% (3.2027 => 3.4248, std.dev.: 0.0702)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.74% (3.4085 => 3.6382, std.dev.: 0.0408)
  MultiSource/Benchmarks/FreeBench/mason/mason: 6.22% (0.2799 => 0.2973, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.98% (5.3042 => 5.6215, std.dev.: 0.0181)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.47% (5.5008 => 5.8016, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.39% (5.1471 => 5.4245, std.dev.: 0.0485)
  MultiSource/Benchmarks/Olden/tsp/tsp: 5.22% (1.5339 => 1.6140, std.dev.: 0.0193)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.26% (4.3151 => 4.4991, std.dev.: 0.0333)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 3.97% (4.4624 => 4.6397, std.dev.: 0.0479)
  SingleSource/Benchmarks/Misc/whetstone: 3.82% (3.4559 => 3.5878, std.dev.: 0.0054)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.43% (6.1245 => 6.3343, std.dev.: 0.0642)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.32% (25.0200 => 25.8495, std.dev.: 0.0500)
  MultiSource/Applications/spiff/spiff: 2.94% (2.7609 => 2.8422, std.dev.: 0.0155)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.32% (5.9307 => 6.0681, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.80% (3.3464 => 3.4068, std.dev.: 0.0138)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.27% (1.5957 => 1.6159, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.26% (3.0680 => 3.1067, std.dev.: 0.0131)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -33.53% (0.2237 => 0.1487, std.dev.: 0.0029)
  MultiSource/Benchmarks/Olden/bisort/bisort: -32.00% (0.1072 => 0.0729, std.dev.: 0.0014)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -23.79% (0.1114 => 0.0849, std.dev.: 0.0019)
  MultiSource/Benchmarks/Olden/tsp/tsp: -23.76% (0.1818 => 0.1386, std.dev.: 0.0027)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -21.93% (0.0675 => 0.0527, std.dev.: 0.0010)
  MultiSource/Benchmarks/Olden/health/health: -20.92% (0.1993 => 0.1576, std.dev.: 0.0026)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -20.17% (1.5228 => 1.2156, std.dev.: 0.0127)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -19.35% (0.3576 => 0.2884, std.dev.: 0.0069)
  MultiSource/Applications/obsequi/Obsequi: -18.75% (1.4685 => 1.1932, std.dev.: 0.0112)
  MultiSource/Applications/lua/lua: -16.97% (5.3200 => 4.4173, std.dev.: 0.0323)
  MultiSource/Benchmarks/Olden/em3d/em3d: -13.86% (0.2367 => 0.2039, std.dev.: 0.0037)
  MultiSource/Applications/sgefa/sgefa: -12.64% (0.4809 => 0.4201, std.dev.: 0.0204)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -12.53% (1.3985 => 1.2233, std.dev.: 0.0029)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -8.63% (0.1947 => 0.1779, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -6.79% (1.5144 => 1.4115, std.dev.: 0.0164)
  MultiSource/Applications/siod/siod: -6.74% (2.7150 => 2.5319, std.dev.: 0.0396)
  MultiSource/Benchmarks/PAQ8p/paq8p: -5.67% (2.6853 => 2.5331, std.dev.: 0.0487)
  MultiSource/Benchmarks/Olden/bh/bh: -5.58% (0.3603 => 0.3402, std.dev.: 0.0029)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -5.30% (0.2432 => 0.2303, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.16% (1.4794 => 1.4030, std.dev.: 0.0082)
  MultiSource/Applications/minisat/minisat: -5.15% (0.8278 => 0.7852, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.00% (1.5437 => 1.4665, std.dev.: 0.0111)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.44% (1.4166 => 1.3537, std.dev.: 0.0224)
  MultiSource/Applications/lemon/lemon: -4.39% (1.2976 => 1.2407, std.dev.: 0.0053)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.35% (1.5239 => 1.4576, std.dev.: 0.0060)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -38.16% (1.4194 => 0.8778, std.dev.: 0.0368)
  MultiSource/Benchmarks/Olden/mst/mst: -37.39% (0.2134 => 0.1336, std.dev.: 0.0191)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.06% (2.1022 => 1.4282, std.dev.: 0.0212)
  MultiSource/Benchmarks/MallocBench/gs/gs: -30.19% (0.1189 => 0.0830, std.dev.: 0.0033)
  MultiSource/Benchmarks/Olden/bisort/bisort: -29.52% (0.9545 => 0.6727, std.dev.: 0.0167)
  MultiSource/Applications/viterbi/viterbi: -27.23% (3.4923 => 2.5412, std.dev.: 0.1020)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.61% (6.9552 => 5.2434, std.dev.: 0.0101)
  MultiSource/Applications/minisat/minisat: -22.42% (8.0162 => 6.2187, std.dev.: 0.2354)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -21.41% (1.0962 => 0.8615, std.dev.: 0.0307)
  SingleSource/Benchmarks/Misc/perlin: -21.35% (4.5989 => 3.6169, std.dev.: 0.0319)
  MultiSource/Applications/obsequi/Obsequi: -19.34% (2.6081 => 2.1036, std.dev.: 0.0264)
  SingleSource/Benchmarks/Misc/mandel: -14.65% (1.1996 => 1.0239, std.dev.: 0.0074)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -12.78% (0.0884 => 0.0771, std.dev.: 0.0002)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.48% (0.3557 => 0.3113, std.dev.: 0.0022)
  MultiSource/Applications/lua/lua: -11.82% (31.0707 => 27.3995, std.dev.: 0.0314)
  MultiSource/Applications/SIBsim4/SIBsim4: -8.01% (3.5791 => 3.2923, std.dev.: 0.0807)
  MultiSource/Benchmarks/Olden/health/health: -7.20% (0.3556 => 0.3300, std.dev.: 0.0045)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -5.72% (0.4969 => 0.4685, std.dev.: 0.0053)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -5.54% (0.3773 => 0.3564, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.80% (3.8119 => 3.6288, std.dev.: 0.0551)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.40% (0.3479 => 0.3326, std.dev.: 0.0016)
  SingleSource/Benchmarks/Misc/fbench: -4.38% (4.9602 => 4.7429, std.dev.: 0.0165)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.08% (0.7355 => 0.7055, std.dev.: 0.0081)
  MultiSource/Benchmarks/Bullet/bullet: -3.24% (7.2995 => 7.0628, std.dev.: 0.0874)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.00% (6.1482 => 5.9637, std.dev.: 0.0421)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.80% (5.2218 => 5.0755, std.dev.: 0.0018)
  MultiSource/Applications/sgefa/sgefa: -2.45% (1.4030 => 1.3686, std.dev.: 0.0061)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.32% (8.6172 => 8.4170, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc/oourafft: -2.08% (3.7891 => 3.7101, std.dev.: 0.0181)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.01% (34.8438 => 34.1444, std.dev.: 0.1495)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.75% (1.8144 => 1.7826, std.dev.: 0.0067)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.71% (1.2012 => 1.1806, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.57% (5.0180 => 4.9393, std.dev.: 0.0218)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.30% (5.8810 => 5.8048, std.dev.: 0.0248)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.20% (2.1343 => 2.1087, std.dev.: 0.0022)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.74% (0.1378 => 0.1354, std.dev.: 0.0098)

Report Time: 0.68s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130807/754a7f76/attachment.html>


More information about the llvm-testresults mailing list