[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Dec 29 00:21:53 PST 2013


http://llvm.org/perf/db_default/v4/nts/19243?compare_to=19229&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 19243, Order: 198152, Start Time: 2013-12-29 06:34:12, End Time: 2013-12-29 08:26:27
      To: 19229, Order: 198146, Start Time: 2013-12-29 04:18:26, End Time: 2013-12-29 06:07:25
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 37 (56 on baseline)
Performance Improvements: 7 (7 on baseline)
Unchanged Tests: 1066 (1047 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2002-12-13-MishaTest: 76.17% (0.0193 => 0.0340, std.dev.: 0.0005)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 59.23% (0.0883 => 0.1406, std.dev.: 0.0026)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 55.45% (0.0413 => 0.0642, std.dev.: 0.0033)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 44.71% (0.0548 => 0.0793, std.dev.: 0.0077)
  SingleSource/Benchmarks/Stanford/Bubblesort: 42.33% (0.0404 => 0.0575, std.dev.: 0.0035)
  SingleSource/Benchmarks/Misc/flops-2: 41.69% (0.0355 => 0.0503, std.dev.: 0.0030)
  MultiSource/Applications/sgefa/sgefa: 36.59% (0.3914 => 0.5346, std.dev.: 0.0332)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 36.43% (0.0689 => 0.0940, std.dev.: 0.0089)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.17% (0.1352 => 0.1841, std.dev.: 0.0171)
  SingleSource/Benchmarks/Misc/flops-8: 32.29% (0.0353 => 0.0467, std.dev.: 0.0030)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 22.99% (5.1453 => 6.3284, std.dev.: 0.1576)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 22.84% (1.1467 => 1.4086, std.dev.: 0.0614)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 22.38% (1.1438 => 1.3998, std.dev.: 0.0646)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 21.42% (1.6566 => 2.0114, std.dev.: 0.1108)
  MultiSource/Applications/lua/lua: 17.33% (4.3116 => 5.0586, std.dev.: 0.1091)
  MultiSource/Benchmarks/nbench/nbench: 14.06% (1.2429 => 1.4176, std.dev.: 0.0414)
  MultiSource/Benchmarks/mafft/pairlocalalign: 9.01% (10.4184 => 11.3567, std.dev.: 0.3071)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.49% (14.7691 => 16.0232, std.dev.: 0.2903)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.73% (5.5465 => 5.9751, std.dev.: 0.1334)
  MultiSource/Benchmarks/Olden/bh/bh: 7.20% (0.3291 => 0.3528, std.dev.: 0.0032)
  MultiSource/Applications/sqlite3/sqlite3: 5.58% (22.1605 => 23.3973, std.dev.: 0.3273)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 77.78% (0.0252 => 0.0448, std.dev.: 0.0018)
  MultiSource/Applications/minisat/minisat: 32.14% (6.3138 => 8.3428, std.dev.: 0.1940)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 31.75% (1.3239 => 1.7443, std.dev.: 0.0798)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.41% (1.4818 => 1.8583, std.dev.: 0.0098)
  MultiSource/Benchmarks/FreeBench/neural/neural: 22.62% (0.4412 => 0.5410, std.dev.: 0.0304)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.04% (1.2978 => 1.4411, std.dev.: 0.0238)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 10.19% (2.8981 => 3.1933, std.dev.: 0.0144)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.57% (1.0223 => 1.1099, std.dev.: 0.0122)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 6.89% (37.7743 => 40.3758, std.dev.: 0.9091)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.71% (4.5821 => 4.7979, std.dev.: 0.0221)
  MultiSource/Applications/sgefa/sgefa: 4.22% (0.8778 => 0.9148, std.dev.: 0.0075)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.65% (4.8482 => 5.0250, std.dev.: 0.0534)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.31% (4.1541 => 4.2915, std.dev.: 0.0097)
  MultiSource/Applications/SIBsim4/SIBsim4: 1.95% (3.5274 => 3.5961, std.dev.: 0.0067)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.71% (1.6046 => 1.6320, std.dev.: 0.0061)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.17% (5.9029 => 5.9719, std.dev.: 0.0190)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -18.87% (0.0959 => 0.0778, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.54% (1.3549 => 1.2663, std.dev.: 0.0338)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary3: -10.54% (5.7710 => 5.1630, std.dev.: 0.0741)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -9.65% (4.5811 => 4.1391, std.dev.: 0.1068)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.29% (5.8920 => 5.5806, std.dev.: 0.0507)
  MultiSource/Benchmarks/FreeBench/mason/mason: -4.05% (0.2990 => 0.2869, std.dev.: 0.0042)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.62% (1.6920 => 1.6477, std.dev.: 0.0121)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2002-12-13-MishaTest: 71.72% (0.0198 => 0.0340, std.dev.: 0.0005)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 69.81% (0.0828 => 0.1406, std.dev.: 0.0026)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 61.31% (0.0398 => 0.0642, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc/flops-2: 55.73% (0.0323 => 0.0503, std.dev.: 0.0030)
  MultiSource/Applications/sqlite3/sqlite3: 48.63% (15.7419 => 23.3973, std.dev.: 0.3273)
  SingleSource/Benchmarks/Stanford/Bubblesort: 48.20% (0.0388 => 0.0575, std.dev.: 0.0035)
  SingleSource/Benchmarks/Misc/flops-8: 46.39% (0.0319 => 0.0467, std.dev.: 0.0030)
  MultiSource/Applications/sgefa/sgefa: 37.50% (0.3888 => 0.5346, std.dev.: 0.0332)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 37.43% (0.0684 => 0.0940, std.dev.: 0.0089)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 33.95% (0.0592 => 0.0793, std.dev.: 0.0077)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 32.16% (0.1393 => 0.1841, std.dev.: 0.0171)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 31.82% (0.3859 => 0.5087, std.dev.: 0.0181)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 25.18% (5.0556 => 6.3284, std.dev.: 0.1576)
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.20% (0.1000 => 0.1212, std.dev.: 0.0049)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.76% (1.6656 => 2.0114, std.dev.: 0.1108)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 20.59% (1.1608 => 1.3998, std.dev.: 0.0646)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 19.71% (1.1767 => 1.4086, std.dev.: 0.0614)
  MultiSource/Applications/lua/lua: 18.37% (4.2737 => 5.0586, std.dev.: 0.1091)
  MultiSource/Benchmarks/nbench/nbench: 12.09% (1.2647 => 1.4176, std.dev.: 0.0414)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.25% (25.9661 => 28.8873, std.dev.: 0.4924)
  MultiSource/Benchmarks/mafft/pairlocalalign: 10.16% (10.3096 => 11.3567, std.dev.: 0.3071)
  SingleSource/Benchmarks/Shootout-C++/hash2: 9.45% (0.4266 => 0.4669, std.dev.: 0.0156)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.79% (5.5433 => 5.9751, std.dev.: 0.1334)
  MultiSource/Benchmarks/Olden/bh/bh: 7.27% (0.3289 => 0.3528, std.dev.: 0.0032)
  MultiSource/Benchmarks/PAQ8p/paq8p: 6.50% (2.5384 => 2.7034, std.dev.: 0.0628)
  MultiSource/Applications/oggenc/oggenc: 5.49% (5.4968 => 5.7987, std.dev.: 0.0793)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.05% (4.2717 => 4.4874, std.dev.: 0.0542)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 4.58% (0.3209 => 0.3356, std.dev.: 0.0047)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 40.17% (2.9492 => 4.1340, std.dev.: 0.2798)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 39.56% (0.0321 => 0.0448, std.dev.: 0.0018)
  MultiSource/Applications/minisat/minisat: 30.60% (6.3881 => 8.3428, std.dev.: 0.1940)
  MultiSource/Benchmarks/FreeBench/neural/neural: 28.20% (0.4220 => 0.5410, std.dev.: 0.0304)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.60% (1.4795 => 1.8583, std.dev.: 0.0098)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 21.68% (1.4335 => 1.7443, std.dev.: 0.0798)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 17.37% (1.2278 => 1.4411, std.dev.: 0.0238)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.20% (5.9583 => 6.9233, std.dev.: 0.0674)
  SingleSource/Benchmarks/Shootout/ary3: 13.65% (4.5977 => 5.2254, std.dev.: 0.2084)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.25% (35.9684 => 40.3758, std.dev.: 0.9091)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 10.34% (2.8940 => 3.1933, std.dev.: 0.0144)
  SingleSource/Benchmarks/Shootout-C++/ary3: 10.33% (4.6797 => 5.1630, std.dev.: 0.0741)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.47% (1.0232 => 1.1099, std.dev.: 0.0122)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.28% (0.3358 => 0.3636, std.dev.: 0.0065)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.20% (3.3810 => 3.6581, std.dev.: 0.0929)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.77% (5.0320 => 5.4228, std.dev.: 0.0605)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 6.97% (2.6658 => 2.8517, std.dev.: 0.0601)
  MultiSource/Applications/siod/siod: 5.95% (3.4258 => 3.6297, std.dev.: 0.0768)
  MultiSource/Applications/SIBsim4/SIBsim4: 5.63% (3.4043 => 3.5961, std.dev.: 0.0067)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.81% (40.5530 => 42.5053, std.dev.: 0.6167)
  MultiSource/Applications/sgefa/sgefa: 4.61% (0.8745 => 0.9148, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.57% (4.5883 => 4.7979, std.dev.: 0.0221)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 4.16% (4.8243 => 5.0250, std.dev.: 0.0534)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.50% (4.1462 => 4.2915, std.dev.: 0.0097)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 3.31% (1.5797 => 1.6320, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.63% (5.0601 => 5.1933, std.dev.: 0.0310)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.35% (3.9755 => 4.0688, std.dev.: 0.0214)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.39% (18.6185 => 18.8773, std.dev.: 0.0415)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.98% (1.3676 => 1.2858, std.dev.: 0.0303)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.23% (1.1409 => 1.0926, std.dev.: 0.0105)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.14% (5.9456 => 5.5806, std.dev.: 0.0507)
  MultiSource/Benchmarks/sim/sim: -4.91% (4.0134 => 3.8164, std.dev.: 0.0480)
  MultiSource/Benchmarks/FreeBench/mason/mason: -4.05% (0.2990 => 0.2869, std.dev.: 0.0042)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.82% (0.3970 => 0.3858, std.dev.: 0.0036)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.35% (6.0535 => 5.9719, std.dev.: 0.0190)

Report Time: 0.77s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131229/809b3361/attachment.html>


More information about the llvm-testresults mailing list