[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Dec 16 14:38:16 PST 2013


http://llvm.org/perf/db_default/v4/nts/18495?compare_to=18492&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18495, Order: 197418, Start Time: 2013-12-16 20:53:52, End Time: 2013-12-16 22:42:35
      To: 18492, Order: 197399, Start Time: 2013-12-16 18:37:38, End Time: 2013-12-16 20:28:00
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

New Failures: 3 (3 on baseline)
Performance Regressions: 18 (40 on baseline)
Performance Improvements: 21 (12 on baseline)
Unchanged Tests: 1068 (1055 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

New Failures - Compile Time
---------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Benchmarks/7zip/7zip-benchmark
  MultiSource/Applications/ClamAV/clamscan: 0.71% (16.9974 => 17.1177, std.dev.: 1.0442)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 3.51% (46.0389 => 47.6559, std.dev.: 1.3777)

New Failures - Execution Time
-----------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -100.00% (0.1377 => 0.0000)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/SmallPT/smallpt: 43.55% (0.1426 => 0.2047, std.dev.: 0.0159)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 24.11% (0.0506 => 0.0628, std.dev.: 0.0029)
  SingleSource/Benchmarks/Linpack/linpack-pc: 17.21% (0.3131 => 0.3670, std.dev.: 0.0146)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.03% (15.1027 => 16.6177, std.dev.: 0.3965)
  MultiSource/Applications/kimwitu++/kc: 5.14% (19.6858 => 20.6973, std.dev.: 0.2114)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.73% (4.3502 => 4.5560, std.dev.: 0.0261)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 41.49% (0.0335 => 0.0474, std.dev.: 0.0037)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 35.40% (0.1455 => 0.1970, std.dev.: 0.0163)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 29.99% (0.1547 => 0.2011, std.dev.: 0.0160)
  SingleSource/Benchmarks/Shootout/matrix: 16.55% (1.8070 => 2.1060, std.dev.: 0.0049)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.31% (2.4696 => 2.8476, std.dev.: 0.0902)
  SingleSource/Benchmarks/Shootout-C++/hash: 5.61% (0.7182 => 0.7585, std.dev.: 0.0030)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 4.19% (3.6039 => 3.7548, std.dev.: 0.0171)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 3.81% (0.4781 => 0.4963, std.dev.: 0.0025)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 3.79% (1.5820 => 1.6419, std.dev.: 0.0004)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.90% (41.6551 => 42.8611, std.dev.: 0.4180)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.26% (6.8065 => 6.9606, std.dev.: 0.0514)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 2.25% (0.6394 => 0.6538, std.dev.: 0.0022)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/PR10189: -38.52% (0.0405 => 0.0249, std.dev.: 0.0001)
  MultiSource/Benchmarks/Olden/em3d/em3d: -35.73% (0.3123 => 0.2007, std.dev.: 0.0113)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -33.28% (0.2524 => 0.1684, std.dev.: 0.0083)
  MultiSource/Benchmarks/Olden/mst/mst: -33.24% (0.2070 => 0.1382, std.dev.: 0.0097)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -28.98% (0.3271 => 0.2323, std.dev.: 0.0218)
  SingleSource/Regression/C/sumarray2d: -27.80% (0.0446 => 0.0322, std.dev.: 0.0004)
  SingleSource/Regression/C/uint64_to_float: -27.12% (0.0553 => 0.0403, std.dev.: 0.0006)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: -25.41% (0.2231 => 0.1664, std.dev.: 0.0084)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -14.60% (1.7637 => 1.5062, std.dev.: 0.0556)
  SingleSource/Benchmarks/Misc/ffbench: -13.74% (0.0895 => 0.0772, std.dev.: 0.0010)
  SingleSource/Benchmarks/Shootout-C++/lists: -4.94% (0.2715 => 0.2581, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.51% (1.3351 => 1.2749, std.dev.: 0.0186)
  MultiSource/Benchmarks/Bullet/bullet: -3.72% (37.3060 => 35.9181, std.dev.: 0.5141)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.50% (1.4521 => 1.4013, std.dev.: 0.0162)
  MultiSource/Applications/oggenc/oggenc: -1.95% (5.8684 => 5.7537, std.dev.: 0.0233)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/7zip/7zip-benchmark: -100.00% (9.8285 => 0.0000)
  MultiSource/Applications/lemon/lemon: -11.38% (0.9951 => 0.8819, std.dev.: 0.0395)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -7.10% (1.4781 => 1.3732, std.dev.: 0.0336)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.77% (50.7464 => 49.3406, std.dev.: 0.2554)
  SingleSource/Benchmarks/Misc/oourafft: -2.47% (3.7349 => 3.6425, std.dev.: 0.0287)
  SingleSource/Benchmarks/Misc/flops-4: -2.35% (1.7759 => 1.7342, std.dev.: 0.0057)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Compile Time
---------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Benchmarks/7zip/7zip-benchmark
  MultiSource/Applications/ClamAV/clamscan: 0.89% (16.9661 => 17.1177, std.dev.: 1.0442)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 6.09% (44.9186 => 47.6559, std.dev.: 1.3777)

New Failures - Execution Time
-----------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -100.00% (0.1339 => 0.0000)

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: 45.66% (15.7419 => 22.9289, std.dev.: 0.0869)
  SingleSource/Benchmarks/SmallPT/smallpt: 44.77% (0.1414 => 0.2047, std.dev.: 0.0159)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 28.66% (0.3859 => 0.4965, std.dev.: 0.0190)
  MultiSource/Benchmarks/MallocBench/gs/gs: 24.05% (4.6860 => 5.8132, std.dev.: 0.4226)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 19.85% (0.0524 => 0.0628, std.dev.: 0.0029)
  SingleSource/Benchmarks/Linpack/linpack-pc: 18.04% (0.3109 => 0.3670, std.dev.: 0.0146)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.47% (25.9661 => 29.7234, std.dev.: 0.4123)
  MultiSource/Applications/kimwitu++/kc: 10.76% (18.6861 => 20.6973, std.dev.: 0.2114)
  MultiSource/Applications/lemon/lemon: 9.89% (1.2200 => 1.3407, std.dev.: 0.0147)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.87% (15.4053 => 16.6177, std.dev.: 0.3965)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.38% (2.7572 => 2.9607, std.dev.: 0.0489)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.66% (4.2717 => 4.5560, std.dev.: 0.0261)
  MultiSource/Benchmarks/mafft/pairlocalalign: 6.32% (10.3096 => 10.9612, std.dev.: 0.1464)
  MultiSource/Applications/oggenc/oggenc: 4.67% (5.4968 => 5.7537, std.dev.: 0.0233)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.45% (1.5198 => 1.5875, std.dev.: 0.0218)
  SingleSource/Benchmarks/Shootout-C++/lists1: 4.11% (0.3069 => 0.3195, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.78% (1.3457 => 1.3696, std.dev.: 0.0082)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 47.66% (0.0321 => 0.0474, std.dev.: 0.0037)
  MultiSource/Benchmarks/FreeBench/neural/neural: 35.55% (0.4220 => 0.5720, std.dev.: 0.0170)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 31.01% (0.1535 => 0.2011, std.dev.: 0.0160)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 20.06% (1.4795 => 1.7763, std.dev.: 0.0424)
  SingleSource/Benchmarks/Shootout/matrix: 17.26% (1.7960 => 2.1060, std.dev.: 0.0049)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 12.94% (2.1020 => 2.3739, std.dev.: 0.0023)
  MultiSource/Applications/obsequi/Obsequi: 11.98% (2.3061 => 2.5824, std.dev.: 0.0408)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.41% (2.5559 => 2.8476, std.dev.: 0.0902)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.55% (3.3810 => 3.6700, std.dev.: 0.0419)
  MultiSource/Applications/SIBsim4/SIBsim4: 6.39% (3.4043 => 3.6218, std.dev.: 0.0254)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.69% (40.5530 => 42.8611, std.dev.: 0.4180)
  MultiSource/Applications/lua/lua: 5.32% (29.1357 => 30.6858, std.dev.: 0.4613)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 5.11% (4.5883 => 4.8228, std.dev.: 0.0042)
  MultiSource/Applications/siod/siod: 4.80% (3.4258 => 3.5902, std.dev.: 0.0244)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 3.94% (1.5797 => 1.6419, std.dev.: 0.0004)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.89% (3.6142 => 3.7548, std.dev.: 0.0171)
  SingleSource/Benchmarks/Misc/flops: 3.87% (9.2673 => 9.6264, std.dev.: 0.0221)
  SingleSource/Benchmarks/Misc/flops-7: 3.02% (1.7183 => 1.7702, std.dev.: 0.0178)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 2.35% (0.6388 => 0.6538, std.dev.: 0.0022)
  SingleSource/Benchmarks/Shootout-C++/hash: 1.63% (0.7463 => 0.7585, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.51% (11.7894 => 11.9674, std.dev.: 0.0640)
  SingleSource/Benchmarks/Misc/perlin: 1.25% (3.6099 => 3.6549, std.dev.: 0.0058)
  SingleSource/Benchmarks/Shootout/fib2: 1.21% (3.5960 => 3.6396, std.dev.: 0.0090)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.75% (1.3819 => 1.3162, std.dev.: 0.0202)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.25% (1.3146 => 1.2587, std.dev.: 0.0081)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.91% (1.3157 => 1.2643, std.dev.: 0.0130)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.52% (1.3505 => 1.3030, std.dev.: 0.0082)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/7zip/7zip-benchmark: -100.00% (10.0217 => 0.0000)
  MultiSource/Benchmarks/nbench/nbench: -10.35% (23.4696 => 21.0411, std.dev.: 0.5437)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.18% (5.9456 => 5.5783, std.dev.: 0.0246)
  MultiSource/Benchmarks/sim/sim: -5.24% (4.0134 => 3.8030, std.dev.: 0.0383)
  MultiSource/Benchmarks/mafft/pairlocalalign: -3.19% (50.9650 => 49.3406, std.dev.: 0.2554)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -3.06% (6.0535 => 5.8684, std.dev.: 0.0515)
  SingleSource/Benchmarks/Shootout-C++/hash2: -2.40% (3.6605 => 3.5725, std.dev.: 0.0139)
  MultiSource/Applications/lambda-0_1_3/lambda: -1.61% (7.9597 => 7.8312, std.dev.: 0.0398)

Report Time: 0.97s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131216/bccc7870/attachment.html>


More information about the llvm-testresults mailing list