[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Mon Aug 5 15:11:16 PDT 2013
http://llvm.org/perf/db_default/v4/nts/14117?compare_to=14114&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15
Comparing:
Run: 14117, Order: 187736, Start Time: 2013-08-05 20:18:12, End Time: 2013-08-05 22:13:06
To: 14114, Order: 187729, Start Time: 2013-08-05 18:02:50, End Time: 2013-08-05 19:56:15
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57
===============
Tests Summary
===============
New Failures: 0 (2 on baseline)
Performance Regressions: 34 (54 on baseline)
Performance Improvements: 2 (30 on baseline)
Existing Failures: 3 (1 on baseline)
Unchanged Tests: 1069 (1021 on baseline)
Total Tests: 1108
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 51.67% (0.0598 => 0.0907, std.dev.: 0.0076)
MultiSource/Benchmarks/MallocBench/gs/gs: 47.26% (4.7315 => 6.9676, std.dev.: 0.5175)
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 36.11% (0.1487 => 0.2024, std.dev.: 0.0064)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 36.07% (1.9489 => 2.6519, std.dev.: 0.0172)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 34.56% (5.0367 => 6.7772, std.dev.: 0.2864)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 34.47% (0.1648 => 0.2216, std.dev.: 0.0184)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 33.30% (4.8504 => 6.4658, std.dev.: 0.1057)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 32.88% (1.0091 => 1.3409, std.dev.: 0.0923)
MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 30.40% (0.7552 => 0.9848, std.dev.: 0.0459)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 26.60% (1.6671 => 2.1105, std.dev.: 0.1136)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 25.92% (5.1202 => 6.4476, std.dev.: 0.1670)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 25.88% (5.8082 => 7.3114, std.dev.: 0.3506)
MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 25.26% (0.0760 => 0.0952, std.dev.: 0.0053)
MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.02% (1.6610 => 2.0599, std.dev.: 0.1437)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 22.92% (0.7042 => 0.8656, std.dev.: 0.0424)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 19.75% (0.2729 => 0.3268, std.dev.: 0.0188)
MultiSource/Benchmarks/nbench/nbench: 19.58% (1.3198 => 1.5782, std.dev.: 0.0450)
MultiSource/Benchmarks/Bullet/bullet: 19.12% (35.9814 => 42.8594, std.dev.: 0.7937)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.10% (15.2344 => 17.6866, std.dev.: 0.4216)
MultiSource/Benchmarks/mafft/pairlocalalign: 13.34% (10.8465 => 12.2938, std.dev.: 0.4006)
MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 12.15% (1.3610 => 1.5264, std.dev.: 0.0397)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.82% (26.7341 => 29.6277, std.dev.: 0.2459)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.68% (1.1828 => 1.3091, std.dev.: 0.0273)
MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.01% (1.5208 => 1.6426, std.dev.: 0.0448)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.88% (1.3966 => 1.4228, std.dev.: 0.0072)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 42.92% (0.1484 => 0.2121, std.dev.: 0.0078)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 36.06% (2.3929 => 3.2558, std.dev.: 0.0917)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 29.86% (2.5405 => 3.2992, std.dev.: 0.0792)
MultiSource/Benchmarks/Bullet/bullet: 15.94% (6.9927 => 8.1070, std.dev.: 0.0354)
SingleSource/Benchmarks/Misc/flops: 13.57% (8.3662 => 9.5012, std.dev.: 0.2030)
MultiSource/Benchmarks/Olden/em3d/em3d: 9.84% (4.7156 => 5.1794, std.dev.: 0.0381)
MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.36% (5.7782 => 5.8566, std.dev.: 0.0283)
MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.08% (5.9616 => 6.0259, std.dev.: 0.0113)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.08% (3.6444 => 3.6837, std.dev.: 0.0046)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/Benchmarks/Linpack/linpack-pc: -12.90% (0.3063 => 0.2668, std.dev.: 0.0104)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/Shootout-C++/hash: -6.23% (0.7771 => 0.7287, std.dev.: 0.0187)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
MultiSource/Benchmarks/mediabench/gsm/toast/toast
MultiSource/Applications/ClamAV/clamscan: 2.92% (0.1301 => 0.1339, std.dev.: 0.0227)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.64% (0.2744 => 0.2699, std.dev.: 0.0056)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.60% (0.0279 => 0.0255, std.dev.: 0.0060)
================================
Run-Over-Baseline Changes Detail
================================
New Failures - Execution Time
-----------------------------
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
MultiSource/Benchmarks/mediabench/gsm/toast/toast
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.05% (0.2813 => 0.2699, std.dev.: 0.0056)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -26.09% (0.0345 => 0.0255, std.dev.: 0.0060)
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 58.84% (0.0571 => 0.0907, std.dev.: 0.0076)
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 35.75% (0.1491 => 0.2024, std.dev.: 0.0064)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 35.52% (4.7710 => 6.4658, std.dev.: 0.1057)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 34.81% (1.9671 => 2.6519, std.dev.: 0.0172)
MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 30.91% (0.7523 => 0.9848, std.dev.: 0.0459)
MultiSource/Benchmarks/SciMark2-C/scimark2: 28.27% (0.3873 => 0.4968, std.dev.: 0.0421)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 28.23% (5.2851 => 6.7772, std.dev.: 0.2864)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 26.48% (1.6686 => 2.1105, std.dev.: 0.1136)
MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.96% (1.6617 => 2.0599, std.dev.: 0.1437)
MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 23.80% (0.0769 => 0.0952, std.dev.: 0.0053)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 23.48% (0.7010 => 0.8656, std.dev.: 0.0424)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 21.77% (1.1012 => 1.3409, std.dev.: 0.0923)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 20.57% (5.3476 => 6.4476, std.dev.: 0.1670)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.10% (0.2721 => 0.3268, std.dev.: 0.0188)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.63% (6.1631 => 7.3114, std.dev.: 0.3506)
MultiSource/Benchmarks/nbench/nbench: 15.39% (1.3677 => 1.5782, std.dev.: 0.0450)
MultiSource/Benchmarks/Bullet/bullet: 14.33% (37.4863 => 42.8594, std.dev.: 0.7937)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.74% (15.5498 => 17.6866, std.dev.: 0.4216)
MultiSource/Benchmarks/mafft/pairlocalalign: 13.26% (10.8541 => 12.2938, std.dev.: 0.4006)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.18% (1.1882 => 1.3091, std.dev.: 0.0273)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.18% (27.6418 => 29.6277, std.dev.: 0.2459)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 72.70% (3.7285 => 6.4393, std.dev.: 0.0460)
SingleSource/Benchmarks/Shootout-C++/matrix: 48.62% (2.8867 => 4.2903, std.dev.: 0.0334)
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 37.55% (0.1542 => 0.2121, std.dev.: 0.0078)
MultiSource/Benchmarks/FreeBench/neural/neural: 36.52% (0.3171 => 0.4329, std.dev.: 0.0417)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 33.14% (0.0341 => 0.0454, std.dev.: 0.0033)
SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 32.70% (0.0526 => 0.0698, std.dev.: 0.0060)
SingleSource/Benchmarks/Shootout/hash: 27.05% (4.1846 => 5.3167, std.dev.: 0.1193)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.44% (2.6094 => 3.2992, std.dev.: 0.0792)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 24.01% (1.5030 => 1.8639, std.dev.: 0.0228)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 20.62% (2.6992 => 3.2558, std.dev.: 0.0917)
MultiSource/Applications/siod/siod: 16.18% (3.3761 => 3.9225, std.dev.: 0.0332)
SingleSource/Benchmarks/Shootout-C++/hash: 15.76% (0.6295 => 0.7287, std.dev.: 0.0187)
MultiSource/Applications/lambda-0_1_3/lambda: 12.65% (7.0762 => 7.9710, std.dev.: 0.0639)
MultiSource/Benchmarks/Bullet/bullet: 11.06% (7.2995 => 8.1070, std.dev.: 0.0354)
SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 10.00% (2.9962 => 3.2957, std.dev.: 0.0661)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.82% (14.9584 => 16.4269, std.dev.: 0.2538)
MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.62% (5.4910 => 5.9643, std.dev.: 0.0440)
MultiSource/Benchmarks/Ptrdist/ks/ks: 8.58% (1.2557 => 1.3635, std.dev.: 0.0358)
SingleSource/Benchmarks/Linpack/linpack-pc: 8.38% (48.3256 => 52.3732, std.dev.: 0.3268)
MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.05% (3.2027 => 3.4286, std.dev.: 0.0283)
SingleSource/Benchmarks/Shootout-C++/hash2: 6.53% (3.3877 => 3.6090, std.dev.: 0.0069)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.47% (2.9568 => 3.1480, std.dev.: 0.0604)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.52% (5.5008 => 5.8046, std.dev.: 0.0330)
SingleSource/Benchmarks/Misc/whetstone: 4.58% (3.4559 => 3.6143, std.dev.: 0.0069)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.35% (4.3151 => 4.5030, std.dev.: 0.0030)
MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.25% (5.1471 => 5.3660, std.dev.: 0.0398)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.20% (3.5351 => 3.6837, std.dev.: 0.0046)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.76% (3.3384 => 3.4638, std.dev.: 0.0452)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.15% (4.8739 => 5.0275, std.dev.: 0.0565)
MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.35% (4.9040 => 4.9701, std.dev.: 0.0216)
SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.33% (1.1618 => 1.1773, std.dev.: 0.0006)
SingleSource/Benchmarks/Misc-C++/Large/ray: 1.31% (4.9089 => 4.9731, std.dev.: 0.0083)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.05% (3.0680 => 3.1002, std.dev.: 0.0080)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Benchmarks/Olden/power/power: -34.24% (0.2237 => 0.1471, std.dev.: 0.0147)
MultiSource/Benchmarks/Olden/bisort/bisort: -30.04% (0.1072 => 0.0750, std.dev.: 0.0023)
MultiSource/Applications/ALAC/decode/alacconvert-decode: -19.00% (1.5228 => 1.2335, std.dev.: 0.0325)
MultiSource/Applications/obsequi/Obsequi: -17.10% (1.4685 => 1.2174, std.dev.: 0.0364)
MultiSource/Applications/lua/lua: -15.69% (5.3200 => 4.4851, std.dev.: 0.1893)
MultiSource/Applications/hexxagon/hexxagon: -15.36% (1.3285 => 1.1245, std.dev.: 0.0729)
MultiSource/Applications/minisat/minisat: -5.11% (0.8278 => 0.7855, std.dev.: 0.0088)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.35% (1.4721 => 1.4228, std.dev.: 0.0072)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Applications/lemon/lemon: -35.77% (1.4194 => 0.9117, std.dev.: 0.1956)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.07% (2.1022 => 1.4280, std.dev.: 0.0030)
MultiSource/Applications/viterbi/viterbi: -27.44% (3.4923 => 2.5339, std.dev.: 0.0155)
MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -23.97% (6.9552 => 5.2880, std.dev.: 0.0038)
MultiSource/Applications/JM/ldecod/ldecod: -22.93% (0.0859 => 0.0662, std.dev.: 0.0057)
SingleSource/Benchmarks/Misc/perlin: -21.43% (4.5989 => 3.6132, std.dev.: 0.0508)
MultiSource/Applications/minisat/minisat: -16.86% (8.0162 => 6.6648, std.dev.: 0.3236)
SingleSource/Benchmarks/Misc/mandel: -13.94% (1.1996 => 1.0324, std.dev.: 0.0002)
MultiSource/Applications/sgefa/sgefa: -13.54% (1.4030 => 1.2130, std.dev.: 0.0145)
MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.51% (0.3557 => 0.3112, std.dev.: 0.0111)
MultiSource/Applications/lua/lua: -6.19% (31.0707 => 29.1481, std.dev.: 0.3806)
MultiSource/Benchmarks/mafft/pairlocalalign: -4.96% (47.2250 => 44.8826, std.dev.: 0.1449)
MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.71% (3.8119 => 3.6325, std.dev.: 0.0212)
SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.35% (0.7355 => 0.7035, std.dev.: 0.0006)
SingleSource/Benchmarks/Misc/fbench: -3.88% (4.9602 => 4.7676, std.dev.: 0.0053)
MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -2.62% (6.0444 => 5.8860, std.dev.: 0.0457)
SingleSource/Benchmarks/Misc/ReedSolomon: -2.37% (8.6172 => 8.4131, std.dev.: 0.0687)
MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.99% (6.1482 => 6.0259, std.dev.: 0.0113)
SingleSource/Benchmarks/CoyoteBench/almabench: -1.91% (34.8438 => 34.1787, std.dev.: 0.0290)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.89% (1.0964 => 1.0757, std.dev.: 0.0022)
SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.41% (3.2461 => 3.2003, std.dev.: 0.0142)
MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.39% (5.8810 => 5.7991, std.dev.: 0.0307)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: -2.83% (0.1378 => 0.1339, std.dev.: 0.0227)
Report Time: 0.65s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130805/b6341f61/attachment.html>
More information about the llvm-testresults
mailing list