[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Oct 14 06:40:11 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16302?compare_to=16299&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16302, Order: 192575, Start Time: 2013-10-14 11:50:24, End Time: 2013-10-14 13:43:20
      To: 16299, Order: 192573, Start Time: 2013-10-14 09:45:18, End Time: 2013-10-14 11:29:13
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 50 (53 on baseline)
Performance Improvements: 10 (18 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1047 (1036 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 58.67% (0.1004 => 0.1593, std.dev.: 0.0110)
  MultiSource/Benchmarks/Olden/health/health: 54.61% (0.1520 => 0.2350, std.dev.: 0.0249)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 51.85% (0.0513 => 0.0779, std.dev.: 0.0076)
  MultiSource/Applications/Burg/burg: 44.39% (1.4233 => 2.0551, std.dev.: 0.0268)
  MultiSource/Applications/sgefa/sgefa: 31.37% (0.3940 => 0.5176, std.dev.: 0.0332)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.98% (1.4276 => 1.7700, std.dev.: 0.1178)
  MultiSource/Applications/treecc/treecc: 22.80% (2.2876 => 2.8092, std.dev.: 0.0657)
  MultiSource/Applications/JM/ldecod/ldecod: 20.09% (7.6887 => 9.2335, std.dev.: 0.1465)
  MultiSource/Applications/d/make_dparser: 19.59% (3.6143 => 4.3225, std.dev.: 0.2314)
  MultiSource/Applications/SPASS/SPASS: 18.32% (16.4483 => 19.4622, std.dev.: 0.4201)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.52% (1.3747 => 1.6155, std.dev.: 0.0450)
  MultiSource/Applications/JM/lencod/lencod: 16.87% (17.2444 => 20.1538, std.dev.: 1.1092)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 16.59% (1.2996 => 1.5152, std.dev.: 0.0381)
  MultiSource/Applications/lemon/lemon: 16.27% (1.2294 => 1.4294, std.dev.: 0.0545)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 14.78% (1.2348 => 1.4173, std.dev.: 0.0314)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 14.34% (9.9092 => 11.3302, std.dev.: 0.3082)
  MultiSource/Applications/siod/siod: 13.84% (2.5269 => 2.8765, std.dev.: 0.0580)
  MultiSource/Applications/sqlite3/sqlite3: 13.36% (16.5834 => 18.7989, std.dev.: 0.4577)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 12.43% (1.2708 => 1.4287, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 12.13% (1.2390 => 1.3893, std.dev.: 0.0235)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.83% (1.3075 => 1.4622, std.dev.: 0.0255)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.31% (1.2926 => 1.4388, std.dev.: 0.0142)
  MultiSource/Applications/oggenc/oggenc: 11.02% (5.4465 => 6.0469, std.dev.: 0.0971)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.49% (1.2771 => 1.4111, std.dev.: 0.0396)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.07% (1.2666 => 1.3941, std.dev.: 0.0354)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.98% (1.3715 => 1.5084, std.dev.: 0.0142)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.10% (1.3437 => 1.4660, std.dev.: 0.0468)
  MultiSource/Benchmarks/McCat/08-main/main: 5.83% (0.3106 => 0.3287, std.dev.: 0.0046)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.72% (0.2692 => 0.2819, std.dev.: 0.0017)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.37% (1.0902 => 1.1160, std.dev.: 0.0074)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/JM/ldecod/ldecod: 58.90% (0.0657 => 0.1044, std.dev.: 0.0041)
  MultiSource/Benchmarks/Olden/bisort/bisort: 51.19% (0.6679 => 1.0098, std.dev.: 0.0193)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 32.91% (0.0316 => 0.0420, std.dev.: 0.0031)
  MultiSource/Applications/SPASS/SPASS: 31.62% (8.3157 => 10.9453, std.dev.: 0.3645)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.68% (1.4814 => 1.8915, std.dev.: 0.0309)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 26.76% (2.6615 => 3.3738, std.dev.: 0.0392)
  MultiSource/Applications/minisat/minisat: 25.63% (6.3477 => 7.9746, std.dev.: 0.4291)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 21.48% (35.4005 => 43.0030, std.dev.: 2.6132)
  MultiSource/Applications/lua/lua: 6.89% (28.9142 => 30.9061, std.dev.: 0.1750)
  MultiSource/Applications/sgefa/sgefa: 6.88% (0.8354 => 0.8929, std.dev.: 0.0124)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.60% (12.8205 => 13.5389, std.dev.: 0.0741)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.83% (0.2632 => 0.2759, std.dev.: 0.0007)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 4.13% (39.3984 => 41.0253, std.dev.: 0.2971)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.01% (5.0934 => 5.2466, std.dev.: 0.0217)
  SingleSource/Benchmarks/Shootout/methcall: 2.91% (8.3967 => 8.6413, std.dev.: 0.0239)
  MultiSource/Benchmarks/Olden/em3d/em3d: 2.85% (5.0302 => 5.1738, std.dev.: 0.0484)
  SingleSource/Benchmarks/Shootout-C++/hash2: 2.74% (3.5747 => 3.6725, std.dev.: 0.0084)
  SingleSource/Benchmarks/Shootout-C++/lists: 2.59% (15.8253 => 16.2359, std.dev.: 0.0217)
  MultiSource/Applications/JM/lencod/lencod: 2.10% (8.1860 => 8.3582, std.dev.: 0.0555)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.47% (8.6333 => 8.7601, std.dev.: 0.0326)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Linpack/linpack-pc: -26.06% (47.0556 => 34.7924, std.dev.: 4.1969)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -5.90% (3.0567 => 2.8764, std.dev.: 0.0285)
  MultiSource/Applications/spiff/spiff: -4.02% (2.9801 => 2.8603, std.dev.: 0.0151)
  MultiSource/Applications/hexxagon/hexxagon: -3.99% (15.7639 => 15.1355, std.dev.: 0.2224)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -3.98% (2.2128 => 2.1248, std.dev.: 0.0222)
  MultiSource/Applications/aha/aha: -3.89% (3.7849 => 3.6375, std.dev.: 0.0291)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.82% (5.2504 => 5.1024, std.dev.: 0.0193)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.62% (5.4050 => 5.3173, std.dev.: 0.0218)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.34% (4.0837 => 4.0288, std.dev.: 0.0190)
  MultiSource/Applications/viterbi/viterbi: -1.16% (2.6928 => 2.6616, std.dev.: 0.0084)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 8.86% (0.1320 => 0.1437, std.dev.: 0.0148)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Olden/health/health: 55.94% (0.1507 => 0.2350, std.dev.: 0.0249)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 55.72% (0.1023 => 0.1593, std.dev.: 0.0110)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 54.56% (0.0504 => 0.0779, std.dev.: 0.0076)
  MultiSource/Applications/Burg/burg: 46.86% (1.3994 => 2.0551, std.dev.: 0.0268)
  MultiSource/Applications/sgefa/sgefa: 34.51% (0.3848 => 0.5176, std.dev.: 0.0332)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.13% (1.4033 => 1.7700, std.dev.: 0.1178)
  MultiSource/Applications/treecc/treecc: 24.76% (2.2516 => 2.8092, std.dev.: 0.0657)
  MultiSource/Applications/JM/ldecod/ldecod: 24.73% (7.4026 => 9.2335, std.dev.: 0.1465)
  MultiSource/Applications/d/make_dparser: 23.63% (3.4962 => 4.3225, std.dev.: 0.2314)
  MultiSource/Applications/JM/lencod/lencod: 21.48% (16.5902 => 20.1538, std.dev.: 1.1092)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.88% (1.3365 => 1.6155, std.dev.: 0.0450)
  MultiSource/Applications/lemon/lemon: 20.50% (1.1862 => 1.4294, std.dev.: 0.0545)
  MultiSource/Applications/SPASS/SPASS: 20.40% (16.1646 => 19.4622, std.dev.: 0.4201)
  MultiSource/Applications/siod/siod: 17.50% (2.4480 => 2.8765, std.dev.: 0.0580)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.38% (9.7354 => 11.3302, std.dev.: 0.3082)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 16.18% (1.3042 => 1.5152, std.dev.: 0.0381)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 16.16% (1.2201 => 1.4173, std.dev.: 0.0314)
  MultiSource/Applications/sqlite3/sqlite3: 15.41% (16.2888 => 18.7989, std.dev.: 0.4577)
  MultiSource/Benchmarks/McCat/08-main/main: 14.53% (0.2870 => 0.3287, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.84% (1.2550 => 1.4287, std.dev.: 0.0039)
  MultiSource/Applications/oggenc/oggenc: 13.37% (5.3339 => 6.0469, std.dev.: 0.0971)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.34% (1.2695 => 1.4388, std.dev.: 0.0142)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.93% (1.2948 => 1.4622, std.dev.: 0.0255)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.73% (1.2630 => 1.4111, std.dev.: 0.0396)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 11.62% (1.3514 => 1.5084, std.dev.: 0.0142)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.43% (1.2468 => 1.3893, std.dev.: 0.0235)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.41% (24.6139 => 27.4221, std.dev.: 0.8069)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 11.32% (1.2523 => 1.3941, std.dev.: 0.0354)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 10.20% (1.3303 => 1.4660, std.dev.: 0.0468)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.95% (0.2686 => 0.2819, std.dev.: 0.0017)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.76% (1.0756 => 1.1160, std.dev.: 0.0074)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.56% (7.6426 => 12.5003, std.dev.: 0.0761)
  MultiSource/Applications/JM/ldecod/ldecod: 60.37% (0.0651 => 0.1044, std.dev.: 0.0041)
  MultiSource/Benchmarks/Olden/bisort/bisort: 51.92% (0.6647 => 1.0098, std.dev.: 0.0193)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 36.30% (2.4753 => 3.3738, std.dev.: 0.0392)
  MultiSource/Applications/SPASS/SPASS: 32.97% (8.2311 => 10.9453, std.dev.: 0.3645)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.55% (1.4830 => 1.8915, std.dev.: 0.0309)
  MultiSource/Applications/minisat/minisat: 27.07% (6.2760 => 7.9746, std.dev.: 0.4291)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 22.40% (1.1431 => 1.3992, std.dev.: 0.0442)
  MultiSource/Applications/lambda-0_1_3/lambda: 7.69% (8.1346 => 8.7601, std.dev.: 0.0326)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0001)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.83% (0.2632 => 0.2759, std.dev.: 0.0007)
  MultiSource/Applications/lua/lua: 4.69% (29.5202 => 30.9061, std.dev.: 0.1750)
  MultiSource/Applications/siod/siod: 3.48% (3.5310 => 3.6539, std.dev.: 0.0292)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.91% (5.0980 => 5.2466, std.dev.: 0.0217)
  MultiSource/Benchmarks/Olden/em3d/em3d: 2.88% (5.0288 => 5.1738, std.dev.: 0.0484)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.69% (39.9519 => 41.0253, std.dev.: 0.2971)
  MultiSource/Benchmarks/Olden/power/power: 2.52% (1.2170 => 1.2477, std.dev.: 0.0032)
  MultiSource/Applications/JM/lencod/lencod: 2.20% (8.1785 => 8.3582, std.dev.: 0.0555)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.59% (16.7972 => 17.0651, std.dev.: 0.0067)
  MultiSource/Applications/spiff/spiff: 1.45% (2.8194 => 2.8603, std.dev.: 0.0151)
  SingleSource/Benchmarks/Shootout/fib2: 1.18% (3.5966 => 3.6391, std.dev.: 0.0077)
  SingleSource/Benchmarks/Shootout/methcall: 1.15% (8.5434 => 8.6413, std.dev.: 0.0239)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -21.04% (0.1483 => 0.1171, std.dev.: 0.0117)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.40% (0.5226 => 0.2383, std.dev.: 0.0019)
  MultiSource/Applications/sgefa/sgefa: -43.45% (1.5790 => 0.8929, std.dev.: 0.0124)
  SingleSource/Benchmarks/Linpack/linpack-pc: -39.21% (57.2347 => 34.7924, std.dev.: 4.1969)
  MultiSource/Benchmarks/mafft/pairlocalalign: -18.54% (50.0284 => 40.7513, std.dev.: 2.0314)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.12% (15.9508 => 13.5389, std.dev.: 0.0741)
  MultiSource/Benchmarks/FreeBench/mason/mason: -12.47% (0.3304 => 0.2892, std.dev.: 0.0039)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.96% (20.8247 => 18.5425, std.dev.: 0.1285)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.58% (3.4956 => 3.1259, std.dev.: 0.0441)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -10.38% (0.5066 => 0.4540, std.dev.: 0.0170)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -5.88% (3.0561 => 2.8764, std.dev.: 0.0285)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.36% (2.5938 => 2.4808, std.dev.: 0.0365)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.99% (2.4471 => 2.3740, std.dev.: 0.0276)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.67% (5.2422 => 5.1024, std.dev.: 0.0193)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.39% (1.1075 => 1.0810, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.15% (17.1431 => 16.7738, std.dev.: 0.0274)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.85% (3.7874 => 3.7173, std.dev.: 0.0044)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.09% (89.7126 => 88.7380, std.dev.: 0.1627)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 6.60% (0.1348 => 0.1437, std.dev.: 0.0148)

Report Time: 0.78s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131014/93b036ff/attachment.html>


More information about the llvm-testresults mailing list