[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Oct 9 07:42:36 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16143?compare_to=16139&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16143, Order: 192293, Start Time: 2013-10-09 13:01:18, End Time: 2013-10-09 14:45:37
      To: 16139, Order: 192286, Start Time: 2013-10-09 10:53:44, End Time: 2013-10-09 12:38:00
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 23 (50 on baseline)
Performance Improvements: 3 (20 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1081 (1037 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.90% (1.0982 => 1.1301, std.dev.: 0.0023)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.47% (0.7001 => 0.7104, std.dev.: 0.0011)
  MultiSource/Benchmarks/MallocBench/gs/gs: 1.35% (4.6106 => 4.6727, std.dev.: 0.0232)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.25% (0.9260 => 0.9376, std.dev.: 0.0033)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 20.46% (0.1637 => 0.1972, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 18.64% (6.4354 => 7.6347, std.dev.: 0.0890)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.08% (3.5682 => 3.8566, std.dev.: 0.0036)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 4.50% (2.9245 => 3.0561, std.dev.: 0.0002)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 3.98% (0.4870 => 0.5064, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.11% (4.0206 => 4.1457, std.dev.: 0.0006)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.57% (2.1284 => 2.1832, std.dev.: 0.0140)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.48% (4.5066 => 4.6185, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.11% (5.5081 => 5.6241, std.dev.: 0.0006)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.92% (1.8627 => 1.8984, std.dev.: 0.0013)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.88% (1.7800 => 1.8135, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.59% (11.8484 => 12.0371, std.dev.: 0.0252)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 1.50% (9.3717 => 9.5120, std.dev.: 0.0144)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.48% (11.9576 => 12.1349, std.dev.: 0.0027)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.29% (2.3934 => 2.4243, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.29% (4.9276 => 4.9911, std.dev.: 0.0016)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.23% (1.6744 => 1.6950, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.12% (6.6236 => 6.6980, std.dev.: 0.0236)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.09% (3.1698 => 3.2045, std.dev.: 0.0083)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.37% (1.3218 => 1.2905, std.dev.: 0.0045)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -4.10% (2.4894 => 2.3873, std.dev.: 0.0228)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.5467 => 2.5184, std.dev.: 0.0104)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.22% (0.1350 => 0.1353, std.dev.: 0.0372)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.35% (1.0935 => 1.1301, std.dev.: 0.0023)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.07% (0.4624 => 0.4766, std.dev.: 0.0034)
  MultiSource/Applications/kimwitu++/kc: 2.81% (18.3608 => 18.8763, std.dev.: 0.0902)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.80% (0.5705 => 0.5865, std.dev.: 0.0045)
  MultiSource/Applications/SPASS/SPASS: 2.69% (16.1646 => 16.5998, std.dev.: 0.0705)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.67% (9.9903 => 10.2573, std.dev.: 0.0458)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 2.55% (1.2728 => 1.3053, std.dev.: 0.0054)
  MultiSource/Benchmarks/Bullet/bullet: 2.27% (32.7552 => 33.4977, std.dev.: 0.1119)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.18% (1.3365 => 1.3657, std.dev.: 0.0018)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.12% (14.4764 => 14.7829, std.dev.: 0.0814)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.03% (1.8775 => 1.9157, std.dev.: 0.0142)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.96% (24.6139 => 25.0964, std.dev.: 0.0570)
  MultiSource/Benchmarks/MallocBench/gs/gs: 1.84% (4.5883 => 4.6727, std.dev.: 0.0232)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.78% (0.9212 => 0.9376, std.dev.: 0.0033)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.70% (7.2661 => 7.3895, std.dev.: 0.0421)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.64% (1.2086 => 1.2284, std.dev.: 0.0016)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 1.46% (44.2807 => 44.9270, std.dev.: 0.0704)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.43% (1.2695 => 1.2876, std.dev.: 0.0033)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.13% (5.5014 => 5.5635, std.dev.: 0.0078)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.04% (1.2152 => 1.2278, std.dev.: 0.0014)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.39% (7.6426 => 12.4869, std.dev.: 0.0866)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 18.51% (6.4425 => 7.6347, std.dev.: 0.0890)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 10.42% (1.1013 => 1.2161, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.48% (3.5550 => 3.8566, std.dev.: 0.0036)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.12% (1.2516 => 1.3532, std.dev.: 0.0015)
  SingleSource/UnitTests/Vector/multiplies: 6.62% (0.5561 => 0.5929, std.dev.: 0.0054)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.27% (8.1346 => 8.6446, std.dev.: 0.0526)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 5.40% (0.1871 => 0.1972, std.dev.: 0.0014)
  MultiSource/Benchmarks/BitBench/five11/five11: 4.89% (5.3716 => 5.6345, std.dev.: 0.0145)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.40% (3.5642 => 3.7212, std.dev.: 0.0021)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.66% (0.2842 => 0.2946, std.dev.: 0.0003)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.42% (2.3084 => 2.3873, std.dev.: 0.0228)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.33% (4.4696 => 4.6185, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.18% (4.0181 => 4.1457, std.dev.: 0.0006)
  MultiSource/Applications/siod/siod: 2.82% (3.5310 => 3.6305, std.dev.: 0.0347)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.74% (1.7652 => 1.8135, std.dev.: 0.0012)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.51% (1.8519 => 1.8984, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.40% (5.4925 => 5.6241, std.dev.: 0.0006)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.39% (0.5182 => 0.5306, std.dev.: 0.0017)
  MultiSource/Benchmarks/Olden/power/power: 2.38% (1.2170 => 1.2460, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.31% (11.7654 => 12.0371, std.dev.: 0.0252)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.93% (5.3022 => 5.4045, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.73% (11.9288 => 12.1349, std.dev.: 0.0027)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.68% (1.0477 => 1.0653, std.dev.: 0.0005)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.62% (1.5940 => 1.6198, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.51% (3.1569 => 3.2045, std.dev.: 0.0083)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.45% (1.6707 => 1.6950, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.44% (6.6028 => 6.6980, std.dev.: 0.0236)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.32% (16.7972 => 17.0185, std.dev.: 0.0246)
  SingleSource/Benchmarks/Shootout/methcall: 1.27% (8.5434 => 8.6517, std.dev.: 0.0224)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -20.57% (0.1483 => 0.1178, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.54% (1.2499 => 1.2307, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.25% (1.3068 => 1.2905, std.dev.: 0.0045)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.63% (0.5226 => 0.2371, std.dev.: 0.0008)
  MultiSource/Applications/sgefa/sgefa: -47.10% (1.5790 => 0.8353, std.dev.: 0.0291)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.95% (15.9508 => 12.9276, std.dev.: 0.0855)
  SingleSource/Benchmarks/Linpack/linpack-pc: -17.81% (57.2347 => 47.0434, std.dev.: 2.0466)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.64% (20.8247 => 18.3999, std.dev.: 0.2089)
  MultiSource/Benchmarks/FreeBench/mason/mason: -9.93% (0.3304 => 0.2976, std.dev.: 0.0004)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -9.07% (3.4956 => 3.1785, std.dev.: 0.0179)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.32% (50.0284 => 46.3662, std.dev.: 0.0932)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.17% (3.7437 => 3.5129, std.dev.: 0.0639)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.00% (0.3501 => 0.3326, std.dev.: 0.0003)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.75% (0.7474 => 0.7119, std.dev.: 0.0088)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.84% (4.3592 => 4.1918, std.dev.: 0.0611)
  SingleSource/Benchmarks/Misc/salsa20: -3.63% (7.7964 => 7.5133, std.dev.: 0.0637)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -3.51% (2.3365 => 2.2544, std.dev.: 0.0249)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.21% (2.5938 => 2.5366, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.69% (17.1431 => 16.8540, std.dev.: 0.0224)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.28% (39.9519 => 39.4388, std.dev.: 0.0825)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.37% (0.1348 => 0.1353, std.dev.: 0.0372)

Report Time: 0.77s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131009/c88694f3/attachment.html>


More information about the llvm-testresults mailing list