[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Dec 4 13:41:16 PST 2013


http://llvm.org/perf/db_default/v4/nts/17971?compare_to=17965&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 17971, Order: 196400, Start Time: 2013-12-04 19:54:33, End Time: 2013-12-04 21:45:21
      To: 17965, Order: 196387, Start Time: 2013-12-04 17:33:04, End Time: 2013-12-04 19:27:49
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 27 (39 on baseline)
Performance Improvements: 28 (3 on baseline)
Unchanged Tests: 1055 (1068 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout/random: 67.78% (0.0329 => 0.0552, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout/hash: 64.45% (0.0602 => 0.0990, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout/heapsort: 58.35% (0.0473 => 0.0749, std.dev.: 0.0032)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 43.81% (0.2182 => 0.3138, std.dev.: 0.0249)
  MultiSource/Benchmarks/Olden/power/power: 40.66% (0.1397 => 0.1965, std.dev.: 0.0196)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.15% (5.1334 => 6.0139, std.dev.: 0.3393)
  MultiSource/Benchmarks/McCat/05-eks/eks: 16.41% (0.5349 => 0.6227, std.dev.: 0.0262)
  MultiSource/Benchmarks/Olden/tsp/tsp: 15.22% (0.1386 => 0.1597, std.dev.: 0.0079)
  SingleSource/Benchmarks/Shootout-C++/lists1: 12.63% (0.3174 => 0.3575, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 12.58% (1.2823 => 1.4436, std.dev.: 0.0180)
  MultiSource/Benchmarks/nbench/nbench: 12.29% (1.2616 => 1.4167, std.dev.: 0.0580)
  MultiSource/Applications/hexxagon/hexxagon: 11.86% (1.0742 => 1.2016, std.dev.: 0.0252)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.57% (1.2408 => 1.2975, std.dev.: 0.0067)
  SingleSource/Benchmarks/Shootout-C++/ary3: 4.19% (0.2576 => 0.2684, std.dev.: 0.0010)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 107.76% (0.1456 => 0.3025, std.dev.: 0.0253)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 27.82% (0.1542 => 0.1971, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout/heapsort: 25.99% (3.6108 => 4.5492, std.dev.: 0.2828)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 13.81% (4.3169 => 4.9130, std.dev.: 0.1204)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 7.60% (1.3862 => 1.4916, std.dev.: 0.0090)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.60% (5.0205 => 5.4021, std.dev.: 0.0387)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.44% (4.5846 => 4.8800, std.dev.: 0.0536)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.29% (5.9173 => 6.1709, std.dev.: 0.0774)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.01% (0.5108 => 0.5313, std.dev.: 0.0035)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.99% (0.6248 => 0.6497, std.dev.: 0.0041)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.30% (1.8323 => 1.8745, std.dev.: 0.0126)
  SingleSource/Benchmarks/McGill/chomp: 1.76% (1.0314 => 1.0496, std.dev.: 0.0028)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.25% (40.2441 => 40.7477, std.dev.: 0.0833)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/2003-07-06-IntOverflow: -45.93% (0.0405 => 0.0219, std.dev.: 0.0043)
  SingleSource/UnitTests/byval-alignment: -40.99% (0.0322 => 0.0190, std.dev.: 0.0006)
  SingleSource/Regression/C/globalrefs: -40.77% (0.0363 => 0.0215, std.dev.: 0.0044)
  SingleSource/Regression/C++/EH/ctor_dtor_count-2: -39.81% (0.0417 => 0.0251, std.dev.: 0.0057)
  SingleSource/Regression/C/2003-05-22-LocalTypeTest: -38.58% (0.0267 => 0.0164, std.dev.: 0.0026)
  SingleSource/Regression/C/DuffsDevice: -38.19% (0.0419 => 0.0259, std.dev.: 0.0015)
  SingleSource/UnitTests/2002-08-02-CastTest: -37.09% (0.0275 => 0.0173, std.dev.: 0.0008)
  SingleSource/Regression/C++/EH/exception_spec_test: -37.05% (0.0610 => 0.0384, std.dev.: 0.0087)
  SingleSource/UnitTests/2003-07-09-LoadShorts: -36.73% (0.0441 => 0.0279, std.dev.: 0.0062)
  SingleSource/UnitTests/2002-05-03-NotTest: -36.01% (0.0311 => 0.0199, std.dev.: 0.0035)
  SingleSource/Regression/C++/pointer_member: -35.07% (0.0288 => 0.0187, std.dev.: 0.0014)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -34.45% (0.0749 => 0.0491, std.dev.: 0.0023)
  SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: -32.95% (0.0689 => 0.0462, std.dev.: 0.0013)
  SingleSource/UnitTests/2005-07-17-INT-To-FP: -32.43% (0.0370 => 0.0250, std.dev.: 0.0024)
  SingleSource/Regression/C/test_indvars: -31.16% (0.0430 => 0.0296, std.dev.: 0.0008)
  SingleSource/UnitTests/SignlessTypes/shr: -24.15% (0.0439 => 0.0333, std.dev.: 0.0019)
  MultiSource/Benchmarks/Prolangs-C++/objects/objects: -19.15% (0.1243 => 0.1005, std.dev.: 0.0051)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -17.68% (0.2488 => 0.2048, std.dev.: 0.0138)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -15.07% (0.0803 => 0.0682, std.dev.: 0.0034)
  SingleSource/Benchmarks/Shootout-C++/methcall: -6.50% (0.2232 => 0.2087, std.dev.: 0.0050)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -6.45% (0.3458 => 0.3235, std.dev.: 0.0054)
  MultiSource/Benchmarks/MallocBench/gs/gs: -6.01% (4.9776 => 4.6785, std.dev.: 0.0821)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: -23.19% (3.7528 => 2.8826, std.dev.: 0.2397)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -22.01% (2.1757 => 1.6968, std.dev.: 0.1827)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -5.84% (4.2193 => 3.9730, std.dev.: 0.0226)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.35% (0.2989 => 0.2889, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc/oourafft: -1.72% (3.7062 => 3.6423, std.dev.: 0.0226)
  SingleSource/Benchmarks/Shootout/sieve: -1.42% (6.8218 => 6.7250, std.dev.: 0.0123)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout/hash: 69.81% (0.0583 => 0.0990, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout/random: 66.27% (0.0332 => 0.0552, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout/heapsort: 64.98% (0.0454 => 0.0749, std.dev.: 0.0032)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 46.84% (0.2137 => 0.3138, std.dev.: 0.0249)
  MultiSource/Benchmarks/Olden/power/power: 39.76% (0.1406 => 0.1965, std.dev.: 0.0196)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.96% (5.0556 => 6.0139, std.dev.: 0.3393)
  MultiSource/Benchmarks/McCat/05-eks/eks: 17.00% (0.5322 => 0.6227, std.dev.: 0.0262)
  SingleSource/Benchmarks/Shootout-C++/lists1: 16.49% (0.3069 => 0.3575, std.dev.: 0.0057)
  MultiSource/Benchmarks/Olden/tsp/tsp: 15.81% (0.1379 => 0.1597, std.dev.: 0.0079)
  MultiSource/Applications/hexxagon/hexxagon: 14.24% (1.0518 => 1.2016, std.dev.: 0.0252)
  MultiSource/Benchmarks/nbench/nbench: 12.02% (1.2647 => 1.4167, std.dev.: 0.0580)
  MultiSource/Applications/lambda-0_1_3/lambda: 11.75% (0.8331 => 0.9310, std.dev.: 0.0270)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.84% (1.3024 => 1.4436, std.dev.: 0.0180)
  MultiSource/Applications/JM/lencod/lencod: 6.97% (17.2968 => 18.5029, std.dev.: 0.3389)
  SingleSource/Regression/C++/ofstream_ctor: 6.45% (0.2045 => 0.2177, std.dev.: 0.0041)
  MultiSource/Applications/SPASS/SPASS: 5.55% (16.7177 => 17.6460, std.dev.: 0.3265)
  SingleSource/Benchmarks/Shootout-C++/ary3: 5.38% (0.2547 => 0.2684, std.dev.: 0.0010)
  MultiSource/Applications/oggenc/oggenc: 5.31% (5.4968 => 5.7886, std.dev.: 0.0236)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 4.44% (0.3582 => 0.3741, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.12% (1.2583 => 1.2975, std.dev.: 0.0067)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 3.01% (0.3950 => 0.4069, std.dev.: 0.0044)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 124.91% (0.1345 => 0.3025, std.dev.: 0.0253)
  SingleSource/Benchmarks/Shootout/heapsort: 54.25% (2.9492 => 4.5492, std.dev.: 0.2828)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 44.18% (2.9945 => 4.3176, std.dev.: 0.4983)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 21.11% (4.0567 => 4.9130, std.dev.: 0.1204)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.50% (1.2278 => 1.4058, std.dev.: 0.0330)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 8.48% (2.8940 => 3.1393, std.dev.: 0.0936)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 7.79% (1.3838 => 1.4916, std.dev.: 0.0090)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.35% (5.0320 => 5.4021, std.dev.: 0.0387)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.36% (4.5883 => 4.8800, std.dev.: 0.0536)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.36% (5.9133 => 6.1709, std.dev.: 0.0774)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.93% (0.5112 => 0.5313, std.dev.: 0.0035)
  SingleSource/Benchmarks/McGill/chomp: 3.93% (1.0099 => 1.0496, std.dev.: 0.0028)
  SingleSource/Benchmarks/Misc/flops: 3.91% (9.2673 => 9.6299, std.dev.: 0.0249)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.77% (0.6261 => 0.6497, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.71% (3.8062 => 3.9093, std.dev.: 0.0155)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.05% (3.1585 => 3.2234, std.dev.: 0.0071)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.83% (1.8409 => 1.8745, std.dev.: 0.0126)
  MultiSource/Benchmarks/Olden/bh/bh: 1.63% (2.3919 => 2.4308, std.dev.: 0.0146)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -9.09% (2.8850 => 2.6227, std.dev.: 0.0804)
  MultiSource/Applications/lambda-0_1_3/lambda: -1.63% (7.9597 => 7.8296, std.dev.: 0.0268)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.32% (2.6281 => 2.5934, std.dev.: 0.0104)

Report Time: 0.74s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131204/3ac8672e/attachment.html>


More information about the llvm-testresults mailing list