[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Oct 28 14:51:03 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16778?compare_to=16774&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16778, Order: 193532, Start Time: 2013-10-28 19:57:01, End Time: 2013-10-28 21:54:26
      To: 16774, Order: 193523, Start Time: 2013-10-28 17:37:29, End Time: 2013-10-28 19:31:08
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 26 (36 on baseline)
Performance Improvements: 5 (15 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1076 (1056 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 42.18% (0.9536 => 1.3558, std.dev.: 0.0697)
  MultiSource/Applications/obsequi/Obsequi: 40.94% (1.1528 => 1.6248, std.dev.: 0.0664)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 37.51% (0.6793 => 0.9341, std.dev.: 0.0437)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 37.27% (0.7403 => 1.0162, std.dev.: 0.0209)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 36.85% (1.4727 => 2.0154, std.dev.: 0.0726)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 34.30% (1.6936 => 2.2745, std.dev.: 0.1705)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 33.95% (1.6464 => 2.2054, std.dev.: 0.0740)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 31.70% (0.0937 => 0.1234, std.dev.: 0.0075)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 27.91% (0.2727 => 0.3488, std.dev.: 0.0172)
  MultiSource/Benchmarks/Prolangs-C/football/football: 23.54% (0.9940 => 1.2280, std.dev.: 0.0583)
  MultiSource/Benchmarks/nbench/nbench: 20.01% (1.2426 => 1.4912, std.dev.: 0.0839)
  MultiSource/Applications/ClamAV/clamscan: 18.29% (16.7408 => 19.8019, std.dev.: 1.0074)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.86% (0.4828 => 0.5642, std.dev.: 0.0166)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 13.94% (1.4416 => 1.6425, std.dev.: 0.0701)
  MultiSource/Benchmarks/FreeBench/distray/distray: 8.32% (0.1202 => 0.1302, std.dev.: 0.0034)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.65% (2.8216 => 3.6017, std.dev.: 0.2377)
  MultiSource/Applications/obsequi/Obsequi: 24.50% (2.2033 => 2.7431, std.dev.: 0.0324)
  MultiSource/Benchmarks/FreeBench/neural/neural: 18.78% (0.2380 => 0.2827, std.dev.: 0.0145)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.93% (2.7629 => 3.1755, std.dev.: 0.1576)
  MultiSource/Applications/JM/lencod/lencod: 4.10% (7.6399 => 7.9534, std.dev.: 0.0611)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.95% (1.3022 => 1.3537, std.dev.: 0.0091)
  SingleSource/Benchmarks/McGill/misr: 2.83% (0.3996 => 0.4109, std.dev.: 0.0024)
  MultiSource/Applications/spiff/spiff: 2.35% (2.9010 => 2.9693, std.dev.: 0.0173)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.32% (13.7799 => 14.0994, std.dev.: 0.1133)
  SingleSource/Benchmarks/Shootout/methcall: 1.86% (8.4457 => 8.6024, std.dev.: 0.0521)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.63% (1.5946 => 1.6206, std.dev.: 0.0029)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -40.11% (0.3854 => 0.2308, std.dev.: 0.0514)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -15.63% (1.4950 => 1.2614, std.dev.: 0.0670)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -15.44% (1.4420 => 1.2193, std.dev.: 0.0785)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -14.85% (1.5385 => 1.3101, std.dev.: 0.0150)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/sim/sim: -4.14% (4.0654 => 3.8969, std.dev.: 0.0256)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.00% (0.1375 => 0.1320, std.dev.: 0.0252)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 47.18% (0.9212 => 1.3558, std.dev.: 0.0697)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 41.74% (1.6047 => 2.2745, std.dev.: 0.1705)
  MultiSource/Applications/obsequi/Obsequi: 40.66% (1.1551 => 1.6248, std.dev.: 0.0664)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 36.67% (1.4746 => 2.0154, std.dev.: 0.0726)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 36.20% (0.7461 => 1.0162, std.dev.: 0.0209)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 36.01% (0.6868 => 0.9341, std.dev.: 0.0437)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 33.94% (1.6465 => 2.2054, std.dev.: 0.0740)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 30.44% (0.0946 => 0.1234, std.dev.: 0.0075)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.86% (0.2686 => 0.3488, std.dev.: 0.0172)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 25.90% (7.2661 => 9.1480, std.dev.: 0.6820)
  MultiSource/Benchmarks/Prolangs-C/football/football: 24.95% (0.9828 => 1.2280, std.dev.: 0.0583)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.90% (1.3365 => 1.6425, std.dev.: 0.0701)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 22.02% (0.4624 => 0.5642, std.dev.: 0.0166)
  MultiSource/Applications/ClamAV/clamscan: 19.72% (16.5398 => 19.8019, std.dev.: 1.0074)
  MultiSource/Benchmarks/nbench/nbench: 19.45% (1.2484 => 1.4912, std.dev.: 0.0839)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 16.76% (1.2086 => 1.4112, std.dev.: 0.0687)
  SingleSource/Benchmarks/Misc/flops: 9.86% (0.1034 => 0.1136, std.dev.: 0.0035)
  MultiSource/Benchmarks/FreeBench/distray/distray: 9.05% (0.1194 => 0.1302, std.dev.: 0.0034)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 60.59% (7.6426 => 12.2734, std.dev.: 0.0383)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 50.01% (2.4010 => 3.6017, std.dev.: 0.2377)
  SingleSource/Benchmarks/Shootout-C++/matrix: 46.41% (2.8554 => 4.1806, std.dev.: 0.0503)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 28.29% (2.4753 => 3.1755, std.dev.: 0.1576)
  MultiSource/Applications/obsequi/Obsequi: 25.35% (2.1884 => 2.7431, std.dev.: 0.0324)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 19.85% (1.1431 => 1.3700, std.dev.: 0.0647)
  SingleSource/Benchmarks/McGill/misr: 8.96% (0.3771 => 0.4109, std.dev.: 0.0024)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.16% (1.2516 => 1.3537, std.dev.: 0.0091)
  SingleSource/UnitTests/Vector/multiplies: 6.60% (0.5561 => 0.5928, std.dev.: 0.0048)
  MultiSource/Applications/spiff/spiff: 5.32% (2.8194 => 2.9693, std.dev.: 0.0173)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.29% (3.1730 => 3.3408, std.dev.: 0.0538)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.26% (89.7126 => 92.6390, std.dev.: 0.1027)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 3.03% (3.5683 => 3.6763, std.dev.: 0.0254)
  MultiSource/Benchmarks/Olden/power/power: 2.42% (1.2170 => 1.2464, std.dev.: 0.0104)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.41% (6.5990 => 6.7581, std.dev.: 0.0566)
  SingleSource/Benchmarks/SmallPT/smallpt: 2.00% (16.7972 => 17.1334, std.dev.: 0.0627)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.67% (1.5940 => 1.6206, std.dev.: 0.0029)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 1.03% (4.9459 => 4.9969, std.dev.: 0.0104)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -19.22% (0.1483 => 0.1198, std.dev.: 0.0016)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -45.91% (0.5226 => 0.2827, std.dev.: 0.0145)
  MultiSource/Applications/sgefa/sgefa: -42.81% (1.5790 => 0.9030, std.dev.: 0.0056)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -29.50% (0.0400 => 0.0282, std.dev.: 0.0034)
  SingleSource/Benchmarks/Linpack/linpack-pc: -22.81% (57.2347 => 44.1802, std.dev.: 2.9437)
  MultiSource/Benchmarks/mafft/pairlocalalign: -12.28% (50.0284 => 43.8864, std.dev.: 0.9277)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -11.61% (15.9508 => 14.0994, std.dev.: 0.1133)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.17% (20.8247 => 18.4981, std.dev.: 0.1590)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.34% (3.4956 => 3.1342, std.dev.: 0.0084)
  SingleSource/Benchmarks/Shootout-C++/ary3: -4.63% (5.0002 => 4.7689, std.dev.: 0.0226)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.92% (3.7874 => 3.6768, std.dev.: 0.0067)
  MultiSource/Applications/JM/lencod/lencod: -2.75% (8.1785 => 7.9534, std.dev.: 0.0611)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.65% (2.4471 => 2.3823, std.dev.: 0.0166)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.13% (4.3592 => 4.2663, std.dev.: 0.0187)
  SingleSource/Benchmarks/Misc/oourafft: -1.41% (3.7484 => 3.6956, std.dev.: 0.0168)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.08% (0.1348 => 0.1320, std.dev.: 0.0252)

Report Time: 1.12s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131028/98128e9c/attachment.html>


More information about the llvm-testresults mailing list