[llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Jun 6 00:56:34 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12105?compare_to=12102&baseline=11496
Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:12

Comparing:
     Run: 12105, Order: 183385, Start Time: 2013-06-06 06:17:28, End Time: 2013-06-06 07:57:15
      To: 12102, Order: 183372, Start Time: 2013-06-06 03:19:57, End Time: 2013-06-06 04:56:28
Baseline: 11496, Order: 181973, Start Time: 2013-05-16 03:50:51, End Time: 2013-05-16 05:27:22

===============
Tests Summary
===============

Performance Regressions: 7 (74 on baseline)
Performance Improvements: 1 (21 on baseline)
Unchanged Tests: 1100 (1013 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.69% (2.1447 => 2.1810, std.dev.: 0.0080)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.43% (3.9111 => 3.9669, std.dev.: 0.0033)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 23.06% (0.1032 => 0.1270, std.dev.: 0.0007)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 4.93% (40.5326 => 42.5323, std.dev.: 0.7592)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.79% (0.2192 => 0.2297, std.dev.: 0.0011)
  SingleSource/Benchmarks/Shootout/heapsort: 1.49% (3.8129 => 3.8696, std.dev.: 0.0069)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.26% (5.5663 => 5.6362, std.dev.: 0.0079)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vectorizer/gcc-loops: -1.70% (0.5883 => 0.5783, std.dev.: 0.0017)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.97% (0.2512 => 0.2662, std.dev.: 0.0006)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.44% (2.1084 => 2.1810, std.dev.: 0.0080)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.21% (3.8437 => 3.9669, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.70% (0.7065 => 0.7256, std.dev.: 0.0041)
  MultiSource/Benchmarks/nbench/nbench: 2.50% (1.1448 => 1.1734, std.dev.: 0.0041)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.48% (0.8673 => 0.8888, std.dev.: 0.0013)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.47% (1.4383 => 1.4738, std.dev.: 0.0062)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.40% (9.7471 => 9.9808, std.dev.: 0.0121)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.37% (0.6655 => 0.6813, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.37% (0.6381 => 0.6532, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.34% (0.6574 => 0.6728, std.dev.: 0.0023)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.33% (13.6931 => 14.0118, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.30% (0.6358 => 0.6504, std.dev.: 0.0024)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (5.1879 => 5.3063, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.25% (0.6881 => 0.7036, std.dev.: 0.0026)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.24% (6.7821 => 6.9342, std.dev.: 0.0064)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.23% (1.2980 => 1.3270, std.dev.: 0.0068)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.22% (1.4746 => 1.5073, std.dev.: 0.0118)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.18% (0.7752 => 0.7921, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.18% (0.8215 => 0.8394, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.16% (0.6895 => 0.7044, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.14% (0.6262 => 0.6396, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.13% (0.6580 => 0.6720, std.dev.: 0.0024)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.11% (1.2996 => 1.3270, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.11% (0.7359 => 0.7514, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.10% (0.6661 => 0.6801, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.09% (0.7379 => 0.7533, std.dev.: 0.0023)
  MultiSource/Benchmarks/MallocBench/gs/gs: 2.08% (4.5839 => 4.6792, std.dev.: 0.0091)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.04% (0.7707 => 0.7864, std.dev.: 0.0005)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.02% (1.8736 => 1.9114, std.dev.: 0.0089)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.01% (0.6367 => 0.6495, std.dev.: 0.0025)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.00% (4.9798 => 5.0796, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.99% (0.6730 => 0.6864, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.95% (0.6261 => 0.6383, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.94% (0.6736 => 0.6867, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.91% (0.7270 => 0.7409, std.dev.: 0.0010)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.87% (23.3724 => 23.8088, std.dev.: 0.0622)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.86% (0.6284 => 0.6401)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.85% (0.6748 => 0.6873, std.dev.: 0.0007)
  SingleSource/UnitTests/Vector/constpool: 1.82% (19.6509 => 20.0088, std.dev.: 0.0228)
  MultiSource/Benchmarks/Prolangs-C/football/football: 1.80% (0.9297 => 0.9464, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.79% (0.7158 => 0.7286, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.79% (0.7723 => 0.7861, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.79% (0.7225 => 0.7354, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.70% (0.8417 => 0.8560, std.dev.: 0.0015)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.68% (2.7259 => 2.7717, std.dev.: 0.0095)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.66% (8.5421 => 8.6843, std.dev.: 0.0077)
  MultiSource/Applications/kimwitu++/kc: 1.64% (18.2895 => 18.5903, std.dev.: 0.0807)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.62% (0.6558 => 0.6664, std.dev.: 0.0011)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 1.61% (1.1683 => 1.1871, std.dev.: 0.0013)
  MultiSource/Applications/lua/lua: 1.58% (4.1467 => 4.2124, std.dev.: 0.0109)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.57% (1.6133 => 1.6386, std.dev.: 0.0022)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.55% (5.0343 => 5.1123, std.dev.: 0.0086)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.52% (1.1013 => 1.1180, std.dev.: 0.0026)
  MultiSource/Benchmarks/Bullet/bullet: 1.49% (33.9176 => 34.4236, std.dev.: 0.0045)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.49% (4.1004 => 4.1615, std.dev.: 0.0109)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.48% (0.7029 => 0.7133, std.dev.: 0.0025)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.31% (0.9356 => 0.9479, std.dev.: 0.0008)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 23.42% (0.1029 => 0.1270, std.dev.: 0.0007)
  MultiSource/Benchmarks/llubenchmark/llu: 6.91% (3.7586 => 4.0182, std.dev.: 0.0309)
  SingleSource/Benchmarks/Dhrystone/fldry: 6.75% (0.6478 => 0.6915, std.dev.: 0.0056)
  SingleSource/Benchmarks/Shootout-C++/sieve: 6.10% (2.4977 => 2.6501, std.dev.: 0.0006)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.00% (0.2167 => 0.2297, std.dev.: 0.0011)
  SingleSource/Benchmarks/Misc/richards_benchmark: 5.82% (0.8640 => 0.9143, std.dev.: 0.0000)
  MultiSource/Applications/hexxagon/hexxagon: 3.24% (11.8352 => 12.2187, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.67% (4.3400 => 4.4558, std.dev.: 0.0063)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.23% (5.5130 => 5.6362, std.dev.: 0.0079)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.06% (78.7923 => 80.4193, std.dev.: 0.4057)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 1.93% (4.0209 => 4.0987, std.dev.: 0.0021)
  MultiSource/Benchmarks/PAQ8p/paq8p: 1.61% (62.9725 => 63.9845, std.dev.: 0.0289)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.60% (3.2340 => 3.2856, std.dev.: 0.0072)
  SingleSource/Benchmarks/Shootout/heapsort: 1.38% (3.8170 => 3.8696, std.dev.: 0.0069)
  MultiSource/Benchmarks/nbench/nbench: 1.32% (11.7138 => 11.8687, std.dev.: 0.0023)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 1.00% (10.3248 => 10.4282, std.dev.: 0.0043)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -32.83% (0.1124 => 0.0755, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.34% (6.2629 => 6.0539, std.dev.: 0.0167)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -2.69% (46.1501 => 44.9087, std.dev.: 0.0029)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/em3d/em3d: -29.51% (4.3829 => 3.0895, std.dev.: 0.0064)
  SingleSource/Benchmarks/Dhrystone/dry: -22.49% (1.5080 => 1.1689)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.74% (0.8419 => 0.7515, std.dev.: 0.0010)
  SingleSource/Benchmarks/McGill/chomp: -8.97% (1.1979 => 1.0904, std.dev.: 0.0025)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -4.52% (18.7069 => 17.8622, std.dev.: 0.0475)
  SingleSource/Benchmarks/Misc/fbench: -3.70% (2.1388 => 2.0596, std.dev.: 0.0041)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.67% (0.8475 => 0.8164, std.dev.: 0.0002)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.60% (0.3136 => 0.3023, std.dev.: 0.0001)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.01% (5.1508 => 4.9957, std.dev.: 0.0436)
  SingleSource/Benchmarks/Misc/salsa20: -2.67% (7.4818 => 7.2822, std.dev.: 0.0028)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.53% (3.4495 => 3.3624, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.48% (4.8598 => 4.7395, std.dev.: 0.0004)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.36% (2.9999 => 2.9290)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.16% (1.1343 => 1.1098, std.dev.: 0.0028)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.11% (1.6077 => 1.5737, std.dev.: 0.0118)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.74% (2.0567 => 2.0210, std.dev.: 0.0000)
  MultiSource/Applications/lua/lua: -1.09% (23.7766 => 23.5172, std.dev.: 0.0545)
  MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.08% (6.3910 => 6.3222, std.dev.: 0.0131)

Report Time: 0.71s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130606/30b95a9f/attachment.html>


More information about the llvm-testresults mailing list