[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Oct 18 04:47:55 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16438?compare_to=16434&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16438, Order: 192958, Start Time: 2013-10-18 10:00:57, End Time: 2013-10-18 11:51:08
      To: 16434, Order: 192953, Start Time: 2013-10-18 07:47:41, End Time: 2013-10-18 09:39:08
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 14 (18 on baseline)
Performance Improvements: 35 (16 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1058 (1073 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 38.24% (2.8564 => 3.9487, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/ary3: 23.00% (5.1584 => 6.3449, std.dev.: 0.4039)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 9.76% (0.3596 => 0.3947, std.dev.: 0.0022)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.28% (0.8460 => 0.8907, std.dev.: 0.0152)
  SingleSource/Benchmarks/Stanford/FloatMM: 4.41% (0.6940 => 0.7246, std.dev.: 0.0013)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.06% (1.8397 => 1.8960, std.dev.: 0.0021)
  MultiSource/Applications/sgefa/sgefa: 2.96% (0.8865 => 0.9127, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.47% (5.2596 => 5.3897, std.dev.: 0.0242)
  MultiSource/Benchmarks/BitBench/five11/five11: 2.14% (5.5317 => 5.6503, std.dev.: 0.0109)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.08% (5.8344 => 5.9556, std.dev.: 0.0437)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.92% (4.1859 => 4.2664, std.dev.: 0.0184)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.60% (2.3871 => 2.4252, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.33% (3.5357 => 3.5826, std.dev.: 0.0114)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.26% (1.3610 => 1.3782, std.dev.: 0.0008)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/2002-05-02-CastTest3: -53.27% (0.0214 => 0.0100, std.dev.: 0.0006)
  SingleSource/UnitTests/2006-12-07-Compare64BitConstant: -50.00% (0.0292 => 0.0146, std.dev.: 0.0007)
  SingleSource/UnitTests/2003-10-13-SwitchTest: -48.21% (0.0280 => 0.0145, std.dev.: 0.0013)
  SingleSource/UnitTests/2003-05-07-VarArgs: -47.49% (0.0478 => 0.0251, std.dev.: 0.0026)
  SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: -46.17% (0.0379 => 0.0204, std.dev.: 0.0018)
  SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: -45.25% (0.0263 => 0.0144, std.dev.: 0.0006)
  SingleSource/UnitTests/2002-12-13-MishaTest: -45.16% (0.0341 => 0.0187, std.dev.: 0.0007)
  SingleSource/Regression/C/PR640: -44.53% (0.0393 => 0.0218, std.dev.: 0.0014)
  SingleSource/UnitTests/printargs: -44.41% (0.0295 => 0.0164, std.dev.: 0.0007)
  SingleSource/UnitTests/2002-05-03-NotTest: -44.38% (0.0329 => 0.0183, std.dev.: 0.0008)
  SingleSource/UnitTests/AtomicOps: -44.27% (0.0375 => 0.0209, std.dev.: 0.0002)
  SingleSource/UnitTests/2002-05-02-CastTest2: -43.82% (0.0356 => 0.0200, std.dev.: 0.0020)
  SingleSource/UnitTests/2003-10-29-ScalarReplBug: -43.02% (0.0265 => 0.0151, std.dev.: 0.0007)
  SingleSource/Regression/C/sumarray: -41.57% (0.0498 => 0.0291, std.dev.: 0.0012)
  SingleSource/Regression/C/PR491: -40.47% (0.0257 => 0.0153, std.dev.: 0.0012)
  SingleSource/UnitTests/2002-10-12-StructureArgs: -38.46% (0.0286 => 0.0176, std.dev.: 0.0002)
  SingleSource/UnitTests/2003-07-09-SignedArgs: -38.02% (0.0434 => 0.0269, std.dev.: 0.0008)
  SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: -35.54% (0.0332 => 0.0214, std.dev.: 0.0015)
  SingleSource/Regression/C/bigstack: -24.65% (0.0860 => 0.0648, std.dev.: 0.0044)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -20.52% (0.0848 => 0.0674, std.dev.: 0.0042)
  SingleSource/UnitTests/vla: -18.38% (0.0555 => 0.0453, std.dev.: 0.0010)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -9.99% (0.1881 => 0.1693, std.dev.: 0.0073)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -7.70% (0.2260 => 0.2086, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc/oourafft: -6.54% (0.2508 => 0.2344, std.dev.: 0.0005)
  MultiSource/Applications/kimwitu++/kc: -6.06% (20.0440 => 18.8300, std.dev.: 0.4452)
  SingleSource/Benchmarks/Shootout-C++/sumcol: -5.71% (0.2240 => 0.2112, std.dev.: 0.0018)
  SingleSource/Benchmarks/Shootout-C++/matrix: -4.60% (0.2499 => 0.2384, std.dev.: 0.0012)
  SingleSource/Benchmarks/Shootout-C++/moments: -3.47% (0.3973 => 0.3835, std.dev.: 0.0001)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.67% (1.0046 => 0.9878, std.dev.: 0.0046)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/ackermann: -93.24% (0.0148 => 0.0010, std.dev.: 0.0029)
  SingleSource/Benchmarks/Shootout/hash: -9.27% (5.7124 => 5.1831, std.dev.: 0.0916)
  MultiSource/Benchmarks/sim/sim: -4.69% (4.0183 => 3.8300, std.dev.: 0.0251)
  MultiSource/Applications/lua/lua: -2.39% (29.3483 => 28.6481, std.dev.: 0.2313)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -2.11% (4.1799 => 4.0915, std.dev.: 0.0275)
  SingleSource/Benchmarks/Misc/mandel: -1.21% (1.0701 => 1.0571, std.dev.: 0.0045)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 13.03% (0.1351 => 0.1527, std.dev.: 0.0093)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.04% (0.9494 => 0.9878, std.dev.: 0.0046)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.52% (7.6426 => 12.4969, std.dev.: 0.0713)
  SingleSource/Benchmarks/Shootout-C++/matrix: 38.29% (2.8554 => 3.9487, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/ary3: 26.89% (5.0002 => 6.3449, std.dev.: 0.4039)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 21.63% (1.1431 => 1.3903, std.dev.: 0.0493)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 7.66% (0.8273 => 0.8907, std.dev.: 0.0152)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0034)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.40% (3.1730 => 3.3444, std.dev.: 0.0189)
  MultiSource/Benchmarks/BitBench/five11/five11: 5.19% (5.3716 => 5.6503, std.dev.: 0.0109)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.29% (89.7126 => 92.6647, std.dev.: 0.3435)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.11% (5.7757 => 5.9556, std.dev.: 0.0437)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.89% (0.3836 => 0.3947, std.dev.: 0.0022)
  MultiSource/Benchmarks/Olden/power/power: 2.41% (1.2170 => 1.2463, std.dev.: 0.0058)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.38% (1.8519 => 1.8960, std.dev.: 0.0021)
  MultiSource/Applications/sqlite3/sqlite3: 2.29% (4.2733 => 4.3710, std.dev.: 0.0190)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.10% (1.7652 => 1.8023, std.dev.: 0.0045)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.30% (16.7972 => 17.0150, std.dev.: 0.0408)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.02% (8.1346 => 8.2173, std.dev.: 0.0317)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -21.51% (0.1483 => 0.1164, std.dev.: 0.0067)
  SingleSource/Benchmarks/Shootout-C++/matrix: -7.27% (0.2571 => 0.2384, std.dev.: 0.0012)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.84% (0.5226 => 0.2360, std.dev.: 0.0610)
  MultiSource/Applications/sgefa/sgefa: -42.20% (1.5790 => 0.9127, std.dev.: 0.0007)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -30.75% (0.0400 => 0.0277, std.dev.: 0.0047)
  MultiSource/Benchmarks/Olden/em3d/em3d: -29.24% (5.0288 => 3.5586, std.dev.: 0.0307)
  SingleSource/Benchmarks/Linpack/linpack-pc: -22.43% (57.2347 => 44.3954, std.dev.: 4.2498)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.12% (15.9508 => 12.9009, std.dev.: 0.1754)
  MultiSource/Benchmarks/mafft/pairlocalalign: -17.20% (50.0284 => 41.4248, std.dev.: 2.3394)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -12.09% (20.8247 => 18.3073, std.dev.: 0.1517)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.98% (3.7437 => 3.5947, std.dev.: 0.0557)
  MultiSource/Applications/lua/lua: -2.95% (29.5202 => 28.6481, std.dev.: 0.2313)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.92% (3.7874 => 3.6767, std.dev.: 0.0140)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.24% (17.1431 => 16.7599, std.dev.: 0.0863)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.13% (4.3592 => 4.2664, std.dev.: 0.0184)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.41% (4.9991 => 4.9284, std.dev.: 0.0268)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 13.28% (0.1348 => 0.1527, std.dev.: 0.0093)

Report Time: 0.72s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131018/17c28da6/attachment.html>


More information about the llvm-testresults mailing list