[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Jan 7 16:31:25 PST 2014


http://llvm.org/perf/db_default/v4/nts/19971?compare_to=19963&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 19971, Order: 198715, Start Time: 2014-01-07 22:49:56, End Time: 2014-01-08 00:36:10
      To: 19963, Order: 198700, Start Time: 2014-01-07 20:24:00, End Time: 2014-01-07 22:22:16
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 20 (34 on baseline)
Performance Improvements: 34 (9 on baseline)
Unchanged Tests: 1056 (1067 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 54.06% (1.6907 => 2.6047, std.dev.: 0.0023)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 32.30% (0.1486 => 0.1966, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout-C++/matrix: 25.20% (2.9265 => 3.6641, std.dev.: 0.1462)
  SingleSource/Benchmarks/Shootout/sieve: 11.29% (6.9124 => 7.6927, std.dev.: 0.2098)
  SingleSource/Benchmarks/Misc/ReedSolomon: 10.63% (8.4580 => 9.3567, std.dev.: 0.1915)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.63% (1.0233 => 1.1218, std.dev.: 0.0063)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.58% (2.8660 => 3.0545, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.24% (3.5020 => 3.7206, std.dev.: 0.0359)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.87% (1.2520 => 1.3255, std.dev.: 0.0092)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.79% (1.8266 => 1.8959, std.dev.: 0.0026)
  SingleSource/Benchmarks/Shootout/lists: 3.69% (7.1375 => 7.4006, std.dev.: 0.0667)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.55% (5.7944 => 6.0001, std.dev.: 0.0796)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.52% (5.2490 => 5.4338, std.dev.: 0.0104)
  SingleSource/Benchmarks/McGill/misr: 3.12% (0.3971 => 0.4095, std.dev.: 0.0027)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.70% (1.6491 => 1.6937, std.dev.: 0.0008)
  SingleSource/Benchmarks/Misc/fp-convert: 2.64% (7.5836 => 7.7837, std.dev.: 0.0466)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.74% (18.6727 => 18.9985, std.dev.: 0.0243)
  MultiSource/Applications/viterbi/viterbi: 1.39% (2.6334 => 2.6699, std.dev.: 0.0041)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.29% (3.8100 => 3.8593, std.dev.: 0.0071)
  SingleSource/Benchmarks/Shootout/fib2: 1.26% (3.6080 => 3.6536, std.dev.: 0.0033)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/2004-02-03-AggregateCopy: -45.49% (0.0266 => 0.0145, std.dev.: 0.0004)
  SingleSource/Regression/C++/BuiltinTypeInfo: -42.20% (0.0346 => 0.0200, std.dev.: 0.0002)
  SingleSource/Regression/C/DuffsDevice: -40.95% (0.0503 => 0.0297, std.dev.: 0.0008)
  SingleSource/Regression/C/PR491: -40.64% (0.0251 => 0.0149, std.dev.: 0.0005)
  SingleSource/Regression/C/2003-05-23-TransparentUnion: -40.00% (0.0265 => 0.0159, std.dev.: 0.0005)
  SingleSource/Regression/C/globalrefs: -36.91% (0.0317 => 0.0200, std.dev.: 0.0004)
  SingleSource/Regression/C++/pointer_method: -35.46% (0.0313 => 0.0202, std.dev.: 0.0005)
  SingleSource/Regression/C/uint64_to_float: -34.84% (0.0620 => 0.0404, std.dev.: 0.0041)
  SingleSource/Regression/C/PR10189: -33.42% (0.0374 => 0.0249, std.dev.: 0.0008)
  SingleSource/Regression/C/test_indvars: -30.50% (0.0400 => 0.0278, std.dev.: 0.0005)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: -28.65% (0.0363 => 0.0259, std.dev.: 0.0001)
  SingleSource/Regression/C/sumarraymalloc: -28.64% (0.0447 => 0.0319, std.dev.: 0.0005)
  SingleSource/Regression/C/bigstack: -16.21% (0.0759 => 0.0636, std.dev.: 0.0008)
  SingleSource/Benchmarks/Shootout/lists: -13.94% (0.0904 => 0.0778, std.dev.: 0.0028)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -10.89% (3.0960 => 2.7590, std.dev.: 0.1120)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -9.75% (0.9188 => 0.8292, std.dev.: 0.0133)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -8.38% (2.1555 => 1.9748, std.dev.: 0.0699)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -8.09% (0.1285 => 0.1181, std.dev.: 0.0039)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -7.63% (0.2019 => 0.1865, std.dev.: 0.0011)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -7.21% (48.2697 => 44.7898, std.dev.: 1.0514)
  SingleSource/UnitTests/Vector/constpool: -6.90% (9.7747 => 9.1004, std.dev.: 0.0891)
  SingleSource/Benchmarks/Shootout-C++/lists: -6.04% (0.2734 => 0.2569, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout-C++/fibo: -5.56% (0.1998 => 0.1887, std.dev.: 0.0028)
  SingleSource/Benchmarks/Shootout-C++/reversefile: -5.23% (0.3751 => 0.3555, std.dev.: 0.0037)
  MultiSource/Applications/JM/ldecod/ldecod: -2.91% (7.8521 => 7.6239, std.dev.: 0.0563)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -2.10% (0.5389 => 0.5276, std.dev.: 0.0023)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: -18.07% (1.7882 => 1.4650, std.dev.: 0.0541)
  SingleSource/Benchmarks/Misc/salsa20: -7.10% (8.0636 => 7.4908, std.dev.: 0.1188)
  SingleSource/Benchmarks/Shootout-C++/fibo: -6.94% (5.4028 => 5.0279, std.dev.: 0.0028)
  SingleSource/Benchmarks/Dhrystone/dry: -5.93% (0.5096 => 0.4794, std.dev.: 0.0034)
  SingleSource/Benchmarks/Misc/flops: -3.75% (9.6248 => 9.2641, std.dev.: 0.0010)
  SingleSource/Benchmarks/Shootout-C++/hash: -2.89% (0.7485 => 0.7269, std.dev.: 0.0081)
  SingleSource/Regression/C/uint64_to_float: -2.86% (1.5126 => 1.4694, std.dev.: 0.0017)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.03% (29.2851 => 28.6915, std.dev.: 0.1250)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: 40.13% (15.7419 => 22.0591, std.dev.: 0.9376)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 25.60% (0.3859 => 0.4847, std.dev.: 0.0296)
  MultiSource/Applications/oggenc/oggenc: 3.45% (5.4968 => 5.6862, std.dev.: 0.0552)
  MultiSource/Applications/JM/lencod/lencod: 1.45% (17.2968 => 17.5481, std.dev.: 0.0480)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 56.11% (1.6685 => 2.6047, std.dev.: 0.0023)
  SingleSource/Benchmarks/Shootout-C++/matrix: 28.08% (2.8607 => 3.6641, std.dev.: 0.1462)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 18.79% (5.9583 => 7.0781, std.dev.: 0.0764)
  SingleSource/Benchmarks/Shootout/sieve: 14.04% (6.7454 => 7.6927, std.dev.: 0.2098)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 12.08% (82.2592 => 92.1942, std.dev.: 0.1672)
  SingleSource/Benchmarks/Misc/ReedSolomon: 10.07% (8.5010 => 9.3567, std.dev.: 0.1915)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.64% (1.0232 => 1.1218, std.dev.: 0.0063)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.27% (3.3810 => 3.6606, std.dev.: 0.0022)
  SingleSource/Benchmarks/McGill/chomp: 7.56% (1.0099 => 1.0862, std.dev.: 0.0134)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.92% (2.8568 => 3.0545, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.70% (3.1585 => 3.3701, std.dev.: 0.0810)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.22% (3.5027 => 3.7206, std.dev.: 0.0359)
  SingleSource/Benchmarks/Shootout/lists: 5.83% (6.9930 => 7.4006, std.dev.: 0.0667)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.57% (1.2556 => 1.3255, std.dev.: 0.0092)
  SingleSource/Benchmarks/Misc/fp-convert: 5.34% (7.3892 => 7.7837, std.dev.: 0.0466)
  MultiSource/Applications/siod/siod: 4.97% (3.4258 => 3.5962, std.dev.: 0.0146)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.53% (5.2486 => 5.4338, std.dev.: 0.0104)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.99% (1.8409 => 1.8959, std.dev.: 0.0026)
  SingleSource/Benchmarks/Shootout-C++/lists: 2.60% (15.6810 => 16.0892, std.dev.: 0.0294)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.60% (5.9126 => 6.0665, std.dev.: 0.0254)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.26% (11.7894 => 12.0556, std.dev.: 0.0124)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 2.04% (18.6185 => 18.9985, std.dev.: 0.0243)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 2.00% (2.8940 => 2.9519, std.dev.: 0.0092)
  SingleSource/Benchmarks/Shootout/fib2: 1.60% (3.5960 => 3.6536, std.dev.: 0.0033)
  MultiSource/Applications/obsequi/Obsequi: 1.59% (2.3061 => 2.3427, std.dev.: 0.0121)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.58% (8.8073 => 8.9464, std.dev.: 0.0070)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.52% (1.7409 => 1.7673, std.dev.: 0.0075)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.43% (1.6699 => 1.6937, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.37% (5.5032 => 5.5787, std.dev.: 0.0186)
  MultiSource/Applications/viterbi/viterbi: 1.26% (2.6366 => 2.6699, std.dev.: 0.0041)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -26.74% (0.0688 => 0.0504, std.dev.: 0.0013)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.64% (1.5034 => 1.4036, std.dev.: 0.0387)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.83% (1.4277 => 1.3587, std.dev.: 0.0233)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.58% (0.3714 => 0.3544, std.dev.: 0.0046)
  MultiSource/Applications/d/make_dparser: -2.45% (3.6428 => 3.5534, std.dev.: 0.0169)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -29.00% (0.0369 => 0.0262, std.dev.: 0.0007)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.91% (0.1035 => 0.0891, std.dev.: 0.0035)
  MultiSource/Benchmarks/mafft/pairlocalalign: -11.22% (50.9650 => 45.2475, std.dev.: 1.6399)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -3.20% (6.0535 => 5.8595, std.dev.: 0.0338)

Report Time: 0.80s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140107/8dd0408c/attachment.html>


More information about the llvm-testresults mailing list