[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Dec 9 15:00:46 PST 2013


http://llvm.org/perf/db_default/v4/nts/18218?compare_to=18212&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18218, Order: 196811, Start Time: 2013-12-09 21:16:57, End Time: 2013-12-09 23:04:57
      To: 18212, Order: 196793, Start Time: 2013-12-09 19:02:04, End Time: 2013-12-09 20:49:37
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 49 (43 on baseline)
Performance Improvements: 13 (4 on baseline)
Unchanged Tests: 1048 (1063 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-05-12-MinIntProblem: 81.58% (0.0152 => 0.0276, std.dev.: 0.0004)
  SingleSource/UnitTests/Threads/2010-12-08-tls: 80.52% (0.0154 => 0.0278, std.dev.: 0.0008)
  SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 79.47% (0.0151 => 0.0271, std.dev.: 0.0010)
  SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 74.32% (0.0148 => 0.0258, std.dev.: 0.0009)
  SingleSource/UnitTests/2003-09-18-BitFieldTest: 72.33% (0.0159 => 0.0274, std.dev.: 0.0017)
  SingleSource/UnitTests/2003-05-07-VarArgs: 71.60% (0.0257 => 0.0441, std.dev.: 0.0021)
  SingleSource/UnitTests/2002-12-13-MishaTest: 70.16% (0.0191 => 0.0325, std.dev.: 0.0024)
  SingleSource/UnitTests/2008-07-13-InlineSetjmp: 68.82% (0.0170 => 0.0287, std.dev.: 0.0012)
  SingleSource/UnitTests/2008-04-18-LoopBug: 67.53% (0.0154 => 0.0258, std.dev.: 0.0029)
  SingleSource/UnitTests/2003-10-29-ScalarReplBug: 66.67% (0.0162 => 0.0270, std.dev.: 0.0024)
  SingleSource/UnitTests/2003-05-14-AtExit: 66.67% (0.0204 => 0.0340, std.dev.: 0.0004)
  SingleSource/UnitTests/byval-alignment: 64.16% (0.0173 => 0.0284, std.dev.: 0.0013)
  SingleSource/UnitTests/Threads/tls: 63.60% (0.0228 => 0.0373, std.dev.: 0.0021)
  SingleSource/UnitTests/SignlessTypes/ccc: 62.21% (0.0262 => 0.0425, std.dev.: 0.0036)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 58.27% (0.0520 => 0.0823, std.dev.: 0.0054)
  SingleSource/Regression/C/sumarraymalloc: 57.10% (0.0317 => 0.0498, std.dev.: 0.0041)
  SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 56.53% (0.0421 => 0.0659, std.dev.: 0.0045)
  SingleSource/UnitTests/Vector/multiplies: 53.87% (0.0297 => 0.0457, std.dev.: 0.0053)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: 53.46% (0.0260 => 0.0399, std.dev.: 0.0015)
  SingleSource/UnitTests/SignlessTypes/factor: 53.22% (0.0342 => 0.0524, std.dev.: 0.0030)
  SingleSource/Benchmarks/Shootout-C++/ary3: 41.70% (0.2573 => 0.3646, std.dev.: 0.0276)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 36.06% (0.0574 => 0.0781, std.dev.: 0.0079)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.88% (0.2184 => 0.2771, std.dev.: 0.0011)
  MultiSource/Benchmarks/nbench/nbench: 11.71% (1.2447 => 1.3904, std.dev.: 0.0260)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.44% (0.1268 => 0.1375, std.dev.: 0.0035)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 8.04% (45.1803 => 48.8126, std.dev.: 1.0088)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.91% (1.2993 => 1.4021, std.dev.: 0.0091)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.02% (1.2682 => 1.3445, std.dev.: 0.0199)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: 42.28% (1.4691 => 2.0903, std.dev.: 0.0505)
  SingleSource/Benchmarks/Shootout/heapsort: 27.94% (2.9652 => 3.7936, std.dev.: 0.3214)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.11% (2.3968 => 3.0226, std.dev.: 0.1777)
  SingleSource/Benchmarks/Shootout-C++/ary3: 14.25% (4.6279 => 5.2874, std.dev.: 0.0295)
  SingleSource/Benchmarks/Shootout/ary3: 13.40% (4.7783 => 5.4187, std.dev.: 0.1818)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 13.15% (28.4603 => 32.2017, std.dev.: 0.8193)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.20% (1.0209 => 1.1352, std.dev.: 0.0005)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.50% (0.4296 => 0.4661, std.dev.: 0.0003)
  SingleSource/Benchmarks/Misc/salsa20: 7.49% (7.5972 => 8.1662, std.dev.: 0.0489)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 7.30% (1.1117 => 1.1928, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.60% (4.1026 => 4.2913, std.dev.: 0.0404)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 4.43% (2.3129 => 2.4154, std.dev.: 0.0363)
  MultiSource/Benchmarks/sim/sim: 4.42% (3.8060 => 3.9741, std.dev.: 0.0329)
  SingleSource/Benchmarks/Misc/fp-convert: 4.33% (7.3432 => 7.6613, std.dev.: 0.0859)
  SingleSource/Benchmarks/Misc/flops-3: 4.19% (2.0406 => 2.1261, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.92% (5.1431 => 5.3445, std.dev.: 0.0419)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.28% (0.6286 => 0.6492, std.dev.: 0.0011)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.22% (1.6410 => 1.6939, std.dev.: 0.0076)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.05% (4.8702 => 5.0188, std.dev.: 0.0303)
  MultiSource/Benchmarks/BitBench/five11/five11: 1.41% (5.4300 => 5.5066, std.dev.: 0.0113)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.33% (3.6014 => 3.6494, std.dev.: 0.0115)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.09% (0.9823 => 0.9225, std.dev.: 0.0188)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.49% (1.3976 => 1.3349, std.dev.: 0.0113)
  MultiSource/Applications/JM/ldecod/ldecod: -3.39% (7.9108 => 7.6424, std.dev.: 0.0378)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.11% (0.7081 => 0.6861, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -2.16% (1.2772 => 1.2496, std.dev.: 0.0099)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/sieve: -17.18% (8.1309 => 6.7344, std.dev.: 0.0724)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -16.27% (0.1045 => 0.0875, std.dev.: 0.0054)
  SingleSource/Benchmarks/Shootout/matrix: -14.44% (2.1120 => 1.8071, std.dev.: 0.0406)
  SingleSource/Benchmarks/McGill/misr: -9.41% (0.4156 => 0.3765, std.dev.: 0.0129)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: -6.27% (0.9057 => 0.8489, std.dev.: 0.0180)
  MultiSource/Benchmarks/FreeBench/neural/neural: -5.05% (0.4473 => 0.4247, std.dev.: 0.0076)
  MultiSource/Applications/sgefa/sgefa: -4.15% (0.9140 => 0.8761, std.dev.: 0.0138)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.48% (3.2031 => 3.1558, std.dev.: 0.0078)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Threads/2010-12-08-tls: 80.52% (0.0154 => 0.0278, std.dev.: 0.0008)
  SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 77.12% (0.0153 => 0.0271, std.dev.: 0.0010)
  SingleSource/UnitTests/2003-05-12-MinIntProblem: 75.80% (0.0157 => 0.0276, std.dev.: 0.0004)
  SingleSource/UnitTests/2003-09-18-BitFieldTest: 75.64% (0.0156 => 0.0274, std.dev.: 0.0017)
  SingleSource/UnitTests/2003-10-29-ScalarReplBug: 71.97% (0.0157 => 0.0270, std.dev.: 0.0024)
  SingleSource/UnitTests/2003-05-07-VarArgs: 70.27% (0.0259 => 0.0441, std.dev.: 0.0021)
  SingleSource/Regression/C/2003-05-21-BitfieldHandling: 69.81% (0.0159 => 0.0270, std.dev.: 0.0008)
  SingleSource/UnitTests/2003-05-14-AtExit: 66.67% (0.0204 => 0.0340, std.dev.: 0.0004)
  SingleSource/UnitTests/2008-07-13-InlineSetjmp: 64.94% (0.0174 => 0.0287, std.dev.: 0.0012)
  SingleSource/UnitTests/2008-04-18-LoopBug: 64.33% (0.0157 => 0.0258, std.dev.: 0.0029)
  SingleSource/UnitTests/2002-12-13-MishaTest: 64.14% (0.0198 => 0.0325, std.dev.: 0.0024)
  SingleSource/UnitTests/2005-05-12-Int64ToFP: 63.19% (0.0163 => 0.0266, std.dev.: 0.0021)
  SingleSource/UnitTests/Threads/tls: 59.40% (0.0234 => 0.0373, std.dev.: 0.0021)
  SingleSource/UnitTests/SignlessTypes/ccc: 59.18% (0.0267 => 0.0425, std.dev.: 0.0036)
  SingleSource/UnitTests/TestLoop: 58.56% (0.0181 => 0.0287, std.dev.: 0.0026)
  SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 54.69% (0.0426 => 0.0659, std.dev.: 0.0045)
  SingleSource/UnitTests/SignlessTypes/factor: 54.12% (0.0340 => 0.0524, std.dev.: 0.0030)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: 53.46% (0.0260 => 0.0399, std.dev.: 0.0015)
  SingleSource/UnitTests/Vector/multiplies: 52.33% (0.0300 => 0.0457, std.dev.: 0.0053)
  SingleSource/Benchmarks/Shootout-C++/ary3: 43.15% (0.2547 => 0.3646, std.dev.: 0.0276)
  SingleSource/Regression/C/sumarraymalloc: 43.10% (0.0348 => 0.0498, std.dev.: 0.0041)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 37.02% (0.0570 => 0.0781, std.dev.: 0.0079)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 23.10% (0.2251 => 0.2771, std.dev.: 0.0011)
  MultiSource/Benchmarks/nbench/nbench: 9.94% (1.2647 => 1.3904, std.dev.: 0.0260)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 8.67% (44.9186 => 48.8126, std.dev.: 1.0088)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 5.71% (1.3264 => 1.4021, std.dev.: 0.0091)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.05% (0.6597 => 0.6732, std.dev.: 0.0014)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: 42.04% (1.4716 => 2.0903, std.dev.: 0.0505)
  SingleSource/Benchmarks/Shootout/heapsort: 28.63% (2.9492 => 3.7936, std.dev.: 0.3214)
  SingleSource/Benchmarks/Shootout/ary3: 17.86% (4.5977 => 5.4187, std.dev.: 0.1818)
  SingleSource/Benchmarks/Shootout-C++/ary3: 12.99% (4.6797 => 5.2874, std.dev.: 0.0295)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 12.34% (28.6638 => 32.2017, std.dev.: 0.8193)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.95% (1.0232 => 1.1352, std.dev.: 0.0005)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 8.25% (1.1019 => 1.1928, std.dev.: 0.0026)
  SingleSource/Benchmarks/Misc/salsa20: 7.52% (7.5947 => 8.1662, std.dev.: 0.0489)
  SingleSource/Benchmarks/Misc/flops-3: 4.19% (2.0406 => 2.1261, std.dev.: 0.0024)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 4.03% (4.8243 => 5.0188, std.dev.: 0.0303)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.69% (0.6261 => 0.6492, std.dev.: 0.0011)
  SingleSource/Benchmarks/Misc/fp-convert: 3.68% (7.3892 => 7.6613, std.dev.: 0.0859)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.50% (4.1462 => 4.2913, std.dev.: 0.0404)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.98% (0.4526 => 0.4661, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.94% (5.7060 => 5.8167, std.dev.: 0.0282)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.44% (1.6699 => 1.6939, std.dev.: 0.0076)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -9.15% (0.3247 => 0.2950, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -3.40% (1.3819 => 1.3349, std.dev.: 0.0113)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -2.56% (1.2824 => 1.2496, std.dev.: 0.0099)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.82% (6.0535 => 5.8825, std.dev.: 0.0428)

Report Time: 1.21s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131209/1f0c7754/attachment.html>


More information about the llvm-testresults mailing list