[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Sep 16 04:28:05 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15341?compare_to=15338&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15341, Order: 190777, Start Time: 2013-09-16 09:40:44, End Time: 2013-09-16 11:30:42
      To: 15338, Order: 190776, Start Time: 2013-09-16 05:54:05, End Time: 2013-09-16 07:34:36
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 34 (40 on baseline)
Performance Improvements: 7 (17 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1066 (1050 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 63.22% (0.2836 => 0.4629, std.dev.: 0.0207)
  MultiSource/Benchmarks/Olden/power/power: 60.13% (0.1367 => 0.2189, std.dev.: 0.0162)
  MultiSource/Benchmarks/MallocBench/gs/gs: 43.57% (4.6512 => 6.6776, std.dev.: 0.1799)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 42.40% (0.3344 => 0.4762, std.dev.: 0.0336)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 40.24% (0.2669 => 0.3743, std.dev.: 0.0291)
  MultiSource/Benchmarks/Olden/em3d/em3d: 40.17% (0.1989 => 0.2788, std.dev.: 0.0184)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 38.41% (1.1129 => 1.5404, std.dev.: 0.1564)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 36.48% (0.6810 => 0.9294, std.dev.: 0.0432)
  MultiSource/Benchmarks/Olden/mst/mst: 34.67% (0.1298 => 0.1748, std.dev.: 0.0161)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 31.00% (0.0529 => 0.0693, std.dev.: 0.0055)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 29.42% (0.9233 => 1.1949, std.dev.: 0.0532)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 29.25% (9.7246 => 12.5689, std.dev.: 0.9472)
  SingleSource/Benchmarks/Shootout/objinst: 25.48% (0.0416 => 0.0522, std.dev.: 0.0023)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 24.58% (5.5157 => 6.8715, std.dev.: 0.2803)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.89% (0.1037 => 0.1264, std.dev.: 0.0063)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 21.47% (1.6007 => 1.9444, std.dev.: 0.1070)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.06% (1.4747 => 1.7852, std.dev.: 0.0952)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.74% (1.1081 => 1.1828, std.dev.: 0.0276)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 128.15% (0.1364 => 0.3112, std.dev.: 0.0141)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 85.73% (0.7374 => 1.3696, std.dev.: 0.0753)
  MultiSource/Benchmarks/MallocBench/gs/gs: 71.88% (0.0850 => 0.1461, std.dev.: 0.0046)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 42.29% (0.0584 => 0.0831, std.dev.: 0.0050)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 40.49% (1.2951 => 1.8195, std.dev.: 0.0271)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 39.59% (0.0917 => 0.1280, std.dev.: 0.0064)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 22.59% (2.4852 => 3.0467, std.dev.: 0.0801)
  MultiSource/Benchmarks/llubenchmark/llu: 21.19% (1.9774 => 2.3965, std.dev.: 0.0344)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 18.77% (0.3197 => 0.3797, std.dev.: 0.0220)
  MultiSource/Applications/obsequi/Obsequi: 10.58% (2.3625 => 2.6125, std.dev.: 0.0290)
  SingleSource/Benchmarks/Shootout-C++/ary3: 5.38% (4.7770 => 5.0342, std.dev.: 0.0554)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 4.07% (0.7079 => 0.7367, std.dev.: 0.0085)
  MultiSource/Benchmarks/Olden/bh/bh: 4.03% (2.3742 => 2.4699, std.dev.: 0.0343)
  MultiSource/Applications/lambda-0_1_3/lambda: 3.53% (8.1298 => 8.4171, std.dev.: 0.0416)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.03% (39.5260 => 40.7221, std.dev.: 0.3750)
  SingleSource/Benchmarks/Misc/flops: 2.21% (9.3575 => 9.5640, std.dev.: 0.0239)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/sieve: -16.73% (8.4926 => 7.0718, std.dev.: 0.1186)
  MultiSource/Applications/JM/lencod/lencod: -9.81% (8.4374 => 7.6101, std.dev.: 0.3070)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -9.31% (0.4631 => 0.4200, std.dev.: 0.0134)
  MultiSource/Applications/spiff/spiff: -4.67% (2.9636 => 2.8253, std.dev.: 0.0345)
  MultiSource/Benchmarks/sim/sim: -4.49% (4.0443 => 3.8627, std.dev.: 0.0532)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.88% (4.1431 => 4.0238, std.dev.: 0.0453)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -1.84% (23.8245 => 23.3858, std.dev.: 0.1683)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -5.43% (0.1344 => 0.1271, std.dev.: 0.0101)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 64.09% (0.2821 => 0.4629, std.dev.: 0.0207)
  MultiSource/Benchmarks/Olden/power/power: 56.58% (0.1398 => 0.2189, std.dev.: 0.0162)
  MultiSource/Benchmarks/MallocBench/gs/gs: 45.54% (4.5883 => 6.6776, std.dev.: 0.1799)
  MultiSource/Benchmarks/Olden/em3d/em3d: 41.38% (0.1972 => 0.2788, std.dev.: 0.0184)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 41.14% (0.3374 => 0.4762, std.dev.: 0.0336)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 40.87% (1.0935 => 1.5404, std.dev.: 0.1564)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 39.35% (0.2686 => 0.3743, std.dev.: 0.0291)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 37.50% (0.0504 => 0.0693, std.dev.: 0.0055)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 35.32% (0.6868 => 0.9294, std.dev.: 0.0432)
  MultiSource/Benchmarks/Olden/mst/mst: 33.33% (0.1311 => 0.1748, std.dev.: 0.0161)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 29.71% (0.9212 => 1.1949, std.dev.: 0.0532)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 29.11% (9.7354 => 12.5689, std.dev.: 0.9472)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 24.90% (5.5014 => 6.8715, std.dev.: 0.2803)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 23.44% (0.1024 => 0.1264, std.dev.: 0.0063)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 21.17% (1.6047 => 1.9444, std.dev.: 0.1070)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.06% (1.4746 => 1.7852, std.dev.: 0.0952)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.03% (1.0756 => 1.1942, std.dev.: 0.0432)
  MultiSource/Applications/sqlite3/sqlite3: 10.97% (16.2888 => 18.0761, std.dev.: 0.6540)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.00% (1.0952 => 1.1828, std.dev.: 0.0276)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 126.00% (0.1377 => 0.3112, std.dev.: 0.0141)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 84.83% (0.7410 => 1.3696, std.dev.: 0.0753)
  MultiSource/Benchmarks/MallocBench/gs/gs: 77.52% (0.0823 => 0.1461, std.dev.: 0.0046)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 41.33% (0.0588 => 0.0831, std.dev.: 0.0050)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 38.44% (1.3143 => 1.8195, std.dev.: 0.0271)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 34.88% (0.0949 => 0.1280, std.dev.: 0.0064)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 23.08% (2.4753 => 3.0467, std.dev.: 0.0801)
  MultiSource/Benchmarks/llubenchmark/llu: 20.49% (1.9889 => 2.3965, std.dev.: 0.0344)
  MultiSource/Applications/obsequi/Obsequi: 19.38% (2.1884 => 2.6125, std.dev.: 0.0290)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.96% (0.3219 => 0.3797, std.dev.: 0.0220)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 7.82% (0.8273 => 0.8920, std.dev.: 0.0118)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0054)
  SingleSource/Benchmarks/McGill/misr: 5.09% (0.3771 => 0.3963, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 5.02% (6.5990 => 6.9301, std.dev.: 0.0763)
  MultiSource/Applications/lambda-0_1_3/lambda: 3.47% (8.1346 => 8.4171, std.dev.: 0.0416)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.91% (1.7652 => 1.8166, std.dev.: 0.0149)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.57% (0.5182 => 0.5315, std.dev.: 0.0006)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.94% (3.7874 => 3.8608, std.dev.: 0.0018)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.56% (2.4920 => 2.5309, std.dev.: 0.0122)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.36% (16.7972 => 17.0260, std.dev.: 0.0865)
  SingleSource/Benchmarks/Misc/flops: 1.28% (9.4433 => 9.5640, std.dev.: 0.0239)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/CoyoteBench/lpbench: -10.21% (0.1195 => 0.1073, std.dev.: 0.0037)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -6.11% (0.2193 => 0.2059, std.dev.: 0.0045)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/sgefa/sgefa: -47.07% (1.5790 => 0.8358, std.dev.: 0.0306)
  MultiSource/Benchmarks/FreeBench/neural/neural: -42.15% (0.5226 => 0.3023, std.dev.: 0.0348)
  SingleSource/Benchmarks/Linpack/linpack-pc: -22.84% (57.2347 => 44.1644, std.dev.: 4.1970)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.79% (15.9508 => 13.2729, std.dev.: 0.3488)
  MultiSource/Benchmarks/mafft/pairlocalalign: -11.47% (50.0284 => 44.2908, std.dev.: 0.3690)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.96% (20.8247 => 18.5414, std.dev.: 0.2819)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -9.91% (3.4956 => 3.1491, std.dev.: 0.0411)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.67% (0.4549 => 0.4200, std.dev.: 0.0134)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -7.04% (4.0006 => 3.7188, std.dev.: 0.0887)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.14% (2.5938 => 2.4863, std.dev.: 0.0240)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -3.05% (2.4471 => 2.3725, std.dev.: 0.0215)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.60% (17.1431 => 16.6967, std.dev.: 0.0892)
  MultiSource/Applications/hexxagon/hexxagon: -1.59% (14.7810 => 14.5453, std.dev.: 0.0608)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.36% (89.7126 => 88.4930, std.dev.: 0.0070)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.36% (3.8582 => 3.8058, std.dev.: 0.0028)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -5.71% (0.1348 => 0.1271, std.dev.: 0.0101)

Report Time: 0.86s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130916/315fc473/attachment.html>


More information about the llvm-testresults mailing list