Some buildbot statistics for the last week
Evgenii Stepanov via llvm-commits
llvm-commits at lists.llvm.org
Wed Nov 18 11:15:56 PST 2015
Permanently failing bots are way better that 50/50 flaky bots, but
still not good.
As for the sanitizer-x86_64-linux-bootstrap, it shows some legitimate
failures in different parts of llvm that no one bothered to fix.
That's kinda understandable because MSan failures are hard to
reproduce locally (one needs to do a full bootstrap, including
libc++/libc++abi built w/ MSan), and FileCheck tends to show only part
of the report.
On Wed, Nov 18, 2015 at 10:43 AM, Aaron Ballman via llvm-commits
<llvm-commits at lists.llvm.org> wrote:
> On Wed, Nov 18, 2015 at 1:40 PM, Galina Kistanova via cfe-commits
> <cfe-commits at lists.llvm.org> wrote:
>> Hello everyone,
>>
>> Here are some buildbot statistics you may found interesting. I will be
>> adding more statistics.
>> My goal is to publish metrics to help with keeping the buildbot
>> infrastructure healthy and improving it.
>
> Thank you for tracking and reporting this information, that's fantastic!
>
>>
>> All the numbers are for the week of 11/8/2015 - 11/14/2015.
>>
>> Thanks
>>
>> Galina
>>
>>
>>
>> Number of commits by project:
>>
>> project | commits
>> -----------------------------------------
>> llvm | 286
>> cfe | 109
>> lldb | 76
>> compiler-rt | 71
>> polly | 42
>> lld | 38
>> libcxx | 10
>> openmp | 9
>> clang-tools-extra | 7
>> clang-tests-external | 2
>> libunwind | 1
>> -----------------------------------------
>> 651
>>
>>
>> Number of completed builds, failed builds and average build time for
>> successful builds per active builder:
>>
>> buildername | completed |
>> failed | time
>> -----------------------------------------------------------------------------------------------------
>> clang-aarch64-lnt | 57 |
>> 3 | 02:30:12
>> clang-atom-d525-fedora | 18 |
>> | 08:28:15
>> clang-atom-d525-fedora-rel | 83 |
>> 5 | 01:29:55
>> clang-bpf-build | 310 |
>> 31 | 00:02:53
>> clang-cmake-aarch64-42vma | 278 |
>> 49 | 00:16:47
>> clang-cmake-aarch64-quick | 209 |
>> 29 | 00:23:46
>> clang-cmake-armv7-a15 | 189 |
>> 8 | 00:25:27
>> clang-cmake-armv7-a15-full | 154 |
>> 38 | 00:45:32
>> clang-cmake-armv7-a15-selfhost | 58 |
>> 24 | 03:00:19
>> clang-cmake-armv7-a15-selfhost-neon | 45 |
>> 22 | 04:26:31
>> clang-cmake-mips | 186 |
>> 38 | 00:28:52
>> clang-cmake-thumbv7-a15 | 178 |
>> 7 | 00:28:30
>> clang-cmake-thumbv7-a15-full-sh | 32 |
>> 23 | 06:03:05
>> clang-hexagon-elf | 169 |
>> 23 | 00:24:42
>> clang-native-aarch64-full | 24 |
>> 8 | 05:53:35
>> clang-native-arm-lnt | 90 |
>> 3 | 01:06:01
>> clang-native-arm-lnt-perf | 14 |
>> | 08:57:04
>> clang-ppc64-elf-linux | 120 |
>> 6 | 01:01:02
>> clang-ppc64-elf-linux2 | 89 |
>> 24 | 01:29:49
>> clang-sphinx-docs | 113 |
>> | 00:00:20
>> clang-x64-ninja-win7 | 285 |
>> 58 | 00:09:49
>> clang-x86-win2008-selfhost | 268 |
>> 46 | 00:12:10
>> clang-x86_64-darwin13-cross-arm | 232 |
>> 1 | 00:19:45
>> clang-x86_64-darwin13-cross-mingw32 | 217 |
>> 12 | 00:23:20
>> clang-x86_64-debian-fast | 147 |
>> 12 | 00:11:37
>> clang-x86_64-linux-abi-test | 314 |
>> 1 | 00:18:39
>> clang-x86_64-linux-selfhost-modules | 261 |
>> 25 | 00:15:02
>> clang-x86_64-ubuntu-gdb-75 | 124 |
>> 62 | 00:53:12
>> libcxx-libcxxabi-arm-linux | 8 |
>> | 01:05:10
>> libcxx-libcxxabi-singlethreaded-x86_64-linux-debian | 11 |
>> 2 | 00:08:50
>> libcxx-libcxxabi-x86_64-linux-debian | 11 |
>> 4 | 00:09:43
>> libcxx-libcxxabi-x86_64-linux-debian-noexceptions | 5 |
>> 2 | 00:09:24
>> libcxx-libcxxabi-x86_64-linux-ubuntu-asan | 10 |
>> 2 | 00:08:22
>> libcxx-libcxxabi-x86_64-linux-ubuntu-cxx03 | 10 |
>> | 00:05:12
>> libcxx-libcxxabi-x86_64-linux-ubuntu-cxx11 | 10 |
>> | 00:06:19
>> libcxx-libcxxabi-x86_64-linux-ubuntu-cxx14 | 9 |
>> | 00:06:56
>> libcxx-libcxxabi-x86_64-linux-ubuntu-cxx1z | 10 |
>> 2 | 00:06:06
>> libcxx-libcxxabi-x86_64-linux-ubuntu-msan | 10 |
>> 2 | 00:17:00
>> libcxx-libcxxabi-x86_64-linux-ubuntu-tsan | 10 |
>> 1 | 00:14:03
>> libcxx-libcxxabi-x86_64-linux-ubuntu-unstable-abi | 10 |
>> 2 | 00:06:28
>> libcxx-sphinx-docs | 11 |
>> | 00:00:13
>> libomp-clang-x86_64-linux-debian | 3 |
>> 3 |
>> libomp-gcc-x86_64-linux-debian | 3 |
>> 3 |
>> lld-sphinx-docs | 100 |
>> | 00:00:17
>> lld-x86_64-darwin13 | 250 |
>> 23 | 00:10:37
>> lld-x86_64-freebsd | 152 |
>> 2 | 00:38:06
>> lld-x86_64-win7 | 254 |
>> 4 | 00:08:51
>> lldb-windows7-android | 109 |
>> 76 | 01:10:59
>> lldb-x86-win7-msvc | 300 |
>> 46 | 00:09:28
>> lldb-x86-windows-msvc | 244 |
>> 40 | 00:18:18
>> lldb-x86_64-darwin-13.4 | 141 |
>> 43 | 00:50:44
>> lldb-x86_64-debian-clang | 142 |
>> 142 |
>> lldb-x86_64-ubuntu-14.04-android | 123 |
>> 33 | 01:00:35
>> lldb-x86_64-ubuntu-14.04-buildserver | 146 |
>> 2 | 00:48:29
>> lldb-x86_64-ubuntu-14.04-cmake | 228 |
>> 39 | 00:24:49
>> lldb-x86_64-ubuntu-14.10 | 191 |
>> 191 |
>> llvm-aarch64-linux | 110 |
>> 6 | 01:00:32
>> llvm-clang-lld-x86_64-debian-fast | 189 |
>> 189 |
>> llvm-clang-lld-x86_64-scei-ps4-ubuntu-fast | 386 |
>> 24 | 00:03:22
>> llvm-hexagon-elf | 190 |
>> 16 | 00:10:08
>> llvm-mips-linux | 29 |
>> 2 | 05:01:59
>> llvm-ppc64-linux1 | 126 |
>> 6 | 00:48:28
>> llvm-ppc64-linux2 | 128 |
>> 6 | 00:48:01
>> llvm-s390x-linux1 | 5 |
>> 3 | 00:37:12
>> llvm-sphinx-docs | 95 |
>> 27 | 00:00:19
>> perf-x86_64-penryn-O3 | 26 |
>> 1 | 05:49:03
>> perf-x86_64-penryn-O3-polly | 73 |
>> | 05:46:16
>> perf-x86_64-penryn-O3-polly-before-vectorizer | 15 |
>> 14 |
>> perf-x86_64-penryn-O3-polly-before-vectorizer-detect-only | 16 |
>> | 05:07:41
>> perf-x86_64-penryn-O3-polly-fast | 309 |
>> 13 | 00:09:45
>> perf-x86_64-penryn-O3-polly-parallel-fast | 189 |
>> 11 | 00:11:38
>> perf-x86_64-penryn-O3-polly-unprofitable | 195 |
>> 139 | 00:12:23
>> polly-amd64-linux | 238 |
>> 2 | 00:11:13
>> ppc64le-clang | 41 |
>> 13 | 03:25:53
>> ppc64le-clanglnt | 67 |
>> 2 | 02:02:39
>> ppc64le-llvm | 74 |
>> 3 | 01:47:07
>> sanitizer-ppc64-linux1 | 173 |
>> 38 | 00:40:18
>> sanitizer-ppc64le-linux | 146 |
>> 28 | 00:51:50
>> sanitizer-windows | 382 |
>> 341 | 00:04:20
>> sanitizer-x86_64-linux | 101 |
>> 53 | 01:30:13
>> sanitizer-x86_64-linux-autoconf | 335 |
>> 252 | 00:10:01
>> sanitizer-x86_64-linux-bootstrap | 92 |
>> 92 |
>> sanitizer-x86_64-linux-fast | 272 |
>> 272 |
>> sanitizer-x86_64-linux-fuzzer | 180 |
>> 47 | 00:45:34
>> sanitizer_x86_64-freebsd | 54 |
>> 54 |
>
> There are definitely some worrying statistics in here, such as the
> bots that seem to have failed all week long on everything:
>
> lldb-x86_64-debian-clang |
> 142 | 142 |
> llvm-clang-lld-x86_64-debian-fast |
> 189 | 189 |
> sanitizer-x86_64-linux-bootstrap |
> 92 | 92 |
> sanitizer-x86_64-linux-fast |
> 272 | 272 |
>
> ~Aaron
> _______________________________________________
> llvm-commits mailing list
> llvm-commits at lists.llvm.org
> http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-commits
More information about the llvm-commits
mailing list