[Lldb-commits] Some buildbot statistics for the last week

Evgenii Stepanov via lldb-commits lldb-commits at lists.llvm.org
Wed Nov 18 11:15:56 PST 2015


Permanently failing bots are way better that 50/50 flaky bots, but
still not good.
As for the sanitizer-x86_64-linux-bootstrap, it shows some legitimate
failures in different parts of llvm that no one bothered to fix.
That's kinda understandable because MSan failures are hard to
reproduce locally (one needs to do a full bootstrap, including
libc++/libc++abi built w/ MSan), and FileCheck tends to show only part
of the report.


On Wed, Nov 18, 2015 at 10:43 AM, Aaron Ballman via llvm-commits
<llvm-commits at lists.llvm.org> wrote:
> On Wed, Nov 18, 2015 at 1:40 PM, Galina Kistanova via cfe-commits
> <cfe-commits at lists.llvm.org> wrote:
>> Hello everyone,
>>
>> Here are some buildbot statistics you may found interesting. I will be
>> adding more statistics.
>> My goal is to publish metrics to help with keeping the buildbot
>> infrastructure healthy and improving it.
>
> Thank you for tracking and reporting this information, that's fantastic!
>
>>
>> All the numbers are for the week of 11/8/2015 - 11/14/2015.
>>
>> Thanks
>>
>> Galina
>>
>>
>>
>> Number of commits by project:
>>
>>  project              |           commits
>>  -----------------------------------------
>>  llvm                 |               286
>>  cfe                  |               109
>>  lldb                 |                76
>>  compiler-rt          |                71
>>  polly                |                42
>>  lld                  |                38
>>  libcxx               |                10
>>  openmp               |                 9
>>  clang-tools-extra    |                 7
>>  clang-tests-external |                 2
>>  libunwind            |                 1
>>  -----------------------------------------
>>                                       651
>>
>>
>> Number of completed builds, failed builds and average build time for
>> successful builds per active builder:
>>
>>  buildername                                               | completed  |
>> failed     | time
>> -----------------------------------------------------------------------------------------------------
>>  clang-aarch64-lnt                                         |         57 |
>> 3 | 02:30:12
>>  clang-atom-d525-fedora                                    |         18 |
>> | 08:28:15
>>  clang-atom-d525-fedora-rel                                |         83 |
>> 5 | 01:29:55
>>  clang-bpf-build                                           |        310 |
>> 31 | 00:02:53
>>  clang-cmake-aarch64-42vma                                 |        278 |
>> 49 | 00:16:47
>>  clang-cmake-aarch64-quick                                 |        209 |
>> 29 | 00:23:46
>>  clang-cmake-armv7-a15                                     |        189 |
>> 8 | 00:25:27
>>  clang-cmake-armv7-a15-full                                |        154 |
>> 38 | 00:45:32
>>  clang-cmake-armv7-a15-selfhost                            |         58 |
>> 24 | 03:00:19
>>  clang-cmake-armv7-a15-selfhost-neon                       |         45 |
>> 22 | 04:26:31
>>  clang-cmake-mips                                          |        186 |
>> 38 | 00:28:52
>>  clang-cmake-thumbv7-a15                                   |        178 |
>> 7 | 00:28:30
>>  clang-cmake-thumbv7-a15-full-sh                           |         32 |
>> 23 | 06:03:05
>>  clang-hexagon-elf                                         |        169 |
>> 23 | 00:24:42
>>  clang-native-aarch64-full                                 |         24 |
>> 8 | 05:53:35
>>  clang-native-arm-lnt                                      |         90 |
>> 3 | 01:06:01
>>  clang-native-arm-lnt-perf                                 |         14 |
>> | 08:57:04
>>  clang-ppc64-elf-linux                                     |        120 |
>> 6 | 01:01:02
>>  clang-ppc64-elf-linux2                                    |         89 |
>> 24 | 01:29:49
>>  clang-sphinx-docs                                         |        113 |
>> | 00:00:20
>>  clang-x64-ninja-win7                                      |        285 |
>> 58 | 00:09:49
>>  clang-x86-win2008-selfhost                                |        268 |
>> 46 | 00:12:10
>>  clang-x86_64-darwin13-cross-arm                           |        232 |
>> 1 | 00:19:45
>>  clang-x86_64-darwin13-cross-mingw32                       |        217 |
>> 12 | 00:23:20
>>  clang-x86_64-debian-fast                                  |        147 |
>> 12 | 00:11:37
>>  clang-x86_64-linux-abi-test                               |        314 |
>> 1 | 00:18:39
>>  clang-x86_64-linux-selfhost-modules                       |        261 |
>> 25 | 00:15:02
>>  clang-x86_64-ubuntu-gdb-75                                |        124 |
>> 62 | 00:53:12
>>  libcxx-libcxxabi-arm-linux                                |          8 |
>> | 01:05:10
>>  libcxx-libcxxabi-singlethreaded-x86_64-linux-debian       |         11 |
>> 2 | 00:08:50
>>  libcxx-libcxxabi-x86_64-linux-debian                      |         11 |
>> 4 | 00:09:43
>>  libcxx-libcxxabi-x86_64-linux-debian-noexceptions         |          5 |
>> 2 | 00:09:24
>>  libcxx-libcxxabi-x86_64-linux-ubuntu-asan                 |         10 |
>> 2 | 00:08:22
>>  libcxx-libcxxabi-x86_64-linux-ubuntu-cxx03                |         10 |
>> | 00:05:12
>>  libcxx-libcxxabi-x86_64-linux-ubuntu-cxx11                |         10 |
>> | 00:06:19
>>  libcxx-libcxxabi-x86_64-linux-ubuntu-cxx14                |          9 |
>> | 00:06:56
>>  libcxx-libcxxabi-x86_64-linux-ubuntu-cxx1z                |         10 |
>> 2 | 00:06:06
>>  libcxx-libcxxabi-x86_64-linux-ubuntu-msan                 |         10 |
>> 2 | 00:17:00
>>  libcxx-libcxxabi-x86_64-linux-ubuntu-tsan                 |         10 |
>> 1 | 00:14:03
>>  libcxx-libcxxabi-x86_64-linux-ubuntu-unstable-abi         |         10 |
>> 2 | 00:06:28
>>  libcxx-sphinx-docs                                        |         11 |
>> | 00:00:13
>>  libomp-clang-x86_64-linux-debian                          |          3 |
>> 3 |
>>  libomp-gcc-x86_64-linux-debian                            |          3 |
>> 3 |
>>  lld-sphinx-docs                                           |        100 |
>> | 00:00:17
>>  lld-x86_64-darwin13                                       |        250 |
>> 23 | 00:10:37
>>  lld-x86_64-freebsd                                        |        152 |
>> 2 | 00:38:06
>>  lld-x86_64-win7                                           |        254 |
>> 4 | 00:08:51
>>  lldb-windows7-android                                     |        109 |
>> 76 | 01:10:59
>>  lldb-x86-win7-msvc                                        |        300 |
>> 46 | 00:09:28
>>  lldb-x86-windows-msvc                                     |        244 |
>> 40 | 00:18:18
>>  lldb-x86_64-darwin-13.4                                   |        141 |
>> 43 | 00:50:44
>>  lldb-x86_64-debian-clang                                  |        142 |
>> 142 |
>>  lldb-x86_64-ubuntu-14.04-android                          |        123 |
>> 33 | 01:00:35
>>  lldb-x86_64-ubuntu-14.04-buildserver                      |        146 |
>> 2 | 00:48:29
>>  lldb-x86_64-ubuntu-14.04-cmake                            |        228 |
>> 39 | 00:24:49
>>  lldb-x86_64-ubuntu-14.10                                  |        191 |
>> 191 |
>>  llvm-aarch64-linux                                        |        110 |
>> 6 | 01:00:32
>>  llvm-clang-lld-x86_64-debian-fast                         |        189 |
>> 189 |
>>  llvm-clang-lld-x86_64-scei-ps4-ubuntu-fast                |        386 |
>> 24 | 00:03:22
>>  llvm-hexagon-elf                                          |        190 |
>> 16 | 00:10:08
>>  llvm-mips-linux                                           |         29 |
>> 2 | 05:01:59
>>  llvm-ppc64-linux1                                         |        126 |
>> 6 | 00:48:28
>>  llvm-ppc64-linux2                                         |        128 |
>> 6 | 00:48:01
>>  llvm-s390x-linux1                                         |          5 |
>> 3 | 00:37:12
>>  llvm-sphinx-docs                                          |         95 |
>> 27 | 00:00:19
>>  perf-x86_64-penryn-O3                                     |         26 |
>> 1 | 05:49:03
>>  perf-x86_64-penryn-O3-polly                               |         73 |
>> | 05:46:16
>>  perf-x86_64-penryn-O3-polly-before-vectorizer             |         15 |
>> 14 |
>>  perf-x86_64-penryn-O3-polly-before-vectorizer-detect-only |         16 |
>> | 05:07:41
>>  perf-x86_64-penryn-O3-polly-fast                          |        309 |
>> 13 | 00:09:45
>>  perf-x86_64-penryn-O3-polly-parallel-fast                 |        189 |
>> 11 | 00:11:38
>>  perf-x86_64-penryn-O3-polly-unprofitable                  |        195 |
>> 139 | 00:12:23
>>  polly-amd64-linux                                         |        238 |
>> 2 | 00:11:13
>>  ppc64le-clang                                             |         41 |
>> 13 | 03:25:53
>>  ppc64le-clanglnt                                          |         67 |
>> 2 | 02:02:39
>>  ppc64le-llvm                                              |         74 |
>> 3 | 01:47:07
>>  sanitizer-ppc64-linux1                                    |        173 |
>> 38 | 00:40:18
>>  sanitizer-ppc64le-linux                                   |        146 |
>> 28 | 00:51:50
>>  sanitizer-windows                                         |        382 |
>> 341 | 00:04:20
>>  sanitizer-x86_64-linux                                    |        101 |
>> 53 | 01:30:13
>>  sanitizer-x86_64-linux-autoconf                           |        335 |
>> 252 | 00:10:01
>>  sanitizer-x86_64-linux-bootstrap                          |         92 |
>> 92 |
>>  sanitizer-x86_64-linux-fast                               |        272 |
>> 272 |
>>  sanitizer-x86_64-linux-fuzzer                             |        180 |
>> 47 | 00:45:34
>>  sanitizer_x86_64-freebsd                                  |         54 |
>> 54 |
>
> There are definitely some worrying statistics in here, such as the
> bots that seem to have failed all week long on everything:
>
>  lldb-x86_64-debian-clang                                  |
> 142 |        142 |
>  llvm-clang-lld-x86_64-debian-fast                         |
> 189 |        189 |
>  sanitizer-x86_64-linux-bootstrap                          |
> 92 |         92 |
>  sanitizer-x86_64-linux-fast                               |
> 272 |        272 |
>
> ~Aaron
> _______________________________________________
> llvm-commits mailing list
> llvm-commits at lists.llvm.org
> http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-commits


More information about the lldb-commits mailing list