Buildbot numbers for week of 11/22/2015 - 11/28/2015

David Blaikie via llvm-commits llvm-commits at lists.llvm.org
Mon Nov 30 17:05:37 PST 2015


On Mon, Nov 30, 2015 at 5:00 PM, Galina Kistanova <gkistanova at gmail.com>
wrote:

> Hi David,
>
> Thank you for the useful suggestions, I will work on these.
>
> >I guess the entries with no entry in the failed column have zero failures?
> Yes.
>
>      perf-x86_64-penryn-O3-polly-before-vectorizer             |
> 31 |         31 |
>      perf-x86_64-penryn-O3-polly-before-vectorizer-detect-only |
> 31 |         27 | 05:28:12
>
> These /\ two builders failed most of the time, but they also only ran a
> handful of times. I guess they're triggering off polly changes only? I
> wonder if they should trigger off LLVM changes too, but I'm not sure.
>
> They build on llvm changes also, but they both build for quite a long
> time. I think it's the reason why they do not build more.
>

Ah, OK - so the other suggestions might help demonstrate/understand that
behavior better.

Tobias - any idea why these builders are /quite/ so slow & whether they
could be improved? With large blame lists that come from a small number of
slaves on a slow builder task it makes them hard to action. Are they useful
to you?

- Dave


>
> Thanks
>
> Galina
>
>
>
>
> On Mon, Nov 30, 2015 at 4:28 PM, David Blaikie <dblaikie at gmail.com> wrote:
>
>> Thanks for tracking these results, Galina
>>
>> I think it might be better to send these to the -dev lists, rather than
>> the -commits lists, but I'm not sure what other people think on that.
>>
>> On Mon, Nov 30, 2015 at 4:17 PM, Galina Kistanova via cfe-commits <
>> cfe-commits at lists.llvm.org> wrote:
>>
>>> Hello everyone,
>>>
>>> Below are some buildbot numbers for the last week of 11/22/2015 -
>>> 11/28/2015.
>>>
>>> Thanks
>>>
>>> Galina
>>>
>>>
>>>
>>> Top 10 fastest builders(not docs):
>>>
>>>  lldb-amd64-ninja-freebsd11
>>>  clang-bpf-build
>>>  llvm-clang-lld-x86_64-scei-ps4-ubuntu-fast
>>>  libcxx-libcxxabi-x86_64-linux-ubuntu-cxx03
>>>  sanitizer-windows
>>>  libcxx-libcxxabi-x86_64-linux-ubuntu-cxx11
>>>  libcxx-libcxxabi-x86_64-linux-ubuntu-cxx1z
>>>  libcxx-libcxxabi-x86_64-linux-ubuntu-cxx14
>>>  libcxx-libcxxabi-x86_64-linux-ubuntu-unstable-abi
>>>  llvm-hexagon-elf
>>>
>>>
>>>
>>>  10 most slow builders:
>>>
>>>  clang-native-arm-lnt-perf
>>>  clang-native-aarch64-full
>>>  clang-atom-d525-fedora
>>>  clang-cmake-thumbv7-a15-full-sh
>>>  perf-x86_64-penryn-O3
>>>  perf-x86_64-penryn-O3-polly
>>>  perf-x86_64-penryn-O3-polly-before-vectorizer-detect-only
>>>  clang-cmake-armv7-a15-selfhost-neon
>>>  llvm-mips-linux
>>>  sanitizer-x86_64-linux-bootstrap
>>>
>>>
>>>
>>> Number of commits by project:
>>>
>>>  project           |           commits
>>> ---------------------------------------
>>>  llvm              |               218
>>>  cfe               |                67
>>>  compiler-rt       |                33
>>>  lld               |                30
>>>  lldb              |                23
>>>  polly             |                 8
>>>  clang-tools-extra |                 7
>>>  libcxx            |                 4
>>>  llgo              |                 1
>>> ---------------------------------------
>>>                                    391
>>>
>>>
>>> Number of completed builds, failed builds and average build time for
>>> successful builds per active builder:
>>>
>>
>> Maybe we could sort this \/ list by some ratio of failed/completed?
>>
>> I guess the entries with no entry in the failed column have zero failures?
>>
>>
>>>
>>>  buildername                                               | completed
>>> | failed     | time
>>>
>>> -----------------------------------------------------------------------------------------------------
>>>  clang-aarch64-lnt                                         |         56
>>> |          3 | 02:31:36
>>>  clang-atom-d525-fedora                                    |         21
>>> |          5 | 08:06:27
>>>  clang-atom-d525-fedora-rel                                |         80
>>> |         12 | 01:31:08
>>>  clang-bpf-build                                           |        239
>>> |         47 | 00:02:59
>>>  clang-cmake-aarch64-42vma                                 |        214
>>> |         80 | 00:16:33
>>>  clang-cmake-aarch64-full                                  |          1
>>> |            | 03:17:48
>>>  clang-cmake-aarch64-quick                                 |        178
>>> |         64 | 00:22:56
>>>  clang-cmake-armv7-a15                                     |        170
>>> |          9 | 00:27:14
>>>  clang-cmake-armv7-a15-full                                |        135
>>> |         31 | 00:47:54
>>>  clang-cmake-armv7-a15-selfhost                            |         41
>>> |         17 | 04:13:48
>>>  clang-cmake-armv7-a15-selfhost-neon                       |         38
>>> |         18 | 05:04:39
>>>  clang-cmake-mips                                          |        158
>>> |         50 | 00:27:47
>>>  clang-cmake-thumbv7-a15                                   |        157
>>> |         22 | 00:27:57
>>>  clang-cmake-thumbv7-a15-full-sh                           |         28
>>> |         12 | 06:13:18
>>>  clang-hexagon-elf                                         |        139
>>> |         12 | 00:16:00
>>>  clang-native-aarch64-full                                 |         16
>>> |          5 | 08:14:29
>>>  clang-native-arm-lnt                                      |        107
>>> |         17 | 01:08:19
>>>  clang-native-arm-lnt-perf                                 |         25
>>> |         11 | 08:40:48
>>>  clang-ppc64-elf-linux                                     |        110
>>> |          3 | 01:01:45
>>>  clang-ppc64-elf-linux2                                    |         83
>>> |         14 | 01:31:11
>>>  clang-sphinx-docs                                         |        111
>>> |            | 00:00:20
>>>  clang-x64-ninja-win7                                      |        158
>>> |         28 | 00:34:54
>>>  clang-x86-win2008-selfhost                                |        110
>>> |         17 | 01:02:17
>>>  clang-x86_64-darwin13-cross-arm                           |        197
>>> |          5 | 00:19:48
>>>  clang-x86_64-darwin13-cross-mingw32                       |        184
>>> |          5 | 00:23:16
>>>  clang-x86_64-debian-fast                                  |        137
>>> |         24 | 00:10:32
>>>  clang-x86_64-linux-abi-test                               |        243
>>> |          3 | 00:18:45
>>>  clang-x86_64-linux-selfhost-modules                       |        212
>>> |         45 | 00:15:08
>>>  clang-x86_64-ubuntu-gdb-75                                |        131
>>> |         45 | 00:49:38
>>>  libcxx-libcxxabi-arm-linux                                |          4
>>> |            | 01:09:42
>>>  libcxx-libcxxabi-singlethreaded-x86_64-linux-debian       |          4
>>> |            | 00:08:08
>>>  libcxx-libcxxabi-x86_64-linux-debian                      |          4
>>> |            | 00:08:33
>>>  libcxx-libcxxabi-x86_64-linux-debian-noexceptions         |          4
>>> |            | 00:08:03
>>>  libcxx-libcxxabi-x86_64-linux-ubuntu-asan                 |          4
>>> |            | 00:08:25
>>>  libcxx-libcxxabi-x86_64-linux-ubuntu-cxx03                |          4
>>> |            | 00:04:29
>>>  libcxx-libcxxabi-x86_64-linux-ubuntu-cxx11                |          4
>>> |            | 00:05:21
>>>  libcxx-libcxxabi-x86_64-linux-ubuntu-cxx14                |          4
>>> |            | 00:05:32
>>>  libcxx-libcxxabi-x86_64-linux-ubuntu-cxx1z                |          4
>>> |            | 00:05:31
>>>  libcxx-libcxxabi-x86_64-linux-ubuntu-msan                 |          4
>>> |            | 00:17:32
>>>  libcxx-libcxxabi-x86_64-linux-ubuntu-tsan                 |          4
>>> |            | 00:12:18
>>>  libcxx-libcxxabi-x86_64-linux-ubuntu-unstable-abi         |          4
>>> |            | 00:05:36
>>>  libcxx-sphinx-docs                                        |          4
>>> |            | 00:00:09
>>>  lld-sphinx-docs                                           |         99
>>> |         99 |
>>>  lld-x86_64-darwin13                                       |        204
>>> |         16 | 00:10:53
>>>  lld-x86_64-freebsd                                        |        110
>>> |          3 | 00:51:39
>>>  lld-x86_64-win7                                           |        202
>>> |            | 00:08:58
>>>  lldb-amd64-ninja-freebsd11                                |         57
>>> |          5 | 00:01:42
>>>  lldb-amd64-ninja-netbsd7                                  |        144
>>> |          6 | 00:44:27
>>>  lldb-windows7-android                                     |        122
>>> |        105 | 00:42:15
>>>  lldb-x86-win7-msvc                                        |        231
>>> |          4 | 00:09:03
>>>  lldb-x86-windows-msvc                                     |        197
>>> |          3 | 00:18:58
>>>  lldb-x86_64-darwin-13.4                                   |        125
>>> |         38 | 00:55:53
>>>  lldb-x86_64-debian-clang                                  |        253
>>> |        253 |
>>>  lldb-x86_64-ubuntu-14.04-android                          |        118
>>> |         27 | 00:56:37
>>>  lldb-x86_64-ubuntu-14.04-buildserver                      |        139
>>> |         18 | 00:50:20
>>>  lldb-x86_64-ubuntu-14.04-cmake                            |        193
>>> |         34 | 00:24:37
>>>  lldb-x86_64-ubuntu-14.10                                  |        151
>>> |        151 |
>>>  llvm-aarch64-linux                                        |         98
>>> |         24 | 01:00:32
>>>  llvm-clang-lld-x86_64-debian-fast                         |        176
>>> |         32 | 00:21:37
>>>  llvm-clang-lld-x86_64-scei-ps4-ubuntu-fast                |        288
>>> |         66 | 00:03:15
>>>  llvm-hexagon-elf                                          |        130
>>> |         12 | 00:06:36
>>>  llvm-mips-linux                                           |         32
>>> |         10 | 04:58:01
>>>  llvm-ppc64-linux1                                         |        111
>>> |          5 | 00:49:07
>>>  llvm-ppc64-linux2                                         |        111
>>> |          5 | 00:49:13
>>>  llvm-s390x-linux1                                         |        156
>>> |          8 | 00:23:11
>>>  llvm-sphinx-docs                                          |         95
>>> |         19 | 00:00:18
>>>  perf-x86_64-penryn-O3                                     |         45
>>> |         23 | 05:54:05
>>>  perf-x86_64-penryn-O3-polly                               |         92
>>> |         32 | 05:38:37
>>>  perf-x86_64-penryn-O3-polly-before-vectorizer             |         31
>>> |         31 |
>>>  perf-x86_64-penryn-O3-polly-before-vectorizer-detect-only |         31
>>> |         27 | 05:28:12
>>>
>>
>> These /\ two builders failed most of the time, but they also only ran a
>> handful of times. I guess they're triggering off polly changes only? I
>> wonder if they should trigger off LLVM changes too, but I'm not sure.
>>
>> It might be worth looking at "patches per run" to see how whether the
>> builders are too slow to keep up with the incoming patch rate, etc. (just
>> seeing the number of builds doesn't tell us this, since some are triggering
>> off low-utilization projects so they won't need to build often)
>>
>>
>>>  perf-x86_64-penryn-O3-polly-fast                          |        227
>>> |         32 | 00:10:35
>>>  perf-x86_64-penryn-O3-polly-parallel-fast                 |        175
>>> |         29 | 00:11:52
>>>  perf-x86_64-penryn-O3-polly-unprofitable                  |        174
>>> |         29 | 00:14:13
>>>  polly-amd64-linux                                         |        191
>>> |         32 | 00:12:02
>>>  ppc64le-clang                                             |         44
>>> |          7 | 03:24:04
>>>  ppc64le-clanglnt                                          |         67
>>> |          3 | 02:02:53
>>>  ppc64le-llvm                                              |         67
>>> |          3 | 01:51:20
>>>  sanitizer-ppc64-linux1                                    |        147
>>> |          7 | 00:40:46
>>>  sanitizer-ppc64le-linux                                   |        127
>>> |          6 | 00:51:32
>>>  sanitizer-windows                                         |        272
>>> |        153 | 00:05:01
>>>  sanitizer-x86_64-linux                                    |         81
>>> |         36 | 01:41:09
>>>  sanitizer-x86_64-linux-autoconf                           |        253
>>> |         34 | 00:11:23
>>>  sanitizer-x86_64-linux-bootstrap                          |         51
>>> |         40 | 04:13:56
>>>  sanitizer-x86_64-linux-fast                               |        158
>>> |        125 | 00:48:54
>>>  sanitizer-x86_64-linux-fuzzer                             |        149
>>> |         30 | 00:46:12
>>>  sanitizer_x86_64-freebsd                                  |        186
>>> |        186 |
>>>
>>
>> If I recall correctly, this last builder was failing all the way through
>> the last summary you sent too? Perhaps we should disable it?
>>
>>
>>> (86 rows)
>>>
>>>
>>> _______________________________________________
>>> cfe-commits mailing list
>>> cfe-commits at lists.llvm.org
>>> http://lists.llvm.org/cgi-bin/mailman/listinfo/cfe-commits
>>>
>>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-commits/attachments/20151130/9a36997c/attachment.html>


More information about the llvm-commits mailing list