<div dir="ltr"><span style="font-family:monospace">Hello everyone,<br><br>Below are some buildbot numbers for the last week of 12/29/2019 - 01/04/2020.<br><br>Please see the same data in attached csv files:<br><br>The longest time each builder was red during the week;<br>"Status change ratio" by active builder (percent of builds that changed the builder status from greed to red or from red to green);<br>Count of commits by project;<br>Number of completed builds, failed builds and average build time for successful builds per active builder;<br>Average waiting time for a revision to get build result per active builder (response time).<br><br>Thanks<br><br>Galina<br><br><br>The longest time each builder was red during the week:<br>                   buildername                    |  was_red  <br>--------------------------------------------------+----------<br> llvm-clang-win-x-aarch64                         | 105:37:31<br> lldb-x64-windows-ninja                           | 85:27:56<br> clang-native-arm-lnt-perf                        | 26:02:57<br> clang-x64-windows-msvc                           | 18:04:43<br> clang-cmake-thumbv7-full-sh                      | 11:50:00<br> sanitizer-x86_64-linux-bootstrap                 | 08:32:06<br> sanitizer-x86_64-linux-fast                      | 08:12:52<br> llvm-clang-win-x-armv7l                          | 06:21:53<br> clang-with-thin-lto-ubuntu                       | 05:59:17<br> clang-cmake-armv7-lnt                            | 05:50:26<br> clang-with-lto-ubuntu                            | 05:47:24<br> llvm-clang-x86_64-expensive-checks-win           | 05:23:58<br> lld-x86_64-win7                                  | 05:19:54<br> clang-ppc64le-linux-multistage                   | 05:10:15<br> clang-cmake-armv7-global-isel                    | 05:02:19<br> sanitizer-x86_64-linux                           | 04:43:27<br> llvm-clang-lld-x86_64-scei-ps4-windows10pro-fast | 04:25:41<br> sanitizer-ppc64le-linux                          | 04:21:57<br> sanitizer-ppc64be-linux                          | 04:00:34<br> openmp-clang-x86_64-linux-debian                 | 03:45:17<br> clang-cmake-armv7-quick                          | 03:35:16<br> sanitizer-x86_64-linux-bootstrap-ubsan           | 03:24:22<br> clang-cmake-armv8-lld                            | 03:21:51<br> clang-s390x-linux-multistage                     | 03:05:57<br> clang-ppc64be-linux                              | 03:00:10<br> clang-x86_64-debian-new-pass-manager-fast        | 03:00:03<br> clang-x86_64-debian-fast                         | 02:59:59<br> llvm-clang-x86_64-expensive-checks-debian        | 02:59:58<br> clang-ppc64le-linux                              | 02:54:31<br> clang-s390x-linux                                | 02:52:49<br> ppc64le-lld-multistage-test                      | 02:50:35<br> sanitizer-x86_64-linux-bootstrap-msan            | 02:47:56<br> lld-x86_64-darwin13                              | 02:45:24<br> clang-ppc64le-linux-lnt                          | 02:40:30<br> clang-ppc64le-rhel                               | 02:39:46<br> clang-s390x-linux-lnt                            | 02:38:02<br> clang-ppc64be-linux-lnt                          | 02:36:40<br> clang-ppc64be-linux-multistage                   | 02:30:27<br> sanitizer-x86_64-linux-android                   | 01:37:15<br> clang-cmake-x86_64-sde-avx512-linux              | 01:33:06<br> clang-cmake-x86_64-avx2-linux                    | 01:25:53<br> sanitizer-x86_64-linux-fuzzer                    | 01:13:39<br> lld-x86_64-ubuntu-fast                           | 00:53:47<br> llvm-clang-x86_64-expensive-checks-ubuntu        | 00:46:45<br> clang-x86_64-linux-abi-test                      | 00:45:17<br> openmp-gcc-x86_64-linux-debian                   | 00:44:03<br> sanitizer-x86_64-linux-autoconf                  | 00:43:40<br> clang-atom-d525-fedora-rel                       | 00:41:15<br> clang-aarch64-linux-build-cache                  | 00:40:32<br> llvm-clang-lld-x86_64-scei-ps4-ubuntu-fast       | 00:40:04<br> llvm-clang-x86_64-win-fast                       | 00:36:25<br> sanitizer-windows                                | 00:33:31<br> lldb-x86_64-debian                               | 00:32:37<br> llvm-sphinx-docs                                 | 00:31:09<br> lldb-sphinx-docs                                 | 00:30:08<br> lld-sphinx-docs                                  | 00:29:10<br> libcxx-sphinx-docs                               | 00:28:34<br> libunwind-sphinx-docs                            | 00:27:56<br> clang-tools-sphinx-docs                          | 00:27:11<br> clang-armv7-linux-build-cache                    | 00:19:14<br>(60 rows)<br><br><br>"Status change ratio" by active builder (percent of builds that changed the builder status from greed to red or from red to green):<br>                   buildername                    | builds | changes | status_change_ratio <br>--------------------------------------------------+--------+---------+--------------------<br> sanitizer-x86_64-linux                           |     71 |      22 |                31.0<br> clang-with-thin-lto-ubuntu                       |     59 |      14 |                23.7<br> ppc64le-lld-multistage-test                      |     56 |      10 |                17.9<br> sanitizer-ppc64le-linux                          |     34 |       6 |                17.6<br> clang-ppc64le-rhel                               |    114 |      20 |                17.5<br> clang-ppc64be-linux-multistage                   |    108 |      16 |                14.8<br> sanitizer-x86_64-linux-bootstrap                 |     71 |      10 |                14.1<br> clang-ppc64be-linux-lnt                          |    131 |      18 |                13.7<br> clang-native-arm-lnt-perf                        |     39 |       5 |                12.8<br> clang-ppc64le-linux-multistage                   |     32 |       4 |                12.5<br> llvm-clang-x86_64-expensive-checks-win           |     91 |      10 |                11.0<br> clang-cmake-thumbv7-full-sh                      |     49 |       5 |                10.2<br> clang-ppc64le-linux-lnt                          |     82 |       8 |                 9.8<br> sanitizer-ppc64be-linux                          |     61 |       6 |                 9.8<br> lld-x86_64-win7                                  |     66 |       6 |                 9.1<br> clang-s390x-linux-multistage                     |     44 |       4 |                 9.1<br> sanitizer-x86_64-linux-bootstrap-ubsan           |     90 |       8 |                 8.9<br> clang-cmake-x86_64-avx2-linux                    |     68 |       6 |                 8.8<br> lld-x86_64-darwin13                              |     34 |       3 |                 8.8<br> clang-with-lto-ubuntu                            |     46 |       4 |                 8.7<br> clang-cmake-armv8-lld                            |     59 |       5 |                 8.5<br> sanitizer-x86_64-linux-bootstrap-msan            |     99 |       8 |                 8.1<br> clang-x64-windows-msvc                           |    125 |      10 |                 8.0<br> llvm-clang-lld-x86_64-scei-ps4-windows10pro-fast |     76 |       6 |                 7.9<br> clang-s390x-linux                                |    131 |      10 |                 7.6<br> openmp-gcc-x86_64-linux-debian                   |    193 |      14 |                 7.3<br> openmp-clang-x86_64-linux-debian                 |    192 |      12 |                 6.3<br> clang-s390x-linux-lnt                            |     99 |       6 |                 6.1<br> lld-x86_64-ubuntu-fast                           |    172 |      10 |                 5.8<br> llvm-clang-win-x-armv7l                          |    207 |      12 |                 5.8<br> clang-ppc64be-linux                              |    182 |      10 |                 5.5<br> sanitizer-x86_64-linux-fast                      |    112 |       6 |                 5.4<br> clang-cmake-x86_64-sde-avx512-linux              |    186 |      10 |                 5.4<br> sanitizer-x86_64-linux-android                   |    115 |       6 |                 5.2<br> clang-cmake-armv7-quick                          |    136 |       7 |                 5.1<br> llvm-clang-x86_64-expensive-checks-debian        |    166 |       8 |                 4.8<br> clang-ppc64le-linux                              |     89 |       4 |                 4.5<br> llvm-clang-x86_64-expensive-checks-ubuntu        |    136 |       6 |                 4.4<br> clang-cmake-armv7-global-isel                    |     70 |       3 |                 4.3<br> clang-x86_64-debian-new-pass-manager-fast        |    201 |       8 |                 4.0<br> clang-x86_64-debian-fast                         |    202 |       8 |                 4.0<br> llvm-clang-lld-x86_64-scei-ps4-ubuntu-fast       |    205 |       7 |                 3.4<br> llvm-clang-x86_64-win-fast                       |    190 |       6 |                 3.2<br> lldb-x64-windows-ninja                           |    164 |       5 |                 3.0<br> clang-cmake-armv7-full                           |     39 |       1 |                 2.6<br> clang-atom-d525-fedora-rel                       |    159 |       4 |                 2.5<br> llvm-sphinx-docs                                 |    165 |       4 |                 2.4<br> libunwind-sphinx-docs                            |    165 |       4 |                 2.4<br> libcxx-sphinx-docs                               |    165 |       4 |                 2.4<br> llvm-clang-win-x-aarch64                         |    207 |       5 |                 2.4<br> lld-sphinx-docs                                  |    172 |       4 |                 2.3<br> clang-cmake-armv7-lnt                            |     87 |       2 |                 2.3<br> clang-armv7-linux-build-cache                    |    190 |       4 |                 2.1<br> clang-tools-sphinx-docs                          |    198 |       4 |                 2.0<br> lldb-sphinx-docs                                 |    207 |       4 |                 1.9<br> clang-x86_64-linux-abi-test                      |    207 |       4 |                 1.9<br> lldb-x86_64-debian                               |    216 |       4 |                 1.9<br> sanitizer-x86_64-linux-fuzzer                    |    137 |       2 |                 1.5<br> clang-aarch64-linux-build-cache                  |    166 |       2 |                 1.2<br> sanitizer-x86_64-linux-autoconf                  |    161 |       2 |                 1.2<br> sanitizer-windows                                |    196 |       2 |                 1.0<br> clang-hexagon-elf                                |      1 |       0 |                 0.0<br> polly-arm-linux                                  |      1 |       0 |                 0.0<br> aosp-O3-polly-before-vectorizer-unprofitable     |      1 |       0 |                 0.0<br> reverse-iteration                                |      1 |       0 |                 0.0<br> clang-sphinx-docs                                |    190 |       0 |                 0.0<br> clang-cmake-aarch64-quick                        |    105 |       0 |                 0.0<br> clang-cmake-aarch64-lld                          |     53 |       0 |                 0.0<br> clang-cmake-aarch64-global-isel                  |    106 |       0 |                 0.0<br> clang-cmake-aarch64-full                         |     46 |       0 |                 0.0<br> clang-x64-ninja-win7                             |     49 |       0 |                 0.0<br> lld-perf-testsuite                               |    151 |       0 |                 0.0<br> clang-cmake-armv7-selfhost-neon                  |     39 |       0 |                 0.0<br> lldb-aarch64-ubuntu                              |    153 |       0 |                 0.0<br> clang-cmake-x86_64-avx2-linux-perf               |    107 |       0 |                 0.0<br> clang-cmake-armv7-selfhost                       |     40 |       0 |                 0.0<br>(76 rows)<br><br><br>Number of commits by project:<br>      project      | number_of_commits <br>-------------------+------------------<br> llvm              |               222<br> cfe               |                45<br> lldb              |                28<br> clang-tools-extra |                18<br> lld               |                14<br> compiler-rt       |                 5<br> polly             |                 3<br> openmp            |                 2<br>-------------------+-------------------<br>                                   337<br><br><br>Number of completed builds, failed builds and average build time for successful builds per active builder:<br>                       name                       | all_builds | red_builds | average_build_time <br>--------------------------------------------------+------------+------------+-------------------<br> aosp-O3-polly-before-vectorizer-unprofitable     |          1 |          1 | <br> clang-aarch64-linux-build-cache                  |        166 |          3 | 00:21:23<br> clang-armv7-linux-build-cache                    |        190 |          2 | 00:12:02<br> clang-atom-d525-fedora-rel                       |        159 |          4 | 00:18:58<br> clang-cmake-aarch64-full                         |         46 |         46 | <br> clang-cmake-aarch64-global-isel                  |        106 |        106 | <br> clang-cmake-aarch64-lld                          |         53 |         53 | <br> clang-cmake-aarch64-quick                        |        105 |        105 | <br> clang-cmake-armv7-full                           |         39 |         12 | 10:36:05<br> clang-cmake-armv7-global-isel                    |         70 |         24 | 01:38:20<br> clang-cmake-armv7-lnt                            |         87 |          2 | 01:13:18<br> clang-cmake-armv7-quick                          |        136 |         62 | 00:30:39<br> clang-cmake-armv7-selfhost                       |         40 |         40 | <br> clang-cmake-armv7-selfhost-neon                  |         39 |         39 | <br> clang-cmake-armv8-lld                            |         59 |         20 | 02:06:03<br> clang-cmake-thumbv7-full-sh                      |         49 |         20 | 09:26:25<br> clang-cmake-x86_64-avx2-linux                    |         68 |          3 | 00:04:57<br> clang-cmake-x86_64-avx2-linux-perf               |        107 |        107 | <br> clang-cmake-x86_64-sde-avx512-linux              |        186 |         11 | 00:07:07<br> clang-hexagon-elf                                |          1 |            | 02:24:38<br> clang-native-arm-lnt-perf                        |         39 |         13 | 03:47:45<br> clang-ppc64be-linux                              |        182 |         13 | 00:12:45<br> clang-ppc64be-linux-lnt                          |        131 |         15 | 00:30:51<br> clang-ppc64be-linux-multistage                   |        108 |         13 | 00:49:47<br> clang-ppc64le-linux                              |         89 |          4 | 01:06:32<br> clang-ppc64le-linux-lnt                          |         82 |          6 | 01:18:59<br> clang-ppc64le-linux-multistage                   |         32 |          2 | 04:31:11<br> clang-ppc64le-rhel                               |        114 |         21 | 00:53:16<br> clang-s390x-linux                                |        131 |          9 | 00:34:38<br> clang-s390x-linux-lnt                            |         99 |          8 | 00:54:51<br> clang-s390x-linux-multistage                     |         44 |          2 | 03:12:14<br> clang-sphinx-docs                                |        190 |        190 | <br> clang-tools-sphinx-docs                          |        198 |          2 | 00:00:30<br> clang-with-lto-ubuntu                            |         46 |          7 | 03:23:07<br> clang-with-thin-lto-ubuntu                       |         59 |         13 | 02:38:12<br> clang-x64-ninja-win7                             |         49 |         49 | <br> clang-x64-windows-msvc                           |        125 |         36 | 00:57:06<br> clang-x86_64-debian-fast                         |        202 |          8 | 00:03:37<br> clang-x86_64-debian-new-pass-manager-fast        |        201 |          8 | 00:04:58<br> clang-x86_64-linux-abi-test                      |        207 |          2 | 00:17:44<br> libcxx-sphinx-docs                               |        165 |          2 | 00:00:21<br> libunwind-sphinx-docs                            |        165 |          2 | 00:00:21<br> lldb-aarch64-ubuntu                              |        153 |            | 00:28:59<br> lldb-sphinx-docs                                 |        207 |          2 | 00:00:24<br> lldb-x64-windows-ninja                           |        164 |        100 | 00:27:20<br> lldb-x86_64-debian                               |        216 |          4 | 00:02:01<br> lld-perf-testsuite                               |        151 |        151 | <br> lld-sphinx-docs                                  |        172 |          2 | 00:00:20<br> lld-x86_64-darwin13                              |         34 |          7 | 00:31:40<br> lld-x86_64-ubuntu-fast                           |        172 |          9 | 00:07:02<br> lld-x86_64-win7                                  |         66 |          5 | 00:05:03<br> llvm-clang-lld-x86_64-scei-ps4-ubuntu-fast       |        205 |         94 | 00:02:33<br> llvm-clang-lld-x86_64-scei-ps4-windows10pro-fast |         76 |          5 | 00:06:47<br> llvm-clang-win-x-aarch64                         |        207 |        134 | 00:16:58<br> llvm-clang-win-x-armv7l                          |        207 |         32 | 00:18:13<br> llvm-clang-x86_64-expensive-checks-debian        |        166 |          7 | 00:03:14<br> llvm-clang-x86_64-expensive-checks-ubuntu        |        136 |          6 | 00:16:06<br> llvm-clang-x86_64-expensive-checks-win           |         91 |         10 | 00:51:31<br> llvm-clang-x86_64-win-fast                       |        190 |          3 | 00:10:35<br> llvm-sphinx-docs                                 |        165 |          2 | 00:00:42<br> openmp-clang-x86_64-linux-debian                 |        192 |          6 | 00:02:40<br> openmp-gcc-x86_64-linux-debian                   |        193 |          7 | 00:02:24<br> polly-arm-linux                                  |          1 |            | 01:56:10<br> ppc64le-lld-multistage-test                      |         56 |          6 | 02:20:24<br> reverse-iteration                                |          1 |          1 | <br> sanitizer-ppc64be-linux                          |         61 |          4 | 01:52:46<br> sanitizer-ppc64le-linux                          |         34 |          3 | 04:19:28<br> sanitizer-windows                                |        196 |          1 | 00:08:07<br> sanitizer-x86_64-linux                           |         71 |         15 | 01:35:44<br> sanitizer-x86_64-linux-android                   |        115 |          4 | 00:47:00<br> sanitizer-x86_64-linux-autoconf                  |        161 |          2 | 00:20:02<br> sanitizer-x86_64-linux-bootstrap                 |         71 |          9 | 01:40:32<br> sanitizer-x86_64-linux-bootstrap-msan            |         99 |          7 | 01:00:51<br> sanitizer-x86_64-linux-bootstrap-ubsan           |         90 |          7 | 01:11:04<br> sanitizer-x86_64-linux-fast                      |        112 |         11 | 00:46:29<br> sanitizer-x86_64-linux-fuzzer                    |        137 |          1 | 00:32:15<br>(76 rows)<br><br><br>Average waiting time for a revision to get build result per active builder (response time):<br>                   builder_name                   | average_wait_time <br>--------------------------------------------------+------------------<br> clang-tools-sphinx-docs                          | 00:00:59<br> clang-sphinx-docs                                | 00:01:05<br> libunwind-sphinx-docs                            | 00:01:12<br> llvm-sphinx-docs                                 | 00:01:33<br> libcxx-sphinx-docs                               | 00:01:36<br> lld-sphinx-docs                                  | 00:01:46<br> lldb-sphinx-docs                                 | 00:01:47<br> lldb-x86_64-debian                               | 00:02:16<br> openmp-gcc-x86_64-linux-debian                   | 00:02:41<br> llvm-clang-lld-x86_64-scei-ps4-ubuntu-fast       | 00:03:26<br> llvm-clang-x86_64-expensive-checks-debian        | 00:03:29<br> clang-x86_64-debian-fast                         | 00:04:00<br> openmp-clang-x86_64-linux-debian                 | 00:05:14<br> clang-x86_64-debian-new-pass-manager-fast        | 00:05:15<br> sanitizer-windows                                | 00:09:11<br> clang-cmake-x86_64-sde-avx512-linux              | 00:09:32<br> llvm-clang-x86_64-win-fast                       | 00:12:09<br> clang-armv7-linux-build-cache                    | 00:14:04<br> clang-ppc64be-linux                              | 00:15:34<br> llvm-clang-win-x-aarch64                         | 00:22:02<br> llvm-clang-x86_64-expensive-checks-ubuntu        | 00:22:52<br> lld-perf-testsuite                               | 00:23:34<br> clang-aarch64-linux-build-cache                  | 00:26:59<br> sanitizer-x86_64-linux-autoconf                  | 00:28:41<br> lld-x86_64-ubuntu-fast                           | 00:29:36<br> clang-atom-d525-fedora-rel                       | 00:34:17<br> lldb-x64-windows-ninja                           | 00:37:11<br> clang-x86_64-linux-abi-test                      | 00:41:00<br> llvm-clang-win-x-armv7l                          | 00:41:37<br> sanitizer-x86_64-linux-fuzzer                    | 00:44:11<br> clang-cmake-armv7-quick                          | 00:44:23<br> lldb-aarch64-ubuntu                              | 00:45:19<br> clang-cmake-x86_64-avx2-linux                    | 00:45:47<br> llvm-clang-lld-x86_64-scei-ps4-windows10pro-fast | 00:51:13<br> clang-ppc64be-linux-lnt                          | 00:52:19<br> lld-x86_64-win7                                  | 00:55:32<br> clang-s390x-linux                                | 01:03:59<br> clang-x64-windows-msvc                           | 01:05:26<br> clang-cmake-x86_64-avx2-linux-perf               | 01:07:30<br> sanitizer-x86_64-linux-android                   | 01:08:08<br> clang-ppc64le-rhel                               | 01:08:41<br> sanitizer-x86_64-linux-fast                      | 01:09:57<br> clang-cmake-aarch64-global-isel                  | 01:16:44<br> clang-cmake-aarch64-quick                        | 01:17:21<br> clang-ppc64be-linux-multistage                   | 01:19:32<br> llvm-clang-x86_64-expensive-checks-win           | 01:22:06<br> sanitizer-x86_64-linux-bootstrap-msan            | 01:28:02<br> sanitizer-x86_64-linux-bootstrap-ubsan           | 01:42:37<br> clang-s390x-linux-lnt                            | 01:43:18<br> clang-cmake-armv7-lnt                            | 01:51:58<br> clang-ppc64le-linux-lnt                          | 02:04:37<br> clang-ppc64le-linux                              | 02:20:21<br> clang-cmake-armv7-global-isel                    | 02:33:38<br> sanitizer-x86_64-linux-bootstrap                 | 02:36:32<br> sanitizer-x86_64-linux                           | 02:38:46<br> clang-cmake-armv8-lld                            | 03:17:45<br> clang-with-thin-lto-ubuntu                       | 03:26:41<br> ppc64le-lld-multistage-test                      | 03:38:38<br> sanitizer-ppc64be-linux                          | 03:50:20<br> clang-cmake-aarch64-lld                          | 03:57:13<br> clang-x64-ninja-win7                             | 04:02:59<br> clang-cmake-aarch64-full                         | 04:25:07<br> clang-s390x-linux-multistage                     | 05:05:17<br> clang-with-lto-ubuntu                            | 05:33:04<br> clang-native-arm-lnt-perf                        | 05:39:44<br> sanitizer-ppc64le-linux                          | 06:24:15<br> clang-ppc64le-linux-multistage                   | 07:03:26<br> clang-cmake-thumbv7-full-sh                      | 11:07:09<br> clang-cmake-armv7-full                           | 12:49:50<br> polly-arm-linux                                  | 13:54:25<br> reverse-iteration                                | 16:46:17<br> aosp-O3-polly-before-vectorizer-unprofitable     | 25:53:23<br> clang-cmake-armv7-selfhost-neon                  | 27:31:43<br> clang-cmake-armv7-selfhost                       | 27:37:58<br> lld-x86_64-darwin13                              | 30:44:20<br> clang-hexagon-elf                                | 36:05:48<br>(76 rows)<br></span></div>