[llvm] [llvm-cov] Export decision coverage to output json (PR #144335)

LLVM Continuous Integration via llvm-commits llvm-commits at lists.llvm.org
Wed Jun 18 12:10:59 PDT 2025


llvm-ci wrote:

LLVM Buildbot has detected a new failure on builder `ml-opt-rel-x86-64` running on `ml-opt-rel-x86-64-b1` while building `llvm` at step 6 "test-build-unified-tree-check-all".

Full details are available at: https://lab.llvm.org/buildbot/#/builders/185/builds/20421

<details>
<summary>Here is the relevant piece of the build log for the reference</summary>

```
Step 6 (test-build-unified-tree-check-all) failure: test (failure)
******************** TEST 'LLVM :: tools/llvm-cov/binary-formats.c' FAILED ********************
Exit Code: 1

Command Output (stderr):
--
/b/ml-opt-rel-x86-64-b1/build/bin/llvm-profdata merge /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/Inputs/binary-formats.proftext -o /b/ml-opt-rel-x86-64-b1/build/test/tools/llvm-cov/Output/binary-formats.c.tmp.profdata # RUN: at line 6
+ /b/ml-opt-rel-x86-64-b1/build/bin/llvm-profdata merge /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/Inputs/binary-formats.proftext -o /b/ml-opt-rel-x86-64-b1/build/test/tools/llvm-cov/Output/binary-formats.c.tmp.profdata
/b/ml-opt-rel-x86-64-b1/build/bin/llvm-cov show /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/Inputs/binary-formats.macho32l -instr-profile /b/ml-opt-rel-x86-64-b1/build/test/tools/llvm-cov/Output/binary-formats.c.tmp.profdata -path-equivalence=/tmp,/b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/binary-formats.c | /b/ml-opt-rel-x86-64-b1/build/bin/FileCheck /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/binary-formats.c # RUN: at line 7
+ /b/ml-opt-rel-x86-64-b1/build/bin/FileCheck /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/binary-formats.c
+ /b/ml-opt-rel-x86-64-b1/build/bin/llvm-cov show /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/Inputs/binary-formats.macho32l -instr-profile /b/ml-opt-rel-x86-64-b1/build/test/tools/llvm-cov/Output/binary-formats.c.tmp.profdata -path-equivalence=/tmp,/b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/binary-formats.c
/b/ml-opt-rel-x86-64-b1/build/bin/llvm-cov show /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/Inputs/binary-formats.macho64l -instr-profile /b/ml-opt-rel-x86-64-b1/build/test/tools/llvm-cov/Output/binary-formats.c.tmp.profdata -path-equivalence=/tmp,/b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/binary-formats.c | /b/ml-opt-rel-x86-64-b1/build/bin/FileCheck /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/binary-formats.c # RUN: at line 8
+ /b/ml-opt-rel-x86-64-b1/build/bin/llvm-cov show /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/Inputs/binary-formats.macho64l -instr-profile /b/ml-opt-rel-x86-64-b1/build/test/tools/llvm-cov/Output/binary-formats.c.tmp.profdata -path-equivalence=/tmp,/b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/binary-formats.c
+ /b/ml-opt-rel-x86-64-b1/build/bin/FileCheck /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/binary-formats.c
/b/ml-opt-rel-x86-64-b1/build/bin/llvm-cov show /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/Inputs/binary-formats.macho32b -instr-profile /b/ml-opt-rel-x86-64-b1/build/test/tools/llvm-cov/Output/binary-formats.c.tmp.profdata -path-equivalence=/tmp,/b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/binary-formats.c | /b/ml-opt-rel-x86-64-b1/build/bin/FileCheck /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/binary-formats.c # RUN: at line 9
+ /b/ml-opt-rel-x86-64-b1/build/bin/llvm-cov show /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/Inputs/binary-formats.macho32b -instr-profile /b/ml-opt-rel-x86-64-b1/build/test/tools/llvm-cov/Output/binary-formats.c.tmp.profdata -path-equivalence=/tmp,/b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/binary-formats.c
+ /b/ml-opt-rel-x86-64-b1/build/bin/FileCheck /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/binary-formats.c
/b/ml-opt-rel-x86-64-b1/build/bin/llvm-cov show /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/Inputs/binary-formats.v3.macho64l -instr-profile /b/ml-opt-rel-x86-64-b1/build/test/tools/llvm-cov/Output/binary-formats.c.tmp.profdata -path-equivalence=/tmp,/b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/binary-formats.c | /b/ml-opt-rel-x86-64-b1/build/bin/FileCheck /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/binary-formats.c # RUN: at line 10
+ /b/ml-opt-rel-x86-64-b1/build/bin/llvm-cov show /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/Inputs/binary-formats.v3.macho64l -instr-profile /b/ml-opt-rel-x86-64-b1/build/test/tools/llvm-cov/Output/binary-formats.c.tmp.profdata -path-equivalence=/tmp,/b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/binary-formats.c
+ /b/ml-opt-rel-x86-64-b1/build/bin/FileCheck /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/binary-formats.c
/b/ml-opt-rel-x86-64-b1/build/bin/llvm-cov show /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/Inputs/binary-formats.v6.linux64l -instr-profile /b/ml-opt-rel-x86-64-b1/build/test/tools/llvm-cov/Output/binary-formats.c.tmp.profdata -path-equivalence=/tmp,/b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/binary-formats.c | /b/ml-opt-rel-x86-64-b1/build/bin/FileCheck /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/binary-formats.c # RUN: at line 11
+ /b/ml-opt-rel-x86-64-b1/build/bin/llvm-cov show /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/Inputs/binary-formats.v6.linux64l -instr-profile /b/ml-opt-rel-x86-64-b1/build/test/tools/llvm-cov/Output/binary-formats.c.tmp.profdata -path-equivalence=/tmp,/b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/binary-formats.c
+ /b/ml-opt-rel-x86-64-b1/build/bin/FileCheck /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/binary-formats.c
/b/ml-opt-rel-x86-64-b1/build/bin/llvm-profdata merge /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/Inputs/binary-formats.wasm.proftext -o /b/ml-opt-rel-x86-64-b1/build/test/tools/llvm-cov/Output/binary-formats.c.tmp.wasm.profdata # RUN: at line 13
+ /b/ml-opt-rel-x86-64-b1/build/bin/llvm-profdata merge /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/Inputs/binary-formats.wasm.proftext -o /b/ml-opt-rel-x86-64-b1/build/test/tools/llvm-cov/Output/binary-formats.c.tmp.wasm.profdata
/b/ml-opt-rel-x86-64-b1/build/bin/llvm-cov show /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/Inputs/binary-formats.v6.wasm32 -instr-profile /b/ml-opt-rel-x86-64-b1/build/test/tools/llvm-cov/Output/binary-formats.c.tmp.wasm.profdata -path-equivalence=/tmp,/b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/binary-formats.c | /b/ml-opt-rel-x86-64-b1/build/bin/FileCheck /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/binary-formats.c # RUN: at line 18
+ /b/ml-opt-rel-x86-64-b1/build/bin/llvm-cov show /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/Inputs/binary-formats.v6.wasm32 -instr-profile /b/ml-opt-rel-x86-64-b1/build/test/tools/llvm-cov/Output/binary-formats.c.tmp.wasm.profdata -path-equivalence=/tmp,/b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/binary-formats.c
+ /b/ml-opt-rel-x86-64-b1/build/bin/FileCheck /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/binary-formats.c
/b/ml-opt-rel-x86-64-b1/build/bin/llvm-cov export /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/Inputs/binary-formats.macho64l -instr-profile /b/ml-opt-rel-x86-64-b1/build/test/tools/llvm-cov/Output/binary-formats.c.tmp.profdata | /b/ml-opt-rel-x86-64-b1/build/bin/FileCheck /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/Inputs/binary-formats.canonical.json # RUN: at line 20
+ /b/ml-opt-rel-x86-64-b1/build/bin/llvm-cov export /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/Inputs/binary-formats.macho64l -instr-profile /b/ml-opt-rel-x86-64-b1/build/test/tools/llvm-cov/Output/binary-formats.c.tmp.profdata
+ /b/ml-opt-rel-x86-64-b1/build/bin/FileCheck /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/Inputs/binary-formats.canonical.json
/b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/Inputs/binary-formats.canonical.json:36:13: error: CHECK-SAME: expected string not found in input
CHECK-SAME: "version":"2.0.1"
            ^
<stdin>:1:1046: note: scanning from here
{"data":[{"files":[{"branches":[],"expansions":[],"filename":"/tmp/binary-formats.c","mcdc_records":[],"segments":[[4,40,100,true,true,false],[4,42,0,false,false,false]],"summary":{"branches":{"count":0,"covered":0,"notcovered":0,"percent":0},"functions":{"count":1,"covered":1,"percent":100},"instantiations":{"count":1,"covered":1,"percent":100},"lines":{"count":1,"covered":1,"percent":100},"mcdc":{"count":0,"covered":0,"notcovered":0,"percent":0},"regions":{"count":1,"covered":1,"notcovered":0,"percent":100}}}],"functions":[{"branches":[],"count":100,"filenames":["/tmp/binary-formats.c"],"mcdc_records":[],"name":"main","regions":[[4,40,4,42,100,0,0,0]]}],"totals":{"branches":{"count":0,"covered":0,"notcovered":0,"percent":0},"functions":{"count":1,"covered":1,"percent":100},"instantiations":{"count":1,"covered":1,"percent":100},"lines":{"count":1,"covered":1,"percent":100},"mcdc":{"count":0,"covered":0,"notcovered":0,"percent":0},"regions":{"count":1,"covered":1,"notcovered":0,"percent":100}}}],"type":"llvm.coverage.json.export","version":"3.0.0"}
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     ^
<stdin>:1:1047: note: possible intended match here
{"data":[{"files":[{"branches":[],"expansions":[],"filename":"/tmp/binary-formats.c","mcdc_records":[],"segments":[[4,40,100,true,true,false],[4,42,0,false,false,false]],"summary":{"branches":{"count":0,"covered":0,"notcovered":0,"percent":0},"functions":{"count":1,"covered":1,"percent":100},"instantiations":{"count":1,"covered":1,"percent":100},"lines":{"count":1,"covered":1,"percent":100},"mcdc":{"count":0,"covered":0,"notcovered":0,"percent":0},"regions":{"count":1,"covered":1,"notcovered":0,"percent":100}}}],"functions":[{"branches":[],"count":100,"filenames":["/tmp/binary-formats.c"],"mcdc_records":[],"name":"main","regions":[[4,40,4,42,100,0,0,0]]}],"totals":{"branches":{"count":0,"covered":0,"notcovered":0,"percent":0},"functions":{"count":1,"covered":1,"percent":100},"instantiations":{"count":1,"covered":1,"percent":100},"lines":{"count":1,"covered":1,"percent":100},"mcdc":{"count":0,"covered":0,"notcovered":0,"percent":0},"regions":{"count":1,"covered":1,"notcovered":0,"percent":100}}}],"type":"llvm.coverage.json.export","version":"3.0.0"}
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      ^

Input file: <stdin>
Check file: /b/ml-opt-rel-x86-64-b1/llvm-project/llvm/test/tools/llvm-cov/Inputs/binary-formats.canonical.json

-dump-input=help explains the following input dump.

Input was:
<<<<<<
           1: {"data":[{"files":[{"branches":[],"expansions":[],"filename":"/tmp/binary-formats.c","mcdc_records":[],"segments":[[4,40,100,true,true,false],[4,42,0,false,false,false]],"summary":{"branches":{"count":0,"covered":0,"notcovered":0,"percent":0},"functions":{"count":1,"covered":1,"percent":100},"instantiations":{"count":1,"covered":1,"percent":100},"lines":{"count":1,"covered":1,"percent":100},"mcdc":{"count":0,"covered":0,"notcovered":0,"percent":0},"regions":{"count":1,"covered":1,"notcovered":0,"percent":100}}}],"functions":[{"branches":[],"count":100,"filenames":["/tmp/binary-formats.c"],"mcdc_records":[],"name":"main","regions":[[4,40,4,42,100,0,0,0]]}],"totals":{"branches":{"count":0,"covered":0,"notcovered":0,"percent":0},"functions":{"count":1,"covered":1,"percent":100},"instantiations":{"count":1,"covered":1,"percent":100},"lines":{"count":1,"covered":1,"percent":100},"mcdc":{"count":0,"covered":0,"notcovered":0,"percent":0},"regions":{"count":1,"covered":1,"notcovered":0,"percent":100}}}],"type":"llvm.coverage.json.export","version":"3.0.0"}
same:36'0                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          X~~~~~~~~~~~~~~~~~~ error: no match found
same:36'1                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           ?                  possible intended match
...

```

</details>

https://github.com/llvm/llvm-project/pull/144335


More information about the llvm-commits mailing list