[llvm-dev] dexter failures in cross-project-tests

[David Blaikie via llvm-dev]

I'm trying to add some test coverage to cross-project-tests (related to the
simplified template names work), and figured I'd start by making sure
everything passes. I fixed some pretty printer issues
(a36032345ed823414fcee0f9aed43628f4320001 - though that makes me wonder: is
any buildbot running these tests, because they look like they've been
failing for a while?) and then some dexter issues.

Anyone know what these dexter failures are about? The first one doesn't
even seem to have the command line arguments right, which seems
concerning/like something's quite broken. The second one gives not much
meaningful/actionable output - and I tried running dexter directly with
--verbose and seeing what it was doing (it didn't print much, but said it
couldn't print the value of a local variable when it was passed to
printf?), tried building the binary with the cflags that are passed to
dexter and the binary ran correctly/was debuggable/I could print the value
of the variable - seems like dexter could be more informative both while
running under lit/the default configuration, and otherwise?

FAIL: cross-project-tests ::
debuginfo-tests/dexter/feature_tests/commands/perfect/dex_declare_file/precompiled_binary/commands.dex
(62 of 104)

******************** TEST 'cross-project-tests ::
debuginfo-tests/dexter/feature_tests/commands/perfect/dex_declare_file/precompiled_binary/commands.dex'
FAILED ********************

Script:

--

: 'RUN: at line 7';
/usr/local/google/home/blaikie/dev/llvm/build/default/bin/clang
/usr/local/google/home/blaikie/dev/llvm/src/cross-project-tests/debuginfo-tests/dexter/feature_tests/commands/perfect/dex_declare_file/precompiled_binary/test.cpp
-O0 -g -o
/usr/local/google/home/blaikie/dev/llvm/build/default/projects/cross-project-tests/debuginfo-tests/dexter/feature_tests/commands/perfect/dex_declare_file/precompiled_binary/Output/commands.dex.tmp

: 'RUN: at line 8';   "/usr/bin/python3.9"
"/usr/local/google/home/blaikie/dev/llvm/src/cross-project-tests/debuginfo-tests/dexter/dexter.py"
test --fail-lt 1.0 -w --builder clang --debugger lldb --cflags "-O0 -glldb"
--binary
/usr/local/google/home/blaikie/dev/llvm/build/default/projects/cross-project-tests/debuginfo-tests/dexter/feature_tests/commands/perfect/dex_declare_file/precompiled_binary/Output/commands.dex.tmp
/usr/local/google/home/blaikie/dev/llvm/src/cross-project-tests/debuginfo-tests/dexter/feature_tests/commands/perfect/dex_declare_file/precompiled_binary/commands.dex
| /usr/local/google/home/blaikie/dev/llvm/build/default/bin/FileCheck
/usr/local/google/home/blaikie/dev/llvm/src/cross-project-tests/debuginfo-tests/dexter/feature_tests/commands/perfect/dex_declare_file/precompiled_binary/commands.dex

--

Exit Code: 2


Command Output (stderr):

--


error: argument --binary: not allowed with argument --builder


usage: DExTer test [-h] [--no-color-output] [--time-report] [-v] [-V] [-w]

                   [--unittest {off,show-failures,show-all}]

                   [--working-directory <file>] [--save-temps]

                   [--fail-lt <float>] [--calculate-average]

                   (--binary <file> | --builder {clang,clang-c,gcc} |
--vs-solution <file>)

                   [--cflags CFLAGS] [--ldflags LDFLAGS]

                   [--lldb-executable <file>] --debugger

                   {dbgeng,lldb,vs2015,vs2017,vs2019} [--max-steps <int>]

                   [--pause-between-steps <seconds>] [--show-debugger]

                   [--arch <architecture>] [--source-root-dir <directory>]

                   [--debugger-use-relative-paths]

                   [--penalty-variable-optimized <int>]

                   [--penalty-misordered-values <int>]

                   [--penalty-irretrievable <int>]

                   [--penalty-not-evaluatable <int>]

                   [--penalty-missing-values <int>]

                   [--penalty-incorrect-values <int>]

                   [--penalty-unreachable <int>]

                   [--penalty-misordered-steps <int>]

                   [--penalty-missing-step <int>]

                   [--penalty-incorrect-program-state <int>]

                   [--results-directory <directory>]

                   [<test-path>]

FileCheck error: '<stdin>' is empty.

FileCheck command line:
/usr/local/google/home/blaikie/dev/llvm/build/default/bin/FileCheck
/usr/local/google/home/blaikie/dev/llvm/src/cross-project-tests/debuginfo-tests/dexter/feature_tests/commands/perfect/dex_declare_file/precompiled_binary/commands.dex


--


********************

FAIL: cross-project-tests ::
debuginfo-tests/dexter/feature_tests/subtools/test/source-root-dir.cpp (91
of 104)

******************** TEST 'cross-project-tests ::
debuginfo-tests/dexter/feature_tests/subtools/test/source-root-dir.cpp'
FAILED ********************

Script:

--

: 'RUN: at line 4';   "/usr/bin/python3.9"
"/usr/local/google/home/blaikie/dev/llvm/src/cross-project-tests/debuginfo-tests/dexter/dexter.py"
test --lldb-executable
"/usr/local/google/home/blaikie/dev/llvm/build/default/bin/lldb" --fail-lt
1.0 -w      --builder 'clang' --debugger 'lldb'      --cflags "-O0 -glldb
-fdebug-prefix-map=/usr/local/google/home/blaikie/dev/llvm/src/cross-project-tests/debuginfo-tests/dexter/feature_tests/subtools/test=/changed"
    --source-root-dir=/usr/local/google/home/blaikie/dev/llvm/src/cross-project-tests/debuginfo-tests/dexter/feature_tests/subtools/test
--debugger-use-relative-paths --
/usr/local/google/home/blaikie/dev/llvm/src/cross-project-tests/debuginfo-tests/dexter/feature_tests/subtools/test/source-root-dir.cpp

--

Exit Code: 2


Command Output (stdout):

--

source-root-dir.cpp: (0.1429)



--


********************
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-dev/attachments/20211026/b158ffd0/attachment.html>