[lldb-dev] DW_TAG_member extends beyond the bounds error on Linux

Jeffrey Tan via lldb-dev lldb-dev at lists.llvm.org
Mon Mar 28 10:34:18 PDT 2016


Thanks Greg. Yes, as I tried in another thread, the error seems to go away
after patching with this fix.

On Mon, Mar 28, 2016 at 9:33 AM, Greg Clayton <gclayton at apple.com> wrote:

> This seems to have been fixed with the http://reviews.llvm.org/D18008.
>
> > On Mar 28, 2016, at 9:31 AM, Greg Clayton via lldb-dev <
> lldb-dev at lists.llvm.org> wrote:
> >
> > Is it possible for me to see the "biggrep_master_server_async" binary? I
> would like to look at the DWARF and try to figure out what is wrong. It
> seems that this code is what is causing the problem:
> >
> >
> > CompilerType member_clang_type = member_type->GetLayoutCompilerType ();
> > if (!member_clang_type.IsCompleteType())
> >    member_clang_type.GetCompleteType();
> >
> > {
> >    // Older versions of clang emit array[0] and array[1] in the same way
> (<rdar://problem/12566646>).
> >    // If the current field is at the end of the structure, then there is
> definitely no room for extra
> >    // elements and we override the type to array[0].
> >
> >    CompilerType member_array_element_type;
> >    uint64_t member_array_size;
> >    bool member_array_is_incomplete;
> >
> >    if (member_clang_type.IsArrayType(&member_array_element_type,
> >                                      &member_array_size,
> >                                      &member_array_is_incomplete) &&
> >        !member_array_is_incomplete)
> >    {
> >        uint64_t parent_byte_size =
> parent_die.GetAttributeValueAsUnsigned(DW_AT_byte_size, UINT64_MAX);
> >
> >        if (member_byte_offset >= parent_byte_size)
> >        {
> >            if (member_array_size != 1 && (member_array_size != 0 ||
> member_byte_offset > parent_byte_size))
> >            {
> >                module_sp->ReportError ("0x%8.8" PRIx64 ": DW_TAG_member
> '%s' refers to type 0x%8.8" PRIx64 " which extends beyond the bounds of
> 0x%8.8" PRIx64,
> >                                        die.GetID(),
> >                                        name,
> >                                        encoding_form.Reference(),
> >                                        parent_die.GetID());
> >            }
> >
> >            member_clang_type =
> m_ast.CreateArrayType(member_array_element_type, 0, false);
> >        }
> >    }
> > }
> >
> >
> > So we are parsing a member variable, and the member variable's type is
> an array type, and the offset of the member is beyond the parent's type's
> size and yet the array claims to have a valid size.
> >
> > This code is trying to correctly create an CompilerType for a struct
> such as this:
> >
> > struct MyStruct
> > {
> >    size_t num_entries;
> >    Entry entries[0];
> > };
> >
> > Older versions of clang would emit the same DWARF for:
> >
> > struct MyStruct
> > {
> >    size_t num_entries;
> >    Entry entries[0];
> > };
> >
> > or
> >
> > struct MyStruct
> > {
> >    size_t num_entries;
> >    Entry entries[1];
> > };
> >
> > This is bad because in the DWARFASTParserClang we are trying to
> faithfully re-create the type as the user initially created it.
> >
> > This error is trying to say that you have a structure where the byte
> size of "MyStruct" is something like 8 bytes, but "entries" is an array
> that has a valid size (not zero or one) and that the offset of "entries" is
> greater than or equal to 8. If "entries" has a size like:
> >
> > struct MyStruct
> > {
> >    size_t num_entries;
> >    Entry entries[1];
> > };
> >
> > You would expect the member offset for "entries" to be less than or
> equal to the sizeof(MyStruct). If "Entry" is 8 bytes in size, you might
> expect the byte size of "MyStruct" to be 16, and the offset of
> "num_entries" to be 0 and "entries" to be 8. Both offsets are less than or
> equal to the byte size of 16.
> >
> > If I can see the DWARF file I can tell you more. If I can't, you will
> need to step through this code and see why this is triggering. The error
> message is telling you all you need to know to dump the problem. So for
> this error message:
> >
> > error: biggrep_master_server_async 0x10b9a91a: DW_TAG_member
> '_M_pod_data' refers to type 0x10bb1e99 which extends beyond the bounds of
> 0x10b9a901
> >
> > So if you dump the DWARF and look for the DIE at 0x10b9a91a, you will be
> able to see the DWARF that is causing the problem. On MacOSX, I would do
> this:
> >
> > % dwarfdump --debug-info=0x10b9a91a --show-children --show-parents
> biggrep_master_server_async
> >
> > llvm-dwarfdump will dump your entire file and you will need to look
> through a ton of DWARF in the output. You will need to search for
> "0x10b9a91a:" (the offset followed by a colon).
> >
> > So LLDB believes it is pointing out an error in the DWARF that needs to
> be fixed in the compiler. It could be an incorrect error, but I would need
> to see the DWARF in question to know more. Debugging can happen just fine
> if you ignore this error, it is actually more of a warning, but we emit an
> error so users know to file a bug and hopefully get the compiler fixed.
> >
> > Greg
> >
> >> On Mar 26, 2016, at 5:10 PM, Jeffrey Tan via lldb-dev <
> lldb-dev at lists.llvm.org> wrote:
> >>
> >> Sorry, sent to the wrong alias.
> >>
> >> ---------- Forwarded message ----------
> >> From: Jeffrey Tan <jeffrey.fudan at gmail.com>
> >> Date: Sat, Mar 26, 2016 at 3:19 PM
> >> Subject: DW_TAG_member extends beyond the bounds error on Linux
> >> To: llvm-dev at lists.llvm.org
> >>
> >>
> >> Hi,
> >>
> >> While dogfooding our lldb based IDE on Linux, I am seeing a lot of
> variable evaluation errors related to DW_TAG_member which prevents us from
> release the IDE. Can anyone help to confirm if they are known issues? If
> not, any information you need to troubleshoot this issue?
> >>
> >> Here is one example:
> >>
> >> (lldb) fr v
> >> error: biggrep_master_server_async 0x10b9a91a: DW_TAG_member
> '_M_pod_data' refers to type 0x10bb1e99 which extends beyond the bounds of
> 0x10b9a901
> >> error: biggrep_master_server_async 0x10b98edc: DW_TAG_member 'small_'
> refers to type 0x10bb1d9f which extends beyond the bounds of 0x10b98ed3
> >> error: biggrep_master_server_async 0x10baf034: DW_TAG_member '__size'
> refers to type 0x10baf04d which extends beyond the bounds of 0x10baefae
> >> (facebook::biggrep::BigGrepMasterAsync *) this = 0x00007fd14d374fd0
> >> (const string &const) corpus = error: summary string parsing error: {
> >>  store_ = {
> >>     = {
> >>      small_ = {}
> >>      ml_ = (data_ =
> "��UH\x89�H�}�H\x8bE�]ÐUH\x89�H��H\x89}�H\x8bE�H\x89��~\xb4��\x90��UH\x89�SH\x83�H\x89}�H�u�H�E�H���\x9e���H\x8b\x18H\x8bE�H���O\xb4��H\x89ƿ\b",
> size_ = 0, capacity_ = 1441151880758558720)
> >>    }
> >>  }
> >> }
> >> (const string &const) needle = error: summary string parsing error: {
> >>  store_ = {
> >>     = {
> >>      small_ = {}
> >>      ml_ = (data_ = "", size_ = 0, capacity_ = 1080863910568919040)
> >>    }
> >>  }
> >> }
> >> (facebook::biggrep::Options &) options = 0x00007fd133cfb7b0: {
> >>  engine = error: summary string parsing error
> >>  full_lines = true
> >>  user = error: summary string parsing error
> >>  max_bytes = 5000000
> >>  leading_context = 0
> >>  trailing_context = 0
> >>  case_sensitive = true
> >>  client_hostname = error: summary string parsing error
> >>  client_ip = error: summary string parsing error
> >>  skip_logging = false
> >>  client_port = 0
> >>  shards_override = 0
> >>  sample = false
> >>  count = false
> >>  filename_pattern = error: summary string parsing error
> >>  limit = 0
> >>  __isset = {
> >>    engine = true
> >>    full_lines = true
> >>    user = true
> >>    max_bytes = true
> >>    leading_context = true
> >>    trailing_context = true
> >>    case_sensitive = true
> >>    client_hostname = true
> >>    client_ip = true
> >>    skip_logging = true
> >>    client_port = true
> >>    shards_override = true
> >>    sample = true
> >>    count = true
> >>    filename_pattern = true
> >>    limit = true
> >>  }
> >> }
> >> (size_t) recv_timeout = 140536468041728
> >> (std::vector<std::basic_fbstring<char, std::char_traits<char>,
> std::allocator<char>, std::fbstring_core<char> >,
> std::allocator<std::basic_fbstring<char, std::char_traits<char>,
> std::allocator<char>, std::fbstring_core<char> > > >) corpuses = size=0 {}
> >> (std::vector<facebook::biggrep::BigGrepMasterAsync::Revision,
> std::allocator<facebook::biggrep::BigGrepMasterAsync::Revision> >)
> revisions = size=0 {}
> >> (std::vector<facebook::biggrep::BigGrepMasterAsync::RevisionShard,
> std::allocator<facebook::biggrep::BigGrepMasterAsync::RevisionShard> >)
> shards = size=0 {}
> >> (std::string) returnRev = error: summary string parsing error
> >> (<lambda(folly::StringPiece)>) quote = {}
> >> (std::basic_fbstring<char, std::char_traits<char>,
> std::allocator<char>, std::fbstring_core<char> >) desc = {
> >>  store_ = {
> >>     = {
> >>      small_ = {}
> >>      ml_ = (data_ = "", size_ = 73415312, capacity_ = 140536494141696)
> >>    }
> >>  }
> >> }
> >> (folly::EventBase *) eb = 0x00007fd133cfb888
> >> (apache::thrift::concurrency::ThreadManager *) tm = 0x00007fd133cfb570
> >>
> >> I suspect each one may be different root cause. I was able to capture
> one callstack of a small repro:
> >>
> >> Breakpoint 1, DWARFASTParserClang::ParseChildMembers (this=0x8c4520,
> sc=..., parent_die=..., class_clang_type=...,
> class_language=lldb::eLanguageTypeUnknown,
> >>    base_classes=..., member_accessibilities=...,
> member_function_dies=..., delayed_properties=...,
> >>    default_accessibility=@0x7ffdf3888cac: lldb::eAccessPublic,
> is_a_class=@0x7ffdf3888cab: false, layout_info=...)
> >>    at
> /home/engshare/third-party2/lldb/3.8.0.rc3/src/llvm/tools/lldb/source/Plugins/SymbolFile/DWARF/DWARFASTParserClang.cpp:2937
> >> 2937
>      parent_die.GetID());
> >> (gdb) bt
> >> #0  0x00007f103d02533d in
> DWARFASTParserClang::ParseChildMembers(lldb_private::SymbolContext const&,
> DWARFDIE const&, lldb_private::CompilerType&, lldb::LanguageType,
> std::vector<clang::CXXBaseSpecifier*,
> std::allocator<clang::CXXBaseSpecifier*> >&, std::vector<int,
> std::allocator<int> >&, DWARFDIECollection&,
> std::vector<DWARFASTParserClang::DelayedAddObjCClassProperty,
> std::allocator<DWARFASTParserClang::DelayedAddObjCClassProperty> >&,
> lldb::AccessType&, bool&, DWARFASTParserClang::LayoutInfo&) (this=0x8c4520,
> sc=..., parent_die=..., class_clang_type=...,
> class_language=lldb::eLanguageTypeUnknown, base_classes=...,
> member_accessibilities=..., member_function_dies=...,
> delayed_properties=..., default_accessibility=@0x7ffdf3888cac:
> lldb::eAccessPublic, is_a_class=@0x7ffdf3888cab: false, layout_info=...) at
> /home/engshare/third-party2/lldb/3.8.0.rc3/src/llvm/tools/lldb/source/Plugins/SymbolFile/DWARF/DWARFASTParserClang.cpp:2937
> >> #1  0x00007f103d025b84 in
> DWARFASTParserClang::CompleteTypeFromDWARF(DWARFDIE const&,
> lldb_private::Type*, lldb_private::CompilerType&) (this=0x8c4520, die=...,
> type=0xc40a50, clang_type=...)
> >>    at
> /home/engshare/third-party2/lldb/3.8.0.rc3/src/llvm/tools/lldb/source/Plugins/SymbolFile/DWARF/DWARFASTParserClang.cpp:2036
> >> #2  0x00007f103d04c5e8 in
> SymbolFileDWARF::CompleteType(lldb_private::CompilerType&) (this=<optimized
> out>, compiler_type=...)
> >>    at
> /home/engshare/third-party2/lldb/3.8.0.rc3/src/llvm/tools/lldb/source/Plugins/SymbolFile/DWARF/SymbolFileDWARF.cpp:1635
> >> #3  0x00007f103ceff9da in
> lldb_private::ClangASTContext::CompleteTagDecl(void*, clang::TagDecl*)
> (baton=<optimized out>, decl=0xc41bc0)
> >>    at
> /home/engshare/third-party2/lldb/3.8.0.rc3/src/llvm/tools/lldb/source/Symbol/ClangASTContext.cpp:9619
> >> #4  0x00007f103cf03400 in GetCompleteQualType(clang::ASTContext*,
> clang::QualType, bool) (ast=0x7f102c020c30, qual_type=...,
> allow_completion=allow_completion at entry=true) at
> /home/engshare/third-party2/lldb/3.8.0.rc3/src/llvm/tools/lldb/source/Symbol/ClangASTContext.cpp:2632
> >> #5  0x00007f103cf0c99e in
> lldb_private::ClangASTContext::GetNumChildren(void*, bool) (this=0x8c43c0,
> type=<optimized out>, omit_empty_base_classes=<optimized out>) at
> /home/engshare/third-party2/lldb/3.8.0.rc3/src/llvm/tools/lldb/source/Symbol/ClangASTContext.cpp:5067
> >> #6  0x00007f103ce876ad in
> lldb_private::ValueObjectVariable::CalculateNumChildren(unsigned int)
> (this=<optimized out>, max=4294967295)
> >>    at
> /home/engshare/third-party2/lldb/3.8.0.rc3/src/llvm/tools/lldb/source/Core/ValueObjectVariable.cpp:102
> >> #7  0x00007f103ce7759f in
> lldb_private::ValueObject::GetNumChildren(unsigned int) (this=0xc40600,
> max=4294967295)
> >>    at
> /home/engshare/third-party2/lldb/3.8.0.rc3/src/llvm/tools/lldb/source/Core/ValueObject.cpp:778
> >> #8  0x00007f103cd999bd in
> lldb_private::FormatManager::ShouldPrintAsOneLiner(lldb_private::ValueObject&)
> (this=this at entry=0x7f103fe2f300 <GetFormatManager()::g_format_manager>,
> valobj=...) at
> /home/engshare/third-party2/lldb/3.8.0.rc3/src/llvm/tools/lldb/source/DataFormatters/FormatManager.cpp:576
> >> #9  0x00007f103cd9226a in
> lldb_private::DataVisualization::ShouldPrintAsOneLiner(lldb_private::ValueObject&)
> (valobj=...)
> >>    at
> /home/engshare/third-party2/lldb/3.8.0.rc3/src/llvm/tools/lldb/source/DataFormatters/DataVisualization.cpp:42
> >> #10 0x00007f103cdc2167 in
> lldb_private::ValueObjectPrinter::PrintChildrenIfNeeded(bool, bool)
> (this=this at entry=0x7ffdf38892a0, value_printed=<optimized out>,
> summary_printed=<optimized out>) at
> /home/engshare/third-party2/lldb/3.8.0.rc3/src/llvm/tools/lldb/source/DataFormatters/ValueObjectPrinter.cpp:869
> >> #11 0x00007f103cdc1572 in
> lldb_private::ValueObjectPrinter::PrintValueObject() (this=this at entry
> =0x7ffdf38892a0)
> >>    at
> /home/engshare/third-party2/lldb/3.8.0.rc3/src/llvm/tools/lldb/source/DataFormatters/ValueObjectPrinter.cpp:111
> >> #12 0x00007f103ce7102f in
> lldb_private::ValueObject::Dump(lldb_private::Stream&,
> lldb_private::DumpValueObjectOptions const&) (this=this at entry=0xc40600,
> s=..., options=...) at
> /home/engshare/third-party2/lldb/3.8.0.rc3/src/llvm/tools/lldb/source/Core/ValueObject.cpp:3585
> >> #13 0x00007f103d27e5e4 in
> CommandObjectFrameVariable::DoExecute(lldb_private::Args&,
> lldb_private::CommandReturnObject&) (this=0x7d0590, command=...,
> result=...) at
> /home/engshare/third-party2/lldb/3.8.0.rc3/src/llvm/tools/lldb/source/Commands/CommandObjectFrame.cpp:591
> >> #14 0x00007f103cece45d in
> lldb_private::CommandObjectParsed::Execute(char const*,
> lldb_private::CommandReturnObject&) (this=0x7d0590, args_string=<optimized
> out>, result=...) at
> /home/engshare/third-party2/lldb/3.8.0.rc3/src/llvm/tools/lldb/source/Interpreter/CommandObject.cpp:1095
> >> #15 0x00007f103cec9559 in
> lldb_private::CommandInterpreter::HandleCommand(char const*,
> lldb_private::LazyBool, lldb_private::CommandReturnObject&,
> lldb_private::ExecutionContext*, bool, bool) (this=this at entry=0x7a5210,
> command_line=<optimized out>, lazy_add_to_history=lazy_add_to_history at entry=lldb_private::eLazyBoolCalculate,
> result=..., override_context=override_context at entry=0x0,
> repeat_on_empty_command=repeat_on_empty_command at entry=true,
> no_context_switching=false)
> >>    at
> /home/engshare/third-party2/lldb/3.8.0.rc3/src/llvm/tools/lldb/source/Interpreter/CommandInterpreter.cpp:1820
> >> #16 0x00007f103ceca50d in
> lldb_private::CommandInterpreter::IOHandlerInputComplete(lldb_private::IOHandler&,
> std::string&) (this=0x7a5210, io_handler=..., line=...) at
> /home/engshare/third-party2/lldb/3.8.0.rc3/src/llvm/tools/lldb/source/Interpreter/CommandInterpreter.cpp:2976
> >> #17 0x00007f103ce1c733 in lldb_private::IOHandlerEditline::Run()
> (this=0x87d9b0)
> >>    at
> /home/engshare/third-party2/lldb/3.8.0.rc3/src/llvm/tools/lldb/source/Core/IOHandler.cpp:736
> >>
> >>
> >> Really appreciate if there is any fix/workaround I can get over this
> issue and unblock us!
> >>
> >> Jeffrey
> >>
> >> _______________________________________________
> >> lldb-dev mailing list
> >> lldb-dev at lists.llvm.org
> >> http://lists.llvm.org/cgi-bin/mailman/listinfo/lldb-dev
> >
> > _______________________________________________
> > lldb-dev mailing list
> > lldb-dev at lists.llvm.org
> > http://lists.llvm.org/cgi-bin/mailman/listinfo/lldb-dev
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/lldb-dev/attachments/20160328/a9ab4c19/attachment-0001.html>


More information about the lldb-dev mailing list