[llvm-dev] LLD status update and performance chart

[Pete Cooper via llvm-dev]

Hi Rui

I agree separating the components out in to libraries only makes sense when there is a clear reason to do so.  However, just this year there was a very involved discussion about what it means to be a library.  Specifically, I don't think your current 'main-as-library' argument is valid while you call exit or (if you) rely on mutable global state.  Having a single entry point via a main function is fine, but that function cannot then kill the process which its linked in to.

If you want  context then the relevant piece of the thread is http://lists.llvm.org/pipermail/llvm-dev/2016-January/093760.html <http://lists.llvm.org/pipermail/llvm-dev/2016-January/093760.html>.

Arseny summarized things very well there, so i'll just quote him at the end here.  I understand that you and others want to first write a fast linker tool and i don't think anyone has any problem with that, but there is also a clear desire from folks to have it be usable as a library and I would hope any patches to do so are accepted, even if they make the code more complex, or slower.

>>> On Thu, Jan 7, 2016 at 7:03 AM, Arseny Kapoulkine via llvm-dev <
>>> llvm-dev at lists.llvm.org <http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev>> wrote:
>>>
>>>> In the process of migrating from old lld ELF linker to new (previously
>>>> ELF2) I noticed the interface lost several important features (ordered by
>>>> importance for my use case):
>>>>
>>>> 1. Detecting errors in the first place. New linker seems to call
>>>> exit(1) for any error.
>>>>
>>>> 2. Reporting messages to non-stderr outputs. Previously all link
>>>> functions had a raw_ostream argument so it was possible to delay the error
>>>> output, aggregate it for multiple linked files, output via a different
>>>> format, etc.
>>>>
>>>> 3. Linking multiple outputs in parallel (useful for test drivers) in a
>>>> single process. Not really an interface issue but there are at least two
>>>> global pointers (Config & Driver) that refer to stack variables and are
>>>> used in various places in the code.
>>>>
>>>> All of this seems to indicate a departure from the linker being useable
>>>> as a library. To maintain the previous behavior you'd have to use a linker
>>>> binary & popen.
Pete
> On Dec 16, 2016, at 10:15 AM, Rui Ueyama via llvm-dev <llvm-dev at lists.llvm.org> wrote:
> 
> I talked several people and found that this is more like a communication issue rather than a technical/philosophical issue. I believe communication problems won't solve themselves. As a person who is on the owners file of LLD, I think I need to say something about that issue. Also, I guess people who were just watching this thread wondered why my happy pre-holiday status report suddenly turned into a heated discussion, and they are probably still wondering what's wrong with LLD. I want to address that, too.
> 
> So, as a project, there is no anti-library policy in LLD. I think this is the misunderstanding one side had. We already provide main-as-a-library feature so that you can embed the linker to your program. We as a project welcome other ideas to export linker features at a well-defined boundary. For example, I think abstracting the file system access so that you can hook file operations could be a well-defined, useful API for those who want to do in-memory linking (I expressed that opinion already in this thread). Just like LLVM, we won't guarantee API compatibility between releases, and we are unlikely to be able to expose deep internals of the linker, but as long as you think you found a reasonable coarse API boundary, there should be nothing preventing you from bringing that to the table.
> 
> On the other hand, as far as I talked, no one who is on the "library" side requested LLD expose deep internals. This is the misunderstanding the other side had. If we as a project said that LLD should not support any library interface at all, they would be upset and speak out loudly, but again, that's not a project policy.
> 
> So, correct me if I'm wrong, but I don't see no serious conflicts here. The conflict I saw in the thread is I believe superficial, and I strongly believe that it could have been addressed calmly and nicely if we have used more words to explain thoughts instead of small number of strong words.
> 
> Hope this helps.
> 
> Rui
> 
> On Fri, Dec 16, 2016 at 1:40 AM, George Rimar via llvm-dev <llvm-dev at lists.llvm.org <mailto:llvm-dev at lists.llvm.org>> wrote:
> >I am on PTO, so slow to respond.
> >
> >Some items that are left:
> >
> >* Debug fission
> >* Single file debug fission
> >* Range extension thunks
> >* All of freebsd links and works
> >* Very good performance when all that is in
> 
> Looks we have initial version of debug fusion implemented.
> r289790, r289810 commits from yesterday did the rest of main job I believe.
> I do not know what is "Single file debug fission" ? (quick googling gives nothing and I never heard about that before I think)
> 
> George.
> _______________________________________________
> LLVM Developers mailing list
> llvm-dev at lists.llvm.org <mailto:llvm-dev at lists.llvm.org>
> http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev <http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev>
> 
> _______________________________________________
> LLVM Developers mailing list
> llvm-dev at lists.llvm.org
> http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-dev/attachments/20161216/076c3388/attachment.html>