[LLVMdev] reducing llc's memory consumption

[Jim Grosbach]

On Jun 26, 2012, at 7:11 AM, Robert Muth <robertm at google.com> wrote:

> 
> We are processing some fairly large, e.g. 10s of MB, bitcode files with llc,
> which result in peak memory use of several GBs.
> We would like to ameliorate this somewhat.
> On one end of the spectrum we could look into reducing the size of common
> data structures and local space optimization.
> On the other end we could try to switch the MCAssembler from a model
> where it processes the entire Module at once, to something more like
> a function at a time.

The assembler has no concept of functions, only labels. As expressions may span arbitrary regions in the assembly and require later fixups, the assembler needs to consider the whole of the output. Consider, for example, X86 branch relaxation.

-Jim

> Does the list have any suggestions what we should look into.
> Important considerations are:
> * anticipated reduction in  memory use
> * likelihood of succeeding
> * upstreamability
> 
> Cheers,
> Robert 
> 
> 
>  
> 
> 
> _______________________________________________
> LLVM Developers mailing list
> LLVMdev at cs.uiuc.edu         http://llvm.cs.uiuc.edu
> http://lists.cs.uiuc.edu/mailman/listinfo/llvmdev

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-dev/attachments/20120626/c061e789/attachment.html>