<div dir="ltr"><div>Perfect, a 20 minutes after joining and everything is working. Will experiment with this option, otherwise will just use the Python ast module and see how far that takes me.<br><br></div>With Go I'll probably just use their AST module, and I'll wait a while for Rust (spoke to the guys on IRC, it's somewhere on their roadmap).<br><div class="gmail_extra"><br></div><div class="gmail_extra">Finally for C++ libclang should work just fine. Might also do something in the JavaScript world, but will get at least the Python version working before touching that.<br><br>=)<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Jul 6, 2015 at 12:10 PM, Kevin Modzelewski <span dir="ltr"><<a href="mailto:kevmod@gmail.com" target="_blank">kevmod@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hmm I'm not sure; might be best to have the discussion at <a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__gitter.im_vinzenz_libpypa&d=AwMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=Mfk2qtn1LTDThVkh6-oGglNfMADXfJdty4_bhmuhMHA&m=qA3ZaBJviC7BhZ84n7H7DDSHu1RbfbbJpMKgDZMiB1E&s=ZIWY199seuglr49BHdHAKsRlq_2_isx3oGC_aNCoPkc&e=" target="_blank">https://gitter.im/vinzenz/libpypa</a> where you can reach the parser's author.</div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">On Sat, Jul 4, 2015 at 11:08 PM, Alec Taylor <span dir="ltr"><<a href="mailto:alec.taylor6@gmail.com" target="_blank">alec.taylor6@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div><div>Thanks, that looks like an interesting project. How do I build it?<br><br></div>I've tried:<br></div>$ cd libpypa && mkdir build && cd $_ && cmake .. -G 'Unix Makefiles' && make<br><br></div>But that didn't give me the `parser-test` binary for experimenting with (as per your README usage).<br></div><div><div><div class="gmail_extra"><br><div class="gmail_quote">On Sun, Jul 5, 2015 at 9:58 AM, Kevin Modzelewski <span dir="ltr"><<a href="mailto:kevmod@gmail.com" target="_blank">kevmod@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Yep we have <a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_vinzenz_libpypa_&d=AwMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=Mfk2qtn1LTDThVkh6-oGglNfMADXfJdty4_bhmuhMHA&m=qA3ZaBJviC7BhZ84n7H7DDSHu1RbfbbJpMKgDZMiB1E&s=LNaaa-wblTizSGH040T6utN6ixvf4y9vBhoIR5mB0Ko&e=" target="_blank">our own parser</a> and we would love to see other people use it. When we looked around at some other Python parsers we didn't feel like any of them were easy to extract and use on their own, so we wrote our own and I think were able to keep ours well-separated. There are some things that make parsing Python somewhat difficult to do in a fully project-agnostic way: any syntax errors usually get thrown as user-level exceptions, you probably don't want to encode the full set of unicode character names into your parser to handle u"\N{POUND SIGN}", and the parser has to support calling back into Python code for supporting custom encodings requested via "# coding" lines.<div><br></div><div>I think we've done a decent job factoring those things out (they get provided by your project via callbacks), but you do have to provide those features or avoid parsing code that would need them. If you can get the job done by working in Python using the ast module, I would recommend that.</div></div><div><div><div class="gmail_extra"><br><div class="gmail_quote">On Sat, Jul 4, 2015 at 5:58 AM, David Jones <span dir="ltr"><<a href="mailto:djones@xtreme-eda.com" target="_blank">djones@xtreme-eda.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>There is also the Pyston project from Dropbox. Presumably that includes a Python parser.<br><br></div>I'm not affiliated with the project.<br></div><div><div><div class="gmail_extra"><br><div class="gmail_quote">On Sat, Jul 4, 2015 at 2:35 AM, Alec Taylor <span dir="ltr"><<a href="mailto:alec.taylor6@gmail.com" target="_blank">alec.taylor6@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Thanks, happy to of confirmed.<br><br>With that in mind, will use the AST modules provided by the languages (with the exception of libclang for C++).<br><br>Antoine: Am aware of Numba, nice job there BTW. So is there a [decoupled] LLVM parser which I can use to read Python files and analyse objects (including computing their attributes in OO and setattr scenarios)?<br><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Jul 1, 2015 at 10:23 PM, Antoine Pitrou <span dir="ltr"><<a href="mailto:antoine@python.org" target="_blank">antoine@python.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><br>
Hi,<br>
<br>
Alec Taylor <alec.taylor6 <at> <a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gmail.com&d=AwMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=Mfk2qtn1LTDThVkh6-oGglNfMADXfJdty4_bhmuhMHA&m=gFwnrq1A6b4bDGDoXVANrEYyGDZzyOClT35YGuILpnw&s=PFeGy9X8Vy60g44Moeq7LIisLzx1skqCoTyOllso94I&e=" rel="noreferrer" target="_blank">gmail.com</a>> writes:<br>
><br>
> Would be good to have Python, Rust and Go.Are there any LLVM parsers<br>
<span>> around for these popular languages?<br>
<br>
</span>A programming language is much more than a parser and AST. It has<br>
specific semantics, and a runtime (in the case of Python, the runtime is<br>
very large as it hosts a lot of functionality).<br>
<br>
So it wouldn't make much sense to have "just a parser".<br>
<br>
However, if you are looking for an implementation of a subset of Python<br>
using LLVM, you can take a look at Numba: <a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__numba.pydata.org_&d=AwMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=Mfk2qtn1LTDThVkh6-oGglNfMADXfJdty4_bhmuhMHA&m=gFwnrq1A6b4bDGDoXVANrEYyGDZzyOClT35YGuILpnw&s=NZGvzCXyd0A8Yrs45NE2hq5RLlpBSo6pdWk2ul6lkO4&e=" rel="noreferrer" target="_blank">http://numba.pydata.org/</a><br>
<br>
(disclaimer: I am part of the Numba team)<br>
<br>
Regards<br>
<span><font color="#888888"><br>
Antoine.<br>
</font></span><div><div><br>
<br>
_______________________________________________<br>
LLVM Developers mailing list<br>
<a href="mailto:LLVMdev@cs.uiuc.edu" target="_blank">LLVMdev@cs.uiuc.edu</a> <a href="http://llvm.cs.uiuc.edu" rel="noreferrer" target="_blank">http://llvm.cs.uiuc.edu</a><br>
<a href="http://lists.cs.uiuc.edu/mailman/listinfo/llvmdev" rel="noreferrer" target="_blank">http://lists.cs.uiuc.edu/mailman/listinfo/llvmdev</a><br>
</div></div></blockquote></div><br></div></div>
<br>_______________________________________________<br>
LLVM Developers mailing list<br>
<a href="mailto:LLVMdev@cs.uiuc.edu" target="_blank">LLVMdev@cs.uiuc.edu</a> <a href="http://llvm.cs.uiuc.edu" rel="noreferrer" target="_blank">http://llvm.cs.uiuc.edu</a><br>
<a href="http://lists.cs.uiuc.edu/mailman/listinfo/llvmdev" rel="noreferrer" target="_blank">http://lists.cs.uiuc.edu/mailman/listinfo/llvmdev</a><br>
<br></blockquote></div><br></div>
</div></div><br>_______________________________________________<br>
LLVM Developers mailing list<br>
<a href="mailto:LLVMdev@cs.uiuc.edu" target="_blank">LLVMdev@cs.uiuc.edu</a> <a href="http://llvm.cs.uiuc.edu" rel="noreferrer" target="_blank">http://llvm.cs.uiuc.edu</a><br>
<a href="http://lists.cs.uiuc.edu/mailman/listinfo/llvmdev" rel="noreferrer" target="_blank">http://lists.cs.uiuc.edu/mailman/listinfo/llvmdev</a><br>
<br></blockquote></div><br></div>
</div></div></blockquote></div><br></div>
</div></div></blockquote></div><br></div>
</div></div></blockquote></div><br></div></div>