[cfe-dev] RFC: Fuzzy parser for highlighting C++

[Nico Weber]

This sounds similar to what clang-format does
(lib/Format/UnwrappedLineParser.cpp) – have you looked at that?


On Wed, Jul 30, 2014 at 10:28 AM, Johannes Kapfhammer <kapf at student.ethz.ch>
wrote:

> Hi all,
>
> I am working on a Google Summer of Code project to use the clang lexer for
> syntax highlighting.  The intended usage is to highlight C++ for LaTeX
> (papers, presentations), HTML (documentations, wikis) and other formats.
> My goal is to provide a better alternative to Pygments (which highlights
> C++
> on the llvm.org docs) or GNU Source-highlight.  These tools can identify
> keywords perfectly well, but aren't able to highlight types and functions.
>
> To correctly highlight those source snippets, I wrote a fuzzy parser
> library on
> top of the clang lexer.  The clang parser cannot be used for this as
> snippets
> don't need to be self-contained, e.g. use types or functions which
> definitions
> aren't included.
>
> The fuzzy parser doesn't understand all language constructs of C++, but
> enough
> to produce a reasonably good highlighting.  A sample output produced with
> LaTeX an be found on github [1] (136 KB).  There's also more documentation
> about clang-highlight [2] and the fuzzy parser [3].
>
> I submitted my work for review on phabricator [4] to get it into
> clang/tools/extra.
>
> The fuzzy parser is a general library that may have some other potential
> uses
> beside clang-highlight.  clang-format internally has a similar fuzzy parser
> and is currently more complete, but not written in a reusable way.
> Another possible use would be for an auto complete system for editors.
>
> Any opinions or suggestions about this project?
>
> Best,
> Johannes
>
>   1 :
> https://github.com/kapf/clang-highlight/blob/master/latex/fuzzyparser.pdf?raw=true
>   2 :
> https://github.com/kapf/clang-highlight/blob/master/docs/clang-highlight.rst
>   3 :
> https://github.com/kapf/clang-highlight/blob/master/docs/LibFuzzy.rst
>   4 : http://reviews.llvm.org/D4725
> _______________________________________________
> cfe-dev mailing list
> cfe-dev at cs.uiuc.edu
> http://lists.cs.uiuc.edu/mailman/listinfo/cfe-dev
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/cfe-dev/attachments/20140730/5a1232a5/attachment.html>