[cfe-dev] RFC: Fuzzy parser for highlighting C++

[Matthew Plant]

>This sounds similar to what clang-format does (lib/Format/UnwrappedLineParser.cpp)
– have you looked at that?

He says in the fifth paragraph:

>  clang-format internally has a similar fuzzy parser and is currently more
complete, but not written in a reusable way.


On Wed, Jul 30, 2014 at 10:40 AM, Nico Weber <thakis at chromium.org> wrote:

> This sounds similar to what clang-format does
> (lib/Format/UnwrappedLineParser.cpp) – have you looked at that?
>
>
> On Wed, Jul 30, 2014 at 10:28 AM, Johannes Kapfhammer <
> kapf at student.ethz.ch> wrote:
>
>> Hi all,
>>
>> I am working on a Google Summer of Code project to use the clang lexer for
>> syntax highlighting.  The intended usage is to highlight C++ for LaTeX
>> (papers, presentations), HTML (documentations, wikis) and other formats.
>> My goal is to provide a better alternative to Pygments (which highlights
>> C++
>> on the llvm.org docs) or GNU Source-highlight.  These tools can identify
>> keywords perfectly well, but aren't able to highlight types and functions.
>>
>> To correctly highlight those source snippets, I wrote a fuzzy parser
>> library on
>> top of the clang lexer.  The clang parser cannot be used for this as
>> snippets
>> don't need to be self-contained, e.g. use types or functions which
>> definitions
>> aren't included.
>>
>> The fuzzy parser doesn't understand all language constructs of C++, but
>> enough
>> to produce a reasonably good highlighting.  A sample output produced with
>> LaTeX an be found on github [1] (136 KB).  There's also more documentation
>> about clang-highlight [2] and the fuzzy parser [3].
>>
>> I submitted my work for review on phabricator [4] to get it into
>> clang/tools/extra.
>>
>> The fuzzy parser is a general library that may have some other potential
>> uses
>> beside clang-highlight.  clang-format internally has a similar fuzzy
>> parser
>> and is currently more complete, but not written in a reusable way.
>> Another possible use would be for an auto complete system for editors.
>>
>> Any opinions or suggestions about this project?
>>
>> Best,
>> Johannes
>>
>>   1 :
>> https://github.com/kapf/clang-highlight/blob/master/latex/fuzzyparser.pdf?raw=true
>>   2 :
>> https://github.com/kapf/clang-highlight/blob/master/docs/clang-highlight.rst
>>   3 :
>> https://github.com/kapf/clang-highlight/blob/master/docs/LibFuzzy.rst
>>   4 : http://reviews.llvm.org/D4725
>> _______________________________________________
>> cfe-dev mailing list
>> cfe-dev at cs.uiuc.edu
>> http://lists.cs.uiuc.edu/mailman/listinfo/cfe-dev
>>
>
>
> _______________________________________________
> cfe-dev mailing list
> cfe-dev at cs.uiuc.edu
> http://lists.cs.uiuc.edu/mailman/listinfo/cfe-dev
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/cfe-dev/attachments/20140730/110d6352/attachment.html>