[all-commits] [llvm/llvm-project] 4a219b: Fix a bug in the .mlir lexer, where a \0 character...

[Chris Lattner via All-commits]

  Branch: refs/heads/master
  Home:   https://github.com/llvm/llvm-project
  Commit: 4a219bf7ff6fbe5cbd3b0c2120c8fe471e3f60fa
      https://github.com/llvm/llvm-project/commit/4a219bf7ff6fbe5cbd3b0c2120c8fe471e3f60fa
  Author: Chris Lattner <clattner at nondot.org>
  Date:   2020-03-23 (Mon, 23 Mar 2020)

  Changed paths:
    M mlir/lib/Parser/Lexer.cpp
    M mlir/lib/Parser/Token.cpp
    M mlir/lib/Parser/Token.h
    M mlir/lib/Parser/TokenKinds.def
    M mlir/test/IR/parser.mlir

  Log Message:
  -----------
  Fix a bug in the .mlir lexer, where a \0 character in a file is treated as a colon (due to an accidental fall through) instead of whitespace.

Summary:
While here, simplify the lexer a bit by eliminating the unneeded 'operator'
classification of certain sigils, they can just be treated as 'punctuation'.

Reviewers: rriddle!

Subscribers: mehdi_amini, rriddle, jpienaar, burmako, shauheen, antiagainst, nicolasvasilache, arpith-jacob, mgester, lucyrfox, liufengdb, Joonsoo, llvm-commits

Tags: #llvm

Differential Revision: https://reviews.llvm.org/D76647