Editing Lexical analysis (section)

== External links ==
* {{cite journal |url= http://people.cs.nctu.edu.tw/~wuuyang/homepage/papers/applicability2002.ps |first1= W. |last1= Yang |first2= Chey-Woei |last2= Tsay |first3= Jien-Tsai |last3= Chan |title= On the applicability of the longest-match rule in lexical analysis |journal= Computer Languages, Systems & Structures |volume= 28 |issue= 3 |pages= 273–288 |date= 2002 |id= NSC 86-2213-E-009-021 and NSC 86-2213-E-009-079 |doi= 10.1016/S0096-0551(02)00014-0 |url-access= subscription }}
* {{cite web |url= https://www.ibm.com/developerworks/community/blogs/nlp/entry/tokenization |title= The Art of Tokenization |first= Craig |last= Trim |date= Jan 23, 2013 |publisher= IBM |work= Developer Works |url-status=dead |archive-url=https://web.archive.org/web/20190530155339/https://www.ibm.com/developerworks/community/blogs/nlp/entry/tokenization?lang=en |archive-date=2019-05-30}}
* [http://www.gabormelli.com/RKB/Word_Mention_Segmentation_Task Word Mention Segmentation Task], an analysis

{{Natural Language Processing}}

[[Category:Lexical analysis| ]]
[[Category:Compiler construction]]
[[Category:Programming language implementation]]
[[Category:Parsing]]