A brief tutorial on parsing and lexing is in order.
应该给出关于解析和词法分析的一个简短指南。
Here is an example of lexing and parsing a sentence.
以下是对一个句子进行词法分析和解析的示例。
This process is known more formally as parsing (or to be more precise, tokenizing, lexing, and parsing).
这个过程更正式的称呼是解析(parsing)(更准确地说,是标记解释(tokenizing)、词法解析(lexing)和语法解析)。
Lexing, to give one definition, is the act of breaking up input into meaningful words (also called lexing tokens or lexemes).
从定义来看,词法分析是将输入内容分解为有意义的单词(也叫做词法分析记号(lexing tokens)或词位(lexemes))的动作。
When lexing is finished, a meaningless stream of data has been transformed into a sequence of words meaningful to the parser.
词法分析结束后,无意义的数据流被转变为一个有意义的单词序列,提供给解析器。
While lexing does not have to be done through regular expressions, they tend to be a handy vehicle through the jungle of programming and data languages.
尽管词法分析不是必须通过正则表达式来完成,但是它们往往可以便捷地解决程序编制和数据语言的难题。
For lexing purposes, this means that the lexer definition of an integer number, for example, can be used to build the lexer definition of a real number and a fraction.
例如,对于词法分析目的而言,这意味着可以用整数的词法分析器定义来构建实数和分数的词法分析器定义。
Tokenizing/Lexing: breaking up a string of characters into meaningful (to the language) chunks, called tokens.
分词/词法分析:分词指将一段字符串破成有意义的(相对于这门语言)小块。
Tokenizing/Lexing: breaking up a string of characters into meaningful (to the language) chunks, called tokens.
分词/词法分析:分词指将一段字符串破成有意义的(相对于这门语言)小块。
应用推荐