执行此匹配的第一步叫做扫描或词法分析。
The first step in performing this match is called scanning, or lexical analysis.
扫描，也称词法分析。
词性标注是词法分析的基础。
扫描程序有时又把它称为词法分析程序。
在索引更新过程中，词法分析确定文档中单词的词元。
During index update processing, the lexical analysis identifies the lemmas of the words in the document, and the analysis adds this information to the text index.
以下是对一个句子进行词法分析和解析的示例。
应该给出关于解析和词法分析的一个简短指南。
转换图是用于词法分析器和解析器的公共实现。
Transition diagrams are a common implementation for lexers and parsers.
和亚历克斯词法分析程序如何解析c风格的评论吗？
这门语言简单到甚至不需要有一个符号表来进行词法分析。
The language is simple enough that it does not even require a symbol table to parse.
这是一个词法分析程序，能够区分标识符、数字、表达式。
This is a lexical analysis procedure and can distinguish identifier, figures and expression.
词法分析是机器翻译的第一阶段，是后续分析-转换的基础。
Morphological analysis, the first step of machine translation, is basic for further analysis and convert.
Lex是一种词法分析工具，它可以用来从源文本识别特定结构的文本字符串。
Lex is a lexical analysis tool that can be used to identify specific text strings in a structured way from source text.
源语分析是机器翻译的核心，包括词法分析、句法分析和语义分析。
Source language analysis is core of MT, and includes morphology analysis, parsing and semantic analysis.
这一部分包括词法分析，语法分析，语义分析和生成目标代码四个部分。
This part contains accidence analyzing, phrasing analyzing, semantic analyzing and creating aim code.
语法分析器完成词法分析和语法分析，建立具有多维语法结构的语法树。
The syntactic analyzer makes lexical analysis and syntactic analysis on the query, and sets up syntactic tree from the structure of the query.
该语法分析器有四个部件组成，分词程序、词法分析、语法分析和语义预置。
There are four components of the parser, word process, lexical analysis, syntax analysis and semantic preferences.
译码过程完成词法分析、语法分析和语义分析，并在此基础上生成中间代码。
The coding process accomplishes accidence analysis, syntax analysis, and semantic analysis and transitional codes are generated on it.
因此，Perl5之上的P：RD是一个解析器与词法分析器的强大组合。
Thus, p: : RD on top of Perl 5 is a powerful parser and lexer combination.
分词/词法分析：分词指将一段字符串破成有意义的（相对于这门语言）小块。
Tokenizing/Lexing: breaking up a string of characters into meaningful (to the language) chunks, called tokens.
词法分析结束后，无意义的数据流被转变为一个有意义的单词序列，提供给解析器。
When lexing is finished, a meaningless stream of data has been transformed into a sequence of words meaningful to the parser.
在下节(“词法分析”)中使用的BNF都是词法定义，以后的章节是句法定义。
All USES of BNF in the next chapter (' lexical Analysis') are lexical definitions; USES in subsequent chapters are syntactic definitions.
作为一种专用的编译工具，LEX的源程序简单，编译后生成的词法分析程序效率高。
Being a special compile tool, the source program of lex is simple. The compiled lexical analyzer constructed by lex has high efficiency.
Perl5提供了非内置的解析工具，但是它没有通过正则表达式提供词法分析工具。
Perl 5 offers no built-in parsing facilities, but it does offer lexing facilities through regular expressions.
本系统针对源程序进行词法分析、语法分析、出错检测，并最终生成自定义的目标代码。
The system carrys through lexical analysis, grammar analysis, fluffing check and finally creating user-defined aim code.
同时还对词法分析、语法分析、预处理技术进行了讨论，并且提出一种同步复制的机制。
Meanwhile, other techniques, like word analysis, parsing, and pretreatment technology are discussed in this paper and a real-time synchronization method is presented.
类库在编译程序的面向对象构造过程中起重要作用，词法分析类库是编译类库的重要组成部分。
Class library plays the vital role in the construction of compiler by object-oriented method and lexical analysis class library is an important part of object-oriented compiling class library.
尽管词法分析不是必须通过正则表达式来完成，但是它们往往可以便捷地解决程序编制和数据语言的难题。
While lexing does not have to be done through regular expressions, they tend to be a handy vehicle through the jungle of programming and data languages.
第一个目的是改进解析ViewState字符串时进行词法分析的效率，因为此时不再需要匹配字符或解析标记。
First, it improves the efficiency of the lexical analysis during the parsing of the view state string since there is no longer any need to match characters or parse tokens.
在状态转换图的基础上，构造词形表，为每个状态设计一段处理程序，使词法分析能从字符串中识别单词。
At the base of converted-state chart, building morphology table, designing a section of program for every status, in order to enable lexical analysis to recognize word from character string.
应用推荐