词法分析器 Lexer ; Tokenizer
词法分析程序 lexer ; [计] lexical analyzer
分词算法 Word segmentation algorithm ; Chinese words automatic segmenting
汉语词法分析系统 ICTCLAS
词法分析系统 IRLAS ; ICTCLAS
英文分词算法 Porter stemmer
词法分析 Lexer ; Accidence Analysis ; lexical ; [计] Lexical Analysis
解析器-词法分析器 Parser-Lexer combination
口诉言词评分法 Verbal Rating Scale ; VRS
原词评分法 the exact word method
该方法建立在词法和句法基础上，从语境角度分析歧义字段，提高分词准确率。
The method improves the accuracy of word segmentation, by combining morphology and syntax with language situation.
前者涉及到词法、句法、语义分析，包括汉语分词、词性标注、注音、命名实体识别、新词发现、句法分析、词义消歧等。
The former includes Chinese word segmentation, part - of - speech tagging, pinyin tagging, named entity recognition, new word detection, syntactic parsing, word sense disambiguation, etc.
前者涉及到词法、句法、语义分析，包括汉语分词、词性标注、注音、命名实体识别、新词发现、句法分析、词义消歧等。
The former includes Chinese word segmentation, part-of-speech tagging, pinyin tagging, named entity recognition, new word detection, syntactic parsing, word sense disambiguation, etc .
应用推荐