滤词器在分词之后对标号做进一步处理（最典型的比如去掉标点符号和一些常见词，像"the", "an", "a"）。

The filters do any post-tokenizing work on the tokens (typically dropping out punctuation and commonly occurring words like "the", "an", "a", etc).

youdao

扫描设备经常遇到难词(两种不同的符号识别程序会将其显示成不同的字母)。

The scanners regularly encounter difficult words (those for which two different character-recognition algorithms produce different transliterations).

youdao

语言允许在符号，比如说出的一个词，与我们想要使用的任何想法之间，存在着这种映射关系。

It allows for this map between a symbol, say a spoken word, and any sort of thought we want to use.

youdao

It allows for this map between a symbol, say a spoken word, and any sort of thought we want to use.

语言允许在符号,比如说出的一个词,与我们想要使用的任何想法之间,存在着这种映射关系

耶鲁公开课 - 心理学导论课程节选

That's not meant to be a bad word but suggests being influenced, one might say, in the sense of "open the window and influenza," by those signs that precede it.

这不是个不好的词，只是想要表达影响的意思，人们可能说将一个符号之前的符号称作是“,“打开了窗户，引发了流感“

耶鲁公开课 - 文学理论导论课程节选