Each line in the file will contain a word and its synonyms separated by a space character or some other known token.

文件中的每一行将包含一个单词及其同义词，并且使用空格或其他一些已知的标记分隔。

youdao

During the text segmentation, each word or token is determined for the lexical dictionary.

在文本分割期间，将针对词汇字典确定每个单词或标记。

youdao

The synonyms and the word would be separated by a known token.

该单词及其同义词使用一个已知的标记分隔。

youdao

But the silence was unbroken, and the stillness gave no token, And the only word there spoken was the whispered word "Lenore!"

VOA: special.2009.02.02