So, you've broken your input into a stream of tokens.

这样，您已经将输入拆分为一连串的记号。

youdao

Album sales have plummeted by more than half since 2000, taking away a lucrative earnings stream for musicians and one of the ways that artists have traditionally broken through into the mainstream.

2000年以来，音乐专辑销量暴跌了一半以上，歌手们少了一个赚大钱的路子，也使艺人们少了一个进入主流的传统方式。

youdao

At the same time, his novels of stream of consciousness has developed a school of his own in literature techniques and broken the old Japanese literature tradition.

同时，他的意识流小说在文学技法上独树一帜，打破了日本文学的旧传统。

youdao

Urgent cases, like broken limbs, come in a steady stream.

FORBES: Magazine Article