Reading from the test file into the input characters, resulting in marked token sequence (that is, to generate meaningful independent logical unit).
英
美
- 从测试文件读入输入字符,产生token记号序列(即生成的独立的有意义的逻辑单元)。