此法分析器代码。从测试文件读入输入字符，产生token记号序列（即生成的独立的有意义的逻辑单元）。 -This method is the code analyzer. Reading from the test file into the input characters, resulting in marked token sequence (that is, to generate meaningful independent logical unit).