词法分析程序。读入一段程序代码，通过词法分析程序将其转化为token串。是编译原理的重要一步。-Lexical analysis program. Read a section of program code, through lexical analysis procedure to string into a token. The principle is an important step in the compiler.