编译原理实验，一个词法分析器，输入需要分析的单词输出Tokens串。编写比较简单有一定的代表性。-Compiler experiment, a lexical analyzer, enter the word need to analyze the output string Tokens. Relatively simple to prepare a certain level of representativeness.