编译原理课程写的词法分析程序。该词法分析程序能够读取测试输入文件中的源程序，并将其词法分析的结果即token序列或词法分析错误信息输出到tokenOut.txt中-Compiler theory lexical analysis program written procedures. The lexical analysis program that can read the test input file of the source, and lexical analysis of the results that token sequences or lexical analysis of the error message is output to tokenOut.txt