我可以在 Python 中查看词法分析器和解析器的中间结果吗？

Question

With the release of Python 3.9, which changed the parser from an LL(1) parser to a PEG-based parser, it got me thinking that I've never seen the lexer or parser for Python (CPython). As I understand it the picture looks like

source -> lexer -> TOKENS
TOKENS -> parser -> AST
AST -> ??? -> pyc file

Is it possible to view these intermediate results (TOKENS, AST, any others I missed)?

Answer 1

ast.parse(some_string) will give you the ast tree. You can then use various methods in the module to print it out or examine it programmatically.