[英]Removal of regex terminal from AST returned by lark-parser
我有兴趣使用lark
解析网站爬虫的典型 output 。 这是基于我自己的 github 网站的一些示例 output 的示例:
--------------------------------------------------------------------
All found URLs:
https://awa5114.github.io/2021/01/12/#step-2-select-location-and-environment-for-new-project
https://awa5114.github.io/2021/01/12/mypy-pycharm.html
https://awa5114.github.io/2021/01/12/#step-6-test-the-template-on-a-script
--------------------------------------------------------------------
All local URLs:
https://awa5114.github.io/2021/01/12/#step-2-select-location-and-environment-for-new-project
https://awa5114.github.io/2021/01/12/mypy-pycharm.html
--------------------------------------------------------------------
All foreign URLs:
https://github.com/awa5114
https://github.com/jekyll/jekyll
https://github.com/jekyll/minima
--------------------------------------------------------------------
All broken URLs:
我正在使用以下语法:
start: section~4
section: (bar "All " descriptor " URLs:" link_list)
link_list: (url)*
descriptor: "found" | "local" | "foreign" | "broken"
url: /.+/
bar: /-{68}/
%import common.NEWLINE
%ignore NEWLINE
在结果树上调用pretty
会产生以下结果:
start
section
bar --------------------------------------------------------------------
descriptor
link_list
url https://awa5114.github.io/2021/01/12/#step-2-select-location-and-environment-for-new-project
url https://awa5114.github.io/2021/01/12/mypy-pycharm.html
url https://awa5114.github.io/2021/01/12/#step-6-test-the-template-on-a-script
section
bar --------------------------------------------------------------------
descriptor
link_list
url https://awa5114.github.io/2021/01/12/#step-2-select-location-and-environment-for-new-project
url https://awa5114.github.io/2021/01/12/mypy-pycharm.html
section
bar --------------------------------------------------------------------
descriptor
link_list
url https://github.com/awa5114
url https://github.com/jekyll/jekyll
url https://github.com/jekyll/minima
section
bar --------------------------------------------------------------------
descriptor
link_list
这看起来没问题,但我不想在我的树中包含终端bar
。 我怎样才能做到这一点? 我浏览了文档并尝试使用下划线和/或问号在前面的bar
,但由于某种原因,这无济于事......
其实我现在才发现。 做到这一点的方法不仅是在bar
前面加上下划线,而且将其变为大写,如下所示:
start: section~4
section: (_BAR "All " descriptor " URLs:" link_list)
link_list: (url)*
descriptor: "found" | "local" | "foreign" | "broken"
url: /.+/
_BAR: /-{68}/
%import common.NEWLINE
%ignore NEWLINE
这导致以下树:
start
section
descriptor
link_list
url https://awa5114.github.io/2021/01/12/#step-2-select-location-and-environment-for-new-project
url https://awa5114.github.io/2021/01/12/mypy-pycharm.html
url https://awa5114.github.io/2021/01/12/#step-6-test-the-template-on-a-script
section
descriptor
link_list
url https://awa5114.github.io/2021/01/12/#step-2-select-location-and-environment-for-new-project
url https://awa5114.github.io/2021/01/12/mypy-pycharm.html
section
descriptor
link_list
url https://github.com/awa5114
url https://github.com/jekyll/jekyll
url https://github.com/jekyll/minima
section
descriptor
link_list
如果在lark-parser
文档中明确这一点会很好......
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.