[英]Web crawling in F#
I'm working on web crawler in F# and have some question on the subject.我正在使用 F# 开发网络爬虫,并且对这个主题有一些疑问。
Do you need to create a script to crawl in F# or can you create a console application?你需要创建一个脚本来在 F# 中爬行还是你可以创建一个控制台应用程序? I have seen some tutorials, and all of them uses #r (references), which is not possible in a console application?
我看过一些教程,他们都使用#r(参考),这在控制台应用程序中是不可能的? What are the benefits with using F# for web crawling maybe compared to C#?
与 C# 相比,使用 F# 进行网络爬虫有什么好处? I hope someone can shed some light on these questions.
我希望有人可以对这些问题有所了解。
I wrote a web crawler a few years ago.几年前我写了一个网络爬虫。 I used F#.
我用过 F#。 I wrote as a console application.
我是作为控制台应用程序编写的。 the
#r
referenced are used in F# script which is cool but I typically deploy a binary.引用的
#r
用于 F# 脚本,这很酷,但我通常部署一个二进制文件。
I picked F# over C# because it's more productive to me (that is subjective of course) but also because I was developed a DSL in F# to describe what parts of a page interested me.我选择 F# 而不是 C# 是因为它对我来说更有效率(这当然是主观的)而且因为我在 F# 中开发了一个 DSL 来描述我对页面的哪些部分感兴趣。
I used FSharp.Data
to do HTML parsing: http://fsharp.github.io/FSharp.Data/library/HtmlParser.html我用
FSharp.Data
做 HTML 解析: http : FSharp.Data
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.