如何使用Perl创建网站摘要？

Question

When you share something on Facebook or Digg, it generates some summary of the page. How would I do this in Perl? What algorithms are there?

For example:

If I go to Facebook and tried to share this question as a link: How can I create a website summary with Perl?

It retrieves "Facebook/Digg get website summary? - Stack Overflow" as the title (which is just the title of the page) and [... incomplete question?]

Answer 1

CPAN is your friend.

Some promising looking modules:

• HTML::Summary
• HTML::SummaryBasic
• Lingua::EN::Summarize

Answer 2

Assuming you mean sharing a link...

Usually the summary is written by the user submitting the URL. If you have to write a summary automagically this can be achieved by:

• Using the first 100 or so characters of the document body (in itself not easy)
• Using metadata like the description or keywords (often empty or spammed)
• Context-relevant summaries like recreating Google snippets (sorry its PHP but simple)
• Tags/keywords from the document using something like the Yahoo Keyword Extractor API or your own keyword density function

Your best bet is to ask the user!

Hope that helps somewhat :)

Answer 3

基本上，您想抓取URL并找到“最重要的段落”，它可能是第一个<h2>或<h1>之后的第一个<div>或<p>元素，具体取决于页面的布局。

Answer 4

您可以检查并查看页面上是否有元描述，但这使您不受编写元描述的任何人的影响。