从网页复制文本

Question

Let's say we have a website speedywap.com

When I open the website in my browser and then I copy the page to the clipboard and when I paste it in my notepad (windows) only text remains. All the code is removed except for the text that was in links etc (ie displayed on the screen).

I want to do something similar with php because I am trying to create a keyword density analyser. So I want something that is able to just keep the text from a webpage that is displayed on the screen.

My server is running apache, php, centos and mysql

Answer 1

<?php
$content = file_get_contents('http://speedywap.com');
echo $content;
?>

you can use strip_tags to strip tags from it then you are just left with text.

Answer 2

For a very naïve start, you can use this:

<?php

echo strip_tags(file_get_contents('http://speedywap.com'));

?>

Answer 3

function curl($url){
    $ch = curl_init();
    curl_setopt($ch, CURLOPT_URL,$url);
    curl_setopt($ch, CURLOPT_RETURNTRANSFER,1);
    return curl_exec($ch);
    curl_close ($ch);
}

$html = curl('http://speedywap.com');

cURL is many times faster then fgc. You can use strip_tags but that doesnt guarantee anything, only way is to manually parse the page, using str_replace, preg_replace etc.

This is what you get using strip_tags : http://pokit.etf.ba/get/47a07bd62ea42dd3d447f060c01ccfb5.png

Answer 4

在此开发您的代码 ->http://www.barattalo.it/2010/03/01/php-curl-bot-to-update-facebook-status/

Answer 5

Use file_get_contents or curl if you want to get fancy.

<?php
$content = file_get_contents('http://speedywap.com');
echo $content; // or analyze, or whatever

Answer 6

You can use file_get_contents('http://www.speedywap.com/'); to get the page source and then use some filters/regular expressions to get the text you need.

Answer 7

您还可以使用strip_tags ： http : //php.net/manual/en/function.strip-tags.php

Answer 8

strip_tags will not remove or replace things like the HTML space (   ), £ , – , etc. from the content like you need, as you say, a browser copy ( Ctrl + A , Ctrl + C ) and paste into notepad. You will have to write specific code to replace each one like:

str_replace('& nbsp;',' ',$mytext); 
str_replace('& ndash;','-',$mytext);

etc. to handle these. I needed to convert content created by users within TinyMCE , which allows formatting text, to plain text for a client. A PHP command that goes beyond strip_tags to do this would be great to have but I can't find one.