Python 3.4-从pastebin.com下载新上传的文本文件

Question

I want to download text files from pastebin.com. Once I start the program it should look for text files that are being uploaded and "download" them once they're uploaded. I know how to "download" them but not how to tell Python to click on one of the public files on http://pastebin.com/archive and then click on the "raw"-button to open a new tab that contains the "raw" content.

I googled a lot but literally nothing came up that would help me.

Thanks

Answer 1

Well, a program doesn't know how to "click" anything :). In order to retrieve information from a page, you simply need to send a GET request at the correct url. In your case, that would be http://pastebin.com/raw/4ffLHviP or any other code of the pastebin you want to download. You can retrieve codes manually, or eg by applying text parsers (regex, beautifulsoup...) on the archive page .

Note that, there is an API for scraping Pastebin (see http://pastebin.com/scraping ). It is strongly recommended, if you want to extract consequent content from them, to use it. It is more "polite", may offer better service, and will avoid you to be blacklisted.

Answer 2

To choose a file you simply do the following:

1. Visit the link of the file, ex. http://pastebin.com/B8A6L7Zt
2. The raw content is already on that page, namely inside <textarea id='paste_code'>...</textarea> . So you just cut this content off, using regex for example.