python：自动化网络任务

Question

how can i automate web tasks with python

what i am trying to do is..

make the script open a forum thread url and post the text i wrote in the script and multiply it with more urls and hopefully browsing them randomly and doing the same task

eg

urllist : example.txt
goto random url
do the task
repeat

can someone give me ideas to where to start and which programs i can use to entegrate with the browser?

i have basic knowledge in python i just need to know what information to learn to complete a script like this

im trying to improve myself

Answer 1

The first thing that comes to mind for your goal is Selenium: http://selenium-python.readthedocs.io/getting-started.html

It can simulate human behavior (including login to site) and locate certain elements (then you can click/hover on them or download an image, for example). What's more - it can be used with PhantomJS (headless browser), so that you will not see the actual browser window. More info here: https://realpython.com/blog/python/headless-selenium-testing-with-python-and-phantomjs/

Selenium has built-in HTML parsing tools as well, so you will not need any extra libs like Beautiful Soup for parsing.