如何通过更改URL来检查网页的存在，请查看详细信息？

Question

If we have a URL :

https://www.example.com/123.html

I wish to check if other web pages are present by changing certain portion of URL , in this case we can do by changing numbers.

Hence :

https://www.example.com/124.html 

So how can i do it , say run a script , which checks presence of web pages in this directory by changing , in this case , last three numbers , say from 000 to 999 ?

Answer 1

For formatting the number, you can use format along with a format string in later versions of Python (>=2.7?) or x.zfill(3) in earlier versions. See this question .

For making requests in a loop:

import requests

for x in range(1000):
   page = requests.get('https://www.example.com/{0:03d}.html'.format(X))
   print(page.content)