Python requests fails to get webpages

Question

I am using Python3 and the package requests to fetch HTML data.

I have tried running the line

r = requests.get('https://github.com/timeline.json')

, which is the example on their tutorial, to no avail. However, when I run

request = requests.get('http://www.math.ksu.edu/events/grad_conf_2013/')

it works fine. I am getting errors such as

AttributeError: 'MockRequest' object has no attribute 'unverifiable' 
Error in sys.excepthook:

I am thinking the errors have something to do with the type of webpage I am attempting to get, since the html page that is working is just basic html that I wrote.

I am very new to requests and Python in general. I am also new to stackoverflow.

Answer 1

As a little example, here is a little tool which I developed in order to fetch data from a website, in this case IP and show it:

# Import the requests module
# TODO: Make sure to install it first
import requests

# Get the raw information from the website
r = requests.get('http://whatismyipaddress.com')
raw_page_source_list = r.text
text = ''

# Join the whole list into a single string in order
# to simplify things
text = text.join(raw_page_source_list)

# Get the exact starting position of the IP address string
ip_text_pos = text.find('IP Information') + 62

# Now extract the IP address and store it
ip_address = text[ip_text_pos : ip_text_pos + 12]

# print 'Your IP address is: %s' % ip_address
#           or, for Python 3 ...            #
# print('Your IP address is: %s' % ip_address)