AttributeError: ResultSet object has no attribute 'find_all'

Question

I am trying to replicate a web scraping code (from an educational site) for fetching names of Indian States from Wikipedia. I have been getting the "AttributeError: ResultSet object has no attribute 'find_all'" error and hence unable to proceed. I am adding my code here and hoping to find some guidance and help:

#

 #import library to query a website from urllib.request import urlopen #the url is stored in a variable called wiki wiki="https://en.wikipedia.org/wiki/List_of_state_and_union_territory_capitals_in_India" #open the html page and store it in a variable called page page=urlopen(wiki) print(wiki) #import the Beautiful soup functions to parse the data returned from the website from bs4 import BeautifulSoup #parsing the html page stored in variable page and storing it in beautiful soup #format soup=BeautifulSoup(page,['lxml','xml']) print(soup) #using 'prettify' function to structure the html page print(soup.prettify()) #storing all the links in a variable all_links=soup.find_all("a") for link in all_links: print(link.get("href")) #storing all the tables in a variable all_tables=soup.find_all("table") print(all_tables) #storing required data in a variable right_table=soup.find_all('table',{'class':'wikitable sortable plainrowheaders'}) print(right_table) #Generating lists A=[] B=[] C=[] D=[] E=[] F=[] G=[] for row in right_table.find_all("tr"): cells = row.find_all('td') states=row.find_all('th') #To store second column data if len(cells)==6: #Only extract table body not heading A.append(cells[0].find(text=True)) B.append(states[0].find(text=True)) C.append(cells[1].find(text=True)) D.append(cells[2].find(text=True)) E.append(cells[3].find(text=True)) F.append(cells[4].find(text=True)) G.append(cells[5].find(text=True)) 

I am using python 3.6 and Windows 10

Thanks in advance for the help!

Answer 1

What i can see is when you call:

right_table=soup.find_all('table',{'class':'wikitable sortable plainrowheaders'})

the output of this command ie right_table contains an array. You would need to call find_all on it's members(even though it has one element), not on entire thing.

So this line:

for row in right_table.find_all("tr"):

should be changed to:

for row in right_table[0].find_all("tr"):