如何在python中删除标签之间的多余空间或间隙

Question

Hello I am scraping an li tag within a div website from website. And I get the output with lots a space in it how can I remove the extra space from the tag I am using python 3.5.1 and BeautifulSoup for scraping My Output:

[<li>

        GUANGZHOU ADS AUDIO SCIENCE &amp; TECHNOLOGY CO.,LTD.

            </li>, <li>

              SHIMA ADS INDUSTRIAL DISTRICT GUANGZHOU GUANGDONG CHINA

            </li>, <li>

        GUANGDONGGUANGZHOU

            </li>, <li>

              510440

            </li>, <li>

              http://www.adsaudio.cc

            </li>]
[<li>

        GUANGDONG TEXTILES IMPORT &amp; EXPORT COMPANY LTD.

            </li>, <li>

              GUANGDONG ,NO.168 XIAO BEI RD.,GUANGZHOU

            </li>, <li>

        GUANGDONGGUANGZHOU

            </li>, <li>

              510045

            </li>, <li>

              http://www.gdtex.com

            </li>]

And I want the output like

 GUANGZHOU ADS AUDIO SCIENCE & TECHNOLOGY CO.,LTD.
 SHIMA ADS INDUSTRIAL DISTRICT GUANGZHOU GUANGDONG CHINA
 GUANGDONG TEXTILES MANSION,NO.168 XIAO BEI RD.,GUANGZHOU
 GUANGDONG ,NO.168 XIAO BEI RD.,GUANGZHOU

How can I remove the extra space or gap

Answer 1

You can use get_text method from BeautifulSoup

items = soup.find_all("li")
for item in items:
    print item.get_text().strip()

Answer 2

Try using strip on the text you are getting back from Beautiful Soup .

Let's say you are using something like this to extract the text from the li tag: text = soup.find('li').get_text() , then add a call to strip() on text text.strip() and that should remove the whitespaces at both ends.

from bs4 import BeautifulSoup

def get_li_texts(html):
  soup = BeautifulSoup(html)
  li_list = soup.findAll('li')

  li_texts = []
  for li in li_list:
    text = li.get_text().strip()
    li_texts.append(text)
  return li_texts

html = '<li>\n\n        GUANGZHOU ADS AUDIO SCIENCE &amp; TECHNOLOGY CO.,LTD.\n\n            </li>, <li>\n\n              SHIMA ADS INDUSTRIAL DISTRICT GUANGZHOU GUANGDONG CHINA\n\n            </li>, <li>\n\n        GUANGDONGGUANGZHOU\n\n            </li>, <li>\n\n              510440\n\n            </li>, <li>\n\n              http://www.adsaudio.cc\n\n            </li>'
texts = get_li_texts(html)
>> [u'GUANGZHOU ADS AUDIO SCIENCE & TECHNOLOGY CO.,LTD.',
>> u'SHIMA ADS INDUSTRIAL DISTRICT GUANGZHOU GUANGDONG CHINA',
>> u'GUANGDONGGUANGZHOU',
>> u'510440',
>> u'http://www.adsaudio.cc']