簡體   English   中英

在request.get()中出現錯誤

[英]Getting error in requests.get()

我嘗試使用beautifulsoup而不是使用twitter API來抓取我的twitter帳戶。 我收到一條錯誤消息,指出有效負載字典中的語法無效。 我的代碼是:

    import requests
from bs4 import BeautifulSoup

payload={
":authority":"twitter.com",
":method":"POST",
":path":"/sessions",
":scheme":"https",
"accept":"text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8",
"accept-encoding":"gzip, deflate, br",
"accept-language":"en-US,en;q=0.9",
"cache-control":"max-age=0",
"content-length":"993",
"content-type":"application/x-www-form-urlencoded",
"cookie":"_twitter_sess=BAh7CSIKZmxhc2hJQzonQWN0aW9uQ29udHJvbGxlcjo6Rmxhc2g6OkZsYXNo%250ASGFzaHsABjoKQHVzZWR7ADoPY3JlYXRlZF9hdGwrCKnkoiBhAToMY3NyZl9p%250AZCIlYjBmNmQ0NmY5NTVmMmVkNTgwYjM2NTU0YzQ2NDY4NzA6B2lkIiUwYTg3%250ANzU1MmU3ZmY3ZWE3NjAyYzIwZmU5ZjkxZWQ5OQ%253D%253D--43822fe18903b3578a1f5deaeb232a8186b75e7d;" "personalization_id"="v1_jQItTVsewWTebwVuukbh6g=="; "guest_id"="v1%3A151667100176659384"; "external_referer=padhuUp37zjgzgv1mFWxJzx4vPNPpMnZ52M34anUtp0%3D|0|8e8t2xd8A2w%3D"; "ct0"="6d7781aae304f30bb5d6d0d64fc34ffe"; "_ga"="GA1.2.1441535218.1516671002"; "_gid"="GA1.2.1585412472.1516671002"; "_gat"="1",
"origin":"https://twitter.com",
"referer":"https://twitter.com/login",
"upgrade-insecure-requests":"1",
"user-agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.132 Safari/537.36",
"username":"aaaaaaa",
"password":"ppppppp",
"authenticity_token":"40a1cc3105efeb2f1a978cf97502bc4e8f97580b"

}


res = requests.get("https://twitter.com/login",data=payload)
soup = BeautifulSoup(res.text,"lxml")
print(soup.prettify())
for item in soup.find_all(class_="title"):
    print(item.text)

我在有效載荷的“ cookie”部分說“語法無效”時出錯。 那里有什么錯誤? 請幫我。

更新:我在cookie部分保留了這樣的內容。

"cookie":'"_twitter_sess"="BAh7CSIKZmxhc2hJQzonQWN0aW9uQ29udHJvbGxlcjo6Rmxhc2g6OkZsYXNo%250ASGFzaHsABjoKQHVzZWR7ADoPY3JlYXRlZF9hdGwrCKnkoiBhAToMY3NyZl9p%250AZCIlYjBmNmQ0NmY5NTVmMmVkNTgwYjM2NTU0YzQ2NDY4NzA6B2lkIiUwYTg3%250ANzU1MmU3ZmY3ZWE3NjAyYzIwZmU5ZjkxZWQ5OQ%253D%253D--43822fe18903b3578a1f5deaeb232a8186b75e7d;" "personalization_id"="v1_jQItTVsewWTebwVuukbh6g=="; "guest_id"="v1%3A151667100176659384"; "external_referer=padhuUp37zjgzgv1mFWxJzx4vPNPpMnZ52M34anUtp0%3D|0|8e8t2xd8A2w%3D"; "ct0"="6d7781aae304f30bb5d6d0d64fc34ffe"; "_ga"="GA1.2.1441535218.1516671002"; "_gid"="GA1.2.1585412472.1516671002"; "_gat"="1"'

但是問題是當我打印出soup.prettify()時,它顯示為空白屏幕。

您需要刪除Cookie之間的引號

"_twitter_sess=BAh7CSIKZmxhc2hJQzonQWN0aW9uQ29udHJvbGxlcjo6Rmxhc2g6OkZsYXNo%250ASGFzaHsABjoKQHVzZWR7ADoPY3JlYXRlZF9hdGwrCKnkoiBhAToMY3NyZl9p%250AZCIlYjBmNmQ0NmY5NTVmMmVkNTgwYjM2NTU0YzQ2NDY4NzA6B2lkIiUwYTg3%250ANzU1MmU3ZmY3ZWE3NjAyYzIwZmU5ZjkxZWQ5OQ%253D%253D--43822fe18903b3578a1f5deaeb232a8186b75e7d; personalization_id=v1_jQItTVsewWTebwVuukbh6g==; guest_id=v1%3A151667100176659384; external_referer=padhuUp37zjgzgv1mFWxJzx4vPNPpMnZ52M34anUtp0%3D|0|8e8t2xd8A2w%3D; ct0=6d7781aae304f30bb5d6d0d64fc34ffe; _ga=GA1.2.1441535218.1516671002; _gid=GA1.2.1585412472.1516671002;_gat=1"

暫無
暫無

聲明:本站的技術帖子網頁,遵循CC BY-SA 4.0協議,如果您需要轉載,請注明本站網址或者原文地址。任何問題請咨詢:yoyou2525@163.com.

 
粵ICP備18138465號  © 2020-2024 STACKOOM.COM