[英]Tweepy not returning the given amount of tweets
我有以下代码
api = tweepy.API(auth,wait_on_rate_limit=True)
for tweet in tweepy.Cursor(api.search,
tweet_mode="extended",
q=query + " exclude:retweets").items(11000):
hashtags = "#" + " #".join([hashtag['text'] for hashtag in tweet.entities.get('hashtags')])
print(i)
if tweet.place:
tweet_place = tweet.place.full_name + ', ' + tweet.place.country_code
else:
tweet_place = "Not Geo-tagged"
i += 1
csvWriter.writerow([tweet.id, tweet.full_text.encode('utf-8'), tweet.created_at, tweet.lang, tweet.retweet_count, tweet.favorite_count, tweet_place, tweet.user.id, tweet.user.screen_name, tweet.user.followers_count, tweet.user.friends_count, tweet.user.created_at, tweet.user.favourites_count, tweet.user.statuses_count, tweet.user.lang, tweet.user.verified, tweet.user.location])
我正在尝试使用特定的搜索查询获取 11000 条推文,但一段时间后它会引发以下错误:
Traceback (most recent call last):
.............
ConnectionResetError: [Errno 54] Connection reset by peer
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
.............
urllib3.exceptions.ProtocolError: ('Connection aborted.', ConnectionResetError(54, 'Connection reset by peer'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
.............
requests.exceptions.ConnectionError: ('Connection aborted.', ConnectionResetError(54, 'Connection reset by peer'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
.............
tweepy.error.TweepError: Failed to send request: ('Connection aborted.', ConnectionResetError(54, 'Connection reset by peer'))
早些时候它发生在大约 2500 条推文中,但在更改查询后,它开始在大约 5000 条推文中发生。 知道什么是错的,我该如何解决?
这很可能是因为您超过了允许的推文数量,您可以一次/每 15 分钟拉取
在这里查看更多信息。
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.