Twitter Analysis in Java

Question

I have a zip file with the ids of the Twitter stream S. How can I load these ids and then complete the dataset by downloading the original tweets of the dataset using Java and Lucene? For reduce the space and the complexity of the dataset it is required to download at least 5% of tweets in a uniform way, check that the tweet is in English and store the data in a compressed form.

Answer 1

You can use Twitter4j library in order to get tweets by IDs. So, stream the provided IDs inside the file and then download tweets by these IDs through Twitter4j. Ofcourse, if you need 5% only, you'll get a subset of the tweets