A list of Twitter datasets and related resources, released under CC0. If you have a resource to add to the list, feel free to open a pull request, or email me at shay.palachy@gmail.com.
The license, when known, is given in {curly brackets}. Dataset size is given in [square brackets] when available.
Dataset entries should use this format when possible:
Name {license} [size] - Availability; short neutral description.
Availability values used in this list:
- Full text - tweet text or full tweet JSON is available.
- Tweet IDs - tweet IDs are available and must be hydrated separately.
- Labelled data - annotations or task labels are available.
- Metadata - profile, rating, annotation, or derived metadata is available.
- Benchmark - benchmark tasks, splits, or evaluation labels are available.
- Graph - user, follow, mention, retweet, list, or other network data is available.
- By request - the dataset is described publicly but access requires contacting the authors.
- Partially available - only a documented subset of the original dataset is available.
- Lost - the dataset is no longer available from a known working source.
Values can be combined when a resource provides multiple data types or access modes.
Prefer primary dataset pages in the dataset sections. Mirrors, warehouses, and broad search pages belong in Other Lists unless they provide a clearly distinct release.
Table of Contents
- 3 million Russian troll tweets {?} [3m] - Full text; released by 538.
- ArchiveTeam JSON Download of Twitter Stream, 2011 - 2022 [16bn] - Full text; archived Twitter stream JSON dumps.
- Cheng-Caverlee-Lee {?} [5m] - Full text; scraped public Twitter updates used in a geolocation academic project.
- Chirps {Apache License 2.0} [9m] - Full text; news-related tweets, updated daily. Used in the paper "Acquiring Predicate Paraphrases from News Tweets" by Vered Shwartz, Gabriel Stanovsky and Ido Dagan.
- Elon Musk Tweets-Until 4/6/17 - Full text; Elon Musk tweets through April 6, 2017.
- Lerman Twitter 2010 Dataset [2.8m] - Full text; Graph; tweets containing URLs posted during October 2010, plus follower links for active users.
- Trump Tweets, 5/4/09 - 12/5/16 - Full text; Donald Trump tweets from May 4, 2009 to December 5, 2016.
- Twitter_2010 {?} [2m] - Full text; released by Kristina Lerman at USC.
- 72 Hours of #Gamersgate [313K] - Tweet IDs; tweets from a 72-hour #Gamergate collection.
- Arab Spring Twitter Dataset {?} [8m] - Tweet IDs; Arab Spring tweets separated by country, without tweet contents.
- COVID-19 Twitter Dataset {CC0} [100m] - Tweet IDs; COVID-19 chatter from the Twitter Stream. Can also be found on Zenodo.org.
- COVID-19-TweetIDs {CC BY-NC-SA 4.0} [1bn+] - Tweet IDs; COVID-19 related research collection.
- CoVaxxy {CC-BY 4.0} [198m] - Tweet IDs; COVID-19 vaccine discourse.
- CrisisLexT26 [28k] - Tweet IDs; Labelled data; crisis-related tweets for 26 crisis events.
- CrisisNLP [?] - Tweet IDs; crisis-related datasets for NLP and humanitarian response research.
- GeoCoV19 {CC-BY 4.0} [500m+] - Tweet IDs; geolocated COVID-19 tweets.
- Geotagged COVID-19 Twitter Dataset {?} [650k] - Tweet IDs; geotagged COVID-19 tweets from the United States.
- ODPtweets {?} [25m] - Tweet IDs; ODP-categorized tweet IDs and usernames, without redistributed tweet text.
- RepLab 2013 Dataset - Tweet IDs; English and Spanish Twitter data with more than 142,000 tweets.
- TweetsKB {?} [1.5bn] - Tweet IDs; Metadata; large knowledge base with extracted metadata and named entities.
- 2015 New Year's Resolutions - Labelled data; tweets about New Year's resolutions.
- Crowdflower Gender Classifier Data [20k] - Labelled data; Twitter profile gender classifier dataset with username, tweet, profile metadata, image, location, and profile colors.
- First GOP Debate Twitter Sentiment {?} [13k] - Labelled data; tweets about the 2016 Republican debate annotated for sentiment.
- Geoparse Benchmark Open Dataset {BSD-4_Clause} [?] - Labelled data; disaster tweets manually labelled with location entries at building, street, and region levels.
- Hate Speech and Offensive Language {MIT} [24k] - Labelled data; tweets labelled as hate speech, offensive language, or neither.
- Natural Language Processing with Disaster Tweets {?} [10k] - Labelled data; tweets labelled as disaster-related or not disaster-related.
- PHEME rumour scheme dataset {CC-BY 4.0} [?] - Labelled data; Twitter conversation threads annotated for rumour and stance analysis.
- PHEME veracity dataset {CC-BY 4.0} [?] - Labelled data; Twitter rumour conversations annotated for rumour detection and veracity classification.
- Sanders Analytics {?} [5k] - Labelled data; hand-classified tweets across four topics. Use Internet Archive's Wayback Machine to get the data.
- Sanders Analytics Sentiment-labelled tweets {?} [5513] - Labelled data; sentiment-labelled tweets.
- SemEval-2016 Task 6 stance dataset {?} [?] - Labelled data; tweets annotated for stance detection.
- SemEval-2017 Task 4 Twitter sentiment datasets {?} [?] - Labelled data; Twitter sentiment classification datasets used in the SemEval-2017 shared task.
- SenWave {Apache License 2.0} [10k] - Labelled data; tweets annotated with fine-grained COVID-19 sentiment and emotion labels.
- Sentiment140 - Labelled data; automatically labelled using positive and negative emoticons.
- TweetEval {?} [?] - Benchmark; Labelled data; unified Twitter benchmark datasets for seven tweet classification tasks.
- Twitter US Airline Sentiment {?} [14k] - Labelled data; airline-related tweets labelled for positive, neutral, and negative sentiment.
- Weather-sentiment - Labelled data; weather-related tweets annotated for sentiment.
- MovieTweetings {MIT} [725k] - Metadata; live movie rating dataset collected from Twitter.
- Twitter User Sample (Tweets Loud and Quiet) {MPL 2.0} [400k] - Metadata; Twitter account metadata scraped between September 17, 2013 and October 19, 2013 for the "Tweets loud and quiet" article.
- Arizona State University Twitter Data Set [11m] - Graph; Twitter network dataset. Alternate download (via torrent) here.
- ego-twitter [80k] - Graph; 80K nodes and 1.7 million edges.
- Higgs Twitter Dataset {?} [456k] - Graph; Twitter activity and social network data around the July 2012 Higgs boson announcement.
- Kwak10www {?} [41.7m users] - Partially available; Graph; the social graph remains available from the "What is Twitter, a Social Network or a News Media?" paper page, while the full tweet, profile, and trend dataset is otherwise unavailable.
- Max Plank Institute's Twitter Dataset {?} [55m] - Graph; social graph component of a larger dataset with 54,981,152 user accounts and 1,963,263,821 social links.
- Multiple Social Network Views Dataset {?} [5 datasets] - Graph; topical Twitter user-network datasets with manually curated communities and multiple sparse-matrix views.
- soTweet [full] {X} - By request; Graph; full Twitter social graph from 2012, plus anonymized social-click data from 2016.
- The SNAP 2010 Dataset [41m] - Graph; 41m nodes and 1.4 billion edges.
- Twitter 15M {?} [15m] - Graph; Twitter follower network mirrored in the KONECT network collection.
- Twitter Data - NIPS 2012 [81k] - Graph; Twitter circles/lists dataset with node features, circles, and ego networks.
- Twitter Social Graph {?} [41m] - Graph; social graph from the "What is Twitter, a Social Network or a News Media?" paper.
- twitter-2010 at LAW {?} [41m] - Graph; WebGraph-format release of the 2010 Twitter follower graph.
- burger2011 - Lost; 213 million tweets from 18.5 million users in many languages. Collected as part of [John D. Burger, John C. Henderson, George Kim, and Guido Zarrella. 2011. Discriminating gender on Twitter. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, pages 1301–1309].
- calufa2011 - Lost; 200+ million tweets from 13+ million users, 173 GB uncompressed, mysql format (543 million rows). The archive.org copy has been taken down: https://archive.org/details/2011-05-calufa-twitter-sql. Several mentions on HackerNews: https://news.ycombinator.com/item?id=2633384
- fifa2014 - Lost; 86k tweets from 2014 FIFA World Cup. Described here: https://opendata.stackexchange.com/a/4015, previously available from a data-provider which is no longer online (topsy.com). One potential source is https://ankeshanand.carto.com/tables/fifatweets/public, although the data export is not clear.
- Twitter Event Detection Dataset {?} [120m] - Lost; collection of 120 million tweets, with relevance judgements for over 500 events.
- twitter7 - Lost; nearly 580 million Twitter posts from 20 million users from June 2009 to February 2010. Created as part of [J. Yang, J. Leskovec. Temporal Variation in Online Media. ACM International Conference on Web Search and Data Mining (WSDM '11), 2011.].
- Tweet ID Datasets {CC-BY 4.0} - A catalog of Twitter ID (i.e. contentless) datasets that are publicly available on the web.
- Free Twitter Datasets by followthehashtag
- Netzschleuder Twitter networks - A searchable catalog of graph datasets with Twitter-related network entries.
- KONECT Twitter networks - Network dataset catalog with several Twitter graph datasets.
- data.world Twitter datasets - A searchable catalog of Twitter-related datasets on data.world.
- Kaggle Twitter datasets - A searchable catalog of Twitter-related datasets on Kaggle.
- Twitter open datasets - A question on opendata.stackexchange.
- Datasets for PAN's shared tasks on digital text forensics - Not Tweeter, but close.
- twitter-dataset-collector {Apache License 2.0} [Java] - Facilitates the distribution of Twitter datasets by downloading sets of tweets (if still available) using their ids as input.
- Expand The Edinburgh Twitter FSD Corpus
- Twitter-ratings {MIT} - A collection of Python scripts to download and extract rating datasets from Twitter for multiple websites.
- RepLab 2013 Twitter text downloaded - Find it at the bottom of the page.
- TwitterAPI.io - A real-time Twitter/X data API for collecting tweets, user profiles, followers, advanced search results and the live tweet stream via REST endpoints.
- Xquik - X/Twitter data extraction platform - 20 bulk tools (followers, replies, quotes, retweets, likes, mentions, lists, communities), REST API, account monitoring, HMAC webhooks.
- TweetClaw {MIT} [OpenClaw plugin] - Collect X/Twitter data through Xquik from OpenClaw: search tweets and replies, export followers, look up users, monitor tweets, receive webhooks, review media workflows, and run giveaway draws.
- OSU Twitter NLP Tools - A suite of Twitter NLP tools.
- sentimentstwitter {MIT} - Given a tweet (that contains some text), estimate the sentiment (negative or positive) of the tweeter.
- Twitter-L-LDA {GPLv3} - A set of tools for performing Labeled Latent Dirichlet Allocation on textual datasets, with an emphasis on Twitter profiles. Contains tools for analysing the results of model training and inference.
- TwitterGenderPredictor by jtwool - Does what it says. Has a simple package wrapper by Shay Palachy.
- Tools by Alan Ritter - Several Twitter-related tools by Alan Ritter.
- Learning Multiview Embeddings of Twitter Users
- Developing Age and Gender Predictive Lexica over Social Media, 2014 - We derive predictive lexica (words and weights) for age and gender using regression and classification models from word usage in Facebook, blog, and Twitter data with associated demographiclabels. The lexica, made publicly available, achieved state-of-the-art accuracy in language based age and gender prediction over Facebook and Twitter, and were evaluated for generalization across social media genres as well as in limited message situations.
- Predicting the Demographics of Twitter Users from Website Traffic Data
- Inferring Perceived Demographics from User Emotional Tone and User-Environment Emotional Contrast
- Mining User Interests to Predict Perceived Psycho-Demographic Traits on Twitter
- Why Gender and Age Prediction from Tweets is Hard: Lessons from a Crowdsourcing Experiment
- Who tweets? deriving the demographic characteristics of age, occupation and social class from twitter user meta-data
- Twitter sentiment analysis using Python and NLTK
- 72 Hours of #Gamersgate
- A beginner's guide to collecting Twitter data (and a bit of web scraping)
- Please check for duplicates first.
- Keep descriptions short, simple and unbiased.
- Please make an individual commit for each suggestion
- Add a new category if needed.
- Prefer primary dataset pages. Add mirrors, warehouses, and broad search pages to Other Lists unless they provide a clearly distinct release.
- For datasets, please keep the format when possible:
Name{license} [size] - Availability; short neutral description. - For Twitter/X datasets, state whether the resource provides full tweet text, tweet IDs only, metadata, graph data, or access by request.
- Include license and availability details when the source states them. Use {?} only when the license is not clear.
- If a source is unavailable, add it to Lost or unavailable datasets instead of a live dataset section.
Thank you for your suggestions!
To the extent possible under law, Shay Palachy has waived all copyright and related or neighboring rights to this work.
