Skip to content

shaypal5/awesome-twitter-data

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

67 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

awesome-twitter-data

Awesome CC0

A list of Twitter datasets and related resources, released under CC0. If you have a resource to add to the list, feel free to open a pull request, or email me at shay.palachy@gmail.com.

The license, when known, is given in {curly brackets}. Dataset size is given in [square brackets] when available.

Dataset entries should use this format when possible:

Name {license} [size] - Availability; short neutral description.

Availability values used in this list:

  • Full text - tweet text or full tweet JSON is available.
  • Tweet IDs - tweet IDs are available and must be hydrated separately.
  • Labelled data - annotations or task labels are available.
  • Metadata - profile, rating, annotation, or derived metadata is available.
  • Benchmark - benchmark tasks, splits, or evaluation labels are available.
  • Graph - user, follow, mention, retweet, list, or other network data is available.
  • By request - the dataset is described publicly but access requires contacting the authors.
  • Partially available - only a documented subset of the original dataset is available.
  • Lost - the dataset is no longer available from a known working source.

Values can be combined when a resource provides multiple data types or access modes.

Prefer primary dataset pages in the dataset sections. Mirrors, warehouses, and broad search pages belong in Other Lists unless they provide a clearly distinct release.

  • twitter-dataset-collector {Apache License 2.0} [Java] - Facilitates the distribution of Twitter datasets by downloading sets of tweets (if still available) using their ids as input.
  • Expand The Edinburgh Twitter FSD Corpus
  • Twitter-ratings {MIT} - A collection of Python scripts to download and extract rating datasets from Twitter for multiple websites.
  • RepLab 2013 Twitter text downloaded - Find it at the bottom of the page.
  • TwitterAPI.io - A real-time Twitter/X data API for collecting tweets, user profiles, followers, advanced search results and the live tweet stream via REST endpoints.
  • Xquik - X/Twitter data extraction platform - 20 bulk tools (followers, replies, quotes, retweets, likes, mentions, lists, communities), REST API, account monitoring, HMAC webhooks.
  • TweetClaw {MIT} [OpenClaw plugin] - Collect X/Twitter data through Xquik from OpenClaw: search tweets and replies, export followers, look up users, monitor tweets, receive webhooks, review media workflows, and run giveaway draws.
  • Learning Multiview Embeddings of Twitter Users
  • Developing Age and Gender Predictive Lexica over Social Media, 2014 - We derive predictive lexica (words and weights) for age and gender using regression and classification models from word usage in Facebook, blog, and Twitter data with associated demographiclabels. The lexica, made publicly available, achieved state-of-the-art accuracy in language based age and gender prediction over Facebook and Twitter, and were evaluated for generalization across social media genres as well as in limited message situations.
  • Predicting the Demographics of Twitter Users from Website Traffic Data
  • Inferring Perceived Demographics from User Emotional Tone and User-Environment Emotional Contrast
  • Mining User Interests to Predict Perceived Psycho-Demographic Traits on Twitter
  • Why Gender and Age Prediction from Tweets is Hard: Lessons from a Crowdsourcing Experiment
  • Who tweets? deriving the demographic characteristics of age, occupation and social class from twitter user meta-data
  • Please check for duplicates first.
  • Keep descriptions short, simple and unbiased.
  • Please make an individual commit for each suggestion
  • Add a new category if needed.
  • Prefer primary dataset pages. Add mirrors, warehouses, and broad search pages to Other Lists unless they provide a clearly distinct release.
  • For datasets, please keep the format when possible: Name {license} [size] - Availability; short neutral description.
  • For Twitter/X datasets, state whether the resource provides full tweet text, tweet IDs only, metadata, graph data, or access by request.
  • Include license and availability details when the source states them. Use {?} only when the license is not clear.
  • If a source is unavailable, add it to Lost or unavailable datasets instead of a live dataset section.

Thank you for your suggestions!

CC0

To the extent possible under law, Shay Palachy has waived all copyright and related or neighboring rights to this work.

Releases

No releases published

Packages

 
 
 

Contributors