PulkitSahu/The-AI-Thread-Engagement
AI Thread Engagement Rate Predictor Dataset This dataset contains a real-world, manually collected sample of 14 threads posted on X (formerly Twitter) under this account between September 2024 and January 2025. Despite its small size, it is an authentic dataset with real engagement metrics, making it ideal for small-scale experiments, educational purposes, and exploratory analysis of how post features influence engagement. π Purpose The dataset is designed toβ¦ See the full description on the dataset page: https://huggingface.co/datasets/PulkitSahu/The-AI-Thread-Engagement.
AI Thread Engagement Rate Predictor Dataset
This dataset contains a real-world, manually collected sample of 14 threads posted on X (formerly Twitter) under this account between September 2024 and January 2025.
Despite its small size, it is an authentic dataset with real engagement metrics, making it ideal for small-scale experiments, educational purposes, and exploratory analysis of how post features influence engagement.
π Purpose
The dataset is designed to help answer:
Can we predict a thread's engagement rate based on its content, structure, and other posting attributes?
Engagement Rate is defined by X as:
The total number of times a user has interacted with a post. This includes all clicks (hashtags, links, usernames, post expansions), reposts, replies, follows, and likes.
π οΈ Collection Methodology
- Data Source: Metrics were collected using X Post Analytics, tracking user engagement, impressions, and other relevant metrics.
- Readability Analysis: Grammarly's data was used to compute the Flesch Reading Ease score and other textual analysis metrics.
π Features Captured
The dataset includes the following columns:
CSV Header Row: id wordcount readingtime(s) readabilityscore postsperthread topiccomplexity mediacount postingtime post_frequency impressions emojis engagements
π Data Cleaning & Transformation
- Basic data cleaning steps were applied.
- Consistency checks ensured no missing or corrupted values.
- Readability scores were normalized, numeric features standardized where necessary.
π Additional Resources
A Jupyter Notebook is available demonstrating:
- Exploratory data analysis (EDA)
- A simple neural network model built to predict engagement rate.
π [Kaggle Notebook Link](https://www.kaggle.com/code/pulkitsahu89/simple-neural-network)
π Potential Use Cases
- Investigate the relationship between post characteristics (e.g., content length, readability, media usage) and engagement.
- Build machine learning models to predict engagement rate.
- Study how readability, timing, and media inclusion affect post performance.
- Experiment with small, real-world datasets for educational purposes.
π License
- License: Apache 2.0
- Usage: Publicly available for research and educational purposes.
- Commercial Use: Not permitted unless explicitly allowed under the license terms.
π’ Source
- Data Source: X Analytics
- Account: PulkitSahu89
