datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
Pytorch-Code-10K
Hot Coco Training Dataset
A curated collection of 10,625 high-quality PyTorch and Transformers code examples with AI-generated captions. This dataset was specifically built for fine-tuning code-specialized language models like Qimi (Coming soon!)
Dataset Description
This dataset contains Python code snippets sourced from open-source repositories that utilize PyTorch or Hugging Face Transformers. Each sample includes:
code: The raw Python source code (typically… See the full description on the dataset page: https://huggingface.co/datasets/Monster-Code/Pytorch-Code-10K.pytorch-image-models-dependents
pytorch-image-models metrics
This dataset contains metrics about the huggingface/pytorch-image-models package.
Number of repositories in the dataset: 3615
Number of packages in the dataset: 89
Package dependents
This contains the data available in the used-by
tab on GitHub.
Package & Repository star count
This section shows the package and repository star count, individually.
Package
Repository
There are 18 packages that have more than 1000… See the full description on the dataset page: https://huggingface.co/datasets/open-source-metrics/pytorch-image-models-dependents.pytorch-issues-dataset-cleangithub-pytorch-issues
Dataset Card for github-pytorch-issues
Dataset Summary
This dataset is a curated collection of GitHub issues from the PyTorch repository. Each entry includes the issue title, body, user, state, labels, comments, and other relevant fields that are useful for tasks such as text classification, semantic search, and question answering.
Supported Tasks and Leaderboards
The dataset supports the following tasks:
Open-domain Question Answering: Given a user query… See the full description on the dataset page: https://huggingface.co/datasets/mayankpuvvala/github-pytorch-issues.pytorch-issues
Dataset Card for "pytorch-issues"
More Information needed
all-pytorch-codepytorch-semantic-dataset-fixed
PyTorch Semantic Code Dataset
A semantically-enriched Python code dataset combining syntactic tokenization with deep semantic analysis from Language Server Protocol (LSP) tools.
🎯 Overview
This dataset enhances tokenized Python code with semantic embeddings derived from static analysis tools (Tree-sitter + Jedi), providing models with both syntactic and semantic understanding of code symbols. Each token in the code is aligned with rich semantic information including type… See the full description on the dataset page: https://huggingface.co/datasets/ant-des/pytorch-semantic-dataset-fixed.pytorch-issues-datasetpytorchmodelmetadata_with_embeddingspytorch-forum-topics-complete-v2
PyTorch Forum Topics Dataset
This dataset contains topic metadata scraped from the PyTorch Community Forum. It includes comprehensive information about forum topics that can be used for various NLP tasks related to PyTorch and deep learning discussions.
Dataset Structure
Each record in the dataset contains the following fields:
id: Unique topic identifier
title: Topic title
slug: URL-friendly version of the title
posts_count: Number of posts in the topic
reply_count:… See the full description on the dataset page: https://huggingface.co/datasets/AmitPrakash/pytorch-forum-topics-complete-v2.metabric_pycox
Dataset Card for "metabric_pycox"
More Information needed
pytorch_assistant
Dataset Card for pytorch_assistant
This dataset has been created with distilabel.
Dataset Summary
This dataset contains a pipeline.yaml which can be used to reproduce the pipeline that generated it in distilabel using the distilabel CLI:
distilabel pipeline run --config "https://huggingface.co/datasets/dvilasuero/pytorch_assistant/raw/main/pipeline.yaml"
or explore the configuration:
distilabel pipeline info --config… See the full description on the dataset page: https://huggingface.co/datasets/dvilasuero/pytorch_assistant.pytorch-tutorial-168
Dataset Card for "pytorch-tutorial-168"
More Information needed
pytorch-discuss-tutorial-1000
Dataset Card for "pytorch-discuss-tutorial-1000"
More Information needed
annotated_dataset_o3_train_pytorch_tritonpytorch-discuss-tutorial-346
Dataset Card for "pytorch-discuss-tutorial-346"
More Information needed
test-pytorch
Dataset Card for test-pytorch
This dataset has been created with distilabel.
Dataset Summary
This dataset contains a pipeline.yaml which can be used to reproduce the pipeline that generated it in distilabel using the distilabel CLI:
distilabel pipeline run --config "https://huggingface.co/datasets/dvilasuero/test-pytorch/raw/main/pipeline.yaml"
or explore the configuration:
distilabel pipeline info --config… See the full description on the dataset page: https://huggingface.co/datasets/dvilasuero/test-pytorch.kkbox
Dataset Card for "kkbox"
More Information needed
pytorch-debug-assistantsupport_pycox
Dataset Card for "support_pycox"
More Information needed
nwtco_pycox
Dataset Card for "nwtco_pycox"
More Information needed
flchain
Dataset Card for "flchain"
More Information needed
gbsg_pycox
Dataset Card for "gbsg_pycox"
More Information needed
pytorchmodelmetadatametabric
Dataset Card for "metabric"
More Information needed
medical_spanish_pytorchpytorch_fn_sft_testflchain_pycox
Dataset Card for "flchain_pycox"
More Information needed
Pytorch_QAScraped data from pytorch forums, scrapper code can be found here: https://github.com/Arush04/Agent_Cheat/blob/main/scrappers/pytorch_scrapper.py
Found the following users with most queries answered:
ptrblck
albanD
KFrank
tom
smth
It has the following columns:['user_q', 'question', 'user_a', 'answer']
whereuser_q is the user name of user who asked questionquestion is the question asked by user_quser_a is the user name of user who provided solutionanswer is the solution provided by user_a
pytorch_scrape_inductor_dataThis dataset is composed of scraping code off of github containing pytorch code, and then running torch compile on it in order to have pairs of pytorch and triton code.
To spot check the data you can run
from datasets import load_dataset
# Load the dataset
ds = load_dataset("GPUMODE/pytorch_scrape_inductor_data")
# Get the first row
row = ds["train"][0]
print("\n=== UUID ===")
print(row['uuid'])
print("\n=== PYTHON CODE ===")
print(row['python_code'])
print("\n=== TRITON CODE ===")… See the full description on the dataset page: https://huggingface.co/datasets/GPUMODE/pytorch_scrape_inductor_data.