datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
code_search_net
Dataset Card for CodeSearchNet corpus
Dataset Summary
CodeSearchNet corpus is a dataset of 2 milllion (comment, code) pairs from opensource libraries hosted on GitHub. It contains code and documentation for several programming languages.
CodeSearchNet corpus was gathered to support the CodeSearchNet challenge, to explore the problem of code retrieval using natural language.
Supported Tasks and Leaderboards
language-modeling: The dataset can be used to… See the full description on the dataset page: https://huggingface.co/datasets/code-search-net/code_search_net.llm-network-study-data
LLM-Network-Study-Data
Per-request network captures (.pcapng) collected by the
LLM-Network-Study benchmark harness (benchmark.py and the
per-workload test scripts). Each directory holds one capture file per request,
named request_<id>_run<n>_<timestamp>.pcapng.
A directory name encodes four dimensions:
<capture-env>_<provider/model>_<workload>[_<dataset/variant>]_results
Dimension legend
Dimension
Values
Meaning
Capture env
ethernet
Wired connection to… See the full description on the dataset page: https://huggingface.co/datasets/wayslab/llm-network-study-data.NetSpec-LLM
📁 Network Spec for LLM Understanding
📄 Overview
This repository houses a comprehensive collection of ETSI (European Telecommunications Standards Institute) documents, systematically downloaded, processed, and organized for streamlined access and analysis. Each ETSI deliverable is paired with its corresponding metadata to ensure thorough information management.
🔍 Data Processing Workflow
The data processing involves two main scripts that automate the… See the full description on the dataset page: https://huggingface.co/datasets/rasoul-nikbakht/NetSpec-LLM.code-search-net-python
Dataset Card for "code-search-net-python"
Dataset Description
Homepage: None
Repository: https://huggingface.co/datasets/Nan-Do/code-search-net-python
Paper: None
Leaderboard: None
Point of Contact: @Nan-Do
Dataset Summary
This dataset is the Python portion of the CodeSarchNet annotated with a summary column.The code-search-net dataset includes open source functions that include comments found at GitHub.The summary is a short description of what the… See the full description on the dataset page: https://huggingface.co/datasets/Nan-Do/code-search-net-python.GUI-Net-1M
Check more details at how to use this dataset at our repo
GUI-Net-1M is the dataset we keep running the pipeline introduced from TongUI paper.
Due to large file size, we have to split image files into parts. To do the extraction of images, please use the following script:
#!/bin/bash
# Directory containing the split files
SPLIT_DIR="/mnt/bofeidisk2/tmp/baidu_experience_full/images/split_parts_baidu_experience"
OUTPUT_DIR="merged_files"
# Create output directory if it doesn't… See the full description on the dataset page: https://huggingface.co/datasets/Bofeee5675/GUI-Net-1M.bitcoin-network-propagation
Bitcoin network propagation
Timestamped block and transaction announcements received from connected Bitcoin peers, with peer metadata and advertised relay-fee floors. These observations support analysis of announcement timing and differences between connected peers.
Contents
Table
Record
bitcoin_block_announcements
A peer's announcement of a block, timestamped on receipt
bitcoin_transaction_announcements
A retained transaction announcement from a peer… See the full description on the dataset page: https://huggingface.co/datasets/dataforge-labs/bitcoin-network-propagation.bitcoin-cash-network-propagation
Bitcoin Cash network propagation
Timestamped block and transaction announcements received from connected Bitcoin Cash peers, with peer metadata and advertised relay-fee floors. These observations support analysis of announcement timing and differences between connected peers.
Contents
Table
Record
bitcoin_cash_block_announcements
A peer's announcement of a block, timestamped on receipt
bitcoin_cash_transaction_announcements
A retained transaction… See the full description on the dataset page: https://huggingface.co/datasets/dataforge-labs/bitcoin-cash-network-propagation.dogecoin-network-propagation
Dogecoin network propagation
Timestamped block and transaction announcements received from connected Dogecoin peers, with peer metadata and advertised relay-fee floors. These observations support analysis of announcement timing and differences between connected peers.
Contents
Table
Record
dogecoin_block_announcements
A peer's announcement of a block, timestamped on receipt
dogecoin_transaction_announcements
A retained transaction announcement from a… See the full description on the dataset page: https://huggingface.co/datasets/dataforge-labs/dogecoin-network-propagation.DNANet_2p5pMixture_PPF6C_2024
2p5p Mixture DNA Research dataset
This dataset repository contains RFU signal reading (.hid) files and their corresponding person mixture labels (.txt) used in the DNANet paper and code.
The data consist of DNA sample mixtures of 2 to 5 persons, of which the mixtures composition is known,
allowing for training on actual ground-truth data for DNA annotation tools such as DNANet
If you use this dataset in your research please cite it appropriately:
@ARTICLE{Benschop2019,
title… See the full description on the dataset page: https://huggingface.co/datasets/NetherlandsForensicInstitute/DNANet_2p5pMixture_PPF6C_2024.litecoin-network-propagation
Litecoin network propagation
Timestamped block and transaction announcements received from connected Litecoin peers, with peer metadata and advertised relay-fee floors. These observations support analysis of announcement timing and differences between connected peers.
Contents
Table
Record
litecoin_block_announcements
A peer's announcement of a block, timestamped on receipt
litecoin_transaction_announcements
A retained transaction announcement from a… See the full description on the dataset page: https://huggingface.co/datasets/dataforge-labs/litecoin-network-propagation.network_security_questionsThis dataset contains a single file full of network security questions in Chinese.
Could be used as good initial sources for scrapers, though not good as your browsing history.
NetConfEval
NetConfEval: Can LLMs Facilitate Network Configuration?
What is it?
We present a set of benchmarks (NetConfEval) to examine the effectiveness of different models in facilitating and automating network configuration described in our paper "NetConfEval: Can LLMs Facilitate Network Configuration?".
📜 Paper - GitHub Repository
This repository contains pre-generated datasets for each of the benchmark task, so that they can be used independently from our testing environment.… See the full description on the dataset page: https://huggingface.co/datasets/NetConfEval/NetConfEval.bridge_network_open_clipNetworking_Commands_DatasetNetworking Commands Dataset
Overview
This dataset is (networking_dataset) contains 750 unique Cisco-specific and general networking commands (NET001–NET750), designed for red teaming AI models in cybersecurity. It focuses on testing model understanding, detecting malicious intent, and ensuring safe responses in enterprise networking environments. The dataset includes both common and obscure commands, emphasizing advanced configurations for adversarial testing.
Dataset Structure
The dataset is… See the full description on the dataset page: https://huggingface.co/datasets/darkknight25/Networking_Commands_Dataset.CDB_DEC2024-CochranSampled_Gemma-300m_Embub-networking-dataset-2024-2instructional_code-search-net-python
Dataset Card for "instructional_code-search-net-python"
Dataset Summary
This is an instructional dataset for Python.
The dataset contains two different kind of tasks:
Given a piece of code generate a description of what it does.
Given a description generate a piece of code that fulfils the description.
Languages
The dataset is in English.
Data Splits
There are no splits.
Dataset Creation
May of 2023
Curation Rationale
This… See the full description on the dataset page: https://huggingface.co/datasets/Nan-Do/instructional_code-search-net-python.network_paperGUI-Net-Video
GUI-Net-Video
A collection of video URLs for GUI-related tasks, organized by platform or application.
This dataset provides the video URLs collected for TongUI: Internet-Scale Trajectories from Multimodal Web Tutorials for Generalized GUI Agents — a framework that turns multimodal web tutorials (including YouTube videos) into large-scale GUI agent trajectories. Each URL is paired with a GUI task description (the .txt filename) and grouped by platform/app.
Paper: arXiv:2504.12679… See the full description on the dataset page: https://huggingface.co/datasets/Bofeee5675/GUI-Net-Video.PRCA-Net-dataset
Ray-Traced Cross-Frequency Radio Map Dataset
A large ray-traced radio-map (path-loss) dataset for zero-shot
cross-frequency generalization research, generated with
Sionna RT over real urban geometry from
OpenStreetMap.
150 urban scenes across 15 cities, 256×256 rasters
8 transmitters per scene across three deployment strata (street,
rooftop, mast)
6 carrier frequencies: 1.8, 3.5, 7, 28 GHz (training) + 10, 60 GHz
(held out, for interpolation / extrapolation studies)
7,200… See the full description on the dataset page: https://huggingface.co/datasets/SHussain37/PRCA-Net-dataset.GUI-Net-1M-relative-annotationscode_search_net_clean
Dataset Card for "code_search_net_clean"
More Information needed
netjuunosusume
Bangumi Image Base of Net-juu No Susume
This is the image base of bangumi Net-juu No Susume, we detected 40 characters, 4334 images in total. The full dataset is here.
Please note that these image bases are not guaranteed to be 100% cleaned, they may be noisy actual. If you intend to manually train models using this dataset, we recommend performing necessary preprocessing on the downloaded dataset to eliminate potential noisy samples (approximately 1% probability).
Here is the… See the full description on the dataset page: https://huggingface.co/datasets/BangumiBase/netjuunosusume.network_security_questionsThis dataset contains a single file full of network security questions in Chinese.
Could be used as good initial sources for scrapers, though not good as your browsing history.
global-meteor-network
Global Meteor Network Trajectory Data
Credit: NASA/ESA
Part of a dataset collection on Hugging Face.
Dataset description
Individual meteor trajectory solutions from the Global Meteor Network (GMN), a worldwide network of 500+ all-sky cameras operated by volunteer astronomers. Each row is one detected meteor with orbital elements derived from multi-station triangulation.
The GMN was founded in 2018 and has grown to cover all longitudes from Europe, the… See the full description on the dataset page: https://huggingface.co/datasets/juliensimon/global-meteor-network.sri-lankan-album-stamp-detection
Sri Lankan Album Stamp Detection Dataset
This dataset contains annotated Sri Lankan stamp album page images prepared for stamp detection using YOLO-based object detection models.
It is used for the Stamp AI Model 1 stamp detector, where the goal is to detect individual stamps from full album page images.
Contents
raw_pages/ — original album page images
yolo_dataset/ — YOLO-formatted detection dataset
The YOLO dataset contains image files, label files, and a… See the full description on the dataset page: https://huggingface.co/datasets/nethsith/sri-lankan-album-stamp-detection.code_search_net
CodeSearchNet
This is an unofficial reupload of the code_search_net dataset in the parquet format. I have also removed the columns func_code_tokens, func_documentation_tokens, and split_name as they are not relevant. The original repository relies on a Python module that is downloaded and executed to unpack the dataset, which is a potential security risk but importantly raises an annoying warning. As a plus, parquets load faster.
Original model card:
Dataset Card for… See the full description on the dataset page: https://huggingface.co/datasets/claudios/code_search_net.CrediBench
Dataset Card for CrediBench 1.1
CrediBench is a large-scale, temporal webgraph constituted of web data pulled from Common Crawl.
Dataset Details
Dataset Description
This dataset is composed of monthly slices of large-scale web networks. These webgraphs contain 1+ billion edges, and 45+ million nodes per month.
In these webgraphs, the nodes represent a website domain (e.g, google.com) and an edge represents a directed hyperlink relation (e.g, an… See the full description on the dataset page: https://huggingface.co/datasets/credi-net/CrediBench.network_instruct_mcq_2481Strandset-Rust-v1
Strandset-Rust-v1
Overview
Strandset-Rust-v1 is a large, high-quality synthetic dataset built to advance code modeling for the Rust programming language.Generated and validated through Fortytwo’s Swarm Inference, it contains 191,008 verified examples across 15 task categories, spanning code generation, bug detection, refactoring, optimization, documentation, and testing.
Rust’s unique ownership and borrowing system makes it one of the most challenging languages for… See the full description on the dataset page: https://huggingface.co/datasets/Fortytwo-Network/Strandset-Rust-v1.