datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
kulyk-bidirectionalscissor_bidirectional_160This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "so_follower",
"total_episodes": 4,
"total_frames": 1030,
"total_tasks": 2,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:4"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/miladgholami/scissor_bidirectional_160.kulyk-bidirectional-gemmakurdish-bidirectional-translation-v2pristine-twi-english-bidirectional-multilen
This dataset is shared under CC BY-NC 4.0, which means you are free to use, share, and adapt it for non-commercial research and educational purposes with attribution. You can read the full license at https://creativecommons.org/licenses/by-nc/4.0/.
Twi ↔ English Bidirectional MT Dataset
Derived from ghananlpcommunity/pristine-twi-english.
Schema
Field
Type
Description
source
string
Source text (no prefix token)
target
string
Clean target translation… See the full description on the dataset page: https://huggingface.co/datasets/ghananlpcommunity/pristine-twi-english-bidirectional-multilen.mtet-vi-en-bidirectional
MTET Vietnamese–English Bidirectional Dataset (Cleaned)
This is the cleaned, bidirectional version of the MTET (Machine Translation Evaluation for Translation) Vietnamese–English parallel corpus used to train the vi-en-transformer-25m model.
Files
File
Description
mtet_bidirectional_cleaned.csv
Main training data (bidirectional, cleaned)
Usage
import pandas as pd
df = pd.read_csv("mtet_bidirectional_cleaned.csv")
print(df.head())
# source… See the full description on the dataset page: https://huggingface.co/datasets/Cong123779/mtet-vi-en-bidirectional.nepali-english-bidirectionalitsbib-nepali-english-bidirectional-1path_selection_bidirectionality_4glossa-bidirectional-t5-bart-splityam_cup_bidirectional_v1This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "bi_yam_follower_robot",
"total_episodes": 4,
"total_frames": 2195,
"total_tasks": 2,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 20,
"splits": {
"train": "0:4"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path": null… See the full description on the dataset page: https://huggingface.co/datasets/nojima-kanta-ctc/yam_cup_bidirectional_v1.english_bangla_nmt_datasets_bidirectional_v2path_selection_bidirectionality_5glossa-bidirectional-t5-bartglossa-bidirectional-llamapath_selection_bidirectionality_3spaceball_bidirectional_v1path_selection_bidirectionality_1kurdish-bidirectional-translation-finall
Kurdish Bidirectional Translation Dataset
Overview
This dataset contains bidirectional translation pairs for Kurdish (Central Kurdish - Sorani script) with English, Arabic, and Persian.
Each sample includes:
translation: Forward translation (Source → Kurdish)
back_translation: Reverse translation (Kurdish → Source)
Dataset Details
Total Samples: 627,103
Languages: Kurdish (ckb), English (en), Arabic (ar), Persian (fa)
Format: JSON conversations with… See the full description on the dataset page: https://huggingface.co/datasets/shiima/kurdish-bidirectional-translation-finall.custom-bidirectional-hip-smoke
Custom Bidirectional HiP Smoke Tests
Permanent repo for Modal smoke tests related to zero-dense bidirectional Block-HiP attention for diffusion LLMs.
Files
zero_dense_bihip_modal.py: Modal app for a no-full-attention bidirectional Block-HiP smoke test.
Run
Install Modal and authenticate first:
pip install modal
modal setup
Download or copy the script, then run:
modal run zero_dense_bihip_modal.py
Or download directly:
wget… See the full description on the dataset page: https://huggingface.co/datasets/mchl-labs/custom-bidirectional-hip-smoke.glossa-bidirectional-llama-splitvlsp-en-vi-bidirectional-sftpath_selection_bidirectionality_7calvert_path_bidirectional_lovepath_selection_bidirectionality_and_connection_understanding_8path_selection_bidirectionality_and_connection_understanding_masterwar_eng_bidirectionalvlsp-en-vi-bidirectional-grpoBidirectional_love