Datasetpublic

SPAISS6F1/spai-ss6-corpus-scb-mt-en-th

SPAI SS6 SCB MT EN-TH Corpus Index Index repo for the SCB MT English-Thai corpus mirrored in the canonical repo. This is a lightweight index dataset repo. It does not duplicate the full corpus. The full Parquet data lives in the canonical repository config below. Canonical Data Canonical repo: SPAISS6F1/spai-ss6-llm-1b-thai-corpus Canonical config: scb_mt_en_th_2020_mt_opus Rows in canonical config: 4,319,905 Parquet size in canonical config: 0.45 GB Source… See the full description on the dataset page: https://huggingface.co/datasets/SPAISS6F1/spai-ss6-corpus-scb-mt-en-th.

sourceHugging Faceotherupdated 4mo agoView on Hugging Face

0likes12downloads

Dataset Card

SPAI SS6 SCB MT EN-TH Corpus Index

Index repo for the SCB MT English-Thai corpus mirrored in the canonical repo.

This is a lightweight index dataset repo. It does not duplicate the full corpus. The full Parquet data lives in the canonical repository config below.

Canonical Data

—Canonical repo: SPAISS6F1/spai-ss6-llm-1b-thai-corpus
—Canonical config: scb_mt_en_th_2020_mt_opus
—Rows in canonical config: 4,319,905
—Parquet size in canonical config: 0.45 GB
—Source license: cc-by-sa-3.0
—License review status: usable_with_sharealike_obligations

Load The Full Data

python

from datasets import load_dataset

ds = load_dataset(
    "SPAISS6F1/spai-ss6-llm-1b-thai-corpus",
    name="scb_mt_en_th_2020_mt_opus",
    split="train",
    streaming=True,
)

Local Index File

data/index.parquet has one metadata row pointing to the canonical data.

Use Notes

—Check the canonical repo audit before training or release.
—This dataset card is not a legal opinion.
—Full model release/commercial use requires source-specific rights review.