datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
bert-128-grouped
Dataset Card for "bert-128-grouped"
More Information needed
bert-base-uncased-refined-web-segment0
Dataset Card for "bert-base-uncased-refined-web-segment0"
More Information needed
CC-MAIN-2022-21-rawbert_pretrain
Dataset Card for "bert_pretrain"
More Information needed
CC-MAIN-2023-06-rawCC-MAIN-2022-05-rawCC-MAIN-2023-40-rawbert-mlm-experiments-en
Unified English MLM Pre-training Corpus (80M Rows)
This dataset is a massive, diverse, multi-domain English text corpus explicitly engineered for pre-training and domain-adaptation of BERT-style models via Masked Language Modeling (MLM). It aggregates over 80 million rows of text, completely stripped of auxiliary metadata, labels, and identifiers to expose purely raw text strings.
Dataset Details
Repository ID: 8Opt/bert-mlm-experiments-en
Total Rows: 80,489,226… See the full description on the dataset page: https://huggingface.co/datasets/LakoreAI/bert-mlm-experiments-en.CC-MAIN-2022-27-rawbert_dataset_202203
Dataset Card for "bert_dataset_202203"
More Information needed
CC-MAIN-2022-33-rawnomic-bert-2048-pretraining-data
Dataset Card for "bert-pretokenized-2048-wiki-2023"
More Information needed
CC-MAIN-2021-25-rawCC-MAIN-2023-14-rawCC-MAIN-2022-49-rawCC-MAIN-2021-10-rawCC-MAIN-2023-23-rawbert_pretrain_datasets
Dataset Card for "bert_pretrain_datasets"
This dataset is essentially a concatenation of the training set of the English Wikipedia (wikipedia.20220301.en.train) and the Book Corpus (bookcorpus.train).
This is exactly how I get this dataset:
from datasets import load_dataset, concatenate_datasets, load_from_disk
cache_dir = "/data/haob2/cache/"
# book corpus
bookcorpus = load_dataset("bookcorpus", split="train", cache_dir=cache_dir)
# english wikipedia
wiki =… See the full description on the dataset page: https://huggingface.co/datasets/JackBAI/bert_pretrain_datasets.processed_tsb_bert_datasetprocessed_bert_dataset
Dataset Card for "processed_bert_dataset"
More Information needed
bert_pretraining_data
Dataset Card for "bert_pretraining_data"
More Information needed
alpaca-spanish
BERTIN Alpaca Spanish
This dataset is a translation to Spanish of alpaca_data_cleaned.json, a clean version of the Alpaca dataset made at Stanford.
An earlier version used Facebook's NLLB 1.3B model, but the current version uses OpenAI's gpt-3.5-turbo, hence this dataset cannot be used to create models that compete in any way against OpenAI.
CC-MAIN-2023-50-rawprocessed_bert_dataset
Dataset Card for "processed_bert_dataset"
More Information needed
processed_bert_dataset
Dataset Card for "processed_bert_dataset"
More Information needed
CC-MAIN-2020-29-rawprocessed_bert_dataset
Dataset Card for "processed_bert_dataset"
More Information needed
CC-MAIN-2020-45-rawwiki_book_corpus_complete_processed_bert_dataset
Dataset Card for "wiki_book_corpus_complete_processed_bert_dataset"
More Information needed
processed_bert_dataset
