datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
Galgame-VisualNovel-Reupload
Galgame VisualNovel Reupload
This repository is a reupload of the visual novel dataset OOPPEENN/56697375616C4E6F76656C5F44617461736574.
The goal of this reupload is to restructure the data for easier and more efficient use with the datasets library, instead of having to manually extract each archive file and parse json files of the original dataset.
Loading the entire dataset
To load and stream all voice lines from all games combined, simply load the train split. The… See the full description on the dataset page: https://huggingface.co/datasets/joujiboi/Galgame-VisualNovel-Reupload.visual-novel-datasets
Dataset Card for Dataset Name
This dataset card aims to be a base template for new datasets. It has been generated using this raw template.
Dataset Details
Dataset Description
Curated by: [More Information Needed]
Funded by [optional]: [More Information Needed]
Shared by [optional]: [More Information Needed]
Language(s) (NLP): [More Information Needed]
License: [More Information Needed]
Dataset Sources [optional]
Repository: [More… See the full description on the dataset page: https://huggingface.co/datasets/TAK-C/visual-novel-datasets.visual-novels
Visual Novel Dataset
This dataset contains parsed Visual Novel scripts for training language models. The dataset consists of approximately 60 million tokens of parsed scripts.
Dataset Structure
The dataset follows a general structure for visual novel scripts:
Dialogue lines: Dialogue lines are formatted with the speaker's name followed by a colon, and the dialogue itself enclosed in quotes. For example:
John: "Hello, how are you?"
Actions and narration: Actions and… See the full description on the dataset page: https://huggingface.co/datasets/alpindale/visual-novels.visual-novels-v1.1
Visual Novels v1.1 (WIP)
This dataset contains parsed Visual Novel scripts.
Dataset Structure
We provide 2 variants of the same dataset:
Extracted (Not Yet released)
Contains the raw unformatted version directly extracted from the game's files.
jsonl
Parsed versions of the raw extracted versions. A sample is provided below:
{
"meta": {
"game": "<Game Title>.jsonl",
"scene_key": "<Scene Key>"
},
"namedconversation": [
{… See the full description on the dataset page: https://huggingface.co/datasets/KaraKaraWitch/visual-novels-v1.1.VisualNovel_Dataset_Metadata
VisualNovel Dataset Metadata
This dataset repository contains metadata for OOPPEENN/56697375616C4E6F76656C5F44617461736574.
maker_game_vnid.tsv: Contains the mapping of maker names, game names, and their corresponding Visual Novel IDs in vndb. Here the column maker and game correspond to {maker}_{game} in the file names of 7z (or directory names of extracted files) in OOPPEENN/VisualNovel_Dataset.
voice_actor_info.tsvmaps maker game character to vndb char id, vndb voice actor id… See the full description on the dataset page: https://huggingface.co/datasets/litagin/VisualNovel_Dataset_Metadata.Visual-Novel-Maker-Datavisual-novels-jsonvisual-novel-summary
Dataset Card for Visual Novel Summary
This dataset contains excerpts from visual novels, derived from the winglian/visual-novels-json dataset. Each excerpt is annotated with respect to elements of fiction, including setting, characters, plot, conflict, themes, point of view, and tone.
Dataset Details
Dataset Description
This dataset was created by splitting rows from the winglian/visual-novels-json dataset into chunks of 32 consecutive lines. Each chunk was… See the full description on the dataset page: https://huggingface.co/datasets/agentlans/visual-novel-summary.alpindale_visual-novelsimport json
import os
import ftfy
dataset = []
for filename in sorted(os.listdir("./visual-novels-parsed/TXT")):
txt_path = os.path.join(TXT_DIR, filename)
with open(txt_path, "r") as f:
txt_data = ftfy.fix_text(f.read()).strip()
dataset.append(
{
"name": ftfy.fix_text(filename.replace(".txt", "")).strip(),
"text": txt_data,
}
)
with open("./visual-novels-parsed/train.json", "w") as f:
json.dump(dataset, f, indent=2)
winglian_visual-novels-json-axowinglian_visual-novels-json-axo-dropped-long