Datasetpublic

trieunh/Vietnamese_literature_VuTrongPhung

Vu Trong Phung Literature Chunks This dataset consists of Vietnamese literary texts written by author Vũ Trọng Phụng, one of the most influential figures of 20th-century Vietnamese literature. The dataset includes both short stories and novels, and has been split into smaller chunks based on the number of tokens. Chunking Strategy We used the tokenizer from vinai/PhoGPT-4B to split the original text into chunks of less than 512 tokens. Each row in the dataset… See the full description on the dataset page: https://huggingface.co/datasets/trieunh/Vietnamese_literature_VuTrongPhung.

sourceHugging Faceccupdated 1y agoView on Hugging Face

0likes51downloads

Dataset Card

Vu Trong Phung Literature Chunks

This dataset consists of Vietnamese literary texts written by author Vũ Trọng Phụng, one of the most influential figures of 20th-century Vietnamese literature.

The dataset includes both short stories and novels, and has been split into smaller chunks based on the number of tokens.

image/png

Chunking Strategy

We used the tokenizer from `vinai/PhoGPT-4B` to split the original text into chunks of less than 512 tokens.

Each row in the dataset contains:

—type: either Truyện ngắn (Short Story) or Tiểu thuyết (Novel)
—title: Title of the story/novel
—author: Always Vũ Trọng Phụng
—chapter: If applicable (for novels), the chapter title
—chunk: Integer identifier for the chunk (1, 2, ...)
—content: Text content of the chunk
—tokens: Token count for this chunk

Use Cases

This dataset is used as human-written samples to generate corresponding machine text, which is useful for:

—Detection of Machine-Generated Text
—Text classification tasks
—LLM output detection

License

This dataset is shared under CC BY 4.0, for academic and research purposes.

Author

Processed by Trieu NH-NTU.

Reference

The text is collected from ntt123/viet-tts-dataset