Datasetpublic

Mitchell6024/quickb

quickb Generated using QuicKB, a tool developed by Adam Lucek. QuicKB optimizes document retrieval by creating fine-tuned knowledge bases through an end-to-end pipeline that handles document chunking, training data generation, and embedding model optimization. Chunking Configuration Chunker: RecursiveTokenChunker Parameters: chunk_size: 400 chunk_overlap: 50 length_type: 'character' separators: ['\n\n', '\n', '.', '?', '!', ' ', ''] keep_separator: True… See the full description on the dataset page: https://huggingface.co/datasets/Mitchell6024/quickb.

sourceHugging Faceupdated 2y agoView on Hugging Face

0likes13downloads

Dataset Card

quickb

Generated using QuicKB, a tool developed by Adam Lucek.

QuicKB optimizes document retrieval by creating fine-tuned knowledge bases through an end-to-end pipeline that handles document chunking, training data generation, and embedding model optimization.

Chunking Configuration

—Chunker: RecursiveTokenChunker
—Parameters:
—chunk_size: 400
—chunk_overlap: 50
—length_type: 'character'
—separators: ['\n\n', '\n', '.', '?', '!', ' ', '']
—keep_separator: True
—is_separator_regex: False

Dataset Statistics

—Total chunks: 3,800
—Average chunk size: 43.1 words
—Source files: 1

Dataset Structure

This dataset contains the following fields:

—text: The content of each text chunk
—source: The source file path for the chunk
—id: Unique identifier for each chunk