ffurfaro/keep-it-simple

keep-it-simple Objective: An ultra-minimalist dataset for pre-training tiny language models. The logic relies on bidirectional symmetry (A is B and B is A]) to foster deep semantic understanding. By training the model to predict the "prompt" from the "text" and vice versa, we maximize the utility of every pair. Data Sources Simple English Wikipedia: Simplified encyclopedic articles. Vikidia (FR): Educational content for younger audiences. OPUS Books (en-fr):… See the full description on the dataset page: https://huggingface.co/datasets/ffurfaro/keep-it-simple.