CoolFace
Datasetpublic

Damaru-ai/damru-knowledge

🐕 Damru Knowledge A continuously growing, self-collected question-answer knowledge base that powers Damru AI — a self-learning assistant built for exam preparation and general-purpose help, with a focus on Indian students. The dataset is harvested and quality-filtered automatically, 24x7, from multiple open sources and a self-evaluating reasoning engine. New rows are appended every hour as parquet shards under data/. 📦 What's inside Column Type Description… See the full description on the dataset page: https://huggingface.co/datasets/Damaru-ai/damru-knowledge.

sourceHugging Faceapache-2.0updated 3h agoView on Hugging Face
4likes9.1kdownloads
Dataset Card

🐕 Damru Knowledge

A continuously growing, self-collected question-answer knowledge base that powers Damru AI — a self-learning assistant built for exam preparation and general-purpose help, with a focus on Indian students.

The dataset is harvested and quality-filtered automatically, 24x7, from multiple open sources and a self-evaluating reasoning engine. New rows are appended every hour as parquet shards under data/.

📦 What's inside

ColumnTypeDescription
questionstringA question, problem, or prompt
answerstringA detailed, self-checked answer / solution
intentstringTopic / category (e.g. math, coding, analysis, general)
langstringLanguage code (en, hi, ...)
upvotesintInternal quality score (higher = better)
created_atstringTimestamp the row was generated

🌐 Sources

  • —Wikipedia — encyclopedic facts across 80+ subjects
  • —arXiv — research-paper concepts and summaries
  • —StackExchange — real Q&A across many communities
  • —Math engine — symbolically-verified maths (SymPy) + olympiad / JEE / MIT-level problems solved and self-checked
  • —Coding engine — problems generated, solved, and executed to verify the solution actually runs (tests must pass)
  • —Analysis engine — deep reasoning and critical-analysis Q&A

🧠 How it's built

Damru runs a multi-worker learning loop that:

  1. 1.Picks a subject and masters it before moving to the next (curriculum-driven).
  2. 2.Generates Q&A, then self-evaluates each item; only high-quality rows are kept.
  3. 3.Raises its own quality bar over time (rising acceptance threshold).
  4. 4.Verifies maths symbolically and runs code to confirm correctness.
  5. 5.Deduplicates and stores rows, then syncs them here hourly.

🎯 Intended use

  • —Supervised fine-tuning / instruction-tuning of small open models (e.g. Qwen2.5-3B) for Damru AI.
  • —Retrieval-augmented generation (RAG) knowledge source.
  • —Educational Q&A research.

⚠️ Limitations

  • —Content is machine-generated and machine-verified; occasional errors are possible.
  • —Coverage grows over time and may be uneven across subjects early on.
  • —Not a substitute for authoritative textbooks or professional advice.

📈 Status

This is a living dataset — it grows continuously toward a multi-million-row target. Row counts and file sizes update as new hourly shards are added.

📝 License

Released under the Apache-2.0 license. Source-derived content remains under its original terms; please respect upstream source licenses where applicable.