liodon-ai/oasst1-decontaminated

Decontaminated — OpenAssistant/oasst1 What this is A filtered version of OpenAssistant/oasst1 (revision fdf72ae0827c1cda404aff25b6603abec9e3399b) with exact-duplicate rows and rows overlapping standard benchmark test sets removed. This is a different artifact from the companion contamination report — that one is an audit of what's wrong; this one is the corpus with those rows actually taken out, ready to train on. Processing Deduplicated… See the full description on the dataset page: https://huggingface.co/datasets/liodon-ai/oasst1-decontaminated.