weaviate/wiki-sample

Loading dataset without vector embeddings You can load the raw dataset without vectors, like this: from datasets import load_dataset dataset = load_dataset("weaviate/wiki-sample", split="train", streaming=True) Loading dataset with vector embeddings You can also load the dataset with vectors, like this: from datasets import load_dataset dataset = load_dataset("weaviate/wiki-sample", "weaviate-snowflake-arctic-v2", split="train", streaming=True) for item in… See the full description on the dataset page: https://huggingface.co/datasets/weaviate/wiki-sample.