CoolFace
Datasetpublic

Supabase/wikipedia-en-embeddings

OpenAI, all-MiniLM-L6-v2, GTE-small embeddings for Wikipedia Simple English Texts and OpenAI embeddings are genereted by Stephan Sturges, big thanks for sharing this dataset. Here we added embeddings for all-MiniLM-L6-v2 and GTE-small. Total 224,482 vectors for each model. Notes These are the embeddings and corresponded simplified articles from the wikipedia "simple english" dump. Please see wikipedia's licensing for usage information:… See the full description on the dataset page: https://huggingface.co/datasets/Supabase/wikipedia-en-embeddings.

sourceHugging Facemitupdated 3y agoView on Hugging Face
18likes231downloads
Dataset Card

OpenAI, all-MiniLM-L6-v2, GTE-small embeddings for Wikipedia Simple English

Texts and OpenAI embeddings are genereted by Stephan Sturges, big thanks for sharing this dataset.

Here we added embeddings for `all-MiniLM-L6-v2` and `GTE-small`.

Total 224,482 vectors for each model.

Notes

These are the embeddings and corresponded simplified articles from the wikipedia "simple english" dump.

Please see wikipedia's licensing for usage information: https://en.wikipedia.org/wiki/Wikipedia:Copyrights

Please see OpenAI's terms of service for usage of the embeddings: https://platform.openai.com/docs/guides/embeddings/can-i-share-my-embeddings-online

For the purposes of this dataset, the embeddings are published under MIT license.