datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
faiss-integration-testcharity-faiss-indexCaselaw_Access_Project_FAISS_index
The Caselaw Access Project
In collaboration with Ravel Law, Harvard Law Library digitized over 40 million U.S. court decisions consisting of 6.7 million cases from the last 360 years into a dataset that is widely accessible to use. Access a bulk download of the data through the Caselaw Access Project API (CAPAPI): https://case.law/caselaw/
Find more information about accessing state and federal written court decisions of common law through the bulk data service documentation here:… See the full description on the dataset page: https://huggingface.co/datasets/free-law/Caselaw_Access_Project_FAISS_index.Wiki_Faiss_Indexes
dataset_info:
features:
- name: text
dtype: string
- name: embeddings
dtype: float32
shape: [384]
configs:
- config_name: default
data_files: "*.parquet"
Wikipedia IVF-OPQ-PQ Vector Database (GPU-Optimized)
A high-performance, GPU-accelerated FAISS vector database built from Wikipedia articles with pre-computed embeddings. This dataset contains approximately 35 million Wikipedia articles with 384-dimensional embeddings using the all-MiniLM-L6-v2… See the full description on the dataset page: https://huggingface.co/datasets/Ram-G/Wiki_Faiss_Indexes.arxiv_abstracts_specter_faiss_flat_indexversion https://git-lfs.github.com/spec/v1
oid sha256:98b45ea81164d1e1a1dd82255207053b15cd6c69d922a1c5cf3387ce604d4b74
size 28
wikipedia-2024-06-bge-m3-faiss-ivfvietnamese-legal-faissragtime-qwen3-8b-faiss-PQ2048x4fstwin-uniref50-faiss
Twin-Model UniRef50 FAISS Index
FAISS index over Twin model mean-pooled embeddings of all UniRef50
representative proteins (~49.8M). The Twin model is a two-tower contrastive
encoder fine-tuned on Resnik GO similarity:
Custom tower: AA-vocab Transformer → padding-masked mean pool → MLP → 512-dim
ESM tower: facebook/esm2_t33_650M_UR50D (frozen) → masked mean pool → MLP → 512-dim
Output: concat(custom, esm) → 1024-dim
Checkpoint:… See the full description on the dataset page: https://huggingface.co/datasets/genomenet/twin-uniref50-faiss.kilt-qwen-faiss-indexfaiss-db-10k-logsastralmath-faiss-indexcodebert-faiss-indexlegal-cases-faisstelecom-rag-faiss-last-V2morrowind-faiss-index-v3esm2-uniref50-faiss
ESM2 UniRef50 FAISS Index
FAISS index over ESM2 (esm2_t33_650M_UR50D) mean-pooled embeddings of
GO-annotated UniRef50 proteins. Used by the
genomenet/functional-distance
Space for nearest-neighbor search.
Files
File
Description
esm2_uniref50.index
FAISS index (OPQ + IVF + PQ, cosine / inner product on L2-normalized vectors)
ids.npy
UniRef50 cluster IDs aligned with FAISS positions (dtype='S24')
metadata.json
Build parameters (dim, factory, nprobe, n_vectors… See the full description on the dataset page: https://huggingface.co/datasets/genomenet/esm2-uniref50-faiss.telecom-rag-faisstelecom-rag-faiss-lasttembalin-faiss-embedingdataset-faissfaissfaiss-indexfaiss-embedding-index