zen-embedding
NEWS5M-simcse-roberta-large-embeddings-pca-256A dataset that contains all data in 'ffgcc/NEWS5M' which the corresponding text embedding produced by 'princeton-nlp/unsup-simcse-roberta-large'. The features are transformed to a size of 256 by PCA.
The usage:
news5M_kd_pca_dataset_unsup = torch.load('./NEWS5M-simcse-roberta-large-embeddings-pca-256/news5M_kd_pca_dataset_unsup.pt')
ANLI-simcse-roberta-large-embeddings-pca-256A dataset that contains all data except those labeled as 'neutral' in 'https://sbert.net/datasets/AllNLI.tsv.gz'' which the corresponding text embedding produced by 'princeton-nlp/unsup-simcse-roberta-large'. The features are transformed to a size of 256 by the PCA object.
In order to load the dictionary of the teacher embeddings corresponding to the anli dataset:
!git clone https://huggingface.co/datasets/zen-E/ANLI-simcse-roberta-large-embeddings-pca-256
# if dimension reduction to 256 is… See the full description on the dataset page: https://huggingface.co/datasets/zen-E/ANLI-simcse-roberta-large-embeddings-pca-256.