Modelpublic

microsoft/Multilingual-MiniLM-L12-H384

sourceHugging Facemitupdated 4y agoView on Hugging Face

111likes90kdownloads

convert_model.py13 linesDownload Raw Back to root

1#!/usr/bin/env python32import logging3from transformers import BertModel, BertTokenizer, TFBertModel, XLMRobertaTokenizer4 5logging.basicConfig(level=logging.INFO, filename="log.txt")6model = BertModel.from_pretrained("../../Multilingual-MiniLM-L12-H384/")7tf_model = TFBertModel.from_pretrained("../../Multilingual-MiniLM-L12-H384/", from_pt=True)8model.save_pretrained("./")9tf_model.save_pretrained("./")10 11tok = XLMRobertaTokenizer.from_pretrained("../../Multilingual-MiniLM-L12-H384/sentencepiece.bpe.model")12tok.save_pretrained("./")13