LeroyDyer/SpydazWebAI_VisionEncoderDecoderModel_Mini548m

1---2license: mit3language:4- en5library_name: transformers6tags:7- vision8- VISION-ENCODER-DECODER-MODEL9pipeline_tag: image-to-text10---11 12# ADD HEAD13```14 15Mistral16VISION-ENCODER-DECODER-MODEL17 18print('Add Vision...')19# ADD HEAD20# Combine pre-trained encoder and pre-trained decoder to form a Seq2Seq model21 22 23 24Vmodel = VisionEncoderDecoderModel.from_encoder_decoder_pretrained(25    "google/vit-base-patch16-224-in21k", "LeroyDyer/Mixtral_AI_Tiny"26)27_Encoder_ImageProcessor = Vmodel.encoder28_Decoder_ImageTokenizer = Vmodel.decoder29_VisionEncoderDecoderModel = Vmodel30# Add Pad tokems31LM_MODEL.VisionEncoderDecoder = _VisionEncoderDecoderModel32# Add Sub Components33LM_MODEL.Encoder_ImageProcessor = _Encoder_ImageProcessor34LM_MODEL.Decoder_ImageTokenizer = _Decoder_ImageTokenizer35LM_MODEL36 37 38 39```