ValentinDorseuil/transformer_from_scratch_english_to_french_translation
0
Transformers
This repository contains an implementation of the Transformer architecture based on the original paper:
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., ... & Polosukhin, I. (2017). Attention is All You Need. Advances in Neural Information Processing Systems (NeurIPS).
Model Description
This is a Transformer model trained on the fra-eng dataset from ManyThings.org. The model is designed to translate English sentences to French.
<!-- ## Usage
To use this model, you can load it with the Hugging Face transformers library:
from transformers import AutoModel, AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("your-username/your-model-name")
model = AutoModel.from_pretrained("your-username/your-model-name")
inputs = tokenizer("Hello, how are you?", return_tensors="pt")
outputs = model(**inputs) GitHub Repository
For more details and the full implementation, please visit the GitHub repository.
License
This project is licensed under the MIT License.
