huawei-noah/JABERv2

Overview

<p align="center"> <img src="https://avatars.githubusercontent.com/u/12619994?s=200&v=4" width="150"> </p>

<!-- -------------------------------------------------------------------------------- -->

This model is only compatible with the code in this github repo (not supported by the Transformers library)

Citation

Please cite the following paper when using our code and model:

@misc{ghaddar2024importance,
      title={On the importance of Data Scale in Pretraining Arabic Language Models}, 
      author={Abbas Ghaddar and Philippe Langlais and Mehdi Rezagholizadeh and Boxing Chen},
      year={2024},
      eprint={2401.07760},
      archivePrefix={arXiv},
      primaryClass={cs.CL}
}