CoolFace
Modelpublic

yhua219/EduRABSA_SLM_v1_SLERP_qw2.5-1.5B_onnx_transformersJS

sourceHugging Facecc-by-nc-sa-4.0updated 10mo agoView on Hugging Face
0likes17downloads
Model Card

[cc-by-nc-sa]: http://creativecommons.org/licenses/by-nc-sa/4.0/ [cc-by-nc-sa-image]: https://licensebuttons.net/l/by-nc-sa/4.0/88x31.png [cc-by-nc-sa-shield]: https://img.shields.io/badge/License-CC%20BY--NC--SA%204.0-lightgrey.svg

Licence and Copyright

[![CC BY-NC-SA 4.0][cc-by-nc-sa-shield]][cc-by-nc-sa]   [![CC BY-NC-SA 4.0][cc-by-nc-sa-image]][cc-by-nc-sa]

  • —The "EduRABSA_SLM" LoRA adaptors and any merged models derived from them are licensed under the [Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License][cc-by-nc-sa].
  • —The two pre-trained base models ("the original models") Phi4-mini-instruct and Qwen2.5-1.5B-Instruct were used for inference and training LoRA adaptors. No modifications were made to the original models. The original models’ licences and copyright notices (where provided) are included in the corresponding subdirectories of this repository.

The EduRABSA_SLM Model Family

The "EduRABSA_SLM" model family consists of fine-tuned multi-task small LLMs (SLMs) designed for resource-efficient opinion mining on education-domain reviews of courses, teaching staff, and universities (e.g. student course or teaching evaluations, and open-ended survey responses).

To cite the LoRA adaptors or merged models in this family:

@misc{hua2025dataefficientadaptationnovelevaluation,
      title={Data-Efficient Adaptation and a Novel Evaluation Method for Aspect-based Sentiment Analysis}, 
      author={Yan Cathy Hua and Paul Denny and Jörg Wicker and Katerina Taškova},
      year={2025},
      eprint={2511.03034},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2511.03034}, 
}

The EduRABSA_SLM multi-task models can perform opinion mining across the following fine-grained Aspect-based Sentiment Analysis (ABSA) tasks, extracting outputs for and across each review entry as illustrated in the image below:

  • —Opinion Extraction (OE)
  • —Aspect-Opinion Pair-Extraction (AOPE)
  • —Aspect-opinion Categorisation (AOC; ASC with opinion term)
  • —Aspect-(opinion)-Sentiment Triplet Extraction (ASTE)
  • —Aspect-(opinion-category)-Sentiment Quadruplet Extraction (ASQE)

&emsp;&emsp; <img src="https://github.com/yhua219/ftsobpandedurabsaslm/blob/main/.figs/figtable_1.png?raw=true" alt="ABSA examples" width="850px;">

Model Info

This model is to be used with the transformers.js library.

This is a WebGPU-focused, ONNX format, int4 (q4) quantised (accuracylevel=1, blocksize=32) version of the model below:

Each of the original EduRABSASLMV1SLERP models was created via weight-merging (using the SLERP algorithm) two LoRA fine-tuned models on the same base model, and shares the multi-task capabilities described above. The **EduRABSASLM** LoRA adaptors were fine-tuned using the EduRABSA dataset.

The model follows its base model's hardware and environment requirements, unless the model name contains onnx (in which case, please refer to the onnx-model's README file).

Full details regarding the development and performance of the EduRABSA_SLM models are available in our paper Data-Efficient Adaptation and a Novel Evaluation Method for Aspect-based Sentiment Analysis.

How to Use