CoolFace
Modelpublic

fastinom/ASR_fassy

sourceHugging Faceupdated 2y agoView on Hugging Face
0likes11downloads
Model Card

Model Card for Model ID

<!-- Provide a quick summary of what the model is/does. -->

Model Details

Model Description

<!-- Provide a longer summary of what this model is. -->

This is the model card of a 🤗 transformers model that has been pushed on the Hub.

  • —Developed by: [Fastino Mateteva]
  • —Model type: [Transformer model]
  • —Language(s) (NLP): [Shona]
  • —License: []

How to Get Started with the Model

Use the code below to get started with the model.

Running the model

Training Details

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 5e-4
  • —perdevicetrainbatchsize=4
  • —evalbatchsize: 2
  • —evaluation_strategy="steps"
  • —gradient_checkpointing=True
  • —gradientaccumulationsteps: 4
  • —totaltrainbatch_size: 16
  • —numtrainepochs=3
  • —savetotallimit=1
  • —fp16=True
  • —save_steps=400
  • —eval_steps=200
  • —logging_steps=200
  • —pushtohub=True

Training results

Training LossWERStepValidation Loss
6.4271.002004.1518
3.79791.004003.8410
3.69241.006003.4249
0.83570.268000.2396
0.15280.2410000.2155
0.14150.2412000.2036
0.12780.2414000.2028

Environmental Impact

<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->

Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019).

  • —Hardware Type: [T4 GPU]
  • —Hours used: [3]
  • —Cloud Provider: [Google Colab]

Technical Specifications [optional]

Model Architecture and Objective

[More Information Needed]

Compute Infrastructure

[More Information Needed]

Hardware

[More Information Needed]

Software

[More Information Needed]

Model Card Authors [optional]

[Fastino Mateteva]

Model Card Contact

[fastinomateteva@gmail.com]