CoolFace
Modelpublic

acon96/Home-FunctionGemma-270m

sourceHugging Facegemmaupdated 9mo agoView on Hugging Face
10likes856downloads
Model Card

Home-FunctionGemma-270m

The "Home" model is a fine tuning of the FunctionGemma model from Google. The model is able to control devices in the user's house via the "Assist" API, as well as perform basic question answering about the provided home's state.

The model is quantized using Lama.cpp in order to enable running the model in super low resource environments that are common with Home Assistant installations such as Rapsberry Pis.

Training

<img src="https://raw.githubusercontent.com/axolotl-ai-cloud/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>

Datasets

Home Assistant Requests V2 - https://huggingface.co/datasets/acon96/Home-Assistant-Requests-V2

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 0.0002
  • —trainbatchsize: 1
  • —evalbatchsize: 1
  • —seed: 42
  • —distributed_type: multi-GPU
  • —num_devices: 2
  • —gradientaccumulationsteps: 16
  • —totaltrainbatch_size: 32
  • —totalevalbatch_size: 2
  • —optimizer: Use OptimizerNames.ADAMWBNB with betas=(0.9,0.999) and epsilon=1e-08 and optimizerargs=No additional optimizer arguments
  • —lrschedulertype: cosine
  • —lrschedulerwarmup_steps: 59
  • —training_steps: 597

License

The model is licensed under the Gemma license as it is a fine-tuning of the FunctionGemma model.