Keynote-Technology/TinyKAI-0.7B-v0.1

TinyKAI 0.7B

Model Details

TinyKAI-0.7B is one of the world's SMALLEST "large" language models EVER! We acheived such a feat by essentially compressing GPT2 and squeezing it to fit into one sub-GB pytorch.bin file!

Uses

Due to being one of the tiniest "large" language models on huggingface, many corners had to be cut. TinyKAI-0.7B has a max output of only 150 characters per computation (without repeating itself). Therefore, TinyKAI is only intended for research purposes. <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->

Banned Use

TinyKAI-1B is governed by the apache 2.0 liscense, and therefore means that whatever the license deems unacceptable shall not be allowed. We specificaly ban the use of ANY AND ALL KAI MODELS for hate speech towards a paricular thing, person, our particular group due to legal and ethical issues.

Limitations

2K characters max output length, English only, and extremely tiny (1GB).

Recommendations

TinyKAI-0.7B is a very small model, and is good for AI research especially.