Modelpublic

caikybaldo999/webcoder-100m-instruct

sourceHugging Faceupdated 1mo agoView on Hugging Face

0likes190downloads

Model Card

WebCoder-100M-Instruct

Instruction-tuned version of caikybaldo999/webcoder-100m-html-css-js specialized in HTML, CSS and JavaScript.

—Full SFT
—Parameters: 99,894,528
—Dataset: iamtarun/code_instructions_120k_alpaca filtered for web-development examples
—Training examples: 30,032
—Max sequence length: 1024
—Tokens processed: 78,226,740
—Supervised response tokens: 48,809,920

Loss is masked on system/user tokens and computed on assistant response tokens.

text

<|system|>
You are WebCoder...<|end|>
<|user|>
Create a responsive website...<|end|>
<|assistant|>
...

This is a small ~100M parameter model. Review generated code before deployment.