Modelpublic

QuantFactory/llama-3-sqlcoder-8b-GGUF

sourceHugging Facecc-by-sa-4.0updated 2y agoView on Hugging Face

14likes1.3kdownloads

Model Card

QuantFactory/llama-3-sqlcoder-8b-GGUF

This is quantized version of defog/llama-3-sqlcoder-8b created using llama.cpp

Model Description

A capable language model for text to SQL generation for Postgres, Redshift and Snowflake that is on-par with the most capable generalist frontier models.

image/png

Developed by: Defog, Inc Model type: [Text to SQL] License: [CC-by-SA-4.0] Finetuned from model: [Meta-Llama-3-8B-Instruct]

Demo Page

https://defog.ai/sqlcoder-demo/

Ideal prompt and inference parameters

Set temperature to 0, and do not do sampling.

Prompt

<|begin_of_text|><|start_header_id|>user<|end_header_id|>

Generate a SQL query to answer this question: `{user_question}`
{instructions}

DDL statements:
{create_table_statements}<|eot_id|><|start_header_id|>assistant<|end_header_id|>

The following SQL query best answers the question `{user_question}`:


## Evaluation
This model was evaluated on SQL-Eval, a PostgreSQL based evaluation framework developed by Defog for testing and alignment of model capabilities.

You can read more about the methodology behind SQLEval [here](https://defog.ai/blog/open-sourcing-sqleval/).

## Contact defog
Contact defog on X at [@defogdata](https://twitter.com/defogdata), or on email at founders@defog.ai