Model server for the base-model bake-off. API: run(messages_json, tools_json, max_new_tokens, temperature).
run(messages_json, tools_json, max_new_tokens, temperature)