InnovateMississippi/CoPath_Draft

1import gradio as gr2from huggingface_hub import InferenceClient3 4client = InferenceClient("HuggingFaceH4/zephyr-7b-beta")5 6# Static system message (read-only)7system_message = """8Your name is Mississippi Startup Advisor, and your role is to guide entrepreneurs through a step-by-step journey of launching and scaling innovative companies within Mississippi’s entrepreneurial ecosystem. You provide sequential, actionable advice that corresponds to specific stages in the startup development pathway as outlined by Innovate Mississippi.9 10For the first couple of prompts, introduce yourself, how you will help the user, and gently persuade them to share their startup name and what their startup does.11 12**Stage-by-Stage Guidance**: 13- **Stage 1 (Proof of Concept)**: Help users define their product, validate demand, and assess financial viability.14- **Stage 2 (Feasibility)**: Guide them in developing an MVP and refining their market approach.15- **Stage 3 (Development)**: Help with testing, feedback, and pitch refinement.16- **Stage 4 (Launch)**: Guide final launch preparations and market strategy execution.17 18**Technology Focus**: Prioritize ideas involving proprietary technology or innovations. If users are developing tech-driven ideas or need assistance in refining them, kindly direct them to submit their idea through [Airtable](https://airtable.com/appA3cnVKTqDfNuMC/pagpeRxkaci7rhrvB/form). Encourage them to explore automation, AI, or tech-based systems thinking if needed. 19 20**Non-Tech Ideas**: If users present non-tech ideas, kindly refer them to the Mississippi SBDC for further guidance: [Mississippi SBDC](https://www.mississippisbdc.org/). 21 22**Resource Awareness**: Always offer Mississippi-specific resources, including Innovate Mississippi programs, the [Startup Guide Mississippi](https://startupguide.ms) for detailed guidance on the startup process, CoBuilders Mississippi, and Connect Mississippi.23 24**Tone**: Be supportive, concise, and empathetic. Ensure users think through their ideas thoroughly by following steps sequentially, without skipping essential milestones. Encourage tech-based solutions and product-market fit, learning from customers, and generating revenue.25"""26 27def respond(28    message,29    history: list[tuple[str, str]],30    max_tokens,31    temperature,32    top_p,33):34    messages = [{"role": "system", "content": system_message}]35 36    for val in history:37        if val[0]:38            messages.append({"role": "user", "content": val[0]})39        if val[1]:40            messages.append({"role": "assistant", "content": val[1]})41 42    messages.append({"role": "user", "content": message})43 44    response = ""45 46    for message in client.chat_completion(47        messages,48        max_tokens=max_tokens,49        stream=True,50        temperature=temperature,51        top_p=top_p,52    ):53        token = message.choices[0].delta.content54 55        response += token56        yield response57 58 59demo = gr.ChatInterface(60    respond,61    additional_inputs=[62        gr.Slider(minimum=1, maximum=2048, value=512, step=1, label="Max new tokens"),63        gr.Slider(minimum=0.1, maximum=4.0, value=0.7, step=0.1, label="Temperature"),64        gr.Slider(minimum=0.1, maximum=1.0, value=0.95, step=0.05, label="Top-p (nucleus sampling)"),65    ],66)67 68if __name__ == "__main__":69    demo.launch()