kamjin/phi-3.5-webgpu
0
1---2title: Phi-3.5 WebGPU3emoji: ⚡4colorFrom: yellow5colorTo: red6sdk: static7pinned: false8license: apache-2.09models:10 - onnx-community/Phi-3.5-mini-instruct-onnx-web11short_description: A powerful AI chatbot that runs locally in your browser12thumbnail: https://huggingface.co/spaces/webml-community/phi-3.5-webgpu/resolve/main/banner.png13---14 15# Phi-3.5 WebGPU16 17A simple React + Vite application for running [Phi-3.5-mini-instruct](https://huggingface.co/onnx-community/Phi-3.5-mini-instruct-onnx-web), a powerful small language model, locally in the browser using Transformers.js and WebGPU-acceleration.18 19## Getting Started20 21Follow the steps below to set up and run the application.22 23### 1. Clone the Repository24 25Clone the examples repository from GitHub:26 27```sh28git clone https://github.com/huggingface/transformers.js-examples.git29```30 31### 2. Navigate to the Project Directory32 33Change your working directory to the `phi-3.5-webgpu` folder:34 35```sh36cd transformers.js-examples/phi-3.5-webgpu37```38 39### 3. Install Dependencies40 41Install the necessary dependencies using npm:42 43```sh44npm i45```46 47### 4. Run the Development Server48 49Start the development server:50 51```sh52npm run dev53```54 55The application should now be running locally. Open your browser and go to `http://localhost:5173` to see it in action.56 