zxcqw12/depot-crisp-4e73
0
Audio Classification
Environmental sound classification with AST. Built with ONNX Runtime for production deployment.
Features
- Graceful shutdown with request draining
- Model warm-up on startup for low latency
- Streaming token generation
Usage
curl http://localhost:7860/healthAPI
POST /embed — Generate embeddings for text
POST /predict — Run model inference on input
GET /metrics — Prometheus-compatible metrics