trhacknon/streaming-text-generation

Showcase streaming text generation using the @huggingface/inference JS lib.

Default model for inference: https://huggingface.co/google/flan-t5-xxl