Furiosa-LLM Examples

Welcome to Furiosa Docs

OpenAI-Compatible Server Responses API Tool Calling Structured Output Vision-Language Models Prefix Caching Hybrid KV Cache Management Data-Parallel Routing Model Preparation Model Parallelism

Chat Embedding Scoring (Similarity Scoring)Reranking (Document Reranking)OpenAI-Compatible API with Logprobs

Deploying Furiosa-LLM on Kubernetes

Cloud Native Toolkit

Examples

Runnable Furiosa-LLM examples covering chat, embedding, scoring, reranking, and OpenAI-compatible logprobs.

Chat

Embedding

Scoring (Similarity Scoring)

Reranking (Document Reranking)

OpenAI-Compatible API with Logprobs

PreviousAsyncLLMEngine class NextChat

© Copyright 2026 FuriosaAI Inc.

Documentation

Gen 1 NPU SDK Doc
Virtual ISA Manual

Community

Forums
Customer Support

Resources

SDK Cookbook

Company

FuriosaAI Home