Fireworks AI is an inference and fine-tuning platform for open large language models, built for developers and AI product teams, billed per token or GPU hour.
Fireworks AI lets a software team put an open-weight language model into production without buying or running GPUs of its own. Fireworks AI, Inc., an independent company, develops and sells it. The same account carries a project from a first API call to a tuned model on dedicated hardware. A team picks a model from the library, calls it through one API, and can later train it on its own data and serve the result at the base model's rate. Serverless Inference answers requests per token with no setup and no cold starts, in Standard and Priority modes. The Batch API takes large asynchronous jobs at a lower rate than live calls. Managed training covers LoRA and full-parameter supervised tuning and DPO, while the Serverless Training API adds reinforcement learning on a shared trainer. On-demand deployments place a base or tuned model on dedicated GPUs billed by the second, and Reservations hold capacity under a longer commitment. Across models the API offers tool calling, JSON schema and grammar output, a reasoning effort setting, prompt caching, embeddings and image or audio input where a model accepts it. The platform suits developers and product teams at software companies building coding assistants, chat products and agents. It also fits a company that wants a specialized model it controls rather than a closed one it rents. Buying starts self-serve: a team adds a payment method, buys credits, and every request draws down the balance, with Auto Reload and a monthly spend limit to keep it running. Larger customers go through sales for reserved capacity, Reserved Throughput under an SLA, Zero Data Retention, single-region data residency, SSO and audit logs. Code assistance, conversational AI and agentic systems are the main jobs it runs, along with bulk request sets that do not need an answer in real time. Vercel, Sourcegraph and Cresta are among the companies that run on it. A typical project starts with prompts in the Playground, moves to serverless calls from the team's own application, and ends on a dedicated deployment once traffic is steady. Datasets and Evaluations in the console keep training data and quality checks beside the models they shape. It fits the team whose product depends on a model it can tune, measure and keep.
Pricing
View plans-
Serverless Inference
Custom pricing
- Pay per token from pre-paid credits; $0.05 per 1M input tokens in Standard mode on the cheapest listed model
- Nemotron 3.5 Lightning 30B: $0.05 input, $0.01 cached input, $0.20 output per 1M tokens
- GPT OSS 120B: $0.15 input, $0.015 cached, $0.60 output per 1M tokens
- Kimi K3: $3.00 input, $0.30 cached, $15.00 output per 1M tokens
- Models not listed individually: $0.10 under 4B parameters, $0.20 from 4B to 16B, $0.90 over 16B, per 1M tokens
- Priority mode adds a 25% premium on listed models
- Embeddings from $0.008 per 1M input tokens
- Batch API: 50% of serverless per-token prices, cached tokens a further 50% off
- Batch jobs are blocked on accounts with Zero Data Retention
- Usage pauses at a zero balance unless Auto Reload is on
- Rate limits rise with the account's spend tier
-
Managed training
Custom pricing
- Per 1M training tokens, usage-based from pre-paid credits; $0.50 for LoRA SFT on models up to 16B parameters
- Up to 16B: LoRA DPO $1.00, full-parameter SFT $1.00, full-parameter DPO $2.00 per 1M training tokens
- 16.1B to 80B: $3.00 LoRA SFT, $6.00 LoRA DPO, $6.00 full SFT, $12.00 full DPO
- 80B to 300B: $6.00 LoRA SFT, $12.00 LoRA DPO, $12.00 full SFT, $24.00 full DPO
- Over 300B: $10.00 LoRA SFT, $20.00 LoRA DPO, $20.00 full SFT, $40.00 full DPO
- Fine-tuned models are served at the same price as their base models
- Serverless Training API, GLM 5.3 Flash: $2.96 prefill, $0.593 cached prefill, $7.41 sample, $8.89 train per 1M tokens
- Serverless Training API, GLM 5.3: $4.86 prefill, $0.972 cached prefill, $12.15 sample, $14.58 train per 1M tokens
- Checkpoint storage for serverless training models included during private preview
- Training is blocked on accounts with Zero Data Retention
-
On-demand GPU deployments
Custom pricing
- Per GPU hour, billed per GPU second from pre-paid credits; $8.00 an hour for an H100 80 GB
- No charge for start-up time
- H200 141 GB $8.00, B200 180 GB $13.00, B300 288 GB $15.00, GB300 288 GB $20.00 per GPU hour
- Region-restricted deployments are priced at a 1.5x premium
- GPU quotas are set per account
-
Enterprise
Custom pricing
- Quote only, through sales; no public price
- Reserved capacity, typically on 1 year commitments
- Reserved Throughput backed by an SLA
- Zero Data Retention, single-region data residency, SSO and audit logs are Enterprise only
Features
- Included: Published context window size
- Included: Image input support
- Included: Audio input support
- Included: Function and tool calling
- Included: JSON schema output mode
- Included: Extended reasoning mode
- Included: Prompt caching discount
- Included: Batch inference API
- Included: Fine-tuning offered
- Not included: Open weights release
- Included: Zero data retention option
- Included: Regional data residency
- Not included: Published safety evaluations
- Not included: Free tier or trial credits
- Included: Enterprise agreement available
- Included: Published deprecation policy
- Not included: Published benchmark results
- Included: Embeddings endpoint
Additional Features
- Serverless per-token inference with no cold starts
- Standard and Priority service modes
- Batch API for asynchronous jobs
- On-demand deployments on H100, H200, B200, B300 and GB300 GPUs
- Reserved capacity and Reserved Throughput with an SLA
- LoRA and full-parameter supervised fine-tuning
- DPO preference tuning
- Reinforcement learning on the Serverless Training API
Best for
- Teams serving open models by the token without running infrastructure
- Product teams tuning an open model on their own data
- Engineering teams that need dedicated GPUs billed by the second
- Enterprises buying reserved capacity under a committed contract
- Companies with zero-retention or single-region data requirements
- AI product companies running large batch workloads
- Developers building agents that call their own tools
Use cases
- Powering a code assistant with an open model
- Running a conversational assistant in a customer product
- Serving tool-calling agents
- Processing a large request set through the Batch API
- Fine-tuning an open model on in-house examples
- Preference-tuning a model with DPO
- Reinforcement learning on a custom task
- Moving a prototype from serverless calls to dedicated GPUs
- Generating embeddings and reranking for retrieval
- Forcing model output into a JSON schema
Screenshots & Videos
Explore Fireworks AI in action
User Reviews
Compare with Similar Software
Click to compare side by side with Fireworks AI