# AI Model Serving

## Invoke and run AI models anywhere

Build faster, data-grounded AI without complex orchestration. Call, serve, and evaluate AI models locally or from hosted providers-directly in Spice.

[Get a demo](https://meetings.hubspot.com/lukekim/talk-to-sales) [View the docs](https://spiceai.org/docs/components/tools)

### Do more with your data

Increase the reliability, performance, and security of data-driven AI workflows.

- **100x** - up to 100x faster queries
- **80%** - up to 80% cost savings on data lakehouse spend
- **2x** - increase in data reliability for critical workloads

#### AI grounded in your data

Run inference where your data lives. Spice removes external dependencies by colocating data, models, and compute in a single engine. Reduce latency and hallucinations by grounding models in federated and accelerated datasets.

[View the docs](https://spiceai.org/docs)

#### Flexible models and deployments

Spice supports custom, open-source, and commercial models, adapting to your workload and regulatory requirements. Deploy and scale models anywhere-locally, in the cloud, or at the edge.

[View the docs](https://spiceai.org/docs)

#### Built-in tooling and memory

Augment models with native federation, search, and retrieval for more robust AI workflows. Enable long-term memory through persistent datasets so models can recall and learn across interactions.

[View the docs](https://spiceai.org/docs)

#### AI sandboxing

Isolate, monitor, and control AI execution. Prevent unwanted model outputs and data leakage with sandbox environments for model inference and tool usage.

[View the docs](https://spiceai.org/docs)

### Integrations across all your data sources

Spice supports Hugging Face, OpenAI, Anthropic, xAI, NVIDIA NIM, and more out of the box. Serve and evaluate models across providers while keeping one consistent runtime for inference, evaluation, and observability.

[See connectors](/content/integrations/index.html)

### Deployed in production

Teams trust Spice to bring inference closer to their data, enabling low-latency, enterprise-grade AI across industries.

#### “Partnering with Spice AI has transformed how NRC Health delivers AI-driven insights. By unifying siloed data across systems, we accelerated AI feature development, reducing time-to-market from months to weeks - and sometimes days. With predictable costs and faster innovation, Spice isn't just solving some of our data and AI challenges - it's helping us redefine personalized healthcare.”

Tim Ottersburg

VP of Technology, NRC Health

#### “Spice AI grounds AI in our actual data, using SQL queries across many data sources. This brings accuracy to probabilistic AI systems, which are very prone to hallucinations.”

Rachel Wong

CTO, Basis Set

### See Spice in action

Walk through your use case with an engineer and see how Spice handles federation, acceleration, and AI integration for production workloads.

[Talk to an engineer](https://meetings.hubspot.com/lukekim/talk-to-sales)