AI inference — AI tools

262 tools in this category

Infrastructure for running models in production: serve checkpoints behind an API, rent GPUs by the second, batch large jobs, and watch latency and cost per request. Sits after the training stage — this is where a model becomes something an app can call.

Try: serverless gpu for ml models deploy machine learning model api cheapest ai inference hosting

Denvr AI Cloud AI inference

High-performance AI cloud platform for training, inference, and data science with sovereign data centers in Canada and USA

Tobira Developer Tools

A network for AI agents to discover, connect, and communicate with each other autonomously.

GPT Proto AI API

A unified API platform that gives developers one key to access over 200 AI models for image, video, and text generation.

Tokenwise Developer Tools

Drop-in proxy that monitors, optimizes, and protects your LLM spending across apps and coding agents

glm5.net LLM

Zhipu AI's 745B parameter language model for advanced reasoning, coding, and agentic tasks — accessible via API and web platform.

ZeusDB Vector Database Developer Tools

High-performance vector database for AI workloads — fast similarity search, metadata filtering, and optional compression.

InfronAI AI API

A unified API for over 400 AI models, offering optimized inference, cost reduction, and enterprise-grade reliability.

Wizzx AI AI API

Unified API for 20+ AI image & video models — access Flux, Kling, Veo, and more with one integration.

Nexa SDK AI inference

Nexa SDK runs any model on any device, across any backend locally—text, vision, audio, speech, or image generation—on NPU, GPU, or CPU. It supports Qualcomm, Intel, AMD and Apple NPUs, GGUF, Apple MLX, and the latest SOTA models (Gemma3n, PaddleOCR).

Zro AI inference

Private inference endpoint for coding agents — zero data retention, EU-hosted, open-weight models.

APIPod AI API

Unified API gateway providing access to 100+ AI models (text, image, video, audio) with intelligent routing and monitoring.

Sesterce Cloud AI inference

On-demand GPU rental service for AI training, machine learning, and high-performance computing workloads

Bitterbot AI Development

Open-source desktop app that runs a P2P AI node to join a distributed intelligence network.

BitaHub Developer Tools

Cloud GPU rental platform for AI research — rent A100, RTX 4090, and other GPUs by the hour with integrated tools.

Rapid AI Developer Tools

Open-source AI engineering toolkits for OCR, document processing, speech, and LLMs — ready for deployment.

OrcaRouter AI API

AI model router — analyzes prompt difficulty, sends hard tasks to frontier models and routine work to cheaper open-source models.

TAHO AI inference

High-performance compute platform for AI workloads — simplifies orchestration and reduces costs compared to legacy systems

you.bot AI API

One API for 70+ AI models — video, image, music, and LLMs — up to 46% cheaper than official APIs

Foil AI Code Security Developer Tools

On-device AI security scanner for macOS — scans code for vulnerabilities locally, no cloud needed.

SuperPowers AI AI API

Access and compare dozens of AI models from OpenAI, Google, Anthropic, and others in one interface with unified pricing.

General Compute AI inference

High-speed AI inference API powered by purpose-built hardware, not repurposed GPUs.

TensorBlock Forge AI inference

Unified inference routing across AI providers — switch between OpenAI, Gemini, Anthropic, and others through a single interface

More in Development

Developer Tools 3441 tools Chatbot 2525 tools No-Code&Low-Code 1686 tools AI API 1511 tools Web Scraping 299 tools Testing 256 tools