rust-ai

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

QiLuo is an enterprise-grade rapid development platform built on the Rust technology stack. It adopts modern architectural design and provides a complete backend management system solution.

Rust runtime with TS/Python bindings for Claude Skills with progressive disclosure of skill metadata, full content and scripts/resources. Any agent can now own skills. Currently support Seatbelt and experimentally, WASM, sandboxing

Self-hosted LLM router. Cost effective, deterministic, and fast. Secure and private by default.

aimos，集智能体管理、开发、测试与应用于一体的智能体平台 an intelligent platform integrating agent management, llm agent,development, testing, and application.

Equip your agent. Define, diff, and deploy your own skills, tools, and hooks - portable across any coding agent harness.

A Rust-based Telegram AI assistant powered by OpenRouter LLM with built-in sandboxed tools, scheduling, persistent memory, and MCP server integration.

A simple CLI tool to interact with generative models like llms and image generation apis.

Resilient AI Agent is a full-stack, production-ready AI Doctor Assistant platform. It features a Rust backend (Axum, MongoDB, Ollama with Llama3 and other models, circuit breaker, retry, logging), a modern Next.js frontend (Tailwind, shadcn/ui), and a Python-based TTS microservice.

Pure Rust multimodal inference engine AI. No Python, no CUDA, no external ML frameworks. Single executable + model weights = portable AI that runs on any machine. GPU accelerated — auto-detects Vulkan (Windows/Linux) or Metal (macOS) GPU and runs inference on it. Falls back to CPU if no GPU available. Smart system awareness

CMCA is a memory system that stores knowledge as non-executable fragments and compiles them into executable thought graphs based on query context.

Smart system awareness — automatically detects your hardware (RAM, CPU threads) and adjusts generation limits so TTS runs well even on constrained systems. Voice cloning — clone any voice from a 3-10 second WAV recording. 25 included voices — ready to use out of the box.

Pure Rust inference engine for OpenAI's Whisper Tiny. No Python, no CUDA, no external dependencies. Single executable + binary weights = portable speech-to-text on any machine.

Dartion is a CLI server for running the Danbooru Tags Tranformer models

🤖 Build a robust AI Doctor Assistant app with a Rust backend, Next.js frontend, and a Python TTS microservice for seamless healthcare interactions.

Track human movement in real-time using LiteRT.js and Three.js for browser-based 3D character animation without server dependencies.

Pure Rust inference engine for the SmolLM3-3B language model. No Python runtime, no CUDA, no external dependencies. Single executable + quantized weights = portable AI on any machine.

Pure Rust TTS engine with 9 built-in speakers. No Python, no CUDA, no safetensors needed. Single executable + Q4 binary = portable TTS.

Cortex is a next generation Tensor Library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.

MNIST AI Trainer + GUI Painter App