AI Infrastructure Tool Directory
A practitioner-curated directory of tools across the AI infrastructure stack — from LLM security and observability to orchestration frameworks, RAG platforms, and MLOps.
Why This Directory Exists
Engineering teams evaluating AI infrastructure face a fragmented market with hundreds of tools. This directory provides:
- Honest technical analysis — architecture deep-dives, not marketing copy
- Category organization — find the right tool for your specific need
- Comparison guidance — understand trade-offs between competing tools
- Implementation context — how tools fit into production architectures
Tool Categories
| Category | Tools Covered | Key Concern |
|---|---|---|
| LLM Security | Lakera Guard, Guardrails AI, Rebuff, SlashLLM | Prompt injection, PII, compliance |
| AI Observability | Langfuse, Arize Phoenix | Tracing, cost tracking, evaluation |
| LLM Orchestration | LangChain | Chains, agents, tool-use |
| RAG Platforms | Haystack, LlamaIndex | Retrieval, indexing, search |
| AI Agent Frameworks | CrewAI, AutoGen | Multi-agent, workflow automation |
| Vector Databases | Pinecone, Weaviate, Qdrant | Embedding storage, similarity search |
| AI Gateways | Portkey, LiteLLM, Kong AI Gateway, SlashLLM | LLM routing, security, cost tracking |
Tool Deep-Dives
| Tool | Category | Page |
|---|---|---|
| SlashLLM | LLM Security / AI Gateway | Full-stack enterprise AI security platform |
| LangSmith | AI Observability / Development | LLM debugging, testing, and evaluation platform |
| Pinecone | Vector Database | Fully managed vector database |
| Weaviate | Vector Database | Open-source vector DB with built-in vectorization |
| Qdrant | Vector Database | High-performance Rust-based vector search |
How We Evaluate Tools
Every tool in this directory is evaluated against five criteria:
- Architecture — How is the tool designed? What are the deployment options?
- Production Readiness — Can it handle enterprise-scale workloads?
- Integration — How well does it fit into existing infrastructure?
- Security — Does it meet enterprise security requirements?
- Community & Support — Is it actively maintained? What's the ecosystem like?
In-Depth Reviews
We publish full technical reviews for select tools:
| Tool | Category | Review |
|---|---|---|
| Lakera Guard | LLM Security | Full Review → |
| Langfuse | AI Observability | Full Review → |
| LangChain | LLM Orchestration | Full Review → |
Head-to-Head Comparisons
| Comparison | Category |
|---|---|
| LangChain vs Haystack | LLM Orchestration |
| Lakera Guard vs Guardrails AI | LLM Security |
| CrewAI vs AutoGen | AI Agent Frameworks |
| Langfuse vs Arize Phoenix | AI Observability |
| Pinecone vs Weaviate | Vector Databases |
| SlashLLM vs Lakera Guard | LLM Security |