Inference Index
Directory · 04 / 07

Harnesses.

Agent frameworks and orchestration platforms — the scaffolding that turns models into autonomous systems.

/
Framework

CrewAI

Multi-agent orchestration. Define roles, goals, and tools — agents collaborate on complex tasks.

multi-agentrole-basedtool-usememory
Language
Python
License
Open Source
GH stars
28.5k
Models
4
Framework

LangGraph

Stateful, graph-based agent orchestration. Build workflows with cycles, branching, and persistence.

graph-basedstatefulstreaminghuman-in-loop
Language
Python
License
Open Source
GH stars
18.7k
Models
4
Framework

AutoGen

Microsoft’s multi-agent framework. Agents talk to each other; add a human or tool as another agent.

multi-agent-chatcode-executiongroupchatautobuild
Language
Python
License
Open Source
GH stars
34.0k
Models
3
Framework

Semantic Kernel

Microsoft’s enterprise-first SDK. Plugins + planners + memory, in C#, Python, and Java.

pluginsplannersmemorymulti-language
Language
Multi
License
Open Source
GH stars
22.1k
Models
3
Library

DSPy

Stanford’s prompt-program compiler. Write Python signatures; DSPy optimizes the prompts for you.

prompt-optimizationautomatic-few-shotcompilersmetrics-driven
Language
Python
License
Open Source
GH stars
17.8k
Models
3
Library

Instructor

Structured output made simple. Pydantic in; validated JSON out. Every model, one API.

pydanticretriesstreaming-partialsvalidation
Language
Python
License
Open Source
GH stars
9.5k
Models
4
Library

Outlines

Guaranteed structured generation via grammar constraints. For local models, no retries needed.

grammar-constraintsregexjson-schemalark-parser
Language
Python
License
Open Source
GH stars
8.9k
Models
4
Runtime

AutoGPT

The original autonomous agent. Give it a goal, watch it loop. Now a full platform.

autonomous-loopsplatform-uiblock-builder
Language
Python
License
Open Source
GH stars
167.0k
Models
2
Platform

Devin

Cognition’s autonomous software engineer. A cloud-hosted AI teammate that owns tickets end-to-end.

cloud-hostedend-to-end-ticketsslack-integrationlong-horizon-tasks
Language
Multi
License
Paid
GH stars
Models
2
Platform

Lindy

No-code AI employees. Build agents with triggers, tools, and workflows in a visual builder.

no-codevisual-builder1500-integrationsalways-on-agents
Language
Multi
License
Freemium
GH stars
Models
2
Platform

Beam AI

Enterprise agentic process automation. Pre-built agents for back-office workflows.

agent-storeenterprise-connectorsobservability
Language
Multi
License
Paid
GH stars
Models
2
Platform

Relevance AI

Low-code platform for building custom AI agents. Workforce-in-a-box for ops teams.

low-codetool-librarymulti-agent-teams
Language
Multi
License
Freemium
GH stars
Models
2
Runtime

BabyAGI

Minimalist autonomous agent. A few hundred lines of Python; the origin of the "task list agent" pattern.

minimal-looptask-listlearning-agents
Language
Python
License
Open Source
GH stars
21.1k
Models
2
Runtime

GPT Pilot

An AI dev team in your terminal. Asks clarifying questions, writes code, runs it, debugs it.

full-app-devclarifying-questionshuman-in-loop
Language
Python
License
Open Source
GH stars
32.8k
Models
2
Platform

Flowise

Drag-and-drop LLM flows. LangChain under the hood, visual builder on top. Self-hostable.

drag-dropself-hostableapi-endpointsmarketplace
Language
TypeScript
License
Freemium
GH stars
28.7k
Models
3
Platform

n8n AI

Workflow automation with AI nodes. Fair-code license, self-hostable, 500+ integrations.

workflow-automationai-nodesself-hostablefair-code
Language
TypeScript
License
Freemium
GH stars
72.0k
Models
3
Framework

Mastra

TypeScript-first agent framework. Workflows, tools, RAG, and evals as first-class primitives.

typescript-nativeworkflowsragevals
Language
TypeScript
License
Open Source
GH stars
7.4k
Models
3
Framework

LiveKit Agents

Realtime voice agents on WebRTC. The standard stack for voice AI in production.

webrtcrealtime-voicemulti-provider-stt-ttstelephony
Language
Python
License
Open Source
GH stars
4.2k
Models
2
Showing 18 of 18