How to integrate Affinda MCP with LlamaIndex

This guide walks you through connecting Affinda to LlamaIndex using the Composio tool router. By the end, you'll have a working Affinda agent that can extract invoice data from uploaded pdf, delete a document no longer needed, create a new tag for hr documents through natural language commands. This guide will help you understand how to give your LlamaIndex agent real control over a Affinda account through Composio's Affinda MCP server. Before we dive in, let's take a quick look at the key ideas and tools involved.

Affinda logoAffinda
Api Key

Affinda is an AI-powered document processing platform that automates data extraction from resumes, invoices, and more. It streamlines document-heavy workflows by turning files into structured, actionable data.

105 Tools

Introduction

This guide walks you through connecting Affinda to LlamaIndex using the Composio tool router. By the end, you'll have a working Affinda agent that can extract invoice data from uploaded pdf, delete a document no longer needed, create a new tag for hr documents through natural language commands.

This guide will help you understand how to give your LlamaIndex agent real control over a Affinda account through Composio's Affinda MCP server.

Before we dive in, let's take a quick look at the key ideas and tools involved.

Also integrate Affinda with

TL;DR

Here's what you'll learn:
  • Set your OpenAI and Composio API keys
  • Install LlamaIndex and Composio packages
  • Create a Composio Tool Router session for Affinda
  • Connect LlamaIndex to the Affinda MCP server
  • Build a Affinda-powered agent using LlamaIndex
  • Interact with Affinda through natural language

What is LlamaIndex?

LlamaIndex is a data framework for building LLM applications. It provides tools for connecting LLMs to external data sources and services through agents and tools.

Key features include:

  • ReAct Agent: Reasoning and acting pattern for tool-using agents
  • MCP Tools: Native support for Model Context Protocol
  • Context Management: Maintain conversation context across interactions
  • Async Support: Built for async/await patterns

What is the Affinda MCP server, and what's possible with it?

The Affinda MCP server is an implementation of the Model Context Protocol that connects your AI agent and assistants like Claude, Cursor, etc directly to your Affinda account. It provides structured and secure access to your document processing workflows, so your agent can upload files, extract data, organize workspaces, label documents, and automate annotation management on your behalf.

  • AI-powered document upload and extraction: Instantly have your agent upload new documents for parsing and extract structured data from various formats using Affinda's advanced AI models.
  • Workspace and collection management: Let your agent create, group, and organize documents into collections and workspaces, keeping your document processing streamlined and organized.
  • Automated annotation updates: Empower your agent to batch update or modify multiple document annotations in a single request, saving you time on manual corrections.
  • Document tagging and organization: Direct your agent to create tags and label documents, making it easy to categorize and quickly retrieve important files.
  • Effortless cleanup and resource management: Have your agent delete unwanted documents or collections, ensuring your Affinda account stays tidy and relevant at all times.

What is the Composio tool router, and how does it fit here?

What is Composio SDK?

Composio's Composio SDK helps agents find the right tools for a task at runtime. You can plug in multiple toolkits (like Gmail, HubSpot, and GitHub), and the agent will identify the relevant app and action to complete multi-step workflows. This can reduce token usage and improve the reliability of tool calls. Read more here: Getting started with Composio SDK

The tool router generates a secure MCP URL that your agents can access to perform actions.

How the Composio SDK works

The Composio SDK follows a three-phase workflow:

  1. Discovery: Searches for tools matching your task and returns relevant toolkits with their details.
  2. Authentication: Checks for active connections. If missing, creates an auth config and returns a connection URL via Auth Link.
  3. Execution: Executes the action using the authenticated connection.

Step-by-step Guide

Step by step10 STEPS
1

Prerequisites

Before you begin, make sure you have:
  • Python 3.8/Node 16 or higher installed
  • A Composio account with the API key
  • An OpenAI API key
  • A Affinda account and project
  • Basic familiarity with async Python/Typescript
2

Getting API Keys for OpenAI, Composio, and Affinda

OpenAI API key (OPENAI_API_KEY)
  • Go to the OpenAI dashboard
  • Create an API key if you don't have one
  • Assign it to OPENAI_API_KEY in .env
Composio API key and user ID
  • Log into the Composio dashboard
  • Copy your API key from Settings
    • Use this as COMPOSIO_API_KEY
  • Pick a stable user identifier (email or ID)
    • Use this as COMPOSIO_USER_ID
3

Installing dependencies

npm install @composio/llamaindex @llamaindex/openai @llamaindex/tools @llamaindex/workflow dotenv

Create a new Typescript project and install the necessary dependencies:

  • @composio/llamaindex: Composio's LlamaIndex integration
  • @llamaindex/openai: OpenAI LLM integration
  • @llamaindex/tools: MCP client for LlamaIndex
  • @llamaindex/workflow: Workflow framework for LlamaIndex
  • dotenv: Environment variable management
4

Set environment variables

bash
OPENAI_API_KEY=your-openai-api-key
COMPOSIO_API_KEY=your-composio-api-key
COMPOSIO_USER_ID=your-user-id

Create a .env file in your project root:

These credentials will be used to:

  • Authenticate with OpenAI's GPT-5 model
  • Connect to Composio's Tool Router
  • Identify your Composio user session for Affinda access
5

Import modules

import "dotenv/config";
import readline from "node:readline/promises";
import { stdin as input, stdout as output } from "node:process";

import { Composio } from "@composio/core";

import { mcp } from "@llamaindex/tools";
import { agent as createAgent } from "@llamaindex/workflow";
import { openai } from "@llamaindex/openai";

dotenv.config();

Create a new file called affinda_llamaindex_agent.ts and import the required modules:

Key imports:

  • dotenv.config loads .env at runtime
  • readline gives us a simple CLI chat loop
  • Composio is the main Composio SDK client
  • mcp connects to an MCP endpoint
  • createAgent builds a LlamaIndex agent
  • openai configures the LLM backend
6

Load environment variables and initialize Composio

const OPENAI_API_KEY = process.env.OPENAI_API_KEY;
const COMPOSIO_API_KEY = process.env.COMPOSIO_API_KEY;
const COMPOSIO_USER_ID = process.env.COMPOSIO_USER_ID;

if (!OPENAI_API_KEY) throw new Error("OPENAI_API_KEY is not set");
if (!COMPOSIO_API_KEY) throw new Error("COMPOSIO_API_KEY is not set");
if (!COMPOSIO_USER_ID) throw new Error("COMPOSIO_USER_ID is not set");

What's happening:

This ensures missing credentials cause early, clear errors before the agent attempts to initialise.

7

Create a Tool Router session and build the agent function

async function buildAgent() {

  console.log(`Initializing Composio client...${COMPOSIO_USER_ID!}...`);
  console.log(`COMPOSIO_USER_ID: ${COMPOSIO_USER_ID!}...`);

  const composio = new Composio({
    apiKey: COMPOSIO_API_KEY,
    provider: new LlamaindexProvider(),
  });

  const session = await composio.create(
    COMPOSIO_USER_ID!,
    {
      toolkits: ["affinda"],
    },
  );

  const mcpUrl = session.mcp.url;
  console.log(`Composio Tool Router MCP URL: ${mcpUrl}`);

  const server = mcp({
    url: mcpUrl,
    clientName: "composio_tool_router_with_llamaindex",
    requestInit: {
      headers: {
        "x-api-key": COMPOSIO_API_KEY!,
      },
    },
    // verbose: true,
  });

  const tools = await server.tools();

  const llm = openai({ apiKey: OPENAI_API_KEY, model: "gpt-5" });

  const agent = createAgent({
    name: "composio_tool_router_with_llamaindex",
        description : "An agent that uses Composio Tool Router MCP tools to perform actions.",
    systemPrompt:
      "You are a helpful assistant connected to Composio Tool Router."+
"Use the available tools to answer user queries and perform Affinda actions." ,
    llm,
    tools,
  });

  return agent;
}

What's happening here:

  • We create a Composio client using your API key and configure it with the LlamaIndex provider
  • We then create a tool router MCP session for your user, specifying the toolkits we want to use (in this case, affinda)
  • The session returns an MCP HTTP endpoint URL that acts as a gateway to all your configured tools
  • LlamaIndex will connect to this endpoint to dynamically discover and use the available Affinda tools.
  • The MCP tools are mapped to LlamaIndex-compatible tools and plug them into the Agent.
8

Create an interactive chat loop

async function chatLoop(agent: ReturnType<typeof createAgent>) {
  const rl = readline.createInterface({ input, output });

  console.log("Type 'quit' or 'exit' to stop.");

  while (true) {
    let userInput: string;

    try {
      userInput = (await rl.question("\nYou: ")).trim();
    } catch {
      console.log("\nAgent: Bye!");
      break;
    }

    if (!userInput) {
      continue;
    }

    const lower = userInput.toLowerCase();
    if (lower === "quit" || lower === "exit") {
      console.log("Agent: Bye!");
      break;
    }

    try {
      process.stdout.write("Agent: ");

      const stream = agent.runStream(userInput);
      let finalResult: any = null;

      for await (const event of stream) {
        // The event.data contains the streamed content
        const data: any = event.data;

        // Check for streaming delta content
        if (data?.delta) {
          process.stdout.write(data.delta);
        }

        // Store final result for fallback
        if (data?.result || data?.message) {
          finalResult = data;
        }
      }

      // If no streaming happened, show the final result
      if (finalResult) {
        const answer =
          finalResult.result ??
          finalResult.message?.content ??
          finalResult.message ??
          "";
        if (answer && typeof answer === "string" && !answer.includes("[object")) {
          process.stdout.write(answer);
        }
      }

      console.log(); // New line after streaming completes
    } catch (err: any) {
      console.error("\nAgent error:", err?.message ?? err);
    }
  }

  rl.close();
}

What's happening:

  • We're creating a direct terminal interface to chat with Affinda
  • The LLM's responses are streamed to the CLI for faster interaction.
  • The agent uses context to maintain conversation history
  • The agent processes the request, selects appropriate Affinda tools, and returns a result
  • We extract the answer from the result data structure and display it to the user
  • You can type 'quit' or 'exit' to stop the chat loop gracefully
  • Agent responses and any errors are streamed in a clear, readable format
9

Define the main entry point

async function main() {
  try {
    const agent = await buildAgent();
    await chatLoop(agent);
  } catch (err) {
    console.error("Failed to start agent:", err);
    process.exit(1);
  }
}

main();

What's happening here:

  • We're orchestrating the entire application flow
  • The agent gets built with proper error handling
  • Then we kick off the interactive chat loop so you can start talking to Affinda
10

Run the agent

npx ts-node llamaindex-agent.ts

When prompted, authenticate and authorise your agent with Affinda, then start asking questions.

Complete Code

Here's the complete code to get you started with Affinda and LlamaIndex:

import "dotenv/config";
import readline from "node:readline/promises";
import { stdin as input, stdout as output } from "node:process";

import { Composio } from "@composio/core";
import { LlamaindexProvider } from "@composio/llamaindex";

import { mcp } from "@llamaindex/tools";
import { agent as createAgent } from "@llamaindex/workflow";
import { openai } from "@llamaindex/openai";

dotenv.config();

const OPENAI_API_KEY = process.env.OPENAI_API_KEY;
const COMPOSIO_API_KEY = process.env.COMPOSIO_API_KEY;
const COMPOSIO_USER_ID = process.env.COMPOSIO_USER_ID;

if (!OPENAI_API_KEY) {
    throw new Error("OPENAI_API_KEY is not set in the environment");
  }
if (!COMPOSIO_API_KEY) {
    throw new Error("COMPOSIO_API_KEY is not set in the environment");
  }
if (!COMPOSIO_USER_ID) {
    throw new Error("COMPOSIO_USER_ID is not set in the environment");
  }

async function buildAgent() {

  console.log(`Initializing Composio client...${COMPOSIO_USER_ID!}...`);
  console.log(`COMPOSIO_USER_ID: ${COMPOSIO_USER_ID!}...`);

  const composio = new Composio({
    apiKey: COMPOSIO_API_KEY,
    provider: new LlamaindexProvider(),
  });

  const session = await composio.create(
    COMPOSIO_USER_ID!,
    {
      toolkits: ["affinda"],
    },
  );

  const mcpUrl = session.mcp.url;
  console.log(`Composio Tool Router MCP URL: ${mcpUrl}`);

  const server = mcp({
    url: mcpUrl,
    clientName: "composio_tool_router_with_llamaindex",
    requestInit: {
      headers: {
        "x-api-key": COMPOSIO_API_KEY!,
      },
    },
    // verbose: true,
  });

  const tools = await server.tools();

  const llm = openai({ apiKey: OPENAI_API_KEY, model: "gpt-5" });

  const agent = createAgent({
    name: "composio_tool_router_with_llamaindex",
    description:
      "An agent that uses Composio Tool Router MCP tools to perform actions.",
    systemPrompt:
      "You are a helpful assistant connected to Composio Tool Router."+
"Use the available tools to answer user queries and perform Affinda actions." ,
    llm,
    tools,
  });

  return agent;
}

async function chatLoop(agent: ReturnType<typeof createAgent>) {
  const rl = readline.createInterface({ input, output });

  console.log("Type 'quit' or 'exit' to stop.");

  while (true) {
    let userInput: string;

    try {
      userInput = (await rl.question("\nYou: ")).trim();
    } catch {
      console.log("\nAgent: Bye!");
      break;
    }

    if (!userInput) {
      continue;
    }

    const lower = userInput.toLowerCase();
    if (lower === "quit" || lower === "exit") {
      console.log("Agent: Bye!");
      break;
    }

    try {
      process.stdout.write("Agent: ");

      const stream = agent.runStream(userInput);
      let finalResult: any = null;

      for await (const event of stream) {
        // The event.data contains the streamed content
        const data: any = event.data;

        // Check for streaming delta content
        if (data?.delta) {
          process.stdout.write(data.delta);
        }

        // Store final result for fallback
        if (data?.result || data?.message) {
          finalResult = data;
        }
      }

      // If no streaming happened, show the final result
      if (finalResult) {
        const answer =
          finalResult.result ??
          finalResult.message?.content ??
          finalResult.message ??
          "";
        if (answer && typeof answer === "string" && !answer.includes("[object")) {
          process.stdout.write(answer);
        }
      }

      console.log(); // New line after streaming completes
    } catch (err: any) {
      console.error("\nAgent error:", err?.message ?? err);
    }
  }

  rl.close();
}

async function main() {
  try {
    const agent = await buildAgent();
    await chatLoop(agent);
  } catch (err: any) {
    console.error("Failed to start agent:", err?.message ?? err);
    process.exit(1);
  }
}

main();

Conclusion

You've successfully connected Affinda to LlamaIndex through Composio's Tool Router MCP layer. Key takeaways:
  • Tool Router dynamically exposes Affinda tools through an MCP endpoint
  • LlamaIndex's ReActAgent handles reasoning and orchestration; Composio handles integrations
  • The agent becomes more capable without increasing prompt size
  • Async Python provides clean, efficient execution of agent workflows
You can easily extend this to other toolkits like Gmail, Notion, Stripe, GitHub, and more by adding them to the toolkits parameter.
TOOLS

Supported Tools

Every Affinda action and event your agent gets out of the box.

Add Tag to Documents

Tool to add a tag to multiple documents in a single operation.

Batch Update Annotations

Batch update multiple document annotations in a single API call.

Create API User

Tool to create a new API user within an organization.

Batch Create Annotations

Batch create multiple document annotations in a single API call.

Create Collection

Tool to create a new collection.

Create Data Field For Collection

Tool to create a data field for a collection along with a new data point.

Create Data Source

Tool to create a custom mapping data source.

Create Data Source Value

Tool to add a new value to a mapping data source.

Create Document

Upload a document to Affinda for parsing and data extraction.

Create Document Type

Tool to create a new document type in the specified organization.

Create Extractor

Tool to create a new extractor.

Create Document from Data

Create a document from structured resume or job description data for Search & Match.

Create Index

Tool to create a new index for search and match functionality.

Create Invitation

Tool to create a new organization invitation.

Create Job Description Search

Search through parsed job descriptions using custom criteria or resume matching.

Create Job Description Search Embed URL

Tool to create and return a signed URL for the embeddable job description search tool.

Create Organization

Tool to create a new organization.

Create RESTHook Subscription

Tool to create a new RESTHook subscription.

Create Resume Search

Tool to search through parsed resumes using three methods: match to a job description, match to a resume, or custom criteria.

Create Resume Search Embed URL

Tool to create and return a signed URL for the embeddable resume search tool.

Create Tag

Creates a new tag in the specified workspace.

Create Validation Result

Create a validation result for document annotations in Affinda.

Batch Create Validation Results

Batch create multiple validation results for document annotations in a single API call.

Create Workspace

Tool to create a new workspace.

Create Workspace Membership

Tool to add a user to a workspace by creating a membership.

Batch Delete Annotations

Batch delete multiple document annotations in a single API call.

Delete Collection

Permanently delete a collection from Affinda by its identifier.

Delete Data Source

Permanently delete a mapping data source from the database by its identifier.

Delete Data Source Value

Tool to delete a specific value from a mapping data source.

Delete Document

Tool to delete a specific document by its ID.

Delete Document Type

Tool to permanently delete a document type by its identifier.

Delete Index

Tool to permanently delete an index from Affinda by its name.

Delete Invitation

Tool to delete an invitation by its identifier.

Delete Organization

Permanently deletes an organization from Affinda.

Delete Resthook Subscription

Tool to delete a specific resthook subscription by ID.

Delete Tag

Permanently delete a tag from Affinda by its ID.

Delete Validation Results

Delete multiple validation results in a single API call.

Delete Workspace

Tool to delete a specific workspace by its ID.

Delete Workspace Membership

Tool to remove a user from a workspace by membership ID.

Get All API Users

Tool to retrieve a list of all API users.

Get All Document Splitters

Tool to get a list of all document splitters.

Get All Invitations

Tool to retrieve all invitations you created or sent to you.

Get Organization Memberships

Retrieve all organization memberships across the account.

Get Tags

Tool to list all tags.

Get All Validation Results

Tool to list validation results for documents.

Get Workspace Memberships

Retrieve all workspace memberships across the account.

Get Annotations

Retrieves all annotations for a specific document.

Get Collection

Tool to retrieve details of a specific collection by its ID.

Get Collections

Tool to retrieve a list of all collections.

Get Data Source

Tool to retrieve details of a specific mapping data source by its identifier.

Get Data Source Value

Tool to retrieve a specific value from a mapping data source.

Get Data Source Values

Tool to retrieve all values from a mapping data source.

Get Document

Retrieve full details and parsed data for a specific document by its identifier.

Get Document Redacted

Tool to retrieve the redacted version of a document as a PDF file.

Get Documents

Tool to retrieve a list of all documents.

Get Document Splitter

Tool to retrieve details of a specific document splitter by its identifier.

Get Document Type

Tool to retrieve details of a specific document type by its ID.

Get Document Type JSON Schema

Tool to generate a JSON schema from a document type by its identifier.

Get Document Type Pydantic Models

Tool to generate Pydantic model code from a document type's schema.

Get Document Types

Retrieve all document types accessible to the authenticated user.

Get Extractor

Tool to retrieve detailed information about a specific extractor by its identifier.

Get Extractors

Retrieve all extractors available for an organization.

Get Index Documents

Tool to retrieve all indexed documents for a specific index.

Get Invitation

Tool to retrieve details of a specific organization invitation by its identifier.

Get Job Description Search Config

Tool to get the configuration for the logged in user's embeddable job description search tool.

Get Mapping

Tool to retrieve a specific mapping by its identifier.

Get Organization

Tool to retrieve details of a specific organization by its ID.

Get Organization Membership

Tool to retrieve details of a specific organization membership by its ID.

Get Organizations

Retrieves all organizations accessible to the authenticated user.

Get Resthook Subscription

Tool to retrieve details of a specific resthook subscription by its ID.

Get RESTHook Subscriptions

Tool to retrieve a list of all RESTHook subscriptions.

Get Tag

Tool to retrieve details of a specific tag by its ID.

Get Usage by Workspace

Retrieves monthly document processing usage statistics for a specific workspace.

Get Workspace

Tool to retrieve details of a specific workspace by its ID.

Get Workspace Membership

Tool to retrieve details of a specific workspace membership by its ID.

Get Workspaces

Tool to retrieve a list of all workspaces.

List Data Points

Tool to retrieve all data points.

List Data Sources

Tool to retrieve the list of all custom mapping data sources.

List Indexes

Tool to retrieve a list of all search indexes.

List Mappings

Tool to retrieve the list of all custom data mappings.

List Occupation Groups

Tool to retrieve the list of searchable occupation groups.

List Resume Search Config

Tool to get the configuration for the logged in user's embeddable resume search tool.

List Resume Search Job Title Suggestions

Tool to get job title suggestions based on provided job title(s).

List Resume Search Skill Suggestions

Tool to get skill suggestions based on provided skills.

Remove Tag from Documents

Remove a tag from multiple documents in a single batch operation.

Replace Data Source Values

Tool to completely replace all values in a mapping data source.

Split Document Pages

Split a document into multiple documents by dividing its pages.

Update Annotation

Tool to update data of a single annotation in Affinda.

Update Collection

Tool to update specific fields of a collection.

Update Data Field For Collection

Tool to update a data field configuration for a collection's data point.

Update Data Source Value

Tool to update an existing value in a mapping data source.

Update Document

Tool to update specific fields of a document.

Update Document Data

Update parsed data for a resume or job description document in Affinda.

Update Document Type

Tool to update a document type by its identifier.

Update Extractor

Tool to update specific fields of an extractor.

Update Index

Tool to update the name of an existing search index.

Update Invitation

Tool to update an organization invitation's role.

Update Job Description Search Config

Tool to update the configuration for the logged in user's embeddable job description search tool.

Update Mapping

Tool to update a specific mapping's settings.

Update Organization

Tool to update specific fields of an organization.

Update Organization Membership

Tool to update an organization membership's role.

Update RESTHook Subscription

Tool to update an existing RESTHook subscription.

Update Resume Search Config

Tool to update the configuration for the logged in user's embeddable resume search tool.

Update Tag

Tool to update data of a tag.

Update Workspace

Tool to update specific fields of a workspace.

FAQ

Frequently asked questions

With a standalone Affinda MCP server, the agents and LLMs can only access a fixed set of Affinda tools tied to that server. However, with the Composio Tool Router, agents can dynamically load tools from Affinda and many other apps based on the task at hand, all through a single MCP endpoint.

Yes, you can. LlamaIndex fully supports MCP integration. You get structured tool calling, message history handling, and model orchestration while Tool Router takes care of discovering and serving the right Affinda tools.

Yes, absolutely. You can configure which Affinda scopes and actions are allowed when connecting your account to Composio. You can also bring your own OAuth credentials or API configuration so you keep full control over what the agent can do.

All sensitive data such as tokens, keys, and configuration is fully encrypted at rest and in transit. Composio is SOC 2 Type 2 compliant and follows strict security practices so your Affinda data and credentials are handled as safely as possible.

Start with Affinda.It takes 30 seconds.

Managed auth, hosted MCP servers, and every Affinda tool your agent needs.Free to start.

Start building