How to integrate Affinda MCP with OpenAI Agents SDK

This guide walks you through connecting Affinda to the OpenAI Agents SDK using the Composio tool router. By the end, you'll have a working Affinda agent that can extract invoice data from uploaded pdf, delete a document no longer needed, create a new tag for hr documents through natural language commands. This guide will help you understand how to give your OpenAI Agents SDK agent real control over a Affinda account through Composio's Affinda MCP server. Before we dive in, let's take a quick look at the key ideas and tools involved.

Affinda logoAffinda
Api Key

Affinda is an AI-powered document processing platform that automates data extraction from resumes, invoices, and more. It streamlines document-heavy workflows by turning files into structured, actionable data.

105 Tools

Introduction

This guide walks you through connecting Affinda to the OpenAI Agents SDK using the Composio tool router. By the end, you'll have a working Affinda agent that can extract invoice data from uploaded pdf, delete a document no longer needed, create a new tag for hr documents through natural language commands.

This guide will help you understand how to give your OpenAI Agents SDK agent real control over a Affinda account through Composio's Affinda MCP server.

Before we dive in, let's take a quick look at the key ideas and tools involved.

Also integrate Affinda with

TL;DR

Here's what you'll learn:
  • Get and set up your OpenAI and Composio API keys
  • Install the necessary dependencies
  • Initialize Composio and create a Tool Router session for Affinda
  • Configure an AI agent that can use Affinda as a tool
  • Run a live chat session where you can ask the agent to perform Affinda operations

What is OpenAI Agents SDK?

The OpenAI Agents SDK is a lightweight framework for building AI agents that can use tools and maintain conversation state. It provides a simple interface for creating agents with hosted MCP tool support.

Key features include:

  • Hosted MCP Tools: Connect to external services through hosted MCP endpoints
  • SQLite Sessions: Persist conversation history across interactions
  • Simple API: Clean interface with Agent, Runner, and tool configuration
  • Streaming Support: Real-time response streaming for interactive applications

What is the Affinda MCP server, and what's possible with it?

The Affinda MCP server is an implementation of the Model Context Protocol that connects your AI agent and assistants like Claude, Cursor, etc directly to your Affinda account. It provides structured and secure access to your document processing workflows, so your agent can upload files, extract data, organize workspaces, label documents, and automate annotation management on your behalf.

  • AI-powered document upload and extraction: Instantly have your agent upload new documents for parsing and extract structured data from various formats using Affinda's advanced AI models.
  • Workspace and collection management: Let your agent create, group, and organize documents into collections and workspaces, keeping your document processing streamlined and organized.
  • Automated annotation updates: Empower your agent to batch update or modify multiple document annotations in a single request, saving you time on manual corrections.
  • Document tagging and organization: Direct your agent to create tags and label documents, making it easy to categorize and quickly retrieve important files.
  • Effortless cleanup and resource management: Have your agent delete unwanted documents or collections, ensuring your Affinda account stays tidy and relevant at all times.

What is the Composio tool router, and how does it fit here?

What is Composio SDK?

Composio's Composio SDK helps agents find the right tools for a task at runtime. You can plug in multiple toolkits (like Gmail, HubSpot, and GitHub), and the agent will identify the relevant app and action to complete multi-step workflows. This can reduce token usage and improve the reliability of tool calls. Read more here: Getting started with Composio SDK

The tool router generates a secure MCP URL that your agents can access to perform actions.

How the Composio SDK works

The Composio SDK follows a three-phase workflow:

  1. Discovery: Searches for tools matching your task and returns relevant toolkits with their details.
  2. Authentication: Checks for active connections. If missing, creates an auth config and returns a connection URL via Auth Link.
  3. Execution: Executes the action using the authenticated connection.

Step-by-step Guide

Step by step09 STEPS
1

Prerequisites

Before starting, make sure you have:
  • Composio API Key and OpenAI API Key
  • Primary know-how of OpenAI Agents SDK
  • A live Affinda project
  • Some knowledge of Python or Typescript
2

Getting API Keys for OpenAI and Composio

OpenAI API Key
  • Go to the OpenAI dashboard and create an API key. You'll need credits to use the models, or you can connect to another model provider.
  • Keep the API key safe.
Composio API Key
3

Install dependencies

npm install @composio/openai-agents @openai/agents dotenv

Install the Composio SDK and the OpenAI Agents SDK.

4

Set up environment variables

bash
OPENAI_API_KEY=sk-...your-api-key
COMPOSIO_API_KEY=your-api-key
USER_ID=composio_user@gmail.com

Create a .env file and add your OpenAI and Composio API keys.

5

Import dependencies

import 'dotenv/config';
import { Composio } from '@composio/core';
import { OpenAIAgentsProvider } from '@composio/openai-agents';
import { Agent, hostedMcpTool, run, OpenAIConversationsSession } from '@openai/agents';
import * as readline from 'readline';
What's happening:
  • You're importing all necessary libraries.
  • The Composio and OpenAIAgentsProvider classes are imported to connect your OpenAI agent to Composio tools like Affinda.
6

Set up the Composio instance

dotenv.config();

const composioApiKey = process.env.COMPOSIO_API_KEY;
const userId = process.env.USER_ID;

if (!composioApiKey) {
  throw new Error('COMPOSIO_API_KEY is not set. Create a .env file with COMPOSIO_API_KEY=your_key');
}
if (!userId) {
  throw new Error('USER_ID is not set');
}

// Initialize Composio
const composio = new Composio({
  apiKey: composioApiKey,
  provider: new OpenAIAgentsProvider(),
});
What's happening:
  • dotenv.config() loads your .env file so COMPOSIO_API_KEY and USER_ID are available as environment variables.
  • Creating a Composio instance using the API Key and OpenAIAgentsProvider class.
7

Create a Tool Router session

// Create Tool Router session for Affinda
const session = await composio.create(userId as string, {
  toolkits: ['affinda'],
});
const mcpUrl = session.mcp.url;

What is happening:

  • You give the Tool Router the user id and the toolkits you want available. Here, it is only affinda.
  • The router checks the user's Affinda connection and prepares the MCP endpoint.
  • The returned session.mcp.url is the MCP URL that your agent will use to access Affinda.
  • This approach keeps things lightweight and lets the agent request Affinda tools only when needed during the conversation.
8

Configure the agent

// Configure agent with MCP tool
const agent = new Agent({
  name: 'Assistant',
  model: 'gpt-5',
  instructions:
    'You are a helpful assistant that can access Affinda. Help users perform Affinda operations through natural language.',
  tools: [
    hostedMcpTool({
      serverLabel: 'tool_router',
      serverUrl: mcpUrl,
      headers: { 'x-api-key': composioApiKey },
      requireApproval: 'never',
    }),
  ],
});
What's happening:
  • We're creating an Agent instance with a name, model (gpt-5), and clear instructions about its purpose.
  • The agent's instructions tell it that it can access Affinda and help with queries, inserts, updates, authentication, and fetching database information.
  • The tools array includes a hostedMcpTool that connects to the MCP server URL we created earlier.
  • The headers object includes the Composio API key for secure authentication with the MCP server.
  • requireApproval: 'never' means the agent can execute Affinda operations without asking for permission each time, making interactions smoother.
9

Start chat loop and handle conversation

// Keep conversation state across turns
const conversationSession = new OpenAIConversationsSession();

// Simple CLI
const rl = readline.createInterface({
  input: process.stdin,
  output: process.stdout,
  prompt: 'You: ',
});

console.log('\nComposio Tool Router session created.');
console.log('\nChat started. Type your requests below.');
console.log("Commands: 'exit', 'quit', or 'q' to end\n");

try {
  const first = await run(agent, 'What can you help me with?', { session: conversationSession });
  console.log(`Assistant: ${first.finalOutput}\n`);
} catch (e) {
  console.error('Error:', e instanceof Error ? e.message : e, '\n');
}

rl.prompt();

rl.on('line', async (userInput) => {
  const text = userInput.trim();

  if (['exit', 'quit', 'q'].includes(text.toLowerCase())) {
    console.log('Goodbye!');
    rl.close();
    process.exit(0);
  }

  if (!text) {
    rl.prompt();
    return;
  }

  try {
    const result = await run(agent, text, { session: conversationSession });
    console.log(`\nAssistant: ${result.finalOutput}\n`);
  } catch (e) {
    console.error('Error:', e instanceof Error ? e.message : e, '\n');
  }

  rl.prompt();
});

rl.on('close', () => {
  console.log('\n👋 Session ended.');
  process.exit(0);
});
What's happening:
  • The program prints a session URL that you visit to authorize Affinda.
  • After authorization, the chat begins.
  • Each message you type is processed by the agent using run().
  • The responses are printed to the console.
  • Typing exit, quit, or q cleanly ends the chat.

Complete Code

Here's the complete code to get you started with Affinda and OpenAI Agents SDK:

import 'dotenv/config';
import { Composio } from '@composio/core';
import { OpenAIAgentsProvider } from '@composio/openai-agents';
import { Agent, hostedMcpTool, run, OpenAIConversationsSession } from '@openai/agents';
import * as readline from 'readline';

const composioApiKey = process.env.COMPOSIO_API_KEY;
const userId = process.env.USER_ID;

if (!composioApiKey) {
  throw new Error('COMPOSIO_API_KEY is not set. Create a .env file with COMPOSIO_API_KEY=your_key');
}
if (!userId) {
  throw new Error('USER_ID is not set');
}

// Initialize Composio
const composio = new Composio({
  apiKey: composioApiKey,
  provider: new OpenAIAgentsProvider(),
});

async function main() {
  // Create Tool Router session
  const session = await composio.create(userId as string, {
    toolkits: ['affinda'],
  });
  const mcpUrl = session.mcp.url;

  // Configure agent with MCP tool
  const agent = new Agent({
    name: 'Assistant',
    model: 'gpt-5',
    instructions:
      'You are a helpful assistant that can access Affinda. Help users perform Affinda operations through natural language.',
    tools: [
      hostedMcpTool({
        serverLabel: 'tool_router',
        serverUrl: mcpUrl,
        headers: { 'x-api-key': composioApiKey },
        requireApproval: 'never',
      }),
    ],
  });

  // Keep conversation state across turns
  const conversationSession = new OpenAIConversationsSession();

  // Simple CLI
  const rl = readline.createInterface({
    input: process.stdin,
    output: process.stdout,
    prompt: 'You: ',
  });

  console.log('\nComposio Tool Router session created.');
  console.log('\nChat started. Type your requests below.');
  console.log("Commands: 'exit', 'quit', or 'q' to end\n");

  try {
    const first = await run(agent, 'What can you help me with?', { session: conversationSession });
    console.log(`Assistant: ${first.finalOutput}\n`);
  } catch (e) {
    console.error('Error:', e instanceof Error ? e.message : e, '\n');
  }

  rl.prompt();

  rl.on('line', async (userInput) => {
    const text = userInput.trim();

    if (['exit', 'quit', 'q'].includes(text.toLowerCase())) {
      console.log('Goodbye!');
      rl.close();
      process.exit(0);
    }

    if (!text) {
      rl.prompt();
      return;
    }

    try {
      const result = await run(agent, text, { session: conversationSession });
      console.log(`\nAssistant: ${result.finalOutput}\n`);
    } catch (e) {
      console.error('Error:', e instanceof Error ? e.message : e, '\n');
    }

    rl.prompt();
  });

  rl.on('close', () => {
    console.log('\nSession ended.');
    process.exit(0);
  });
}

main().catch((err) => {
  console.error('Fatal error:', err);
  process.exit(1);
});

Conclusion

This was a starter code for integrating Affinda MCP with OpenAI Agents SDK to build a functional AI agent that can interact with Affinda.

Key features:

  • Hosted MCP tool integration through Composio's Tool Router
  • SQLite session persistence for conversation history
  • Simple async chat loop for interactive testing
You can extend this by adding more toolkits, implementing custom business logic, or building a web interface around the agent.
TOOLS

Supported Tools

Every Affinda action and event your agent gets out of the box.

Add Tag to Documents

Tool to add a tag to multiple documents in a single operation.

Batch Update Annotations

Batch update multiple document annotations in a single API call.

Create API User

Tool to create a new API user within an organization.

Batch Create Annotations

Batch create multiple document annotations in a single API call.

Create Collection

Tool to create a new collection.

Create Data Field For Collection

Tool to create a data field for a collection along with a new data point.

Create Data Source

Tool to create a custom mapping data source.

Create Data Source Value

Tool to add a new value to a mapping data source.

Create Document

Upload a document to Affinda for parsing and data extraction.

Create Document Type

Tool to create a new document type in the specified organization.

Create Extractor

Tool to create a new extractor.

Create Document from Data

Create a document from structured resume or job description data for Search & Match.

Create Index

Tool to create a new index for search and match functionality.

Create Invitation

Tool to create a new organization invitation.

Create Job Description Search

Search through parsed job descriptions using custom criteria or resume matching.

Create Job Description Search Embed URL

Tool to create and return a signed URL for the embeddable job description search tool.

Create Organization

Tool to create a new organization.

Create RESTHook Subscription

Tool to create a new RESTHook subscription.

Create Resume Search

Tool to search through parsed resumes using three methods: match to a job description, match to a resume, or custom criteria.

Create Resume Search Embed URL

Tool to create and return a signed URL for the embeddable resume search tool.

Create Tag

Creates a new tag in the specified workspace.

Create Validation Result

Create a validation result for document annotations in Affinda.

Batch Create Validation Results

Batch create multiple validation results for document annotations in a single API call.

Create Workspace

Tool to create a new workspace.

Create Workspace Membership

Tool to add a user to a workspace by creating a membership.

Batch Delete Annotations

Batch delete multiple document annotations in a single API call.

Delete Collection

Permanently delete a collection from Affinda by its identifier.

Delete Data Source

Permanently delete a mapping data source from the database by its identifier.

Delete Data Source Value

Tool to delete a specific value from a mapping data source.

Delete Document

Tool to delete a specific document by its ID.

Delete Document Type

Tool to permanently delete a document type by its identifier.

Delete Index

Tool to permanently delete an index from Affinda by its name.

Delete Invitation

Tool to delete an invitation by its identifier.

Delete Organization

Permanently deletes an organization from Affinda.

Delete Resthook Subscription

Tool to delete a specific resthook subscription by ID.

Delete Tag

Permanently delete a tag from Affinda by its ID.

Delete Validation Results

Delete multiple validation results in a single API call.

Delete Workspace

Tool to delete a specific workspace by its ID.

Delete Workspace Membership

Tool to remove a user from a workspace by membership ID.

Get All API Users

Tool to retrieve a list of all API users.

Get All Document Splitters

Tool to get a list of all document splitters.

Get All Invitations

Tool to retrieve all invitations you created or sent to you.

Get Organization Memberships

Retrieve all organization memberships across the account.

Get Tags

Tool to list all tags.

Get All Validation Results

Tool to list validation results for documents.

Get Workspace Memberships

Retrieve all workspace memberships across the account.

Get Annotations

Retrieves all annotations for a specific document.

Get Collection

Tool to retrieve details of a specific collection by its ID.

Get Collections

Tool to retrieve a list of all collections.

Get Data Source

Tool to retrieve details of a specific mapping data source by its identifier.

Get Data Source Value

Tool to retrieve a specific value from a mapping data source.

Get Data Source Values

Tool to retrieve all values from a mapping data source.

Get Document

Retrieve full details and parsed data for a specific document by its identifier.

Get Document Redacted

Tool to retrieve the redacted version of a document as a PDF file.

Get Documents

Tool to retrieve a list of all documents.

Get Document Splitter

Tool to retrieve details of a specific document splitter by its identifier.

Get Document Type

Tool to retrieve details of a specific document type by its ID.

Get Document Type JSON Schema

Tool to generate a JSON schema from a document type by its identifier.

Get Document Type Pydantic Models

Tool to generate Pydantic model code from a document type's schema.

Get Document Types

Retrieve all document types accessible to the authenticated user.

Get Extractor

Tool to retrieve detailed information about a specific extractor by its identifier.

Get Extractors

Retrieve all extractors available for an organization.

Get Index Documents

Tool to retrieve all indexed documents for a specific index.

Get Invitation

Tool to retrieve details of a specific organization invitation by its identifier.

Get Job Description Search Config

Tool to get the configuration for the logged in user's embeddable job description search tool.

Get Mapping

Tool to retrieve a specific mapping by its identifier.

Get Organization

Tool to retrieve details of a specific organization by its ID.

Get Organization Membership

Tool to retrieve details of a specific organization membership by its ID.

Get Organizations

Retrieves all organizations accessible to the authenticated user.

Get Resthook Subscription

Tool to retrieve details of a specific resthook subscription by its ID.

Get RESTHook Subscriptions

Tool to retrieve a list of all RESTHook subscriptions.

Get Tag

Tool to retrieve details of a specific tag by its ID.

Get Usage by Workspace

Retrieves monthly document processing usage statistics for a specific workspace.

Get Workspace

Tool to retrieve details of a specific workspace by its ID.

Get Workspace Membership

Tool to retrieve details of a specific workspace membership by its ID.

Get Workspaces

Tool to retrieve a list of all workspaces.

List Data Points

Tool to retrieve all data points.

List Data Sources

Tool to retrieve the list of all custom mapping data sources.

List Indexes

Tool to retrieve a list of all search indexes.

List Mappings

Tool to retrieve the list of all custom data mappings.

List Occupation Groups

Tool to retrieve the list of searchable occupation groups.

List Resume Search Config

Tool to get the configuration for the logged in user's embeddable resume search tool.

List Resume Search Job Title Suggestions

Tool to get job title suggestions based on provided job title(s).

List Resume Search Skill Suggestions

Tool to get skill suggestions based on provided skills.

Remove Tag from Documents

Remove a tag from multiple documents in a single batch operation.

Replace Data Source Values

Tool to completely replace all values in a mapping data source.

Split Document Pages

Split a document into multiple documents by dividing its pages.

Update Annotation

Tool to update data of a single annotation in Affinda.

Update Collection

Tool to update specific fields of a collection.

Update Data Field For Collection

Tool to update a data field configuration for a collection's data point.

Update Data Source Value

Tool to update an existing value in a mapping data source.

Update Document

Tool to update specific fields of a document.

Update Document Data

Update parsed data for a resume or job description document in Affinda.

Update Document Type

Tool to update a document type by its identifier.

Update Extractor

Tool to update specific fields of an extractor.

Update Index

Tool to update the name of an existing search index.

Update Invitation

Tool to update an organization invitation's role.

Update Job Description Search Config

Tool to update the configuration for the logged in user's embeddable job description search tool.

Update Mapping

Tool to update a specific mapping's settings.

Update Organization

Tool to update specific fields of an organization.

Update Organization Membership

Tool to update an organization membership's role.

Update RESTHook Subscription

Tool to update an existing RESTHook subscription.

Update Resume Search Config

Tool to update the configuration for the logged in user's embeddable resume search tool.

Update Tag

Tool to update data of a tag.

Update Workspace

Tool to update specific fields of a workspace.

FAQ

Frequently asked questions

With a standalone Affinda MCP server, the agents and LLMs can only access a fixed set of Affinda tools tied to that server. However, with the Composio Tool Router, agents can dynamically load tools from Affinda and many other apps based on the task at hand, all through a single MCP endpoint.

Yes, you can. OpenAI Agents SDK fully supports MCP integration. You get structured tool calling, message history handling, and model orchestration while Tool Router takes care of discovering and serving the right Affinda tools.

Yes, absolutely. You can configure which Affinda scopes and actions are allowed when connecting your account to Composio. You can also bring your own OAuth credentials or API configuration so you keep full control over what the agent can do.

All sensitive data such as tokens, keys, and configuration is fully encrypted at rest and in transit. Composio is SOC 2 Type 2 compliant and follows strict security practices so your Affinda data and credentials are handled as safely as possible.

Start with Affinda.It takes 30 seconds.

Managed auth, hosted MCP servers, and every Affinda tool your agent needs.Free to start.

Start building