Integration Guide

Overview

This guide shows how to build dynamic integrations that work with any external service in the proxy API. Learn how to parse path templates, handle different response types, and create a reusable client.

Developer

---

Understanding Path Templates

Each endpoint has a path_template that defines the upstream URL path. Placeholders in curly braces {param_name} must be provided via the path_params field.

Example: Extracting Required Path Parameters

Given an endpoint with:

{
  "slug": "tts",
  "path_template": "/v1/text-to-speech/{voice_id}",
  "http_method": "POST"
}

The {voice_id} placeholder tells you that path_params.voice_id is required:

// Request must include path_params with voice_id
{
  "path_params": {
    "voice_id": "21m00Tcm4TlvDq8ikWAM"  // Required - matches {voice_id} in template
  },
  "body": {
    "text": "Hello world"
  }
}

Parsing Path Templates Dynamically

function extractPathParams(pathTemplate) {
  const regex = /\{(\w+)\}/g;
  const params = [];
  let match;
  while ((match = regex.exec(pathTemplate)) !== null) {
    params.push(match[1]);
  }
  return params;
}

// Usage
const template = "/v1/text-to-speech/{voice_id}";
const required = extractPathParams(template);
// Returns: ["voice_id"]

const template2 = "/v2/videos/{template_id}/generate";
const required2 = extractPathParams(template2);
// Returns: ["template_id"]

---

Understanding Response Modes

Each endpoint specifies a response_mode that tells you how to handle the response:

Handling Different Response Types

async function invokeEndpoint(service, action, payload, responseMode) {
  const response = await fetch(
    `/api/ai-proxy/orgs/${org}/services/${service}/${action}/`,
    {
      method: 'POST',
      headers: {
        'Authorization': `Api-Key ${apiKey}`,
        'Content-Type': 'application/json',
      },
      body: JSON.stringify(payload)
    }
  );

  if (!response.ok) {
    const error = await response.json();
    throw new Error(error.detail || error.error || 'Request failed');
  }

  // Handle based on response_mode from endpoint config
  switch (responseMode) {
    case 'json':
      return await response.json();

    case 'binary':
    case 'passthrough':
      // Check content type to determine handling
      const contentType = response.headers.get('Content-Type') || '';
      if (contentType.includes('application/json')) {
        return await response.json();
      } else if (
        contentType.includes('audio/') ||
        contentType.includes('video/') ||
        contentType.includes('image/')
      ) {
        return await response.blob();
      }
      return await response.text();

    case 'stream':
      return response.body; // Returns ReadableStream

    default:
      return await response.json();
  }
}

---

Complete Dynamic Integration Example

This example shows how to build a fully dynamic integration that works with any service:

class ExternalProxyClient {
  constructor(org, apiKey) {
    this.org = org;
    this.apiKey = apiKey;
    this.baseUrl = `/api/ai-proxy/orgs/${org}`;
    this.servicesCache = null;
    this.serviceDetailsCache = {};
  }

  async getServices() {
    if (this.servicesCache) return this.servicesCache;

    const response = await fetch(`${this.baseUrl}/services/`, {
      headers: { 'Authorization': `Api-Key ${this.apiKey}` }
    });
    this.servicesCache = await response.json();
    return this.servicesCache;
  }

  async getServiceDetails(serviceSlug) {
    if (this.serviceDetailsCache[serviceSlug]) {
      return this.serviceDetailsCache[serviceSlug];
    }

    const response = await fetch(`${this.baseUrl}/services/${serviceSlug}/`, {
      headers: { 'Authorization': `Api-Key ${this.apiKey}` }
    });
    const details = await response.json();
    this.serviceDetailsCache[serviceSlug] = details;
    return details;
  }

  extractPathParams(pathTemplate) {
    const regex = /\{(\w+)\}/g;
    const params = [];
    let match;
    while ((match = regex.exec(pathTemplate)) !== null) {
      params.push(match[1]);
    }
    return params;
  }

  async invoke(serviceSlug, actionSlug, payload = {}) {
    // Get endpoint details to know response mode
    const service = await this.getServiceDetails(serviceSlug);
    const endpoint = service.endpoints.find(e => e.slug === actionSlug);

    if (!endpoint) {
      throw new Error(`Endpoint '${actionSlug}' not found in service '${serviceSlug}'`);
    }

    // Validate required path params
    const requiredParams = this.extractPathParams(endpoint.path_template);
    const providedParams = Object.keys(payload.path_params || {});
    const missingParams = requiredParams.filter(p => !providedParams.includes(p));

    if (missingParams.length > 0) {
      throw new Error(`Missing required path_params: ${missingParams.join(', ')}`);
    }

    // Make the request
    const response = await fetch(
      `${this.baseUrl}/services/${serviceSlug}/${actionSlug}/`,
      {
        method: 'POST',
        headers: {
          'Authorization': `Api-Key ${this.apiKey}`,
          'Content-Type': 'application/json',
        },
        body: JSON.stringify(payload)
      }
    );

    if (!response.ok) {
      const error = await response.json().catch(() => ({ detail: 'Request failed' }));
      throw new Error(error.detail || error.error || `HTTP ${response.status}`);
    }

    // Handle response based on mode
    const contentType = response.headers.get('Content-Type') || '';

    if (endpoint.response_mode === 'binary' ||
        contentType.includes('audio/') ||
        contentType.includes('video/') ||
        contentType.includes('image/')) {
      return {
        type: 'binary',
        blob: await response.blob(),
        contentType: contentType
      };
    }

    return {
      type: 'json',
      data: await response.json()
    };
  }
}

// Usage Example
async function example() {
  const client = new ExternalProxyClient('my-org', 'my-api-key');

  // 1. Discover available services
  const services = await client.getServices();
  console.log('Available services:', services.map(s => s.display_name));

  // 2. Get details for a specific service
  const elevenlabs = await client.getServiceDetails('elevenlabs');
  console.log('ElevenLabs endpoints:', elevenlabs.endpoints.map(e => e.slug));

  // 3. Check what params an endpoint needs
  const ttsEndpoint = elevenlabs.endpoints.find(e => e.slug === 'tts');
  const requiredParams = client.extractPathParams(ttsEndpoint.path_template);
  console.log('TTS requires path_params:', requiredParams); // ["voice_id"]

  // 4. Invoke the endpoint
  const result = await client.invoke('elevenlabs', 'tts', {
    path_params: { voice_id: '21m00Tcm4TlvDq8ikWAM' },
    body: {
      text: 'Hello, world!',
      model_id: 'eleven_multilingual_v2'
    }
  });

  // 5. Handle the response based on type
  if (result.type === 'binary') {
    const audioUrl = URL.createObjectURL(result.blob);
    const audio = new Audio(audioUrl);
    audio.play();
  } else {
    console.log('Response:', result.data);
  }
}

---

Upstream API Documentation

For details on what body parameters each upstream API expects, refer to their official documentation:

Finding Required Body Parameters

The body field in your request is passed directly to the upstream API. To know what parameters are required:

1. Use the discovery endpoints to find the upstream path_template
2. Check the upstream API documentation for that endpoint's request body schema
3. Use list endpoints first (e.g., list-voices, list-avatars) to get valid IDs

Example: Building a TTS Request

// Step 1: Get available voices
const voices = await client.invoke('elevenlabs', 'list-voices', {});
const voiceId = voices.data.voices[0].voice_id;

// Step 2: Get available models
const models = await client.invoke('elevenlabs', 'list-models', {});
const modelId = models.data[0].model_id;

// Step 3: Make TTS request with discovered values
const audio = await client.invoke('elevenlabs', 'tts', {
  path_params: { voice_id: voiceId },
  body: {
    text: 'Hello, world!',
    model_id: modelId,
    voice_settings: {
      stability: 0.5,
      similarity_boost: 0.5
    }
  }
});

---

Related Pages

• Overview - Authentication and service discovery
• ElevenLabs Integration - Text-to-speech endpoints
• HeyGen Integration - Video generation endpoints
• Error Handling - Error responses and credential setup