OpenAI Proxy

​

Overview

In this method, Aporia acts as a proxy, forwarding your requests to OpenAI and simultaneously invoking guardrails. The returned response is either the original from OpenAI or a modified version enforced by Aporia’s policies.

This integration supports real-time applications through streaming capabilities, making it particularly useful for chatbots.

​

Prerequisites

To use this integration method, ensure you have:

1. Created an Aporia Guardrails project.

​

Integration Guide

​

Step 1: Gather Aporia’s Base URL and API Key

1. Log into the Aporia dashboard.
2. Select your project and click on the Integration tab.
3. Under Integration, ensure that Host URL is active.
4. Copy the Host URL.
5. Click on “API Keys Table” to navigate to your keys table.
6. Create a new API key and save it somewhere safe and accessible. If you lose this secret key, you’ll need to create a new one.

​

Step 2: Integrate into Your Code

1. Locate the section in your codebase where you use the OpenAI’s API.
2. Replace the existing base_url in your code with the URL copied from the Aporia dashboard.
3. Add the X-APORIA-API-KEY header to your HTTP requests using the default_headers parameter provided by OpenAI’s SDK.

​

Code Example

Here is a basic example of how to configure the OpenAI client to use Aporia’s OpenAI Proxy method:

​

Azure OpenAI

To integrate Aporia with Azure OpenAI, use the X-AZURE-OPENAI-ENDPOINT header to specify your Azure OpenAI endpoint.