replit.md

ai-go Gateway

Overview

A Go-based API gateway that proxies requests to NVIDIA's language model API, exposing an OpenAI-compatible interface.

Stack

• Language: Go 1.21+
• Port: 8080 (configurable via PORT env variable)

Structure

/
├── main.go          # HTTP server, request handling, streaming proxy logic
├── prompts.go       # Prompt utilities
├── provider.ts      # TypeScript provider file
├── system_prompts/  # System prompt files for various models
├── go.mod           # Go module definition
├── Dockerfile       # Container configuration
└── README.md        # Documentation

Available Endpoints

• GET /v1/models — List available model aliases
• POST /v1/chat/completions — Chat completions (OpenAI-compatible, supports streaming)

Model Aliases

Alias	Model
Bielik-11b	speakleash/bielik-11b-v2.6-instruct
GLM-4.7	z-ai/glm4.7
Mistral-Small-4	mistralai/mistral-small-4-119b-2603
DeepSeek-V3.1	deepseek-ai/deepseek-v3.1
Kimi-K2	moonshotai/kimi-k2-instruct

Running

go run .

Authentication

Gateway requires the Authorization: Bearer connect header (configured via GatewayAPIKey).