File size: 2,331 Bytes
93ad15b
ad99445
 
 
 
 
93ad15b
 
e251d62
ad99445
 
 
 
 
 
 
 
 
 
e251d62
 
 
ad99445
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
e251d62
ad99445
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
e251d62
 
ad99445
 
 
 
e251d62
 
 
ad99445
 
e251d62
 
 
 
 
ad99445
e251d62
 
ad99445
e251d62
ad99445
e251d62
 
 
 
ad99445
e251d62
ad99445
 
e251d62
 
ad99445
e251d62
ad99445
e251d62
ad99445
e251d62
 
 
 
 
ad99445
e251d62
ad99445
e251d62
ad99445
 
 
 
 
 
e251d62
ad99445
e251d62
ad99445
 
 
e251d62
ad99445
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
---
license: mit
title: KORA AI
emoji: πŸ‘€
colorTo: blue
short_description: KORA is the intelligent AI assistant for the Kontyra ecosyst
sdk: docker
---

# KORA AI

KORA is the intelligent AI assistant for the Kontyra ecosystem.

This Space hosts the KORA application and related AI services.


## Overview

This repository contains the backend infrastructure for KORA, built with FastAPI, Transformers, and Docker. The API is designed to be compatible with OpenAI-style chat completion endpoints while supporting custom system prompts, knowledge-base integration, and streaming responses.

## Features

* OpenAI-compatible API endpoint
* FastAPI-based architecture
* Streaming responses via Server-Sent Events (SSE)
* Docker-ready deployment
* Environment-based configuration
* Custom KORA system prompt injection
* Knowledge-base context integration
* Scalable backend foundation for future Kontyra products

## Technology Stack

* Python
* FastAPI
* Transformers
* PyTorch
* Docker
* Hugging Face

## API Endpoint

```http
POST /v1/chat/completions
```

### Example Request

```json
{
  "model": "KORA",
  "stream": true,
  "messages": [
    {
      "role": "user",
      "content": "Who created KORA?"
    }
  ]
}
```

## Project Structure

```text
app/
β”œβ”€β”€ routes/
β”œβ”€β”€ services/
β”œβ”€β”€ utils/
β”œβ”€β”€ prompts/
β”œβ”€β”€ knowledge/
β”œβ”€β”€ main.py
β”œβ”€β”€ requirements.txt
└── Dockerfile
```

## Environment Variables

```bash
APP_NAME="KORA AI"
APP_ENV="production"
LOG_LEVEL="INFO"

MODEL_NAME="microsoft/Phi-3-mini-4k-instruct"

DEFAULT_TEMPERATURE=0.7
DEFAULT_TOP_P=0.9
DEFAULT_MAX_TOKENS=512

MAX_INPUT_TOKENS=3072

TRUST_REMOTE_CODE=true
LOW_CPU_MEM_USAGE=true
```

## Deployment

This Space is configured as a Docker Space and automatically starts the KORA API service when deployed.

The application listens on the port provided by Hugging Face:

```bash
uvicorn main:app --host 0.0.0.0 --port ${PORT:-7860}
```

## Vision

KORA serves as the intelligence layer of the Kontyra ecosystem and is being developed to support future products including:

* DevOS
* VUX
* Kontyra Jobs
* Tech Visionaries Network (TVN)
* Kontyra Learn
* Kontyra Projects

## Author

**Heritage Oluwalonimi Oladoye**

Founder of Kontyra

Building technology that creates impact across Nigeria, Africa, and the world.