Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,9 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
# Rhesis: Collaborative Testing for LLM & Agentic Applications
|
| 2 |
|
| 3 |
<p align="center">
|
|
@@ -46,7 +52,7 @@ Generate tests from requirements, simulate conversation flows, detect adversaria
|
|
| 46 |
|
| 47 |
<p align="center">
|
| 48 |
<a href="https://rhesis.ai/?video=open" target="_blank">
|
| 49 |
-
<img src="https://
|
| 50 |
loading="lazy"
|
| 51 |
width="1080"
|
| 52 |
alt="Rhesis Platform Overview - Click to watch demo">
|
|
@@ -58,7 +64,7 @@ Generate tests from requirements, simulate conversation flows, detect adversaria
|
|
| 58 |
## Core features
|
| 59 |
|
| 60 |
<p align="center">
|
| 61 |
-
<img src="https://
|
| 62 |
loading="lazy"
|
| 63 |
width="1080"
|
| 64 |
alt="Rhesis Core Features">
|
|
@@ -193,6 +199,45 @@ Six integrated phases from project setup to team collaboration:
|
|
| 193 |
|
| 194 |
---
|
| 195 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 196 |
## Deployment options
|
| 197 |
|
| 198 |
| Option | Best For | Setup Time |
|
|
@@ -249,7 +294,7 @@ See [Integration Docs](https://docs.rhesis.ai/development) for setup instruction
|
|
| 249 |
|
| 250 |
## Open source
|
| 251 |
|
| 252 |
-
[MIT licensed](LICENSE). No plans to relicense core features. Enterprise version live in `ee/` folders and remain separate.
|
| 253 |
|
| 254 |
We built Rhesis because existing LLM testing tools didn't meet our needs. If you face the same challenges, contributions are welcome.
|
| 255 |
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
sdk: docker
|
| 4 |
+
emoji: 📚
|
| 5 |
+
short_description: Collaborative Testing for LLM & Agentic Applications
|
| 6 |
+
---
|
| 7 |
# Rhesis: Collaborative Testing for LLM & Agentic Applications
|
| 8 |
|
| 9 |
<p align="center">
|
|
|
|
| 52 |
|
| 53 |
<p align="center">
|
| 54 |
<a href="https://rhesis.ai/?video=open" target="_blank">
|
| 55 |
+
<img src="https://raw.githubusercontent.com/rhesis-ai/rhesis/main/.github/images/GH_Short_Demo.png"
|
| 56 |
loading="lazy"
|
| 57 |
width="1080"
|
| 58 |
alt="Rhesis Platform Overview - Click to watch demo">
|
|
|
|
| 64 |
## Core features
|
| 65 |
|
| 66 |
<p align="center">
|
| 67 |
+
<img src="https://raw.githubusercontent.com/rhesis-ai/rhesis/main/.github/images/GH_Features.png"
|
| 68 |
loading="lazy"
|
| 69 |
width="1080"
|
| 70 |
alt="Rhesis Core Features">
|
|
|
|
| 199 |
|
| 200 |
---
|
| 201 |
|
| 202 |
+
## What you can test
|
| 203 |
+
|
| 204 |
+
| Use Case | What Rhesis Tests |
|
| 205 |
+
|----------|-------------------|
|
| 206 |
+
| **Conversational AI** | Conversation simulation, role adherence, knowledge retention |
|
| 207 |
+
| **RAG Systems** | Context relevance, faithfulness, hallucination detection |
|
| 208 |
+
| **NL-to-SQL / NL-to-Code** | Query accuracy, syntax validation, edge case handling |
|
| 209 |
+
| **Agentic Systems** | Tool selection, goal achievement, multi-agent coordination |
|
| 210 |
+
|
| 211 |
+
---
|
| 212 |
+
|
| 213 |
+
## SDK: Code-first testing
|
| 214 |
+
|
| 215 |
+
Test your Python functions directly with the `@endpoint` decorator:
|
| 216 |
+
|
| 217 |
+
```python
|
| 218 |
+
from rhesis.sdk.decorators import endpoint
|
| 219 |
+
|
| 220 |
+
@endpoint(name="my-chatbot")
|
| 221 |
+
def chat(message: str) -> str:
|
| 222 |
+
# Your LLM logic here
|
| 223 |
+
return response
|
| 224 |
+
```
|
| 225 |
+
|
| 226 |
+
**Features:** Zero configuration, automatic parameter binding, auto-reconnection, environment management (dev/staging/production).
|
| 227 |
+
|
| 228 |
+
**Generate tests programmatically:**
|
| 229 |
+
|
| 230 |
+
```python
|
| 231 |
+
from rhesis.sdk.synthesizers import PromptSynthesizer
|
| 232 |
+
|
| 233 |
+
synthesizer = PromptSynthesizer(
|
| 234 |
+
prompt="Generate tests for a medical chatbot that must never provide diagnosis"
|
| 235 |
+
)
|
| 236 |
+
test_set = synthesizer.generate(num_tests=10)
|
| 237 |
+
```
|
| 238 |
+
|
| 239 |
+
---
|
| 240 |
+
|
| 241 |
## Deployment options
|
| 242 |
|
| 243 |
| Option | Best For | Setup Time |
|
|
|
|
| 294 |
|
| 295 |
## Open source
|
| 296 |
|
| 297 |
+
[MIT licensed](LICENSE). No plans to relicense core features. Enterprise version will live in `ee/` folders and remain separate.
|
| 298 |
|
| 299 |
We built Rhesis because existing LLM testing tools didn't meet our needs. If you face the same challenges, contributions are welcome.
|
| 300 |
|