AutogenLLM / LLMCONFIG /LLM_CONFIG_LIST.json
genaitiwari's picture
groq llm
0aca678
raw
history blame contribute delete
217 Bytes
[
{
"model": "Open-Orca/Mistral-7B-OpenOrca",
"model_client_cls": "CustomModelClient",
"device": "cuda",
"n": 1,
"params": {
"max_length": 1000
}
}
]