File size: 2,585 Bytes
c33a7ce |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 |
# AI Lab Recipes
This repo contains recipes for building and running containerized AI and LLM
Applications with Podman.
These containerized AI recipes can be used to help developers quickly prototype
new AI and LLM based applications locally, without the need for relying on any other
externally hosted services. Since they are already containerized, it also helps
developers move quickly from prototype to production.
## Model servers
#### What's a model server?
A model server is a program that serves machine-learning models, such as LLMs, and
makes their functions available via an API. This makes it easy for developers to
incorporate AI into their applications. This repository provides descriptions and
code for building several of these model servers.
Many of the sample applications rely on the `llamacpp_python` model server by
default. This server can be used for various generative AI applications with various models.
However, each sample application can be paired with a variety of model servers.
Learn how to build and run the llamacpp_python model server by following the
[llamacpp_python model server README](/model_servers/llamacpp_python/README.md).
## Current Recipes
Recipes consist of at least two components: A model server and an AI application.
The model server manages the model, and the AI application provides the specific
logic needed to perform some specific task such as chat, summarization, object
detection, etc.
There are several sample applications in this repository that can be found in the
[recipes](./recipes) directory.
They fall under the categories:
* [audio](./recipes/audio)
* [computer-vision](./recipes/computer_vision)
* [multimodal](./recipes/multimodal)
* [natural language processing](./recipes/natural_language_processing)
Learn how to build and run each application by visiting their README's.
For example, learn how to run the [chatbot recipe here](./recipes/natural_language_processing/chatbot).
## Current AI Lab Recipe images built from this repository
Images for many sample applications and models are available in `quay.io`. All
currently built images are tracked in
[ailab-images.md](./ailab-images.md)
## [Training](./training/README.md)
Linux Operating System Bootable containers enabled for AI Training
## Setting Up Git Hooks
To install our standard git hooks, run the following command:
```sh
./install-hooks.sh
```
### pre-commit hook
Ensures that `training/ilab-wrapper/ilab` is duplicated into `training/nvidia-bootc/duplicated/ilab-wrapper/ilab`
|