Update README.md

README.md

@@ -16,4 +16,39 @@ tags:
 - obom
 - ml-bom
 - cbom
----
+---
+
+**PREVIEW RELEASE**
+
+## Testing with LM Studio
+
+Use [LM Studio](https://lmstudio.ai/docs/basics/download-model) to download and test this model. Search for `CycloneDX/cdx1-mlx` (Full version) or `CycloneDX/cdx1-mlx-8bit` (Recommended).
+
+Use the below configurations:
+
+System Prompt: `You are a helpful assistant to the user.` Use Prompt [Template](https://lmstudio.ai/docs/advanced/prompt-template).
+Temperature: 0.05
+Max tokens: 8192 or 16000
+Context length: 16000
+
+## Testing with mlx
+
+Install [miniconda](https://docs.anaconda.com/miniconda/install/) or Python 3.11
+
+```
+conda create --name cdx1-mlx python=3.11
+conda activate cdx1-mlx
+pip install mlx
+```
+
+LLM Inference from the CLI.
+
+```shell
+mlx_lm.generate --model CycloneDX/cdx1-mlx --system-prompt "You are a helpful assistant to the user." --prompt "tell me about cdxgen" --temp 0.05
+```
+
+Use the 8 bit version for better speed and performance.
+
+```shell
+mlx_lm.generate --model CycloneDX/cdx1-mlx-8bit --system-prompt "You are a helpful assistant to the user." --prompt "tell me about cdxgen" --temp 0.05
+```