BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
Paper • 2211.05100 • Published • 37
Model Card for Model ID
This model card describes a transformers model based on the Bloom 560m architecture, fine-tuned with LORA (Linear Regression for Out-of-Distribution Adaptation). This model is intended for advanced users familiar with large language models and LORA.
Model Description
This is a Bloom 560m model fine-tuned with LORA. Bloom 560m is a factual language model from Adept AI, trained on a massive dataset of text and code. LORA is a technique for adapting a pre-trained model to new data without retraining the entire model.
- Developed by: Tayyib Ul Hassan
- Finetuned from model: Bloom 560m (original model by Adept AI)
Model Sources
- Paper: Link to paper!
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support