Spaces:
Configuration error
Configuration error
Delete README.md
Browse files
README.md
DELETED
|
@@ -1,58 +0,0 @@
|
|
| 1 |
-
---
|
| 2 |
-
title: Databricks
|
| 3 |
-
emoji: 🏢
|
| 4 |
-
colorFrom: yellow
|
| 5 |
-
colorTo: pink
|
| 6 |
-
sdk: static
|
| 7 |
-
pinned: false
|
| 8 |
-
---
|
| 9 |
-
|
| 10 |
-
# About Us
|
| 11 |
-
|
| 12 |
-
With origins in academia and the open source community, Databricks was founded in 2013 by the original creators of Apache Spark™, Delta Lake and MLflow.
|
| 13 |
-
Our Data Intelligence Platform unifies data, AI and governance to make it easy for enterprises to create AI applications that understand their data.
|
| 14 |
-
|
| 15 |
-
Bolstered by the 2023 acquisition of MosaicML, the combined AI R&D teams – creators of the Dolly models and [IFT dataset](http://databricks-dolly-15k), and the
|
| 16 |
-
[MPT family of models](https://huggingface.co/collections/mosaicml/mpt-6564f3d9e5aac326bfa22def) –
|
| 17 |
-
are now known as Databricks Mosaic AI Research. We continue to use rigorous science and engineering to deliver state-of-the-art generative AI training
|
| 18 |
-
and inference capabilities to organizations, while enabling them to retain control, security, and ownership over their valuable data.
|
| 19 |
-
|
| 20 |
-
To get started with using models hosted on Hugging Face for training and inference on the Databricks platform,
|
| 21 |
-
[sign up for a free trial](https://www.databricks.com/try-databricks)!
|
| 22 |
-
|
| 23 |
-
# Resources
|
| 24 |
-
|
| 25 |
-
## [LLM Foundry](https://github.com/mosaicml/llm-foundry/tree/main)
|
| 26 |
-
|
| 27 |
-
This repo contains code for training, finetuning, evaluating, and deploying LLMs for inference with [Composer](https://github.com/mosaicml/composer)
|
| 28 |
-
on the Databricks Data Intelligence Platform.
|
| 29 |
-
|
| 30 |
-
## [Composer Library](https://github.com/mosaicml/composer)
|
| 31 |
-
|
| 32 |
-
The open source Composer library makes it easy to train models faster at the algorithmic level. It is built on top of PyTorch.
|
| 33 |
-
Use our collection of speedup methods in your own training loop or—for the best experience—with our Composer trainer.
|
| 34 |
-
|
| 35 |
-
## [StreamingDataset](https://github.com/mosaicml/streaming)
|
| 36 |
-
|
| 37 |
-
Fast, accurate streaming of training data from cloud storage. We built `StreamingDataset` to make training on large datasets from cloud storage as fast,
|
| 38 |
-
cheap, and scalable as possible.
|
| 39 |
-
|
| 40 |
-
It’s specially designed for multi-node, distributed training for large models—maximizing correctness guarantees, performance, and ease of use.
|
| 41 |
-
Now, you can efficiently train anywhere, independent of your training data location. Just stream in the data you need, when you need it.
|
| 42 |
-
To learn more about why we built `StreamingDataset`, read our [announcement blog](https://www.databricks.com/blog/mosaicml-streamingdataset).
|
| 43 |
-
|
| 44 |
-
`StreamingDataset` is compatible with any data type, including images, text, video, and multimodal data.
|
| 45 |
-
|
| 46 |
-
With support for major cloud storage providers, and designed as a drop-in replacement for your PyTorch
|
| 47 |
-
[`IterableDataset`](https://pytorch.org/docs/stable/data.html#torch.utils.data.IterableDataset) class,
|
| 48 |
-
`StreamingDataset` seamlessly integrates into your existing training workflows.
|
| 49 |
-
|
| 50 |
-
## [Examples Repo](https://github.com/mosaicml/examples)
|
| 51 |
-
|
| 52 |
-
This repo contains reference examples for training ML models quickly and to high accuracy. It's designed to be easily forked and modified.
|
| 53 |
-
It currently features the following examples:
|
| 54 |
-
|
| 55 |
-
- [ResNet-50 + ImageNet](https://github.com/mosaicml/examples#resnet-50--imagenet)
|
| 56 |
-
- [DeeplabV3 + ADE20k](https://github.com/mosaicml/examples#deeplabv3--ade20k)
|
| 57 |
-
- [GPT / Large Language Models](https://github.com/mosaicml/examples#large-language-models-llms)
|
| 58 |
-
- [BERT](https://github.com/mosaicml/examples#bert)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|