Add Lambda support information
Browse files
README.md
CHANGED
|
@@ -23,6 +23,28 @@ tags:
|
|
| 23 |
|
| 24 |
# lambda-1-360m-mid
|
| 25 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 26 |
lambda-1-360m-mid is an experimental Japanese language model based on [`lambda-1-360m-base`](https://huggingface.co/KeisukeMiyamoto/lambda-1-360m-base) and further pretrained on a synthetic Japanese textbook corpus.
|
| 27 |
|
| 28 |
All training code is publicly available at [KeisukeMiyamoto1324/lambda](https://github.com/KeisukeMiyamoto1324/lambda).
|
|
|
|
| 23 |
|
| 24 |
# lambda-1-360m-mid
|
| 25 |
|
| 26 |
+
## Support Lambda
|
| 27 |
+
|
| 28 |
+
[Lambda](https://github.com/KeisukeMiyamoto1324/lambda) is a project developed by a student to build small Japanese language models from scratch. The datasets, source code, and model weights are publicly available.
|
| 29 |
+
|
| 30 |
+
Training language models is very expensive, and I have funded the project with income from my part-time job. As the models grow, the cost is becoming too high for me to maintain the current development pace.
|
| 31 |
+
|
| 32 |
+
You can support Lambda in two ways: use the Vast.ai referral link when purchasing GPU credits or make a donation through Ko-fi. Thank you for helping Lambda continue to grow.
|
| 33 |
+
|
| 34 |
+
### PR: vast.ai
|
| 35 |
+
|
| 36 |
+
Vast.ai is a GPU cloud platform that lets you rent powerful GPUs from providers around the world. It is often more affordable than major cloud providers, with **NVIDIA H100 SXM GPUs available from around $1.54 per hour**. Check out Vast.ai for a lower-cost way to train language models.
|
| 37 |
+
|
| 38 |
+
When you sign up and purchase credits through the link below, I receive GPU credits equal to 3% of your purchase. This does not reduce your credits or add any extra cost. Using this link directly supports the development of Lambda.
|
| 39 |
+
|
| 40 |
+
Link: https://cloud.vast.ai/?ref_id=521936
|
| 41 |
+
|
| 42 |
+
### Donate
|
| 43 |
+
|
| 44 |
+
You can support the project with a donation starting from $5 through Ko-fi. Your support helps cover GPU costs and allows me to continue developing larger models.
|
| 45 |
+
|
| 46 |
+
Link: https://ko-fi.com/lambda_llm
|
| 47 |
+
|
| 48 |
lambda-1-360m-mid is an experimental Japanese language model based on [`lambda-1-360m-base`](https://huggingface.co/KeisukeMiyamoto/lambda-1-360m-base) and further pretrained on a synthetic Japanese textbook corpus.
|
| 49 |
|
| 50 |
All training code is publicly available at [KeisukeMiyamoto1324/lambda](https://github.com/KeisukeMiyamoto1324/lambda).
|