anwgpt4 collection
Collection
4 items
•
Updated
AI & ML interests
None defined yet.
Recent Activity
FlameF0X
updated
a
collection
1 day ago
FlameF0X
updated
a
model
2 days ago
FlameF0X
published
a
model
2 days ago
FlameF0X
updated
a
model
2 days ago
FlameF0X
published
a
model
2 days ago
FlameF0X
updated
a
Space
2 days ago
FlameF0X
updated
a
collection
2 days ago
FlameF0X
updated
a
model
2 days ago
Post
4083
I am very sad to say that the budget in creating of SnowflakeCore-G1 1b and 7b MoE models ran out and I can't pre-train them anymore.
-
- 7 replies
Post
529
the training for SnowflakeCore-G1-1B and 7B would be retaken because now I implemented DeepSpeed and management to use two gpus.
Post
273
The development of SnowflakeCore-G1-7B-MoE it getting delay. In the mean time I am working on SnowflakeCore-G1-1B-MoE witch would be a pre-train chatbot.
-
- 1 reply
Post
2956
The development of SnowflakeCore-G1-7B-MoE. I can't say when it would be publish yet because it's big and it requires a lot of computational power.
-
- 1 reply
Post
291
I just finished the benchmarks for https://huggingface.co/FlameF0X/SnowflakeCore-G1-Tiny and https://huggingface.co/FlameF0X/SnowflakeCore-G1-Tiny2 in comparation with
openai-community/gpt2 .
Post
313
Hello! Important announcement, I will rename SnowflakeCore-G1-Medium to SnowflakeCore-G1-Tiny2 because it's going to have the same parameters as the Tiny version, but this one is trained on more data.
- 1 reply
Post
745
Currently working on SnowflakeCore-G1-Medium. [Updated loss cruve]
-
- 3 replies
Post
155
Hello there world! I am happy to announce that you now can fine-tune https://huggingface.co/FlameF0X/SnowflakeCore-G1-Tiny , the code for that is in the model card.
I aslo lost the training log 😐
I aslo lost the training log 😐
Post
1206
Hello! I am sad to say but fine-tuning https://huggingface.co/FlameF0X/SnowflakeCore-G1-Tiny is complicated and the instruct version would need to wait some time.
-
- 2 replies
Post
229
SnowflakeCore-G1-Tiny has landed on Hugging Face! 🚀. Give it a try and let me know what you think: https://huggingface.co/FlameF0X/SnowflakeCore-G1-Tiny.
Post
256
SnowflakeCore-G1 Update:
Got it running and training! Context window is currently set to 2048 tokens.
Training is active and stable. Will share results once I have some metrics to report.
Got it running and training! Context window is currently set to 2048 tokens.
Training is active and stable. Will share results once I have some metrics to report.
-
- 2 replies