Hugging Face's logo

OpenPeerAI
/
Cloud-Agents

Cloud Agents
English
agent
cloud
computing
distributed
distributed-learning
decentralized
grid
grid-computing
machine-learning
ml
Model card Files
xet
 Community
1
How to use from the
Use from the
Cloud Agents library
# No code snippets available yet for this library.

# To use this model, check the repository files and the library's documentation.

# Want to help? PRs adding snippets are welcome at:
# https://github.com/huggingface/huggingface.js

Cloud Agents for Distributed Model Training

A lightweight and horizontally scalable distributed computing system for training large language models, specifically designed for OpenPeerLLM.

Features

  • Distributed tensor operations for model training
  • CouchDB-based coordination layer
  • Automatic agent discovery and load balancing
  • Horizontal scaling capabilities
  • Fault tolerance and recovery
  • Integration with OpenPeerAI's OpenPeerLLM

Installation 

pip install -r requirements.txt

Configuration

  1. Set up CouchDB instance
  2. Copy .env.example to .env and configure your settings
  3. Start the coordinator node
  4. Launch agent nodes

Quick Start 

# Start coordinator
python -m cloud_agents.coordinator

# Start agent (on each machine)
python -m cloud_agents.agent

Architecture

  • coordinator: Manages job distribution and agent coordination
  • agent: Handles tensor operations and model training
  • couchdb_client: Interface for CouchDB communication
  • tensor_ops: Distributed tensor operations
  • utils: Helper functions and utilities

License

MIT

Downloads last month
10
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for OpenPeerAI/Cloud-Agents

Base model

OpenPeerAI/OpenPeerLLM
Finetuned
(1)
this model
Finetunes
1 model

Dataset used to train OpenPeerAI/Cloud-Agents