| | <!doctype html> |
| | <html lang="en"> |
| | <head> |
| | |
| | <script async src="https://www.googletagmanager.com/gtag/js?id=G-LENBCEYH86"></script> |
| | <script> |
| | window.dataLayer = window.dataLayer || []; |
| | function gtag(){dataLayer.push(arguments);} |
| | gtag('js', new Date()); |
| | |
| | gtag('config', 'G-LENBCEYH86'); |
| | </script> |
| |
|
| | <meta charset="utf-8"> |
| | <meta name="viewport" content="width=device-width, initial-scale=1"> |
| | <link rel="icon" class="js-site-favicon" type="image/png" href="./static/logo.svg"> |
| | <title>Petals – Decentralized platform for running large language models</title> |
| | <link href="./static/bootstrap.min.css" rel="stylesheet"> |
| | <link href="./static/style.css" rel="stylesheet"> |
| | </head> |
| | <body> |
| |
|
| | <main> |
| | <div class="position-relative overflow-hidden px-5 pt-1 m-md-4 text-center"> |
| | <div class="col-lg-6 col-md-8 p-md-3 mx-auto my-3" style="max-width: 700px;"> |
| | <div class="mb-4"> |
| | <div class="d-md-inline-block pe-md-4"> |
| | <a target="_blank" href="https://petals.dev"><img src="./static/logo.svg" height="100" class="rot-image"></a> |
| | </div> |
| | <h1 class="display-4 fw-bold d-md-inline-block justify-content-center" style="font-size: 40pt; vertical-align: middle;"> |
| | Petals |
| | <span style="font-size: 25pt; color: #aaa;">Chat</span> |
| | </h1> |
| | </div> |
| | <div class="welcome mb-4"> |
| | <div> |
| | <b>Welcome!</b> This is a demo app running |
| | <a target="_blank" class="model-name" href="https://huggingface.co/meta-llama/Llama-2-70b-chat-hf">LLaMA 2 (70B-chat)</a> |
| | over the <a target="_blank" href="https://petals.dev">Petals</a> network. |
| | Please follow the model's |
| | <a target="_blank" class="license-link" href="https://bit.ly/llama2-license">terms of use</a> |
| | and do not enter sensitive data. |
| | The chat history is recorded. |
| | </div> |
| | <form id="settings"> |
| | <div class="mt-2"> |
| | <label class="group-label">Family:</label> |
| | <div class="btn-group family-selector" role="group"> |
| | <input type="radio" class="btn-check" name="family" value="llama-2" id="family-llama-2" checked> |
| | <label class="btn btn-outline-primary" for="family-llama-2">LLaMA 2</label> |
| | <input type="radio" class="btn-check" name="family" value="llama" id="family-llama"> |
| | <label class="btn btn-outline-primary" for="family-llama">LLaMA</label> |
| | <input type="radio" class="btn-check" name="family" value="bloom" id="family-bloom"> |
| | <label class="btn btn-outline-primary" for="family-bloom">BLOOM</label> |
| | </div> |
| | </div> |
| | <div class="mt-2"> |
| | <label class="group-label">Model:</label> |
| | <div class="model-selector btn-group" role="group" data-family="llama-2"> |
| | <input type="radio" class="btn-check" name="model" value="meta-llama/Llama-2-70b-chat-hf" id="meta-llama-2-70b-chat-hf" checked> |
| | <label class="btn btn-outline-primary" for="meta-llama-2-70b-chat-hf">LLaMA 2 (70B-chat)</label> |
| | <input type="radio" class="btn-check" name="model" value="meta-llama/Llama-2-70b-hf" id="meta-llama-2-70b-hf"> |
| | <label class="btn btn-outline-primary" for="meta-llama-2-70b-hf">LLaMA 2 (70B)</label> |
| | </div> |
| | <div class="model-selector btn-group" role="group" data-family="llama" style="display: none;"> |
| | <input type="radio" class="btn-check" name="model" value="timdettmers/guanaco-65b" id="model-guanaco-65b"> |
| | <label class="btn btn-outline-primary" for="model-guanaco-65b">Guanaco-65B</label> |
| | <input type="radio" class="btn-check" name="model" value="enoch/llama-65b-hf" id="model-llama-65b-hf"> |
| | <label class="btn btn-outline-primary" for="model-llama-65b-hf">LLaMA-65B</label> |
| | </div> |
| | <div class="model-selector btn-group" role="group" data-family="bloom" style="display: none;"> |
| | |
| | |
| | <input type="radio" class="btn-check" name="model" value="bigscience/bloomz" id="model-bloomz"> |
| | <label class="btn btn-outline-primary" for="model-bloomz">BLOOMZ-176B</label> |
| | </div> |
| | </div> |
| | </form> |
| | </div> |
| | <div class="dialogue"> |
| | <p class="human-replica">A chat between a curious human and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions.</p> |
| | <p class="ai-replica"><span class="text">Assistant: Hi! How can I help you?</span></p> |
| | <p class="human-replica"><textarea class="form-control" id="exampleTextarea" rows="2">Human: </textarea></p> |
| | </div> |
| | <p class="error-box" style="display: none;"> |
| | Request failed. <a class="retry-link" href="#">Retry</a><br> |
| | <span class="error-message"></span> |
| | <span class="out-of-capacity"><br> |
| | <b>We're out of capacity</b> — attention caches of existing servers are full. |
| | Please come back later, or |
| | <a target="_blank" href="https://github.com/bigscience-workshop/petals#connect-your-gpu-and-increase-petals-capacity">connect your GPU</a> |
| | to increase Petals capacity now! |
| | </span> |
| | </p> |
| |
|
| | <p class="acknowledgements mt-5 pt-3"> |
| | |
| | <b>Shift+Enter</b> inserts newlines.<br> |
| | See source code and API docs on <a target="_blank" href="https://github.com/petals-infra/chat.petals.dev">GitHub</a>. |
| | </p> |
| | </div> |
| | </div> |
| | </main> |
| | <script src="https://code.jquery.com/jquery-3.3.1.min.js" crossorigin="anonymous"></script> |
| | <script src="./static/autosize.min.js"></script> |
| | <script src="./static/chat.js"></script> |
| | </body> |
| | </html> |
| |
|
