File size: 899 Bytes
062ffb1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
---
language:
- code
library_name: transformers
pipeline_tag: text-generation
base_model: caikybaldo999/webcoder-100m-html-css-js
tags:
- html
- css
- javascript
- instruct
- sft
---

# WebCoder-100M-Instruct

Instruction-tuned version of `caikybaldo999/webcoder-100m-html-css-js` specialized in HTML, CSS and JavaScript.

## Training
- Full SFT
- Parameters: 99,894,528
- Dataset: `iamtarun/code_instructions_120k_alpaca` filtered for web-development examples
- Training examples: 30,032
- Max sequence length: 1024
- Tokens processed: 78,226,740
- Supervised response tokens: 48,809,920

Loss is masked on system/user tokens and computed on assistant response tokens.

## Prompt format
```text
<|system|>
You are WebCoder...<|end|>
<|user|>
Create a responsive website...<|end|>
<|assistant|>
...
```

## Limitations
This is a small ~100M parameter model. Review generated code before deployment.