How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="caikybaldo999/webcoder-100m-instruct")
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("caikybaldo999/webcoder-100m-instruct")
model = AutoModelForCausalLM.from_pretrained("caikybaldo999/webcoder-100m-instruct", device_map="auto")
Quick Links

WebCoder-100M-Instruct

Instruction-tuned version of caikybaldo999/webcoder-100m-html-css-js specialized in HTML, CSS and JavaScript.

Training

  • Full SFT
  • Parameters: 99,894,528
  • Dataset: iamtarun/code_instructions_120k_alpaca filtered for web-development examples
  • Training examples: 30,032
  • Max sequence length: 1024
  • Tokens processed: 78,226,740
  • Supervised response tokens: 48,809,920

Loss is masked on system/user tokens and computed on assistant response tokens.

Prompt format

<|system|>
You are WebCoder...<|end|>
<|user|>
Create a responsive website...<|end|>
<|assistant|>
...

Limitations

This is a small ~100M parameter model. Review generated code before deployment.

Downloads last month
-
Safetensors
Model size
99.9M params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for caikybaldo999/webcoder-100m-instruct

Finetuned
(1)
this model