README.md

metadata

license: mit
pipeline_tag: text-generation
datasets:
  - tatsu-lab/alpaca

VLM 1

• First model of VLM series (Vortex Language Model)

Talk with the model:

• Open Google Colab
• Create new notebook
• Paste this code in the first cell:

pip install transformers

or

!pip install transformers

Then past this in the second cell:

from transformers import AutoModelForCausalLM, AutoTokenizer
import torch

model_id = "PingVortex/VLM-1"

tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id)

print("VLM 1 Chat\nType 'exit' to quit")

while True:
    user_input = input("You: ")
    if user_input.strip().lower() == "exit":
        break

    input_ids = tokenizer(user_input, return_tensors="pt").input_ids
    input_ids = input_ids[:, -1024:]

    with torch.no_grad():
        output = model.generate(
            input_ids,
            max_new_tokens=50,
            do_sample=True,
            temperature=0.7,
            top_p=0.9,
            pad_token_id=tokenizer.eos_token_id
        )

    new_tokens = output[0][input_ids.shape[1]:]
    response = tokenizer.decode(new_tokens, skip_special_tokens=True)

    print("VLM:", response.strip())