mybuddy10 / README.md
Jahnviy's picture
Add files using upload-large-folder tool
b6ecb8f verified
metadata
library_name: transformers
pipeline_tag: text-generation
tags:
  - text-generation
  - conversational
  - offline
  - merged-model
  - bloom
license: other

Jahnviy/mybuddy10

This repo contains the full merged model for offline app handoff.

What is in this repo

  • The merged full model at the repo root
  • Tokenizer files at the repo root
  • The exact chat UI script copied from:
    • /workspace/chat_tutu_continued_apr_ui.py
  • Optional adapter artifact
  • Optional training metadata

Main artifact for the app developer

Use the repo root as the model folder.

Included exact local chat script

  • chat_tutu_continued_apr_ui.py

Load directly from Hugging Face

from transformers import AutoTokenizer, AutoModelForCausalLM

repo_id = "Jahnviy/mybuddy10"

tokenizer = AutoTokenizer.from_pretrained(repo_id, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(repo_id, trust_remote_code=True)

Load from a local offline copy

from transformers import AutoTokenizer, AutoModelForCausalLM

local_path = "/path/to/local/mybuddy10"

tokenizer = AutoTokenizer.from_pretrained(local_path, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(local_path, trust_remote_code=True)