PratapB/mistral-7b-chat-hf-instruct-dbahn-assistant_v10

Model Card for Model ID

This is a chat bot for Dbahn PratapB/mistral-7b-chat-hf-instruct-dbahn-assistant_v10 (3E)

Model Details

Model Description

• Developed by: OTSI https://otsi-global.com/
• Funded by [optional]: [More Information Needed]
• Shared by [optional]: [More Information Needed]
• Model type: Mistral-7b
• Language(s) (NLP): German
• License: Meta
• Finetuned from model [optional]: flozi00/Mistral-7B-german-assistant-v3

Model Sources [optional]

flozi00/Mistral-7B-german-assistant-v3

Training Details:

num_train_epochs = 10, max_steps = -1, bf16 = False, fp16 = True, per_device_train_batch_size = 4, per_device_eval_batch_size = 4, gradient_accumulation_steps = 1, max_grad_norm = 0.3, optim = "paged_adamw_32bit", learning_rate = 3e-5, lr_scheduler_type = "constant", warmup_ratio = 0.03, weight_decay = 0.001, group_by_length = False, gradient_checkpointing = True, save_steps = 100, logging_steps = 100

Notice

"### Instruction:" Dies ist eine Unterhaltung zwischen einem intelligenten, hilfsbereitem digitaler KI-Assistenten von die "Deutsche Bahn AG" und einem Nutzer. Der Assistent gibt ausführliche, hilfreiche und ehrliche Antworten. "### User:" frage: Was ist BahnBohnus? "### Assistant:"