what is the multi_query_group_num in config.json?

#75

by lg920810 - opened Aug 4, 2023

lg920810

Aug 4, 2023

Hi~ Can anyone know the multi_query_group_num? Please help to understand the meaning of it.
"multi_query_attention": true,
"multi_query_group_num": 2,
"num_attention_heads": 32,
"num_layers": 28,

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment