WHATEVER420 commited on
Commit
759ae19
·
1 Parent(s): 3c9a2fa

:pen: put some examples out there

Browse files
Files changed (1) hide show
  1. README.md +38 -34
README.md CHANGED
@@ -61,7 +61,44 @@ On December 25, 2022, in New York City, the sun will rise at 07:16 AM and set at
61
 
62
  ## Usage
63
 
64
-
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
65
 
66
  ### Model Description
67
 
@@ -95,39 +132,6 @@ This software is provided strictly for educational and research purposes only. I
95
 
96
  <!-- This section describes the evaluation protocols and provides the results. -->
97
 
98
- ### Testing Data, Factors & Metrics
99
-
100
- #### Testing Data
101
-
102
- <!-- This should link to a Dataset Card if possible. -->
103
-
104
- [More Information Needed]
105
-
106
- #### Factors
107
-
108
- <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
109
-
110
- [More Information Needed]
111
-
112
- #### Metrics
113
-
114
- <!-- These are the evaluation metrics being used, ideally with a description of why. -->
115
-
116
- [More Information Needed]
117
-
118
- ### Results
119
-
120
- [More Information Needed]
121
-
122
- #### Summary
123
-
124
-
125
-
126
- ## Model Examination [optional]
127
-
128
- <!-- Relevant interpretability work for the model goes here -->
129
-
130
- [More Information Needed]
131
 
132
  ## Environmental Impact
133
 
 
61
 
62
  ## Usage
63
 
64
+ Suggested use is:
65
+ - serve with `vllm`
66
+ - use agent `qwen_agent`
67
+
68
+
69
+ ### Example Qwen Agent Usage
70
+
71
+ ```python
72
+ agent = Assistant(
73
+ llm={
74
+ "model": "WHATEVER420/script-kiddy",
75
+ "model_server": base_url,
76
+ "api_key": "EMPTY",
77
+ "generate_cfg": {
78
+ "max_tokens": 1000,
79
+ "temperature": 0.0,
80
+ "top_p": 0.9,
81
+ "frequency_penalty": 0.5,
82
+ "presence_penalty": 0.0,
83
+ "extra_body": {
84
+ "chat_template_kwargs": {
85
+ "enable_thinking": False,
86
+ },
87
+ },
88
+ },
89
+ },
90
+ function_list=["nmap", "gobuster"],
91
+ )
92
+
93
+ stream = agent.run(
94
+ [
95
+ {
96
+ "role": "user",
97
+ "content": query,
98
+ },
99
+ ],
100
+ )
101
+ ```
102
 
103
  ### Model Description
104
 
 
132
 
133
  <!-- This section describes the evaluation protocols and provides the results. -->
134
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
135
 
136
  ## Environmental Impact
137