LovnishVerma commited on
Commit
04fa53f
·
verified ·
1 Parent(s): b5fdb2a

Delete model.md

Browse files
Files changed (1) hide show
  1. model.md +0 -106
model.md DELETED
@@ -1,106 +0,0 @@
1
- Qwen3-Coder-480B-A35B-Instruct
2
- Model Overview
3
- Description:
4
- Qwen3-Coder-480B-A35B-Instruct is a state-of-the-art large language model specifically designed for code generation and agentic coding tasks. It is a mixture-of-experts (MoE) model with 480B total parameters and 35B activated parameters, featuring native support for 262,144 tokens context length and extendable up to 1M tokens using YaRN.
5
-
6
- This model demonstrates significant performance among open models on Agentic Coding, Agentic Browser-Use, and other foundational coding tasks, achieving results comparable to Claude Sonnet. It supports function calling and tool choice capabilities, making it ideal for complex coding workflows and agentic applications.
7
-
8
- This model is ready for commercial use.
9
-
10
- License/Terms of Use
11
- GOVERNING TERMS: This trial service is governed by the NVIDIA API Trial Terms of Service. Use of this model is governed by the NVIDIA Community Model License. Additional Information: Apache 2.0.
12
-
13
- Deployment Geography
14
- Deployment Geography: Global
15
-
16
- Use Cases
17
- Code Generation: Generate high-quality code from natural language descriptions
18
- Agentic Coding: Execute complex coding workflows with function calling
19
- Repository Understanding: Process large codebases with long-context capabilities
20
- Tool Integration: Interface with development tools and APIs
21
- Code Review and Analysis: Analyze and improve existing code
22
- Documentation Generation: Create code documentation and comments
23
- Browser Automation: Agentic browser-use scenarios
24
- Function Calling: Structured tool execution and API integration
25
- Release Information
26
- Release Date: 08/22/2025
27
- Build.NVIDIA.com: Available via link
28
-
29
- Third-Party Community Consideration
30
- This model is not owned or developed by NVIDIA. This model has been developed by Qwen (Alibaba Cloud). This model has been developed and built to a third-party's requirements for this application and use case; see link to Qwen3-Coder-480B-A35B-Instruct.
31
-
32
- References
33
- Qwen3-Coder: A Large Language Model for Code Generation
34
- Qwen3-Coder GitHub Repository
35
- Qwen Documentation
36
- Hugging Face Model Page
37
- Qwen3 Technical Report (arXiv:2505.09388)
38
- Model Architecture
39
- Architecture Type: mixture-of-experts (MoE) with Sparse Activation
40
- Network Architecture: Qwen3MoeForCausalLM (Transformer-based decoder-only)
41
- Parameter Count: 480B total parameters with 35B activated parameters
42
- Expert Configuration: 160 experts with 8 activated per forward pass
43
- Attention Mechanism: Grouped Query Attention (GQA) with 96 query heads and 8 KV heads
44
- Number of Layers: 62
45
- Hidden Size: 6144
46
- Head Dimension: 128
47
- Intermediate Size: 8192
48
- MoE Intermediate Size: 2560
49
- Context Length: 262,144 tokens (native), extendable to 1M with YaRN
50
- Vocabulary Size: 151,936
51
-
52
- Input
53
- Input Type(s): Text, Code, Function calls
54
- Input Format(s): Natural language prompts, code snippets, structured function calls
55
- Input Parameters:
56
-
57
- Max input length: 262,144 tokens (native), up to 1M with YaRN
58
- Support for function calling format
59
- Tool choice enabled
60
- Trust remote code execution
61
- Custom tool call parser (qwen3_coder)
62
- Output
63
- Output Type(s): Text, Code, Function responses
64
- Output Format(s): Natural language responses, code generation, structured function outputs
65
- Output Parameters: One-Dimensional (1D)
66
-
67
- Max output length: Configurable based on remaining context
68
- Function call responses in structured format
69
- Other Properties Related to Output:
70
-
71
- Non-thinking mode (no <think></think> blocks)
72
- Auto tool choice responses
73
- Software Integration
74
- Runtime Engine: vLLM, Transformers (4.51.0+)
75
- Supported Hardware Platform(s): NVIDIA Hopper
76
- Supported Operating System(s): Linux
77
- Data Type: FP8
78
- Data Modality: Text
79
- Model Version: v1.0
80
-
81
- Training, Testing, and Evaluation Datasets
82
- Training Dataset
83
- Data Collection Method by dataset: The model was trained on a diverse dataset including code repositories, documentation, and natural language text related to programming
84
- Labeling Method by dataset: Supervised fine-tuning with instruction-following data
85
- Properties: Multi-language code support, instruction-following capabilities, function calling training
86
- Testing Dataset
87
- Data Collection Method by dataset: Standard benchmarks for code generation and agentic tasks
88
- Labeling Method by dataset: Automated evaluation metrics
89
- Properties: HumanEval, MBPP, Agentic coding benchmarks
90
- Evaluation Dataset
91
- Data Collection Method by dataset: Public benchmarks and custom evaluation sets
92
- Labeling Method by dataset: Automated metrics and human evaluation
93
- Properties: Code generation quality, function calling accuracy, agentic task performance
94
- Benchmark Results
95
- The model achieves significant performance among open models on:
96
-
97
- Agentic Coding tasks
98
- Agentic Browser-Use scenarios
99
- Foundational coding benchmarks
100
- Results comparable to Claude Sonnet on various coding tasks
101
- Inference
102
- Acceleration Engine: vLLM
103
- Test Hardware: NVIDIA Hopper
104
-
105
- Ethical Considerations
106
- NVIDIA believes Trustworthy AI is a shared responsibility and we have established policies and practices to enable development for a wide array of AI applications. When downloaded or used in accordance with our terms of service, developers should work with their internal model team to ensure this model meets requirements for the relevant industry and use case and addresses unforeseen product misuse.