muhammad-mujtaba-ai commited on
Commit
1dd05d9
·
verified ·
1 Parent(s): 8668039

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -52,8 +52,8 @@ Model is deployed on huggingface space for inference
52
  We have compared our model with the following models
53
  - GPT 4.5 Preview
54
  - GPT 4o mini
55
- - Gwen 2.5-Coder-7B
56
- - DeepSeek-Coder-7B-Instruct-v1.5
57
 
58
  On the following parameters
59
  - **Compilation(%)** - Percentage of generated contracts that compile successfully without modification.
@@ -68,9 +68,9 @@ Below is a figure summarizing the performance of each model across the four eval
68
 
69
  Following obvservation were made regarding Solidity LLM.
70
  - Highest Compilation Success Rate (~83%), demonstrating strong Solidity syntax and structure generation.
71
- - Good OpenZeppelin Compliance (~65%), indicating frequent use of standard libraries and contract patterns.
72
  - Top Gas Efficiency (~72%), producing optimized code as evaluated by tools like Slither.
73
- - Moderate Security Score (~58%), showing acceptable security posture but room for improvement.
74
  - Concise Code (~70% LOC score), generating relatively compact and efficient smart contracts.
75
 
76
 
 
52
  We have compared our model with the following models
53
  - GPT 4.5 Preview
54
  - GPT 4o mini
55
+ - [Qwen 2.5-Coder-7B](https://huggingface.co/Qwen/Qwen2.5-Coder-7B)
56
+ - [DeepSeek-Coder-7B-Instruct-v1.5](https://huggingface.co/deepseek-ai/deepseek-coder-7b-instruct-v1.5)
57
 
58
  On the following parameters
59
  - **Compilation(%)** - Percentage of generated contracts that compile successfully without modification.
 
68
 
69
  Following obvservation were made regarding Solidity LLM.
70
  - Highest Compilation Success Rate (~83%), demonstrating strong Solidity syntax and structure generation.
71
+ - Good OpenZeppelin Compliance (~65%), indicating frequent use of standard libraries and contract patterns. While GPT-4.5, being a much larger model, naturally exhibits stronger adherence to OpenZeppelin standards due to its broader training data, Solidity LLM achieves commendable compliance given its smaller size.
72
  - Top Gas Efficiency (~72%), producing optimized code as evaluated by tools like Slither.
73
+ - Moderate Security Score (~58%), showing acceptable security posture but room for improvement. GPT-4.5 benefits from its scale in handling more security cases.
74
  - Concise Code (~70% LOC score), generating relatively compact and efficient smart contracts.
75
 
76