fumx66 commited on
Commit
8a3ccf8
Β·
verified Β·
1 Parent(s): f85a7a0

Update model card for TypeGround paper

Browse files
Files changed (1) hide show
  1. README.md +5 -32
README.md CHANGED
@@ -25,36 +25,9 @@ datasets:
25
 
26
  Model weights for the paper **"TypeGround: Fine-Grained Benchmarking for TypeScript Type Inference"**.
27
 
28
- > **Abstract:** TypeScript is widely used in web applications and mini-programs, yet real-world projects still contain many variables, function parameters, and return values whose annotations are missing or inferred as coarse-grained types (e.g., `any`). Automatic type inference requires benchmarks with reliable training and evaluation signals. Existing TypeScript datasets (e.g., ManyTypes4TypeScript), however, still contain compiler-uncheckable type expressions, coarse annotations, insufficient context, and evaluation protocols that deviate from compiler semantics, which threatens the reliability of both the training labels and the evaluation signals derived from them. To mitigate the above limitation, we present TypeGround, an automatically constructed TypeScript type inference benchmark. The core idea of TypeGround is to leverage the type-checking capability of the TypeScript Compiler (TSC), together with the generative capability of large language models, to produce compiler-friendly type annotations while avoiding coarse-grained types. TypeGround covers 2,735 projects, 99,209 source files, and 1,428,997 type annotations. Experiments show that training on TypeGround improves overall EM-based MRR@5 by 23.55 percentage points on average over ManyTypes4TypeScript. The user study further confirms the reliability of TypeGround's automatic labelling process.
29
- >
30
- > **Dataset:** [github.com/fumx66/TypeGround](https://github.com/fumx66/TypeGround)
31
 
32
- ## πŸ“¦ Repository Structure
33
-
34
- ```
35
- TypeGround_weight/
36
- β”œβ”€β”€ CodeT5/ # Full fine-tune (T5ForConditionalGeneration)
37
- β”‚ β”œβ”€β”€ TypeGround/
38
- β”‚ └── ManyTypes4TypeScrip/
39
- β”œβ”€β”€ CodeT5+/ # Full fine-tune (T5ForConditionalGeneration)
40
- β”‚ β”œβ”€β”€ TypeGround/
41
- β”‚ └── ManyTypes4TypeScrip/
42
- β”œβ”€β”€ UniXcoder/ # Full fine-tune (UniXcoder)
43
- β”‚ β”œβ”€β”€ TypeGround/
44
- β”‚ └── ManyTypes4TypeScrip/
45
- β”œβ”€β”€ Llama3-8B/ # LoRA adapters
46
- β”‚ β”œβ”€β”€ ManyTypes4TypeScrip/lora/sft/
47
- β”‚ └── TypeGround/{slice,snippet}/lora/sft/
48
- β”œβ”€β”€ Qwen3-14B/ # LoRA adapters
49
- β”‚ β”œβ”€β”€ ManyTypes4TypeScrip/lora/sft/
50
- β”‚ └── TypeGround/{slice,snippet}/lora/sft/
51
- β”œβ”€β”€ DeepSeek-Coder-6.7B/ # LoRA adapters
52
- β”‚ β”œβ”€β”€ ManyTypes4TypeScrip/lora/sft/
53
- β”‚ └── TypeGround/{slice,snippet}/lora/sft/
54
- └── prediction.py # Batch prediction script
55
- ```
56
-
57
- ## πŸš€ Usage
58
 
59
  ### Traditional Models (Full Fine-tune)
60
 
@@ -90,7 +63,7 @@ vllm serve meta-llama/Meta-Llama-3-8B-Instruct \
90
  python prediction.py
91
  ```
92
 
93
- ## πŸ“Š Models
94
 
95
  | Model | Architecture | Type | LoRA Config |
96
  |---|---|---|---|
@@ -101,7 +74,7 @@ python prediction.py
101
  | Qwen3-14B | CausalLM + LoRA | Adapter | rank=8, Ξ±=16 |
102
  | DeepSeek-Coder-6.7B | CausalLM + LoRA | Adapter | rank=8, Ξ±=16 |
103
 
104
- ## πŸ“ Citation
105
 
106
  ```bibtex
107
  @inproceedings{typeground,
@@ -113,6 +86,6 @@ python prediction.py
113
  }
114
  ```
115
 
116
- ## πŸ“„ License
117
 
118
  MIT License
 
25
 
26
  Model weights for the paper **"TypeGround: Fine-Grained Benchmarking for TypeScript Type Inference"**.
27
 
28
+ > [TypeGround](https://github.com/fumx66/TypeGround)
 
 
29
 
30
+ ## Usage
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
31
 
32
  ### Traditional Models (Full Fine-tune)
33
 
 
63
  python prediction.py
64
  ```
65
 
66
+ ## Models
67
 
68
  | Model | Architecture | Type | LoRA Config |
69
  |---|---|---|---|
 
74
  | Qwen3-14B | CausalLM + LoRA | Adapter | rank=8, Ξ±=16 |
75
  | DeepSeek-Coder-6.7B | CausalLM + LoRA | Adapter | rank=8, Ξ±=16 |
76
 
77
+ ## Citation
78
 
79
  ```bibtex
80
  @inproceedings{typeground,
 
86
  }
87
  ```
88
 
89
+ ## License
90
 
91
  MIT License