Update README.md
Browse files
README.md
CHANGED
|
@@ -97,14 +97,12 @@ Llama-3-8B: 8B parameters
|
|
| 97 |
## Evaluation
|
| 98 |
|
| 99 |
|
| 100 |
-
### Testing Data
|
| 101 |
-
|
| 102 |
-
#### Testing Data
|
| 103 |
|
| 104 |
The testing data is from an open-source dataset, DeepCAD: https://github.com/ChrisWu1997/DeepCAD?tab=readme-ov-file. We use its pre-processed version: https://github.com/samxuxiang/SkexGen.
|
| 105 |
|
| 106 |
|
| 107 |
-
|
| 108 |
|
| 109 |
- Generation diversity and quality on the generated CAD models in comparison to the test set, including Coverage (COV), Minimum Matching Distance (MMD) and Jensen-Shannon Divergence (JSD) [\[1\]](https://arxiv.org/abs/2207.04632)[\[2\]](https://arxiv.org/abs/2307.00149).
|
| 110 |
- The percentage of predicted CAD sequences that can be successfully rendered into 3D models, denoted as Prediction Validity (PV).
|
|
@@ -112,7 +110,6 @@ The testing data is from an open-source dataset, DeepCAD: https://github.com/Chr
|
|
| 112 |
|
| 113 |
### Results
|
| 114 |
|
| 115 |
-
#### Summary
|
| 116 |
We use prior work, including [Skexgen](https://arxiv.org/abs/2207.04632), [Hnc-cad](https://arxiv.org/abs/2307.00149), and prompting [GPT-4o](https://platform.openai.com/docs/models#gpt-4o), as baselines. FlexCAD demonstrates superior performance compared to these baselines across most metrics. Notably, it achieves significant improvements in PV, with the PV values for GPT-4o, Skexgen, Hnc-cad, and FlexCAD being 62.3%, 68.7%, 72.6%, and 93.4% respectively, in the context of sketch-level controllable generation. See Table 1 for the complete evaluation in our paper (https://arxiv.org/pdf/2411.05823).
|
| 117 |
|
| 118 |
|
|
@@ -123,8 +120,6 @@ Carbon emissions can be estimated using the [Machine Learning Impact calculator]
|
|
| 123 |
|
| 124 |
## Citation
|
| 125 |
|
| 126 |
-
**BibTeX:**
|
| 127 |
-
|
| 128 |
```
|
| 129 |
@InProceedings{zhang2024flexcad,
|
| 130 |
title={FlexCAD: Unified and Versatile Controllable CAD Generation with Fine-tuned Large Language Models},
|
|
|
|
| 97 |
## Evaluation
|
| 98 |
|
| 99 |
|
| 100 |
+
### Testing Data
|
|
|
|
|
|
|
| 101 |
|
| 102 |
The testing data is from an open-source dataset, DeepCAD: https://github.com/ChrisWu1997/DeepCAD?tab=readme-ov-file. We use its pre-processed version: https://github.com/samxuxiang/SkexGen.
|
| 103 |
|
| 104 |
|
| 105 |
+
### Metrics
|
| 106 |
|
| 107 |
- Generation diversity and quality on the generated CAD models in comparison to the test set, including Coverage (COV), Minimum Matching Distance (MMD) and Jensen-Shannon Divergence (JSD) [\[1\]](https://arxiv.org/abs/2207.04632)[\[2\]](https://arxiv.org/abs/2307.00149).
|
| 108 |
- The percentage of predicted CAD sequences that can be successfully rendered into 3D models, denoted as Prediction Validity (PV).
|
|
|
|
| 110 |
|
| 111 |
### Results
|
| 112 |
|
|
|
|
| 113 |
We use prior work, including [Skexgen](https://arxiv.org/abs/2207.04632), [Hnc-cad](https://arxiv.org/abs/2307.00149), and prompting [GPT-4o](https://platform.openai.com/docs/models#gpt-4o), as baselines. FlexCAD demonstrates superior performance compared to these baselines across most metrics. Notably, it achieves significant improvements in PV, with the PV values for GPT-4o, Skexgen, Hnc-cad, and FlexCAD being 62.3%, 68.7%, 72.6%, and 93.4% respectively, in the context of sketch-level controllable generation. See Table 1 for the complete evaluation in our paper (https://arxiv.org/pdf/2411.05823).
|
| 114 |
|
| 115 |
|
|
|
|
| 120 |
|
| 121 |
## Citation
|
| 122 |
|
|
|
|
|
|
|
| 123 |
```
|
| 124 |
@InProceedings{zhang2024flexcad,
|
| 125 |
title={FlexCAD: Unified and Versatile Controllable CAD Generation with Fine-tuned Large Language Models},
|