Instructions to use dzungpham/graphcodebert-code-classification with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use dzungpham/graphcodebert-code-classification with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("dzungpham/graphcodebert-code-classification", dtype="auto") - Notebooks
- Google Colab
- Kaggle
| 2026-04-20 11:12:17,780 - INFO - Loading model and tokenizer from: output_checkpoints/graphcodebert-mixcode-fft/checkpoint-200 | |
| 2026-04-20 11:12:18,292 - INFO - ===== Model Architecture ===== | |
| 2026-04-20 11:12:18,296 - INFO - | |
| RobertaForSequenceClassification( | |
| (roberta): RobertaModel( | |
| (embeddings): RobertaEmbeddings( | |
| (word_embeddings): Embedding(50265, 768, padding_idx=1) | |
| (position_embeddings): Embedding(514, 768, padding_idx=1) | |
| (token_type_embeddings): Embedding(1, 768) | |
| (LayerNorm): LayerNorm((768,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.3, inplace=False) | |
| ) | |
| (encoder): RobertaEncoder( | |
| (layer): ModuleList( | |
| (0-11): 12 x RobertaLayer( | |
| (attention): RobertaAttention( | |
| (self): RobertaSdpaSelfAttention( | |
| (query): Linear(in_features=768, out_features=768, bias=True) | |
| (key): Linear(in_features=768, out_features=768, bias=True) | |
| (value): Linear(in_features=768, out_features=768, bias=True) | |
| (dropout): Dropout(p=0.3, inplace=False) | |
| ) | |
| (output): RobertaSelfOutput( | |
| (dense): Linear(in_features=768, out_features=768, bias=True) | |
| (LayerNorm): LayerNorm((768,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.3, inplace=False) | |
| ) | |
| ) | |
| (intermediate): RobertaIntermediate( | |
| (dense): Linear(in_features=768, out_features=3072, bias=True) | |
| (intermediate_act_fn): GELUActivation() | |
| ) | |
| (output): RobertaOutput( | |
| (dense): Linear(in_features=3072, out_features=768, bias=True) | |
| (LayerNorm): LayerNorm((768,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.3, inplace=False) | |
| ) | |
| ) | |
| ) | |
| ) | |
| ) | |
| (classifier): RobertaClassificationHead( | |
| (dense): Linear(in_features=768, out_features=768, bias=True) | |
| (dropout): Dropout(p=0.3, inplace=False) | |
| (out_proj): Linear(in_features=768, out_features=2, bias=True) | |
| ) | |
| ) | |
| 2026-04-20 11:12:18,301 - INFO - ===== Parameter Summary ===== | |
| 2026-04-20 11:12:18,303 - INFO - Total Parameters: 124,647,170 | |
| 2026-04-20 11:12:18,304 - INFO - Trainable Parameters: 124,647,170 | |
| 2026-04-20 11:12:18,306 - INFO - Non-trainable Parameters: 0 | |
| 2026-04-20 11:12:18,307 - INFO - ===== Tokenizer Summary ===== | |
| 2026-04-20 11:12:18,332 - INFO - Vocab size: 50265 | Special tokens: ['<s>', '</s>', '<unk>', '<pad>', '<mask>'] | |
| 2026-04-20 11:12:18,333 - INFO - ===== End of Architecture Log ===== | |
| 2026-04-20 11:12:18,798 - INFO - Loading dataset: DaniilOr/SemEval-2026-Task13 (A) | |
| 2026-04-20 11:12:20,862 - INFO - Tokenising dataset... | |
| 2026-04-20 11:12:21,038 - INFO - Running inference on 1000 examples... | |
| 2026-04-20 11:12:56,041 - INFO - Classification metrics for output_checkpoints/graphcodebert-mixcode-fft/checkpoint-200 | |
| 2026-04-20 11:12:56,081 - INFO - ------------------------------ | |
| 2026-04-20 11:12:56,082 - INFO - METRICS FOR SPLIT: test | |
| 2026-04-20 11:12:56,085 - INFO - Accuracy: 0.5880 | |
| 2026-04-20 11:12:56,088 - INFO - Precision: 0.6758 | |
| 2026-04-20 11:12:56,090 - INFO - Recall: 0.5880 | |
| 2026-04-20 11:12:56,092 - INFO - F1-Score: 0.6189 | |
| 2026-04-20 11:12:56,094 - INFO - ------------------------------ | |
| 2026-04-20 11:12:56,098 - INFO - Confusion Matrix: | |
| [[490 287] | |
| [125 98]] | |
| 2026-04-20 11:12:56,102 - INFO - ✅ Predictions saved to test/inference/graphcodebert-mixcode-fft/submission.csv | |
| 2026-04-20 11:15:57,077 - INFO - Loading model and tokenizer from: output_checkpoints/graphcodebert-mixcode-fft/checkpoint-200 | |
| 2026-04-20 11:15:57,642 - INFO - ===== Model Architecture ===== | |
| 2026-04-20 11:15:57,646 - INFO - | |
| RobertaForSequenceClassification( | |
| (roberta): RobertaModel( | |
| (embeddings): RobertaEmbeddings( | |
| (word_embeddings): Embedding(50265, 768, padding_idx=1) | |
| (position_embeddings): Embedding(514, 768, padding_idx=1) | |
| (token_type_embeddings): Embedding(1, 768) | |
| (LayerNorm): LayerNorm((768,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.3, inplace=False) | |
| ) | |
| (encoder): RobertaEncoder( | |
| (layer): ModuleList( | |
| (0-11): 12 x RobertaLayer( | |
| (attention): RobertaAttention( | |
| (self): RobertaSdpaSelfAttention( | |
| (query): Linear(in_features=768, out_features=768, bias=True) | |
| (key): Linear(in_features=768, out_features=768, bias=True) | |
| (value): Linear(in_features=768, out_features=768, bias=True) | |
| (dropout): Dropout(p=0.3, inplace=False) | |
| ) | |
| (output): RobertaSelfOutput( | |
| (dense): Linear(in_features=768, out_features=768, bias=True) | |
| (LayerNorm): LayerNorm((768,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.3, inplace=False) | |
| ) | |
| ) | |
| (intermediate): RobertaIntermediate( | |
| (dense): Linear(in_features=768, out_features=3072, bias=True) | |
| (intermediate_act_fn): GELUActivation() | |
| ) | |
| (output): RobertaOutput( | |
| (dense): Linear(in_features=3072, out_features=768, bias=True) | |
| (LayerNorm): LayerNorm((768,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.3, inplace=False) | |
| ) | |
| ) | |
| ) | |
| ) | |
| ) | |
| (classifier): RobertaClassificationHead( | |
| (dense): Linear(in_features=768, out_features=768, bias=True) | |
| (dropout): Dropout(p=0.3, inplace=False) | |
| (out_proj): Linear(in_features=768, out_features=2, bias=True) | |
| ) | |
| ) | |
| 2026-04-20 11:15:57,651 - INFO - ===== Parameter Summary ===== | |
| 2026-04-20 11:15:57,654 - INFO - Total Parameters: 124,647,170 | |
| 2026-04-20 11:15:57,656 - INFO - Trainable Parameters: 124,647,170 | |
| 2026-04-20 11:15:57,658 - INFO - Non-trainable Parameters: 0 | |
| 2026-04-20 11:15:57,662 - INFO - ===== Tokenizer Summary ===== | |
| 2026-04-20 11:15:57,722 - INFO - Vocab size: 50265 | Special tokens: ['<s>', '</s>', '<unk>', '<pad>', '<mask>'] | |
| 2026-04-20 11:15:57,726 - INFO - ===== End of Architecture Log ===== | |
| 2026-04-20 11:15:58,051 - INFO - Loading dataset: DaniilOr/SemEval-2026-Task13 (A) | |
| 2026-04-20 11:16:00,140 - INFO - Tokenising dataset... | |
| 2026-04-20 11:16:00,328 - INFO - Running inference on 1000 examples... | |
| 2026-04-20 11:16:34,745 - INFO - Classification metrics for output_checkpoints/graphcodebert-mixcode-fft/checkpoint-200 | |
| 2026-04-20 11:16:34,789 - INFO - ------------------------------ | |
| 2026-04-20 11:16:34,795 - INFO - METRICS FOR SPLIT: test | |
| 2026-04-20 11:16:34,799 - INFO - Accuracy: 0.5880 | |
| 2026-04-20 11:16:34,805 - INFO - Precision: 0.6758 | |
| 2026-04-20 11:16:34,814 - INFO - Recall: 0.5880 | |
| 2026-04-20 11:16:34,821 - INFO - F1-Score: 0.6189 | |
| 2026-04-20 11:16:34,829 - INFO - ------------------------------ | |
| 2026-04-20 11:16:34,834 - INFO - Confusion Matrix: | |
| [[490 287] | |
| [125 98]] | |
| 2026-04-20 11:16:34,842 - INFO - ✅ Metrics saved to test/inference/graphcodebert-mixcode-fft/checkpoint-200/metrics.json | |
| 2026-04-20 11:16:34,850 - INFO - ✅ Predictions saved to test/inference/graphcodebert-mixcode-fft/checkpoint-200/submission.csv | |
| 2026-04-20 11:18:51,695 - INFO - Loading model and tokenizer from: output_checkpoints/graphcodebert-mixcode-fft/checkpoint-200 | |
| 2026-04-20 11:18:52,448 - INFO - ===== Model Architecture ===== | |
| 2026-04-20 11:18:52,458 - INFO - | |
| RobertaForSequenceClassification( | |
| (roberta): RobertaModel( | |
| (embeddings): RobertaEmbeddings( | |
| (word_embeddings): Embedding(50265, 768, padding_idx=1) | |
| (position_embeddings): Embedding(514, 768, padding_idx=1) | |
| (token_type_embeddings): Embedding(1, 768) | |
| (LayerNorm): LayerNorm((768,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.3, inplace=False) | |
| ) | |
| (encoder): RobertaEncoder( | |
| (layer): ModuleList( | |
| (0-11): 12 x RobertaLayer( | |
| (attention): RobertaAttention( | |
| (self): RobertaSdpaSelfAttention( | |
| (query): Linear(in_features=768, out_features=768, bias=True) | |
| (key): Linear(in_features=768, out_features=768, bias=True) | |
| (value): Linear(in_features=768, out_features=768, bias=True) | |
| (dropout): Dropout(p=0.3, inplace=False) | |
| ) | |
| (output): RobertaSelfOutput( | |
| (dense): Linear(in_features=768, out_features=768, bias=True) | |
| (LayerNorm): LayerNorm((768,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.3, inplace=False) | |
| ) | |
| ) | |
| (intermediate): RobertaIntermediate( | |
| (dense): Linear(in_features=768, out_features=3072, bias=True) | |
| (intermediate_act_fn): GELUActivation() | |
| ) | |
| (output): RobertaOutput( | |
| (dense): Linear(in_features=3072, out_features=768, bias=True) | |
| (LayerNorm): LayerNorm((768,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.3, inplace=False) | |
| ) | |
| ) | |
| ) | |
| ) | |
| ) | |
| (classifier): RobertaClassificationHead( | |
| (dense): Linear(in_features=768, out_features=768, bias=True) | |
| (dropout): Dropout(p=0.3, inplace=False) | |
| (out_proj): Linear(in_features=768, out_features=2, bias=True) | |
| ) | |
| ) | |
| 2026-04-20 11:18:52,475 - INFO - ===== Parameter Summary ===== | |
| 2026-04-20 11:18:52,482 - INFO - Total Parameters: 124,647,170 | |
| 2026-04-20 11:18:52,487 - INFO - Trainable Parameters: 124,647,170 | |
| 2026-04-20 11:18:52,493 - INFO - Non-trainable Parameters: 0 | |
| 2026-04-20 11:18:52,499 - INFO - ===== Tokenizer Summary ===== | |
| 2026-04-20 11:18:52,537 - INFO - Vocab size: 50265 | Special tokens: ['<s>', '</s>', '<unk>', '<pad>', '<mask>'] | |
| 2026-04-20 11:18:52,545 - INFO - ===== End of Architecture Log ===== | |
| 2026-04-20 11:18:52,827 - INFO - Loading dataset: DaniilOr/SemEval-2026-Task13 (A) | |
| 2026-04-20 11:18:54,882 - INFO - Tokenising dataset... | |
| 2026-04-20 11:18:55,060 - INFO - Running inference on 1000 examples... | |
| 2026-04-20 11:19:29,762 - INFO - Classification metrics for output_checkpoints/graphcodebert-mixcode-fft/checkpoint-200 | |
| 2026-04-20 11:19:29,813 - INFO - ------------------------------ | |
| 2026-04-20 11:19:29,818 - INFO - METRICS FOR SPLIT: test | |
| 2026-04-20 11:19:29,824 - INFO - Accuracy: 0.5880 | |
| 2026-04-20 11:19:29,829 - INFO - Precision: 0.6758 | |
| 2026-04-20 11:19:29,834 - INFO - Recall: 0.5880 | |
| 2026-04-20 11:19:29,839 - INFO - F1-Score: 0.6189 | |
| 2026-04-20 11:19:29,846 - INFO - ------------------------------ | |
| 2026-04-20 11:19:29,853 - INFO - Confusion Matrix: | |
| [[490 287] | |
| [125 98]] | |
| 2026-04-20 11:19:29,859 - INFO - ✅ Metrics saved to test/inference/graphcodebert-mixcode-fft/checkpoint-200/metrics.json | |
| 2026-04-20 11:19:29,865 - INFO - ✅ Predictions saved to test/inference/graphcodebert-mixcode-fft/checkpoint-200/submission.csv | |
| 2026-04-20 11:21:17,370 - INFO - Loading model and tokenizer from: output_checkpoints/graphcodebert-mixcode-fft/checkpoint-150 | |
| 2026-04-20 11:21:17,931 - INFO - ===== Model Architecture ===== | |
| 2026-04-20 11:21:17,944 - INFO - | |
| RobertaForSequenceClassification( | |
| (roberta): RobertaModel( | |
| (embeddings): RobertaEmbeddings( | |
| (word_embeddings): Embedding(50265, 768, padding_idx=1) | |
| (position_embeddings): Embedding(514, 768, padding_idx=1) | |
| (token_type_embeddings): Embedding(1, 768) | |
| (LayerNorm): LayerNorm((768,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.3, inplace=False) | |
| ) | |
| (encoder): RobertaEncoder( | |
| (layer): ModuleList( | |
| (0-11): 12 x RobertaLayer( | |
| (attention): RobertaAttention( | |
| (self): RobertaSdpaSelfAttention( | |
| (query): Linear(in_features=768, out_features=768, bias=True) | |
| (key): Linear(in_features=768, out_features=768, bias=True) | |
| (value): Linear(in_features=768, out_features=768, bias=True) | |
| (dropout): Dropout(p=0.3, inplace=False) | |
| ) | |
| (output): RobertaSelfOutput( | |
| (dense): Linear(in_features=768, out_features=768, bias=True) | |
| (LayerNorm): LayerNorm((768,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.3, inplace=False) | |
| ) | |
| ) | |
| (intermediate): RobertaIntermediate( | |
| (dense): Linear(in_features=768, out_features=3072, bias=True) | |
| (intermediate_act_fn): GELUActivation() | |
| ) | |
| (output): RobertaOutput( | |
| (dense): Linear(in_features=3072, out_features=768, bias=True) | |
| (LayerNorm): LayerNorm((768,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.3, inplace=False) | |
| ) | |
| ) | |
| ) | |
| ) | |
| ) | |
| (classifier): RobertaClassificationHead( | |
| (dense): Linear(in_features=768, out_features=768, bias=True) | |
| (dropout): Dropout(p=0.3, inplace=False) | |
| (out_proj): Linear(in_features=768, out_features=2, bias=True) | |
| ) | |
| ) | |
| 2026-04-20 11:21:17,954 - INFO - ===== Parameter Summary ===== | |
| 2026-04-20 11:21:17,963 - INFO - Total Parameters: 124,647,170 | |
| 2026-04-20 11:21:17,970 - INFO - Trainable Parameters: 124,647,170 | |
| 2026-04-20 11:21:17,980 - INFO - Non‑trainable Parameters: 0 | |
| 2026-04-20 11:21:17,986 - INFO - ===== Tokenizer Summary ===== | |
| 2026-04-20 11:21:18,059 - INFO - Vocab size: 50265 | Special tokens: ['<s>', '</s>', '<unk>', '<pad>', '<mask>'] | |
| 2026-04-20 11:21:18,067 - INFO - ===== End of Architecture Log ===== | |
| 2026-04-20 11:21:18,559 - INFO - Loading dataset: DaniilOr/SemEval-2026-Task13 (A) | |
| 2026-04-20 11:21:20,637 - INFO - Tokenising dataset... | |
| 2026-04-20 11:21:20,809 - INFO - Running inference on 1000 examples... | |
| 2026-04-20 11:21:55,162 - INFO - Computing metrics for output_checkpoints/graphcodebert-mixcode-fft/checkpoint-150 | |
| 2026-04-20 11:21:55,216 - INFO - ------------------------------ | |
| 2026-04-20 11:21:55,223 - INFO - METRICS FOR SPLIT: test | |
| 2026-04-20 11:21:55,232 - INFO - Accuracy: 0.6870 | |
| 2026-04-20 11:21:55,239 - INFO - Precision: 0.6708 | |
| 2026-04-20 11:21:55,247 - INFO - Recall: 0.6870 | |
| 2026-04-20 11:21:55,256 - INFO - F1‑Score: 0.6784 | |
| 2026-04-20 11:21:55,260 - INFO - ------------------------------ | |
| 2026-04-20 11:21:55,268 - INFO - Confusion Matrix: | |
| [[636 141] | |
| [172 51]] | |
| 2026-04-20 11:21:55,280 - INFO - ✅ Metrics saved to test/inference/graphcodebert-mixcode-fft/checkpoint-150/metrics.json | |
| 2026-04-20 11:21:55,288 - INFO - ✅ Predictions saved to test/inference/graphcodebert-mixcode-fft/checkpoint-150/submission.csv | |
| 2026-04-20 11:22:18,401 - INFO - Loading model and tokenizer from: output_checkpoints/graphcodebert-mixcode-fft/checkpoint-100 | |
| 2026-04-20 11:22:19,077 - INFO - ===== Model Architecture ===== | |
| 2026-04-20 11:22:19,094 - INFO - | |
| RobertaForSequenceClassification( | |
| (roberta): RobertaModel( | |
| (embeddings): RobertaEmbeddings( | |
| (word_embeddings): Embedding(50265, 768, padding_idx=1) | |
| (position_embeddings): Embedding(514, 768, padding_idx=1) | |
| (token_type_embeddings): Embedding(1, 768) | |
| (LayerNorm): LayerNorm((768,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.3, inplace=False) | |
| ) | |
| (encoder): RobertaEncoder( | |
| (layer): ModuleList( | |
| (0-11): 12 x RobertaLayer( | |
| (attention): RobertaAttention( | |
| (self): RobertaSdpaSelfAttention( | |
| (query): Linear(in_features=768, out_features=768, bias=True) | |
| (key): Linear(in_features=768, out_features=768, bias=True) | |
| (value): Linear(in_features=768, out_features=768, bias=True) | |
| (dropout): Dropout(p=0.3, inplace=False) | |
| ) | |
| (output): RobertaSelfOutput( | |
| (dense): Linear(in_features=768, out_features=768, bias=True) | |
| (LayerNorm): LayerNorm((768,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.3, inplace=False) | |
| ) | |
| ) | |
| (intermediate): RobertaIntermediate( | |
| (dense): Linear(in_features=768, out_features=3072, bias=True) | |
| (intermediate_act_fn): GELUActivation() | |
| ) | |
| (output): RobertaOutput( | |
| (dense): Linear(in_features=3072, out_features=768, bias=True) | |
| (LayerNorm): LayerNorm((768,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.3, inplace=False) | |
| ) | |
| ) | |
| ) | |
| ) | |
| ) | |
| (classifier): RobertaClassificationHead( | |
| (dense): Linear(in_features=768, out_features=768, bias=True) | |
| (dropout): Dropout(p=0.3, inplace=False) | |
| (out_proj): Linear(in_features=768, out_features=2, bias=True) | |
| ) | |
| ) | |
| 2026-04-20 11:22:19,112 - INFO - ===== Parameter Summary ===== | |
| 2026-04-20 11:22:19,123 - INFO - Total Parameters: 124,647,170 | |
| 2026-04-20 11:22:19,132 - INFO - Trainable Parameters: 124,647,170 | |
| 2026-04-20 11:22:19,141 - INFO - Non‑trainable Parameters: 0 | |
| 2026-04-20 11:22:19,145 - INFO - ===== Tokenizer Summary ===== | |
| 2026-04-20 11:22:19,195 - INFO - Vocab size: 50265 | Special tokens: ['<s>', '</s>', '<unk>', '<pad>', '<mask>'] | |
| 2026-04-20 11:22:19,205 - INFO - ===== End of Architecture Log ===== | |
| 2026-04-20 11:22:21,126 - INFO - Loading dataset: DaniilOr/SemEval-2026-Task13 (A) | |
| 2026-04-20 11:22:23,159 - INFO - Tokenising dataset... | |
| 2026-04-20 11:22:23,233 - INFO - Running inference on 1000 examples... | |
| 2026-04-20 11:22:57,170 - INFO - Computing metrics for output_checkpoints/graphcodebert-mixcode-fft/checkpoint-100 | |
| 2026-04-20 11:22:57,283 - INFO - ------------------------------ | |
| 2026-04-20 11:22:57,300 - INFO - METRICS FOR SPLIT: test | |
| 2026-04-20 11:22:57,312 - INFO - Accuracy: 0.7340 | |
| 2026-04-20 11:22:57,326 - INFO - Precision: 0.6704 | |
| 2026-04-20 11:22:57,337 - INFO - Recall: 0.7340 | |
| 2026-04-20 11:22:57,354 - INFO - F1‑Score: 0.6916 | |
| 2026-04-20 11:22:57,373 - INFO - ------------------------------ | |
| 2026-04-20 11:22:57,392 - INFO - Confusion Matrix: | |
| [[707 70] | |
| [196 27]] | |
| 2026-04-20 11:22:57,401 - INFO - ✅ Metrics saved to test/inference/graphcodebert-mixcode-fft/checkpoint-100/metrics.json | |
| 2026-04-20 11:22:57,412 - INFO - ✅ Predictions saved to test/inference/graphcodebert-mixcode-fft/checkpoint-100/submission.csv | |
| 2026-04-20 11:23:14,035 - INFO - Loading model and tokenizer from: output_checkpoints/graphcodebert-mixcode-fft/checkpoint-50 | |
| 2026-04-20 11:23:14,977 - INFO - ===== Model Architecture ===== | |
| 2026-04-20 11:23:14,996 - INFO - | |
| RobertaForSequenceClassification( | |
| (roberta): RobertaModel( | |
| (embeddings): RobertaEmbeddings( | |
| (word_embeddings): Embedding(50265, 768, padding_idx=1) | |
| (position_embeddings): Embedding(514, 768, padding_idx=1) | |
| (token_type_embeddings): Embedding(1, 768) | |
| (LayerNorm): LayerNorm((768,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.3, inplace=False) | |
| ) | |
| (encoder): RobertaEncoder( | |
| (layer): ModuleList( | |
| (0-11): 12 x RobertaLayer( | |
| (attention): RobertaAttention( | |
| (self): RobertaSdpaSelfAttention( | |
| (query): Linear(in_features=768, out_features=768, bias=True) | |
| (key): Linear(in_features=768, out_features=768, bias=True) | |
| (value): Linear(in_features=768, out_features=768, bias=True) | |
| (dropout): Dropout(p=0.3, inplace=False) | |
| ) | |
| (output): RobertaSelfOutput( | |
| (dense): Linear(in_features=768, out_features=768, bias=True) | |
| (LayerNorm): LayerNorm((768,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.3, inplace=False) | |
| ) | |
| ) | |
| (intermediate): RobertaIntermediate( | |
| (dense): Linear(in_features=768, out_features=3072, bias=True) | |
| (intermediate_act_fn): GELUActivation() | |
| ) | |
| (output): RobertaOutput( | |
| (dense): Linear(in_features=3072, out_features=768, bias=True) | |
| (LayerNorm): LayerNorm((768,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.3, inplace=False) | |
| ) | |
| ) | |
| ) | |
| ) | |
| ) | |
| (classifier): RobertaClassificationHead( | |
| (dense): Linear(in_features=768, out_features=768, bias=True) | |
| (dropout): Dropout(p=0.3, inplace=False) | |
| (out_proj): Linear(in_features=768, out_features=2, bias=True) | |
| ) | |
| ) | |
| 2026-04-20 11:23:15,018 - INFO - ===== Parameter Summary ===== | |
| 2026-04-20 11:23:15,029 - INFO - Total Parameters: 124,647,170 | |
| 2026-04-20 11:23:15,041 - INFO - Trainable Parameters: 124,647,170 | |
| 2026-04-20 11:23:15,052 - INFO - Non‑trainable Parameters: 0 | |
| 2026-04-20 11:23:15,068 - INFO - ===== Tokenizer Summary ===== | |
| 2026-04-20 11:23:15,164 - INFO - Vocab size: 50265 | Special tokens: ['<s>', '</s>', '<unk>', '<pad>', '<mask>'] | |
| 2026-04-20 11:23:15,176 - INFO - ===== End of Architecture Log ===== | |
| 2026-04-20 11:23:17,129 - INFO - Loading dataset: DaniilOr/SemEval-2026-Task13 (A) | |
| 2026-04-20 11:23:19,193 - INFO - Tokenising dataset... | |
| 2026-04-20 11:23:19,390 - INFO - Running inference on 1000 examples... | |
| 2026-04-20 11:23:53,670 - INFO - Computing metrics for output_checkpoints/graphcodebert-mixcode-fft/checkpoint-50 | |
| 2026-04-20 11:23:53,713 - INFO - ------------------------------ | |
| 2026-04-20 11:23:53,719 - INFO - METRICS FOR SPLIT: test | |
| 2026-04-20 11:23:53,731 - INFO - Accuracy: 0.7400 | |
| 2026-04-20 11:23:53,740 - INFO - Precision: 0.6640 | |
| 2026-04-20 11:23:53,752 - INFO - Recall: 0.7400 | |
| 2026-04-20 11:23:53,761 - INFO - F1‑Score: 0.6879 | |
| 2026-04-20 11:23:53,773 - INFO - ------------------------------ | |
| 2026-04-20 11:23:53,782 - INFO - Confusion Matrix: | |
| [[720 57] | |
| [203 20]] | |
| 2026-04-20 11:23:53,793 - INFO - ✅ Metrics saved to test/inference/graphcodebert-mixcode-fft/checkpoint-50/metrics.json | |
| 2026-04-20 11:23:53,807 - INFO - ✅ Predictions saved to test/inference/graphcodebert-mixcode-fft/checkpoint-50/submission.csv | |