ckt2

This model is a fine-tuned version of samhitmantrala/ckt1 on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.6151

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 50

Training results

Training Loss	Epoch	Step	Validation Loss
No log	1.0	1	0.9362
No log	2.0	2	0.9030
No log	3.0	3	0.8719
No log	4.0	4	0.8419
No log	5.0	5	0.8177
No log	6.0	6	0.7950
No log	7.0	7	0.7742
No log	8.0	8	0.7567
No log	9.0	9	0.7407
No log	10.0	10	0.7287
No log	11.0	11	0.7185
No log	12.0	12	0.7094
No log	13.0	13	0.7015
No log	14.0	14	0.6948
No log	15.0	15	0.6899
No log	16.0	16	0.6856
No log	17.0	17	0.6820
No log	18.0	18	0.6784
No log	19.0	19	0.6769
No log	20.0	20	0.6741
No log	21.0	21	0.6699
No log	22.0	22	0.6656
No log	23.0	23	0.6606
No log	24.0	24	0.6549
No log	25.0	25	0.6488
No log	26.0	26	0.6434
No log	27.0	27	0.6395
No log	28.0	28	0.6360
No log	29.0	29	0.6335
No log	30.0	30	0.6318
No log	31.0	31	0.6305
No log	32.0	32	0.6285
No log	33.0	33	0.6275
No log	34.0	34	0.6265
No log	35.0	35	0.6263
No log	36.0	36	0.6257
No log	37.0	37	0.6251
No log	38.0	38	0.6244
No log	39.0	39	0.6237
No log	40.0	40	0.6229
No log	41.0	41	0.6221
No log	42.0	42	0.6210
No log	43.0	43	0.6199
No log	44.0	44	0.6188
No log	45.0	45	0.6178
No log	46.0	46	0.6170
No log	47.0	47	0.6161
No log	48.0	48	0.6156
No log	49.0	49	0.6153
No log	50.0	50	0.6151

Framework versions

• Transformers 4.38.2
• Pytorch 2.2.1+cu121
• Datasets 2.18.0
• Tokenizers 0.15.2