SEBIS

/

code_trans_t5_base_code_comment_generation_java_transfer_learning_finetune

like 0

Follow

Software Engineering for Business Information Systems (sebis) 17

I'm trying to fine-tune the model using my own dataset. When running the train() method, I get the following error: TypeError: 'TensorSliceDataset' object is not subscriptable

I suppose it is due to the type of dataset given to the Trainer (TensorSliceDataset).

train_dataset = tf.data.Dataset.from_tensor_slices((
dict(train_encodings),
train_message
))

test_dataset = tf.data.Dataset.from_tensor_slices((
dict(val_encodings),
val_message
))

args = TrainingArguments(
output_dir="output",
num_train_epochs=1,
per_device_train_batch_size=8

)
trainer = Trainer(
model=model,
args=args,
train_dataset=train_dataset,
eval_dataset=test_dataset,
compute_metrics=compute_metrics
)