6 Commits

Author	SHA1	Message	Date
Christian Risi	9c1043e0ba	Added post tokenization utils	2025-10-06 17:01:18 +02:00
Christian Risi	ee8e56798c	Added new utils	2025-10-06 17:00:55 +02:00
GassiGiuseppe	948c3fd7ac	update to batch attention mask	2025-10-06 13:03:03 +02:00
GassiGiuseppe	87409fecd5	added method fot batched attention_mask	2025-10-06 12:00:11 +02:00
GassiGiuseppe	d48815cca2	added task_type and updated init	2025-10-05 18:58:42 +02:00
GassiGiuseppe	6f219f634f	Added attention_mask	2025-10-05 17:49:01 +02:00