5 Commits

Author	SHA1	Message	Date
GassiGiuseppe	b4ee8362a2	WIP training Batching	2025-10-07 17:41:53 +02:00
Christian Risi	da0bdf703b	Added a way to see vocabulary size	2025-10-04 19:42:29 +02:00
Christian Risi	c5c0c61f79	Fix of bugs and semantics	2025-10-03 13:26:58 +02:00
GassiGiuseppe	070dc1b744	implemented token nano for the BPE encoding/decoding	2025-10-03 01:04:06 +02:00
Christian Risi	fbbe6226bb	Finished uploading stubs for TokeNano	2025-10-01 18:56:53 +02:00