Christian Risi
|
aac7675b30
|
Pipeline fix and added a util to decode
|
2025-10-09 13:24:48 +02:00 |
|
Christian Risi
|
d2a3dfe90f
|
Fixed bug
|
2025-10-03 17:59:46 +02:00 |
|
Christian Risi
|
0ee6e48004
|
Fixed the same bug as before, but this time is correct
|
2025-10-03 16:09:53 +02:00 |
|
Christian Risi
|
55e0d2ac23
|
Fixed a encoding bug
|
2025-10-03 16:08:11 +02:00 |
|
Christian Risi
|
c5c0c61f79
|
Fix of bugs and semantics
|
2025-10-03 13:26:58 +02:00 |
|
GassiGiuseppe
|
7c935d2700
|
Update NanoSocratesBPE: corrected a minor bug about dictionary lenght,
added some comment to make the code more clear
|
2025-10-03 00:57:19 +02:00 |
|
GassiGiuseppe
|
0eef2148a9
|
in NanoSocratesBPE: encode() method rewritten and tested
|
2025-10-02 12:12:44 +02:00 |
|
Christian Risi
|
1eae8582b2
|
Fixed decoding phase
|
2025-10-02 09:33:58 +02:00 |
|
Christian Risi
|
0975c19e69
|
added nwew method to encode from list of tokens
|
2025-10-02 08:48:13 +02:00 |
|
Christian Risi
|
b80b4e4112
|
Fixed returning type hints
|
2025-10-02 01:29:57 +02:00 |
|
Christian Risi
|
89a0a1f4bb
|
Fixed bug for utf-8 conversion
|
2025-09-30 23:58:31 +02:00 |
|
Christian Risi
|
c9032cab09
|
Added fit method
|
2025-09-30 13:33:28 +02:00 |
|
Christian Risi
|
e433941405
|
Added BPE
TODO:
- complete the fit method
|
2025-09-28 18:04:44 +02:00 |
|