[](https://hamel.dev/notes/llm/finetuning/tokenizer_gotchas.html#cb2-1)enc = partial(tok.encode, add_special_tokens=False)
[](https://hamel.dev/notes/llm/finetuning/tokenizer_gotchas.html#cb2-2)dec = partial(tok.decode)