Skip to content

Commit

Permalink
style
Browse files Browse the repository at this point in the history
  • Loading branch information
Cyrilvallez committed Jan 29, 2025
1 parent 7f6ec14 commit 746705b
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@
from tokenizers import Regex, Tokenizer, decoders, pre_tokenizers, processors
from tokenizers.models import BPE

from transformers import AutoTokenizer, MistralConfig, MistralForCausalLM, LlamaTokenizerFast
from transformers import AutoTokenizer, LlamaTokenizerFast, MistralConfig, MistralForCausalLM
from transformers.convert_slow_tokenizer import bytes_to_unicode


Expand Down

0 comments on commit 746705b

Please sign in to comment.