How to use guymorlan/DialectTransliterator with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("guymorlan/DialectTransliterator") model = AutoModelForSeq2SeqLM.from_pretrained("guymorlan/DialectTransliterator", device_map="auto")
https://huggingface.co/guymorlan/DialectTransliterator/resolve/main/source.spm
hf download hf://guymorlan/DialectTransliterator/source.spm
curl -L -o source.spm https://huggingface.co/guymorlan/DialectTransliterator/resolve/main/source.spm
