This is a pretrained model for Part of Speech Tagging of hindi-english code-mixed data used from LinCE
This model is trained for this below repository.
https://github.com/sagorbrur/codeswitch
To install codeswitch:
pip install codeswitch
from transformers import AutoTokenizer, AutoModelForTokenClassification, pipeline tokenizer = AutoTokenizer.from_pretrained("sagorsarker/codeswitch-hineng-pos-lince") model = AutoModelForTokenClassification.from_pretrained("sagorsarker/codeswitch-hineng-pos-lince") pos_model = pipeline('ner', model=model, tokenizer=tokenizer) pos_model("put any hindi english code-mixed sentence")
from codeswitch.codeswitch import POS pos = POS('hin-eng') text = "" # your mixed sentence result = pos.tag(text) print(result)