How to Load Any HuggingFace Model in spaCy

Scarlet Macaw answered on May 23, 2022 Popularity 6/10 Helpfulness 1/10

answer How to Load Any HuggingFace Model in spaCy

How to Load Any HuggingFace Model in spaCy

Comment

import spacy
nlp = spacy.blank("en") # empty English pipeline
# create the config with the name of your model
# values omitted will get default values
config = {
    "model": {
        "@architectures": "spacy-transformers.TransformerModel.v3",
        "name": "roberta-base" # XXX customize this bit
    }
}
nlp.add_pipe("transformer", config=config)
nlp.initialize() # XXX don't forget this step!
doc = nlp("Robots in disguise")
print(doc._.trf_data) # all the Transformer output is stored here

Popularity 6/10 Helpfulness 1/10 Language python

Source: github.com

Tags: any huggingface load model python spacy

Link to this answer
Share Copy Link

Contributed on May 23 2022

Scarlet Macaw

0 Answers Avg Quality 2/10

How to Load Any HuggingFace Model in spaCy

Contents

More Related Answers

How to Load Any HuggingFace Model in spaCy

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.