Transformers
PyTorch
English
electra
pretraining
Financial Language Modelling
financial-sentiment-analysis
Instructions to use SALT-NLP/FLANG-ELECTRA with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use SALT-NLP/FLANG-ELECTRA with Transformers:
# Load model directly from transformers import AutoTokenizer, AutoModelForPreTraining tokenizer = AutoTokenizer.from_pretrained("SALT-NLP/FLANG-ELECTRA") model = AutoModelForPreTraining.from_pretrained("SALT-NLP/FLANG-ELECTRA", device_map="auto") - Notebooks
- Google Colab
- Kaggle
FLANG-ELECTRA "Unable to load weights"
#1
by JunHou - opened
The published paper inspired me to do ESG research for my NLP course. However, I find that the FLANG_ELECTRA model cannot be successfully loaded into PyTorch through the transformers.
I find that all other models of this paper have the pickle detected for the "pytorch_model.bin" file, but for this model, the pickle is missing. I'm not sure whether this is the reason that the loading of weights failed.
If anyone can successfully load this model, please let me know how you did it. Sincerely appreciate your help!