我按照這個筆記本 ( https://nbviewer.jupyter.org/github/amaiya/ktrain/blob/master/tutorials/tutorial-06-sequence-tagging.ipynb ) 訓練了我的英語模型。我能夠保存我的預訓練模型并毫無問題地運行它。但是,我需要再次運行它但離線并且它不起作用,我知道我需要下載文件并執行類似于此處所做的操作。https://github.com/huggingface/transformers/issues/136但是,我無法理解我需要在哪里更改 ktrain 的設置。我運行這個:ktrain.load_predictor('Functions/my_english_nermodel')這是我得到的錯誤:Traceback (most recent call last): File "Z:\Functions\NER.py", line 155, in load_bert reloaded_predictor= ktrain.load_predictor('Z:/Functions/my_english_nermodel') File "C:\Program Files\Python37\lib\site-packages\ktrain\core.py", line 1316, in load_predictor preproc = pickle.load(f) File "C:\Program Files\Python37\lib\site-packages\ktrain\text\ner\anago\preprocessing.py", line 76, in __setstate__ if self.te_model is not None: self.activate_transformer(self.te_model, layers=self.te_layers) File "C:\Program Files\Python37\lib\site-packages\ktrain\text\ner\anago\preprocessing.py", line 100, in activate_transformer self.te = TransformerEmbedding(model_name, layers=layers) File "C:\Program Files\Python37\lib\site-packages\ktrain\text\preprocessor.py", line 1095, in __init__ self.tokenizer = self.tokenizer_type.from_pretrained(model_name) File "C:\Program Files\Python37\lib\site-packages\transformers\tokenization_utils.py", line 903, in from_pretrained return cls._from_pretrained(*inputs, **kwargs) File "C:\Program Files\Python37\lib\site-packages\transformers\tokenization_utils.py", line 1008, in _from_pretrained list(cls.vocab_files_names.values()),Process finished with exit code 1
如何使用 ktrain for NER Offline?
慕桂英4014372
2022-12-20 14:37:29