Named entity recognition is a basic task in the field of natural language processing. The existing named entity recognition model has the problem of poor recognition effect on specific domain data sets. Aiming at the inconsistency of sequence labeling caused by the shortcomings of the traditional BIO (B-begin, I-inside, O-outside) annotation method, a named entity recognition model based on transformer is proposed, which uses the feature extraction of encoder in transformer and the labeling method of limited interval. Firstly, the BERT pre-training model is used to perform word-level dynamic vector representation of the input text. Then the vector representation of the text is intercepted by the span-based labeling method, and the feature of text and candidate named entity is extracted by self-attention mechanism. The results of experiment on the dataset in the industrial informatization field show the effectiveness of the model.
The Span-Based Transformer Classifier for Named Entity Recognition
Lect. Notes Electrical Eng.
International Conference on Autonomous Unmanned Systems ; 2021 ; Changsha, China September 24, 2021 - September 26, 2021
Proceedings of 2021 International Conference on Autonomous Unmanned Systems (ICAUS 2021) ; Kapitel : 242 ; 2457-2466
2022-03-18
10 pages
Aufsatz/Kapitel (Buch)
Elektronische Ressource
Englisch
IDCNN-CRF-based domain named entity recognition method
IEEE | 2020
|NAMED ENTITY RECOGNIZING SYSTEM AND METHOD OF RECOGNIZING NAMED ENTITY
Europäisches Patentamt | 2023
|Named entity recognition of railway dispatching command based on BiLSTM-CRF
British Library Conference Proceedings | 2023
|