← Back to Publications List

Named Entity Recognition in Bangla Using Conditional Random Field (CRF)

Students & Supervisors

Student Authors
Saad Muhammod Bijoy
Master of Science in Computer Science, FST
Supervisors
Firoz Ahmed
Professor, Faculty, FST

Abstract

Named Entity Recognition (NER) in the Bangla language is field of diversity towards Natural Language Processing. As Bengali is one of the top spoken languages in the world, there are so many factors and subjects to research with. This research is conducted because of the scarcity of lexical analysis in bangla language and scarcity of the well annotated dataset. This research encompasses a comprehensive method ology, including data collection from diverse Bangla newspapers, feature engineering, and model training. The aim of this research is to con tribute to the field of NLP with newer approach using diverse dataset. The dataset, meticulously curated to align with the complexities of NER, consists of almost 150,000 words and 8 unique NER tags. In the analysis phase, 8 classes were identified, and a strategic split of 20% for testing and 80% for training facilitated the evaluation of the models. Notably, the CRF model demonstrated superior performance, achieving an im pressive Precision 93%, Recall 94%, and F1-Score 93.4%. Therefore, the accuracy of the CRF model comes 93.4%. The results underscore the efficacy of leveraging sequential dependencies and contextual informa tion in the CRF model for accurate entity recognition. The discussion delves into the challenges of NER in the Bangla language, emphasizing the need for a balanced dataset and the development of a custom evalu ation matrix. So, the CRF model emerged as the superior choice. This research contributes insights into the nuances of NER in Bangla, offering a tailored dataset, meticulous analysis, and model comparison. The find ings emphasize the superiority of the CRF model, providing a valuable foundation for advancing NER applications in the Bangla language.

Keywords

CRF NER NLP Keras Tensorflow Enbedding.

Publication Details

  • Type of Publication:
  • Conference Name: 3rd International Conference on Big Data, IoT and Machine Learning (BIM 2025)
  • Date of Conference: 25/09/2025 - 25/09/2025
  • Venue: Dhaka International University (DIU)
  • Organizer: Dhaka International University (DIU)