ERGONOMIC METHODOLOGY OF ALGORITHMS FOR SEMANTIC ANALYSIS OF OBJECTS IN A FILE
Keywords:
artificial intelligence, semantic search, TF-IDF, Word2Vec, student response validation, PDF search, text similarity, cosine similarity.Abstract
This article examines the issue of quickly searching for relevant information in electronic literature and PDF files, as well as the semantic analysis of their data. A semantic search algorithm developed using artificial intelligence is proposed. This study utilized modern methods of information retrieval and natural language processing for semantic text analysis. The results obtained demonstrated that deep learning models provide higher accuracy compared to classical methods.
References
1. Abdurahmonov S. Matnlarni qayta ishlash va tabiiy til texnologiyalari. – Toshkent, 2020.
2. Axmedov J. R. Tizimli tahlil: darslik. – Jizzax: Ilm nuri print MChJ, 2023. – 266 bet.
3. Devlin J. et al. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding // NAACL-HLT. – 2019.
4. Goldberg Y., Levy O. word2vec Explained: Deriving Mikolov et al.'s Negative-Sampling Word-Embedding Method [Electronic resource]. – 2014. – Mode of access: arXiv.
5. Jones K. S. A statistical interpretation of term specificity and its application in retrieval // Journal of Documentation. – 1972. – Vol. 28, № 1. – P. 11–21.
6. Karaboga D. et al. Automatic Short Answer Grading Using Deep Learning // Computers & Education. – 2020.
7. Karimov A., Tursunov B. Sun’iy intellekt va uning qo‘llanilishi. – Toshkent, 2021.
8. Le Q., Mikolov T. Distributed Representations of Sentences and Documents // International Conference on Machine Learning (ICML). – 2014.
9. Mikolov T. et al. Efficient Estimation of Word Representations in Vector Space [Electronic resource]. – 2013. – Mode of access: arXiv:1301.3781.
