Извор странице Ugrađivanje reči

U [[natural language processing|obradi prirodnog jezika]] (NLP), '''ugrađivanje reči''' je reprezentacija reči. Ugrađivanje se koristi u analizi teksta. Tipično, reprezentacija je vektor realne vrednosti koji kodira značenje reči na takav način da se očekuje da su reči koje su bliže u vektorskom prostoru slične po značenju.<ref>{{cite book |last1=Jurafsky |first1=Daniel |last2=H. James |first2=Martin |title=Speech and language processing : an introduction to natural language processing, computational linguistics, and speech recognition |date=2000 |publisher=Prentice Hall |location=Upper Saddle River, N.J. |isbn=978-0-13-095069-7 |url=https://web.stanford.edu/~jurafsky/slp3/}}</ref> Ugrađivanje reči se može dobiti korišćenjem [[language model|jezičkog modelovanja]] i tehnika [[feature learning|učenja karakteristika]], gde se reči ili fraze iz rečnika mapiraju u [[vector (mathematics)|vektore]] [[real numbers|realnih brojeva]].

Metode za generisanje ovog mapiranja uključuju [[neural net language model|neuronske mreže]],<ref>{{cite arXiv|eprint=1310.4546|last1=Mikolov|first1=Tomas|title=Distributed Representations of Words and Phrases and their Compositionality|last2=Sutskever|first2=Ilya|last3=Chen|first3=Kai|last4=Corrado|first4=Greg|last5=Dean|first5=Jeffrey|class=cs.CL|year=2013}}</ref> [[dimensionality reduction|smanjenje dimenzionalnosti]] na [[co-occurrence matrix|matrici pojavljivanja reči]],<ref>{{Cite book|arxiv=1312.5542|last1=Lebret|first1=Rémi|chapter=Word Emdeddings through Hellinger PCA|title=Conference of the European Chapter of the Association for Computational Linguistics (EACL)|volume=2014|last2=Collobert|first2=Ronan|year=2013}}</ref><ref>{{Cite conference|url=http://papers.nips.cc/paper/5477-neural-word-embedding-as-implicit-matrix-factorization.pdf|title=Neural Word Embedding as Implicit Matrix Factorization|last1=Levy|first1=Omer|conference=NIPS|year=2014|last2=Goldberg|first2=Yoav}}</ref><ref>{{Cite conference|url=http://ijcai.org/papers15/Papers/IJCAI15-513.pdf|title=Word Embedding Revisited: A New Representation Learning and Explicit Matrix Factorization Perspective|last1=Li|first1=Yitan|conference=Int'l J. Conf. on Artificial Intelligence (IJCAI)|year=2015|last2=Xu|first2=Linli}}</ref> modele verovatnoće,<ref>{{Cite journal|last=Globerson|first=Amir|date=2007|title=Euclidean Embedding of Co-occurrence Data|url=http://static.googleusercontent.com/media/research.google.com/en//pubs/archive/34951.pdf|journal=Journal of Machine Learning Research}}</ref> objašnjivu metodu baze znanja,<ref>{{Cite journal|last1=Qureshi|first1=M. Atif|last2=Greene|first2=Derek|date=2018-06-04|title=EVE: explainable vector based embedding technique using Wikipedia|journal=Journal of Intelligent Information Systems|volume=53|pages=137–165|language=en|doi=10.1007/s10844-018-0511-x|issn=0925-9902|arxiv=1702.06891|s2cid=10656055}}</ref> i eksplicitno predstavljanje u smislu konteksta u kome se reči pojavljuju.<ref>{{cite conference|last1=Levy|first1=Omer|last2=Goldberg|first2=Yoav|title=Linguistic Regularities in Sparse and Explicit Word Representations|conference=CoNLL|pages=171–180|year=2014|url=https://levyomer.files.wordpress.com/2014/04/linguistic-regularities-in-sparse-and-explicit-word-representations-conll-2014.pdf}}</ref>

Pokazalo se da ugrađivanje reči i fraza, kada se koristi kao osnovna ulazna reprezentacija, poboljšava performanse u NLP zadacima kao što su [[syntactic parsing|sintaksičko raščlanjivanje]]<ref>{{cite conference|last1=Socher|first1=Richard|last2=Bauer|first2=John|last3=Manning|first3=Christopher|last4=Ng|first4=Andrew|title=Parsing with compositional vector grammars|conference=Proc. ACL Conf.|year=2013|url=http://www.socher.org/uploads/Main/SocherBauerManningNg_ACL2013.pdf|access-date=2014-08-14|archive-date=2016-08-11|archive-url=https://web.archive.org/web/20160811041232/http://www.socher.org/uploads/Main/SocherBauerManningNg_ACL2013.pdf|url-status=dead}}</ref> i [[sentiment analysis|analiza osećanja]].<ref>{{cite conference|last1=Socher|first1=Richard|last2=Perelygin|first2=Alex|last3=Wu|first3=Jean|last4=Chuang|first4=Jason|last5=Manning|first5=Chris|last6=Ng|first6=Andrew|last7=Potts|first7=Chris|title=Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank|conference=EMNLP|year=2013|url=http://nlp.stanford.edu/~socherr/EMNLP2013_RNTN.pdf}}</ref>

== Reference ==
{{Reflist}}

{{Authority control-lat}}

[[Категорија:Рачунарска лингвистика]]
[[Категорија:Вештачке неуронске мреже]]
[[Категорија:Обрада природних језика]]
[[Категорија:Лексичка семантика]]