Natural language processing 2021



IEEE PAPERS ON NATURAL LANGUAGE PROCESING

Attention in natural language processing
free download

Attention is an increasingly popular mechanism used in a wide range of neural architectures. The mechanism itself has been realized in a variety of formats. However, because of the fast-paced advances in this domain, a systematic overview of attention is still

Natural language processing for requirements engineering: The best is yet to come
free download

As part of the growing interest in natural language processing for requirements engineering (RE), RE researchers, computational linguists, and industry practitioners met at the First Workshop on Natural Language Processing for Requirements Engineering (NLP4RE 18)

Experience report: Log mining using natural language processing and application to anomaly detection
free download

Event logging is a key source of information on a system state. Reading logs provides insights on its activity, assess its correct state and allows to diagnose problems. However, reading does not scale: with the number of machines increasingly rising, and the

Feature extraction and analysis of natural language processing for deep learning English language
free download

NLP ( Natural Language Processing ) is a technology that enables computers to understand human languages. Deep-level grammatical and semantic analysis usually uses words as the basic unit, and word segmentation is usually the primary task of NLP. In order to solve

Arabic natural language processing and machine learning-based systems
free download

Arabic natural language processing (ANLP) consists of developing techniques and tools that can utilize and analyze the Arabic language in both written and spoken contexts. ANLP makes an important contribution to many existing developed systems. It provides Arabic and

Recent trends in deep learning based natural language processing
free download

Deep learning methods employ multiple processing layers to learn hierarchical representations of data, and have produced state-of-the-art results in many domains. Recently, a variety of model designs and methods have blossomed in the context of natural

A survey of the usages of deep learning for natural language processing
free download

Over the last several years, the field of natural language processing has been propelled forward by an explosion in the use of deep learning models. This article provides a brief introduction to the field and a quick overview of deep learning architectures and methods. It This paper underlines the necessity to incorporate Deep learning and Neural networking in language models under scrutiny for Natural Language Processing . The paper describes various statistical models proposed and the limitations incurred in the same due to limited

Automated extraction of semantic legal metadata using natural language processing
free download

[Context] Semantic legal metadata provides information that helps with understanding and interpreting the meaning of legal provisions. Such metadata is important for the systematic analysis of legal requirements.[Objectives] Our work is motivated by two observations:(1)

Review on Natural Language Processing (NLP) and its toolkits for opinion mining and sentiment analysis
free download

As the majority of online networking on the Internet, opinion mining has turned into a fundamental way to deal with investigating such huge numbers of information. Different applications show up in an extensive variety of modern areas. In the interim, opinions have

Large-scale point-of-interest category prediction using natural language processing models
free download

Point-of-Interest (POI) recommendation is an important application in Location-based Social Networks (LBSN). The category prediction problem is to predict the next POI category that users visit. The predicted category information is critical in large-scale POI

Natural language processing methods for acoustic and landmark event-based features in speech-based depression detection
free download

The processing of speech as an explicit sequence of events is common in automatic speech recognition (linguistic events), but has received relatively little attention in paralinguistic speech classification despite its potential for characterizing broad acoustic event sequences

On application of natural language processing in machine translation
free download

Natural language processing is the core of machine translation. In the history, its development process is almost the same as machine translation, and the two complement each other. This article compares the natural language processing of statistical corpora with

A natural language processing framework for assessing hospital readmissions for patients with COPD
free download

With the passage of recent federal legislation, many medical institutions are now responsible for reaching target hospital readmission rates. Chronic diseases account for many hospital readmissions and chronic obstructive pulmonary disease has been recently

Automating articulation: Applying natural language processing to post-secondary credit transfer
free download

Within the field of post-secondary student mobility, the assessment, and evaluation of transfer credit is a labor-intensive human intelligence task that is subject to time limits and human bias. This paper introduces a semi-automated approach to assessing transfer credit

Inflectional review of deep learning on natural language processing
free download

In the age of knowledge, Natural Language Processing (NLP) express its demand by a huge range of utilization. Previously NLP was dealing with statically data. Contemporary time NLP is doing considerably with the corpus, lexicon database, pattern reorganization. Considering

A review of natural language processing and machine learning tools used to analyze arabic social media
free download

Arabic Language is spoken widely in the world. It has very special characteristics that made it hard to be handled by computers. Recently, Social Media is considered as one of the richest source for knowledge sharing and information gathering in the internet. Arabic

Matching real-world facilities to building information modeling data using natural language processing
free download

Building Information Modeling (BIM) is a promising technology for building informatics. Currently, an increasing number of applications adopt BIM to improve the building operations and facility management. In these applications, matching real-world facilities to

Predicting decisions of the philippine supreme court using natural language processing and machine learning
free download

For the past decades, Philippine courts have been experiencing severe court congestion and case backlog problems. This study aims to provide a solution to alleviate these problems by predicting the outcome of court cases. As the Philippine Supreme Court case
LexNLP: Natural language processing and information extraction for legal and regulatory texts
free download

Over the last two decades, many high-quality, open-source packages for natural language processing and machine learning have been released. Researchers and developers can quickly write applications in languages such as Java, Python, and R that stand on theCustomer satisfaction is very important for public service providers, customer satisfaction can be delivered with a survey application or writing criticism that can be used to evaluate and improve service. Unfortunately, there are only a few customers who are willing to give

TRUNAJOD: A text complexity library to enhance natural language processing
free download

We present TRUNAJOD, a text complexity analysis tool that includes a wide variety of linguistics measurements that can be extracted from texts as an approximation for readability, coherence, and cohesion. The features that TRUNAJOD can extract from the text

Exploring the Possibilities of Applying Transfer Learning Methods for Natural Language Processing in Software Development
free download

Nowadays, we have a growing number of mature applications in the field of natural language processing (NLP), especially natural language understanding (NLU) and generation (NLG), like chatbots or auto-generated reports. Such applications relieve users

Development of a Natural Language Processing based Deep Learning Model for Automated HS Code Classification of the Imported Goods
free download

The Korean Customs Law requires the owner to directly classify items on imported goods and pay customs duties at the tax rate of the declared HS code. However, the rapid changes in the industrial environment, the expansion of trade, and the emergence of new

Extraction and Analysis of Stories: Natural Language Processing for Software Engineering.
free download

ABSTRACT GUO, HUI. Extraction and Analysis of Stories: Natural Language Processing for Software Engineering.(Under the direction of Dr. Munindar P. Singh.) Modern software systems are deployed in sociotechnical settings, combining social entities (humans and

Proceedings of the First Workshop on Bridging Human Computer Interaction and Natural Language Processing
free download

The rapid advancement of natural language processing (NLP) research has led to a variety of applications spanning a wide range of domains. As NLP applications are being used by more people in their everyday lives, and are increasingly powered by data generated by

A Principled Approach to Enriching Security-related Data for Running Processes through Statistics and Natural Language Processing
free download

We propose a principled method of enriching security related information for running processes. Our methodology applies to large organizational infrastructures, where information is properly collected and stored. The data we use is based on the Hubble Stack

TextFlint: Unified Multilingual Robustness Evaluation Toolkit for Natural Language Processing
free download

TextFlint is a multilingual robustness evaluation toolkit for NLP tasks that incorporates universal text transformation, task-specific transformation, adversarial attack, subpopulation, and their combinations to provide comprehensive robustness analysis. This enables

Comparing Natural Language Processing Methods for Text Classification of Small Educational Data
free download

Over the past decade, new natural language processing techniques have been developed that show promise when applied to educational data. Although these methods can be effective, little work has been done to measure the comparative strength of these methods

RuThes Thesaurus for Natural Language Processing
free download

In natural language processing (NLP) and information retrieval (IR), it is often useful to utilize various types of knowledge, including lexical knowledge about relations between words, their senses, domain-specific knowledge, and commonsense knowledge. The conventional

How You Say It Matters: Text Analysis of FOMC Statements Using Natural Language Processing
free download

Taeyoung Doh is a senior economist at the Federal Reserve Bank of Kansas City. Sungil Kim is a research associate at the bank. Shu-Kuei Yang is a software engineer at the bank. This article is on the banks website at www.KansasCityFed.org The Federal Reserve has increasingly

Secure Computational Resource Sharing System Using Natural Language Processing
free download

Nowadays, cloud computing is used in every industry, and the growth of cloud computing has increased exponentially since the release of Amazon Web Services (AWS). It enables the user to develop or create a software or product without investing upfront in the hardware

Parametrized Quantum Circuits of Synonymous Sentences in Quantum Natural Language Processing
free download

In this paper we develop a compositional vector-based semantics of positive transitive sentences in quantum natural language processing for a non-English language ie Persian, to compare the parametrised quantum circuits of two synonymous sentences in two

Sinhala Language Plagiarism Tool with Internet Resources Using Natural Language Processing
free download

With the digitalization of text through the World Wide Web, plagiarism turned into a crucial problem. Hence, a way to detect plagiarism became a very essential thing. Even though there are many plagiarism detection systems, applying in the world by considering other

Visualizing NLP in Undergraduate Students Learning about Natural Language
free download

Keywords: natural language processing linguistics, un- dergraduate students, non-majors, educational visualization and visual summarization, interpretability, inclusivity AllenNLP: A Deep Semantic Natural Language Processing Platform

of theConference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: Industry Papers
free download

The Industry Track at NAACL HLTrepresents innovations and implementations in speech and natural language processing technologies and systems that are relevant to industrial applications. The primary focus of this

Clustering Natural Language Test Case Instructions as Input for Deriving Automotive Testing DSLs
free download

Both be applicable for instructions in automotive test case specifications. Furthermore, typical natural language processing techniques for comparing texts are Word2Vec (Mikolov et al. 2013), Doc2Vec (Le Mikolov 2014), or TF-IDF (Rajaraman Ull- man 2011) Other than giving access to the technical literature and state of the art in the field of natural language processing to non-specialist readers, the paper seeks to reveal the conceptual and philosophi- cal stakes involved in the recent application of new neural network techniques to

Natural Language Understanding
free download

The current state of research in natural language understanding finds its foundations in such diverse fields as linguistics (computational linguistics), computer science ( natural language processing ), electrical engineering (speech recognition) and psychology (computational Abstract: Clinical parsing is useful in medical domain .Clinical narratives are difficult to understand as it is in unstructured format .Medical Natural language processing systems are used to make these clinical narratives in readable format

Deep Learning for the Russian Language
free download

org/10.1007/978-3-030-42855-6_26 CHAPTER 26 Deep Learning for the Russian Language Ekaterina Artemova 26.1 INTRODUCTION Deep learning has conquered the natural language processing (NLP) research area in the mid-2010s

Why Do Masked Neural Language Models Still Need Semantic Knowledge in Question Answering
free download

Page 4. Page 5. Abstract Pre-trained language models have widely been used to solve various natural language processing tasks MNLM Masked Neural Language Model. 4 1 1 1 18 NLP Natural Language Processing . 18 QA Question Answering In particular, the sentiment analysis of short texts such as single sentences and social media tweets and comments are one of the main chal- lenges of natural language processing (NLP) given the limited contextual information they usually convey

Bangla language textual image description by hybrid neural network model
free download

the substances of the picture as well as the communications among the substances [1-5]. Image description is essentially the language based textual description of an image, which has been an active field of research in computer vision and natural language processing [6-13]

Simple Ways to Improve NER in Every Language using Markup.
free download

issues: the processing of uppercase tokens, the detection of entity boundaries and low generalization. Specifically, we first explore the marking of uppercase tokens for providing extra casing information. We then randomly mask tokens, as in a masked language model, and Hindi to English: Transformer-Based Neural Machine Translation Kavit Gangar, Hardik Ruparel, and Shreyas Lele Abstract Machine Translation (MT) is one of the most prominent tasks in Natural Language Processing (NLP) which involves the automatic conversion of texts from Computer Security Based Question Answering System with IR and Google BERT Pragya Agrawal, Priyanka Askani, Ranjitha Nayak, and HR Mamatha Abstract Machine learning perception and question answering is a fundamental errand in natural language processing

The finsim shared task: Learning semantic representations for the financial domain
free download

The FinSim shared task, colocated with the FinNLP workshop, offered the challenge to automatically learn effective and precise semantic models for the financial domain. Going beyond the mere representation of words is a key step to industrial applications that make

SPEECH PROCESSING Electronic textbook
free download

teachers, scientists and all those who independently wish to study methods of computer processing of the Kazakh language based on their morphological analysis and synthesis, the current state of the problem of natural language processing theoretical foundations of word

Case study: How Well Can IBMs Requirements Quality Assistant Review Automotive Requirements
free download

aRobert Bosch GmbH, Postfach 300240, 70442 Stuttgart, Germany Abstract In the last years natural language processing evolved immensely Keywords case study, requirements analysis, natural language processing Requirements Quality Assistant 1. Introduction

A Comparative Analysis for English and Ukrainian Texts Processing Based on Semantics and Syntax Approach
free download

Keywords 1 Natural language processing word order, Ukrainian language NLP, English language noun group, verb group, direct word order, grammatical category, base form, structural scheme, information resource processing natural language text, terminal chain Natural Language Processing system is used for unlock information from the EHR (electronic heath records) Natural language processing with the combination of PCFG (probabilistic context free grammar) gives accurate result. Clinical narrative is in unstructured formfor neutral (anti-ISIS) group it needs further investigation. Keywords: Radicalization; extremism; machine learning; natural language processing ; twitter; text mining 1 Introduction Internet and social media networks play a

CS 230: Film Success Prediction Using NLP Techniques
free download

Abstract While Natural Language Processing has been applied to the film industry already and with some success Deep Learning techniques have not previously been used to study the predictive capabilities of movie scripts on revenue and reviews, due to the difficulty of

Risk Minimization for Zero-shot Sequence Labeling
free download

Zero-shot sequence labeling aims to build a sequence labeler without human-annotated datasets. One straightforward approach is utilizing existing systems (source models) to generate pseudo-labeled datasets and train a target sequence labeler accordingly

Multi-View Cross-Lingual Structured Prediction with Minimum Supervision
free download

In structured prediction problems, crosslingual transfer learning is an efficient way to train quality models for low-resource languages, and further improvement can be obtained by learning from multiple source languages. However, not all source models are created equal

Mitigating political bias in language models through reinforced calibration
free download

1 Introduction Large-scale language models (LMs) can generate human- like text and have shown promise in many Natural Lan- guage Generation (NLG) applications such as dialogue gen- eration (Zhang et al. 2020; Peng et al. 2020) and machine translation (Yang et al

Exploring chord embedding spaces between musical composers and eras
free download

Abstract In recent years, natural language processing al- gorithms have become more sophisticated and powerful due to the development of deep neural networks Foun- dations of Statistical Natural Language Processing . Cambridge, Massachusetts: The MIT Press

Building interpretable interaction trees for deep nlp models
free download

Abstract This paper proposes a method to disentangle and quantify in- teractions among words that are encoded inside a DNN for natural language processing . We construct a tree to encode salient interactions extracted by the DNN