Considering that emotional events diversify as one ages, this study formulates the Salient Episodic Memory Aggregation Hypothesis, which claims that aging induces homogenization of episodic memory and consequently increases the salience of emotional episodes. To test this hypothesis, the study focused on sadness episodic memory and conducted a web-based survey and a combined analysis consisting of natural language processing, machine learning, and network graph analysis. A sample of 2,954 adults aged between their 20s and over 70s participated in this study. They were asked to describe a sad event they had experienced and assess the psychological properties of the recalled episodes. After isolating and lemmatizing episodic words using natural language processing, vocabulary frequency was counted for each generation, and network graph analysis based on machine learning was performed to compare the structures of sadness episodes between generations. As a result, there were mainly two types of episodic words for which frequencies either declined or increased with age. The network structures of episodic words for the older generations possessed higher proximity (shortest path length) to higher concentrations of episodic words. These findings support the current hypothesis, indicating that the nature of sadness episodes differ between generations, and that older people have more aggregated episodic memory structures.

In this review paper, we discuss the use of BERT, one of the most well-liked deep learning-based language models. The model's operation mechanism, key areas of applicability to text analytics tasks, comparisons with related models for each activity, and a description of certain proprietary models are all covered in this work. The data from several dozen original scientific studies that have been published in the last few years and have garnered the greatest interest from the scientific community were systematized in order to prepare this review. All researchers and students who wish to learn about the most recent developments in the field of natural language text analysis may find this survey helpful. Bidirectional Encoder Representations from Transformers, or BERT for short, is the subject of a thorough investigation that we present. The area of natural language processing holds significant importance in the creation of intelligent systems. To do a variety of activities, one must comprehend the sentence's correct meaning in order to produce the desired result. Computers have a hard time understanding languages because of how context constantly changes. The main challenge in natural language processing tasks is getting computers to understand text context, and BERT is seen as a revolution in this regard. It picks up the language and its meaning in a manner that is quite similar to how the human brain processes meaning from sentences. Its capacity to identify a word from both the left and right contexts of a sentence makes it special. A new era in the perception and comprehension of natural languages has been ushered in with the development of BERT, which could help computers understand natural languages more fully. This study aims to provide readers with a deeper knowledge of the BERT language model and how it is applied to different NLP tasks.

Patient symptoms play a critical role in disease progression and diagnosis, yet they are most often captured in unstructured clinical notes. This study explores use of large language models (LLMs) for extracting patient symptoms from clinical notes, comparing their performance against rule-based information extraction (IE) systems, like BioMedICUS. By fine-tuning an LLM on diverse corpora from multiple healthcare institutions, we aimed to improve symptom extraction accuracy and efficiency with symptoms related to acute and post-acute sequelae of SARS-CoV-2. We also conducted prevalence analysis to highlight significant differences in symptom prevalence across corpora and performed fairness analysis to assess the model's equity across race and gender. Our findings indicate that while LLMs can match the effectiveness of rule-based IE methods, they face significant challenges related to demographic bias and generalizability due to variability in training corpora. This evaluation revealed overfitting and insufficient generalization, especially when models were trained predominantly on limited datasets with single annotator bias. This study also revealed that LLMs offer substantial advantages in efficiency, adaptability, and scalability for biomedical IE, marking a transformative shift in clinical data extraction processes. These results provide real-world evidence of the necessity for diverse, high-quality training datasets and robust annotation processes to enhance LLM’s performance and reliability in clinical applications.

Natural language processing model (NLP) are used in chatbots to understand user input, interpret its meaning, and generate conversational responses to provide immediate and consistent assistance. This reduces problem-solving time and staff workload and increases user satisfaction. There are both rule-based chatbots, which use decision trees and are programmed to answer specific questions, and self-learning chatbots, which can handle more complex conversations through continuous learning about data and user interactions. However, only a few chatbots have been developed specifically for the Italian language. This work proposes an NLP model to develop a powerful and efficient Italian QA (Question Answering) chatbot that is easy to use for Italian Public Administration (PA). The proposed model is based on BERT (Bidirectional Encoder Representations from Transformer) architecture, where an Encoder/Decoder module and a Highway Network module have been added to perform more efficient filtering of input text. The Italian version of the Stanford Question Answering Dataset (SQuAD-IT) is used to test the proposed model. The proposed model is one of the first models developed for Italian language-specific chatbots.

RNA sequencing techniques, like bulk RNA-seq and Single Cell (sc) RNA-seq, are critical tools for the biologist looking to analyze the genetic activity/transcriptome of a tissue or cell during an experimental procedure. Platforms like Illumina's next-generation sequencing (NGS) are used to produce the raw data for this experimental procedure. This raw FASTQ data must then be prepared via a complex series of data manipulations by bioinformaticians. This process currently takes place on an unwieldy textual user interface like a terminal/command line that requires the user to install and import multiple program packages, preventing the untrained biologist from initiating data analysis. Open-source platforms like Galaxy have produced a more user-friendly pipeline, yet the visual interface remains cluttered and highly technical, remaining uninviting for the natural scientist. To address this, SeqMate is a user-friendly tool that allows for one-click analytics by utilizing the power of a large language model (LLM) to automate both data preparation and analysis (differential expression, trajectory analysis, etc). Furthermore, by utilizing the power of generative AI, SeqMate is also capable of analyzing such findings and producing written reports of upregulated/downregulated/user-prompted genes with sources cited from known repositories like PubMed, PDB, and Uniprot.

In the digital age, social media platforms have become a significant source of both information and misinformation, presenting challenges and opportunities for threat intelligence. Natural Language Processing (NLP) has emerged as a powerful tool for extracting actionable insights from the vast amounts of unstructured text generated on these platforms. This paper explores the application of NLP techniques to enhance social media threat intelligence, focusing on methodologies for detecting and analyzing threats such as disinformation, cyberbullying, and extremist content. We examine various NLP approaches, including sentiment analysis, topic modeling, and entity recognition, and their effectiveness in identifying and mitigating potential risks. The paper also addresses the challenges associated with processing social media data, such as dealing with slang, context, and multilingual content. By leveraging NLP, organizations can improve their ability to monitor and respond to emerging threats in real-time, ultimately enhancing their overall security posture. The findings suggest that while NLP offers significant benefits, it must be complemented by human expertise and ethical considerations to ensure accurate and responsible threat assessment.

LLMs are a compressed repository of a vast corpus of valuable information on which they are trained. Therefore, this work hypothesizes that LLMs such as Llama, Orca, Falcon, and Mistral can be used for misinformation detection by making them cross-check new information with the repository on which they are trained. Accordingly, this paper describes the findings from the investigation of the abilities of LLMs in detecting misinformation on multiple datasets. The results are interpreted using explainable AI techniques such as LIME, SHAP, and Integrated Gradients. The LLMs themselves are also asked to explain their classification. These complementary approaches aid in better understanding the inner workings of misinformation detection using LLMs and lead to conclusions about their effectiveness at the task.

The predominance of English and Latin-based large language models (LLMs) has led to a notable deficit in native Arabic LLMs. This discrepancy is accentuated by the prevalent inclusion of English tokens in existing Arabic models, detracting from their efficacy in processing native Arabic's intricate morphology and syntax. Consequently, there is a theoretical and practical imperative for developing LLMs predominantly focused on Arabic linguistic elements. To address this gap, this paper proposes ArabianGPT, a series of transformer-based models within the ArabianLLM suite designed explicitly for Arabic. These models, including ArabianGPT-0.1B and ArabianGPT-0.3B, vary in size and complexity, aligning with the nuanced linguistic characteristics of Arabic. The AraNizer tokenizer, integral to these models, addresses the unique morphological aspects of Arabic script, ensuring more accurate text processing. Empirical results from fine-tuning the models on tasks like sentiment analysis and summarization demonstrate significant improvements. For sentiment analysis, the fine-tuned ArabianGPT-0.1B model achieved a remarkable accuracy of 95%, a substantial increase from the base model's 56%. Similarly, in summarization tasks, fine-tuned models showed enhanced F1 scores, indicating improved precision and recall in generating concise summaries. Comparative analysis of fine-tuned ArabianGPT models against their base versions across various benchmarks reveals nuanced differences in performance, with fine-tuning positively impacting specific tasks like question answering and summarization. These findings underscore the efficacy of fine-tuning in aligning ArabianGPT models more closely with specific NLP tasks, highlighting the potential of tailored transformer architectures in advancing Arabic NLP.

Natural Language Understanding (NLU) includes temporal text understanding, which can be complex and encompasses temporal common sense understanding. There are many challenges in comprehending common sense within a text. Currently, there are a limited number of datasets containing temporal common sense in English, and there is an absence of such datasets specifically for the Arabic language. In this study, an Arabic dataset was constructed based on an available English dataset. This dataset is considered a valuable resource for the Arabic community. Consequently, different multilingual pretrained language models (PLMs) were applied to both the English and new Arabic datasets. Based on this, the effectiveness of these models in Arabic and English is compared and discussed. After analyzing the errors, a new categorization of errors was proposed. Finally, the ability of the PLMs to understand the input text and predict temporal features was evaluated. Through this detailed categorization of errors and classification of temporal elements, this study establishes a comprehensive framework aimed at clarifying the specific challenges encountered by PLMs in temporal common sense understanding (TCU). This methodology underscores the urgent need for further research on PLMs’ capabilities for TCU tasks.

Current language models have achieved remarkable success in NLP tasks. Nonetheless, individual decoding methods face difficulties in realizing the immense potential of these models. The challenge is primarily due to the lack of a decoding framework that can integrate language models and decoding methods. We introduce the DecoStrat which bridges the gap between language modeling and the decoding process in D2T generation. By leveraging language models, DecoStrat facilitates the exploration of alternative decoding methods tailored to specific tasks. We fine-tune the model on the MultiWOZ dataset to meet task-specific requirements and employ it to generate output(s) through multiple interactive modules of the framework. The Director module orchestrates the decoding processes, engaging the Generator to produce output(s) text based on the selected decoding method and input data. The Manager module enforces a selection strategy, integrating Ranker and Selector to identify the optimal result. Evaluations on the stated dataset show that DecoStrat effectively produces diverse and accurate output, with MBR variants consistently outperforming other methods. DecoStrat with the T5-small model surpasses some baseline. Generally, the findings highlight DecoStrat's potential for optimizing decoding methods in diverse real-world applications.

Sentiment analysis has become an important tool for understanding public opinion across languages and domains. Recently, there has been an increase in the number of studies on sentiment analysis in low-resource languages such as Kazakh. This is important to ensure that modern text analysis technologies are accessible to all users, regardless of their language background. The aim of the study is to create a sentiment analysis model for analyzing texts in Kazakh. As part of this work, we aim to use fine-tuning techniques on our own dataset for already existing models, thus improving their accuracy and efficiency for analyzing Kazakh language texts. This paper presents a manually collected dataset "KazIntTelCom" from the city information service 2GIS, consisting of user reviews, manually annotated by the authors taking into account the polarity of sentiment (i.e. negative positive or neutral). This dataset was used to fine-tune two pre-trained multi-lingual Transformer-based sentiment analysis models taken from the HuggingFace platform. The distillBERT and XLM-RoBERTa models were used for tuning. Also, the models were tested on the dataset "KazSAnDRA". The results show that accurate tuning even on a relatively small dataset gives a significant increase in performance, which is confirmed by an increase in the accuracy index by 20%-30%. In addition, false misses and false detections are analyzed, which allows us to identify directions for further improvement of the models. The contribution of this work, in addition to the dataset, is the analysis of model errors, which will help future developers to make more accurate settings of hyperparameters of training for sentiment analysis in Kazakh. These results are important for natural language processing and their adaptation to low-resource languages, promoting more inclusive and equitable access to modern analytical tools. Thus, this study demonstrates the effectiveness of the Transformers architecture for sentiment analysis in Kazakh and opens new opportunities for further model improvement.

It is essential to deal with data scattered among heterogeneous information sources, which can be structured, semi-structured, or unstructured, to give consumers a cohesive perspective of the data. Information gathering is challenging as a result, and one of the major causes of this is that data sources are developed to support specific applications. A method to simplify this procedure is to use ontology representation as an intermediate step. An ontology represents a knowledge structure that reasonably reflects the real world's complexity and is ideally used in many industries today. This research aims to enhance the functionality of a global ontology system by implementing and integrating a natural language query system. Leveraging NLP-based approaches, we constructed SPARQL queries for our ontologies to facilitate natural language translation into a well-structured query format. A dedicated query component was developed to transform natural language questions into SPARQL queries, with the selection of the optimal query graph to generate the final queries. In the subsequent phase, we explored the integration of distinct sentence encoders to improve latent sentence representations during query construction. The generated SPARQL queries were executed on the global ontology output and then translated into source-specific questions. This innovative approach enables unified access to heterogeneous data sources through a user-friendly natural language querying interface.

Combining genomics with digital healthcare information is set to transform per- sonalized medicine. However, this integration is challenging due to the differing nature of the data modalities. The large size of the genome makes it impossible to store it as part of the standard electronic health record (EHR) system. Rep- resenting the genome as a condensed representation containing biomarkers and usable features is required to make the genome interoperable with EHR data. This systematic review examines both conventional and state-of-the-art methods for genome language modeling (GLM), which involves representing and extract- ing features from genomic sequences. Feature extraction is an essential step for applying machine learning (ML) models to large genomic datasets, especially within integrated workflows. We first provide a step-by-step guide to various genomic sequence pre-processing and representation techniques. Then we explore feature extraction methods including tokenization, and transformation of tokens using frequency, embedding, and neural network-based approaches. In the end, we discuss ML applications in genomics, focusing on classification, prediction, and language processing algorithms. Additionally, we explore the role of GLM in func- tional annotation, emphasizing how advanced ML models, such as Bidirectional encoder representations from transformers (BERT), enhance the interpretation of genomic data. To the best of our knowledge, we compile the first end-to-end analytic guide to convert complex genomic data into biologically interpretable information using GLM, thereby facilitating the development of novel data-driven hypotheses.

The dominance of social media has added to the channels of bullying to perpetrators. Unfortunately, cyberbullying (CB) is the most prevalent phenomenon in today’s cyber world and is a severe threat to the mental and physical health of citizens. This opens the need to develop a robust system to prevent bullying content from online forums, blogs, and social media platforms to manage the impact in our society. Several machine learning (ML) algorithms have been proposed for this purpose. However, their performances are not consistent due to high class imbalance issue and generalisation. In recent years, large language models (LLM) like BERT and RoBERTa have achieved state of the art (SOTA) results in several natural language processing (NLP) tasks. Unfortunately, the LLMs have not been applied extensively. In our paper, we explored the use of these models for cyberbullying (CB) detection. We have prepared a new dataset (D2) from existing studies (Formspring and Twitter). Our experimental results for dataset D1 and D2 showed RoBERTa outperformed other models.

Sentiment analysis has emerged as a vital application of Natural Language Processing (NLP), enabling the extraction of subjective information from textual data. This study conducts a comparative analysis of various machine learning algorithms employed in sentiment analysis, including traditional models such as Naïve Bayes, Support Vector Machines (SVM), and Decision Trees, as well as contemporary techniques such as Random Forest, Gradient Boosting, and deep learning approaches like Recurrent Neural Networks (RNN) and Long Short-Term Memory (LSTM) networks. Using a comprehensive dataset sourced from social media platforms and product reviews, we evaluate the performance of these algorithms based on accuracy, precision, recall, and F1-score. Our findings highlight the strengths and weaknesses of each algorithm in handling sentiment classification tasks, emphasizing the influence of feature extraction techniques, such as Bag of Words and Word Embeddings, on model performance. The results indicate that while deep learning models generally outperform traditional algorithms, the choice of algorithm should be tailored to the specific context and requirements of the analysis. This study contributes to the ongoing discourse on the efficacy of machine learning methods in NLP, offering insights that can guide researchers and practitioners in selecting appropriate algorithms for sentiment analysis tasks.

Large Language Models (LLMs) have revolutionized the field of Artificial Intelligence with their ability to understand and generate natural language discourse. This has led to the use of LLMs in various creative fields such as music, art, and storytelling, which has sparked a debate on the impact of LLMs on human creativity. This article explores the cyclic effect of LLMs on human creativity, where LLMs can generate an ever-evolving cycle of creative output from both humans and machines. The article also highlights the importance of responsible and ethical use of LLMs, including privacy and copyright issues with the training data used by LLMs. The article emphasizes the need for transparency, data security measures, and AI governance policies to protect user data and ensure the safe use of LLMs. It also calls for the development of educational materials and resources to increase public understanding of LLMs and their ethical implications. The article concludes by highlighting the potential of LLMs as powerful tools for communication and education, but also emphasizes the need for ethical considerations to ensure the responsible and beneficial use of LLMs in society.

Despite the growing capabilities of large language models, concerns exist about the biases they develop. In this paper, we propose a novel, automated mechanism for debiasing through specified dataset augmentation in the lens of bias producers that can be useful in a variety of industries, especially ones that are “restricted” and have limited data. We consider that bias can occur due to intrinsic model architecture and dataset quality. The two aspects are evaluated using two different metrics we created. We show that our dataset augmentation algorithm reduces bias as measured by our metrics.

Sentiment analysis is a technique used to understand the publics’ opinion towards an event, product, or organization. For example, positive or negative opinion or attitude towards electric vehicle (EV) brands. This provides companies with valuable insight about the public's opinion of their products and brands. In the field of natural language processing (NLP), transformer models have shown great performances over the traditional machine learning algorithms. However, these models have not been explored extensively in the EV domain. EV companies are becoming signif-icant competitors in the automotive industry and are projected to cover up to 30% of the United States light vehicle market by 2030 [1]. In this study, we present a comparative study of large language models (LLMs) including bidirectional encoder representations from transformers (BERT), robustly optimized BERT approach and generalized autoregressive pretraining for language un-derstanding using Lucid motors and Tesla motors YouTube datasets. Results evidenced LLMs like BERT and her variants are off-the-shelf algorithms for sentiment analysis, specifically, when fi-ne-tuned. Furthermore, our findings presents the need for domain adaptation whilst utilizing LLMs. Finally, the experimental results showed that RoBERTa achieved consistent performance across the EV datasets with a F1 score of at least 92%.

The natural units of measure lauded by Max Planck more than 100 years ago are rarely used today. But many physical constants, including Planck's constant, the gravitational constant, the speed of light, vacuum permittivity, and vacuum permeability, consist of natural units in their unit dimensions. The natural units are present in all formulas containing these constants. The defining characteristic of the natural units is an alignment of unit values at the Planck scale. This alignment gives a computational basis of proportionality from which the correlated properties and dynamics of elementary particles, including wavelength, period, mass, momentum, and energy, manifest in equal or inversely proportional ratios of the Planck scale. These correlations explain many of the defining equations of quantum mechanics, classical gravity, and electromagnetism.

With the increasing use of cloud-based services for training and deploying machine learning models, data privacy has become a major concern. This is particularly important for natural language processing (NLP) models, which often process sensitive information such as personal communications and confidential documents. In this study, we propose a method for training NLP models on encrypted text data to mitigate data privacy concerns while maintaining similar performance to models trained on non-encrypted data. We demonstrate our method using two different architectures, namely Doc2Vec+XGBoost and Doc2Vec+LSTM, and evaluate the models on the 20 Newsgroups dataset. Our results indicate that both encrypted and non-encrypted models achieve comparable performance, suggesting that our encryption method is effective in preserving data privacy without sacrificing model accuracy. In order to replicate our experiments, we have provided a Colab notebook at the following address: https://t.ly/lR-TP

The goal of the next generation World Wide Web is machine readability through linked databases. To improve web search, integration, and mining in local languages like Urdu, there is a growing need to develop ontologies and vocabulary in these languages. The majority of people use the web in local languages for agriculture, social media interaction, news, etc. How to create agents for the integration of web data. In our country, the literacy ratio is very low and IT literacy is negligible. More comprehensive information for its target audience is only possible through the World Wide Web. Our first target is to improve and enhance the use of social media and the web in local languages. That will encourage its constructive use in Urdu for society and the economy. The Web in natural languages is the source of income for small and medium enterprises. The semantic web is concerned with linked databases and structured data. In this work, we are focused on some selected ontologies to be translated into natural languages. Expertise in Ontology Engineering helps us in job production. Ontology Engineering has extensive freelancing opportunities. Only if the web is correctly interpreted in regional languages is an economic boost achievable. A standardized foundation for data sharing and reuse on the internet is provided by the Semantic Web. In other words, a group of standards and technology that enables computers to comprehend the semantics (meaning) of material on the Web.

Kinetic modeling is an essential tool in systems biology research, enabling the quantitative analysis of biological systems and predicting their behavior. However, the development of kinetic models is a complex and time-consuming process. In this article, we propose a novel approach called KinModGPT, which generates kinetic models directly from natural language text. KinModGPT employs GPT-3 as a natural language interpreter and Tellurium as an SBML generator. We demonstrate the effectiveness of KinModGPT in creating SBML models from complex natural language descriptions of biochemical reactions. KinModGPT successfully generates valid SBML models from a range of natural language model descriptions of metabolic pathways, protein-protein interaction networks, and heat shock response. This article demonstrates the potential of KinModGPT in kinetic modeling automation.

Version Control and Source Code Management Systems, such as GitHub, contain large amount ofunstructured historical information of software projects. Recent studies have introduced Natural Language Processing (NLP) to help software engineers retrieve information from very large collection of unstructured data. In this study, we have extended our previous study by increasing our datasets and ML and clustering techniques. Method: We have followed a complex methodology made up of various steps. Starting from the raw commit messages we have employed NLP techniques to build a structured database. We have extracted their main features and used as input of different clustering algorithms. Once labelled each entry, we have applied supervised machine learning techniques to build a prediction and classification model. Results: We have developed a machine learning-based model to automatically classify commit messages of a software project. Our model exploits a ground-truth dataset which includes commit messages obtained from various GitHub projects belonging to the HEP context. Conclusions: The contribution of this paper is two-fold: it proposes a ground-truth database; it provides a machine learning prediction model. They automatically identify the more change-proneness areas of code. Our model has obtained a very high average precision, recall and F1-score.

In this paper, we propose "Synergized Efficiency Optimization for Large Language Models" (SEO-LLM), a groundbreaking approach that integrates advanced data utilization and model compression techniques to significantly enhance the performance, efficiency, and scalability of large language models (LLMs). Our method synergistically combines Adaptive Data Augmentation (ADA), Transfer- Active Learning (TAL), Adaptive Iterative Pruning (AIP), and Synergistic Quantization and Distillation (SQD). These components work together to reduce the training data requirement by 30%, compress model size by 67.6%, and improve inference speed by up to 50%, while preserving or even enhancing model accuracy across various NLP tasks. ADA dynamically adjusts augmentation strategies to optimize model generalization, while TAL leverages pre-trained models to focus learning on the most informative data samples. AIP intelligently prunes less significant weights, and SQD harmonizes quantization with knowledge distillation to achieve high compression rates without significant performance loss. The synergy between these techniques makes SEO-LLM a robust solution for deploying LLMs in resource-constrained environments, maintaining state-of-the-art performance with a fraction of the computational and data resources.

The rise of abusive language on social media is a significant threat to mental health and 1 social cohesion. For Bengali speakers, the need for effective detection is critical. However, current 2 methods fall short in addressing the massive volume of content. Improved techniques are urgently 3 needed to combat online hate speech in Bengali. Traditional machine learning techniques, while 4 useful, often require large, linguistically diverse datasets to train models effectively. This paper 5 addresses the urgent need for improved hate speech detection methods in Bengali, aiming to fill the 6 existing research gap. Contextual understanding is crucial in differentiating between harmful speech 7 and benign expressions. Large language models (LLMs) have shown state-of-the-art performance in 8 various natural language tasks due to their extensive training on vast amounts of data. We explore the 9 application of LLMs, specifically GPT-3.5 Turbo and Gemini 1.5 Pro, for Bengali hate speech detection 10 using Zero-Shot and Few-Shot Learning approaches. Unlike conventional methods, Zero-Shot 11 Learning identifies hate speech without task-specific training data, making it highly adaptable to new 12 datasets and languages. Few-Shot Learning, on the other hand, requires minimal labeled examples, 13 allowing for efficient model training with limited resources. Our experimental results show that 14 LLMs outperform traditional approaches. In this study, we evaluated GPT-3.5 Turbo and Gemini 1.5 15 Pro on multiple datasets. To further enhance our study, we considered the distribution of comments 16 in different datasets and the challenge of class imbalance, which can affect model performance. The 17 BD-SHS dataset consists of 35,197 comments in the training set, 7,542 in the validation set, and 7,542 18 in the test set. The Bengali Hate Speech Dataset v1.0 & v2.0 includes comments distributed across 19 various hate categories: personal hate (629), political hate (1,771), religious hate (502), geopolitical hate 20 (1,179), and gender abusive hate (316). The Bengali Hate Dataset comprises 7,500 non-hate and 7,500 21 hate comments. GPT-3.5 Turbo achieved impressive results with 97.33%, 98.42%, and 98.53% accuracy. 22 In contrast, Gemini 1.5 Pro showed lower performance across all datasets. Specifically, GPT-3.5 Turbo 23 excelled with significantly higher accuracy compared to Gemini 1.5 Pro. These outcomes highlight a 24 6.28% increase in accuracy compared to traditional methods, which achieved 92.25%. Our research 25 contributes to the growing body of literature on LLM applications in natural language processing, 26 particularly in the context of low-resource languages.

The ability to identify and rank risk is essential for efficient and effective supervision of financial service firms, such as banks and insurers. Risk ranking ensures limited resources are allocated where they are most needed. Today, automatic risk identification within insurance supervision primarily relies on quantitative metrics based on numerical data (e.g. returns). The purpose of this work is to assess whether Natural Language Processing (NLP) and cognitive networks can achieve similar automated risk ranking and identification by analysing textual data, i.e. NIDT=829 investor transcripts from Bloomberg. To this aim, this work explores and tunes 3 NLP techniques: (1) keyword extraction enhanced by cognitive network analysis; (2) valence/sentiment analysis; and (3) topic modelling. Results highlight that keyword analysis, enriched by term frequency-inverse document frequency scores and semantic framing through cognitive networks, could detect events of relevance for the insurance system like cyber-attacks or the COVID-19 pandemic. Cognitive networks were found to highlight events that related to specific financial transitions: The semantic frame of "climate" grew in size by +538% between 2018 and 2020 and outlined an increased awareness that agents and insurers expressed towards climate change. A lexicon-based sentiment analysis achieved a Pearson’s correlation of ρ=0.16 (p<0.001,N=829) between sentiment levels and daily share prices. Although relatively weak, this finding indicates that insurance jargon is insightful to support risk supervision. Topic modelling is considered less amenable to support supervision, because of a lack of results’ stability and an intrinsic difficulty to interpret risk patterns. We discuss how these automatic methods could complement existing supervisory tools in automated risk ranking.

Introduction: Around a million people are reported to die by suicide every year, and due to the stigma associated with the nature of the death, this figure is usually assumed to be an underestimate. Suicide may be prevented if prompt intervention is taken to mitigate risk. Machine learning and artificial intelligence-based modelling, such as natural language processing (NLP) and other text analytics approaches, has the potential to become a major technique for the detection, diagnosis, and treatment of people who are suffering from mental health issues. The primary aims of this research are to determine whether NLP techniques have been utilised in the field of suicide prevention, and if so, were they effective? What were their limitations? Methods: PubMed, EMBASE, MEDLINE, PsycInfo, and Global Health databases were searched for studies that reported use of NLP for suicide ideation or self-harm. Thematic analysis was used to synthesise and analyse the included studies. Findings were reported using the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement, and the Mixed Methods Appraisal Tool (MMAT) was used in assessing paper quality. Result: The preliminary search of five databases generated 387 results. Removal of duplicates resulted in 158 potentially suitable studies. Twenty papers were finally included in this review. Discussion: Studies show that combining structured and unstructured data in NLP data modelling yielded more accurate results than utilizing either alone. Also, to reduce suicides, people with mental problems must be continuously and passively monitored. Further, NLP and other machine learning/artificial intelligence technologies can be used to address health inequities and electronic health records provide valuable data for creating suicide risk tools. Finally, Online, social media, and smartphone applications can be leverage in detecting people with suicide ideation. Conclusion: The use of artificial intelligence and machine learning opens new avenues for considerably guiding risk prediction and advancing suicide prevention frameworks. The review's analysis of the included research revealed that the use of NLP may result in low-cost and effective alternatives to existing resource-intensive methods of suicide prevention. To summarise, there is substantial evidence that NLP is useful in identifying people who have suicide ideation.

Nowadays, an analysis of virtual media to predict society’s reaction to any events or processes is a task of great relevance. Especially it concerns meaningful information on healthcare problems. Internet sources contain a large amount of pharmacologically meaningful information useful for pharmacovigilance purposes and repurposing drug use. An analysis of such a scale of information demands developing the methods that require the creation of a corpus with labeled relations among entities. Before, there have been no such Russian language datasets. This paper considers the first Russian language dataset where labeled entity pairs are divided into multiple contexts within a single text (by used drugs, by different users, by the cases of use, etc.), and a method based on the XLM-RoBERTa language model, previously trained on medical texts to evaluate the state-of-the-art accuracy for the task of indication of the four types of relationships among entities: ADR–Drugname, Drugname–Diseasename, Drugname–SourceInfoDrug, Diseasename–Indication. As shown based on the presented dataset from the Russian Drug Review Corpus, the developed method achieves the F1-score of 81.2% (obtained using cross-validation and averaged for the four types of relationships), which is 7.8% higher than the basic classifiers.

The proliferation of deep learning in natural language processing (NLP) has led to the development and release of innovative technologies capable of understanding and generating human language with remarkable proficiency. Atinuke, a Transformer-based neural network, optimises performance across various language tasks by utilising a unique configuration. The architecture interweaves layers for processing sequential data with attention mechanisms to draw meaningful affinities between inputs and outputs. Due to the configuration of its topology and hyperparameter tuning, it can emulate human-like language by extracting features and learning complex mappings. Atinuke is modular, extensible, and integrates seamlessly with existing machine learning pipelines. Advanced matrix operations like softmax, embeddings, and multi-head attention enable nuanced handling of textual, acoustic, and visual signals. By unifying modern deep learning techniques with software design principles and mathematical theory, the system achieves state-of-the-art results on natural language tasks whilst remaining interpretable and robust.

Large Language Models (LLMs) like GPT-4 and mBERT have revolutionized natural languageprocessing (NLP) by providing multilingual capabilities, making it possible to develop models thathandle diverse linguistic inputs across various languages. However, despite these advances, thereremains a noticeable performance gap between how well these models perform in high-resourcelanguages such as English and low-resource languages such as Nepali or Malagasy. We term thisphenomenon the "Babel Effect," highlighting the disproportionate performance that arises fromdifferences in resource availability across languages.This paper aims to explore the root causes of these performance discrepancies in LLMs, focusingon the underlying challenges in tokenization, training, and data scarcity. We utilize cross-lingualbenchmarks, such as XGLUE and TyDiQA, to quantify these performance variations and examinethem in detail. Furthermore, we propose solutions, including enhancing tokenization strategies,employing data augmentation techniques, and refining fine-tuning methods. The paper concludeswith a discussion on how these improvements can mitigate the Babel Effect and lead to more equitablelanguage modeling across diverse linguistic contexts.

Coronavirus, also known as COVID-19, has been declared a pandemic by the World Health Organization (WHO). At the time of conducting this study, it had recorded over 1.6 million cases while more than 105,000 have died due to it, with these figures rising on a daily basis across the globe. The burden of this highly contagious respiratory disease is that it presents itself in both symptomatic and asymptomatic patterns in those already infected, thereby leading to an exponential rise in the number of contractions of the disease and fatalities. It is therefore crucial to expedite the process of early detection and diagnosis of the disease across the world. The case-based reasoning (CBR) model is an effective paradigm that allows for the utilization of cases’ specific knowledge previously experienced, concrete problem situations or specific patient cases for solving new cases. This study therefore aims to leverage the very rich database of cases of COVID-19 to solve new cases. The approach adopted in this study employs the use of an improved CBR model for state-of-the-art reasoning task in classification of suspected cases of Covid19. The CBR model leverages on a novel feature selection and semantic-based mathematical model proposed in this study for case similarity computation. An initial population of the archive was achieved with 68 cases obtained from the Italian Society of Medical and Interventional Radiology (SIRM) repository. Results obtained revealed that the proposed approach in this study successfully classified suspected cases into their categories at an accuracy of 97.10%. The study found that the proposed model can support physicians to easily diagnose suspected cases of Covid19 base on their medical records without subjecting the specimen to laboratory test. As a result, there will be a global minimization of contagion rate occasioned by slow testing and as well reduce false positive rates of diagnosed cases as observed in some parts of the globe.

This paper investigates if Corporate Social Responsibility (CSR) reports published by a selected group of Nordic companies are aligned with the Global Reporting Initiative (GRI) standards. To achieve this goal, several natural language processing, and text mining techniques were implemented and tested. We extracted strings, corpus, and hybrid semantic similarities from the reports and evaluated the models through the intrinsic assessment methodology. A quantitative ranking score based on index matching was developed to complement the semantic valuation. The final results show that Latent Semantic Analysis (LSA) and Global Vectors for Word Representation (GloVE) are the best methods for our study. Our findings will open the door to the automatic evaluation of sustainability reports which could have a strong impact on the environment.

In recent years, e-commerce platforms have replaced conventional marketplaces. People are rapidly adopting internet shopping due to the convenience of making purchases from the comfort of their homes. Online review sites allow customers to share their thoughts on products and services. Customers and businesses are increasingly relying on online reviews to assess and improve the quality of products. Existing literature uses Natural language processing (NLP) to analyze customer reviews for different applications. Due to the growing importance of NLP for online customer reviews, this study attempts to provide a taxonomy of NLP applications based on existing literature. This study also examined emerging methods, data sources, and research challenges by reviewing 154 publications from 2013 to 2023 that explore state-of-the-art approaches for diverse applications. Based on existing research, the taxonomy of applications divides literature into five categories: sentiment analysis, review analysis, customer feedback and satisfaction, user profiling, and marketing and reputation management. It is interesting to note that the majority of existing research relies on Amazon user reviews. Additionally, recent research has encouraged the use of advanced techniques like Bidirectional Encoder Representations from Transformers (BERT), Long Short-Term Memory (LSTM), and ensemble classifiers. The rising number of articles published each year indicates increasing interest of researchers and continued growth. This survey additionally addresses open issues, providing future directions in online customer review analysis.

Natural language Processing (NLP) has significantly transformed in the last decade, especially in the field of Language Modeling. Large Language Models (LLMs) have achieved SOTA performances on Natural Language Understanding (NLU) and Natural Language Generation (NLG) tasks by learning language representation in self-supervised ways. This paper provides a comprehensive survey to capture the progression of advances in Language Models. In this paper, we examine the different aspects of Language Models, which started with a few million parameters but have reached the size of a trillion in a very short time. We also look at how these LLMs transitioned from task-specific to task-independent to task-and-language-independent architectures. This paper extensively discusses different pre-training objectives, benchmarks, and transfer learning methods used in LLMs. It also examines different fine-tuning and In-Context learning techniques used in downstream tasks. It also explores how LLMs can perform well across many domains and datasets if sufficiently trained on a large and diverse dataset. Next, it discusses how, over time, the availability of cheap computational power and large datasets have improved LLM’s capabilities and raised new challenges. As part of our study, we also inspect LLMs from the lens of scalability to see how their performance is affected by the model’s depth, width, and data size. Lastly, we provide an empirical comparison of existing trends and techniques and a comprehensive analysis of where the field of LLM currently stand.

Colonoscopy is used for colorectal cancer (CRC) screening. Extracting details of the colonoscopy findings from free text in electronic health records (EHRs) can be used to determine patient risk for CRC and colorectal screening strategies. In this study, we developed and evaluated the accuracy of a deep learning model framework to extract information for the clinical decision support system to analyze relevant free-text colonoscopy reports, including indications, pathology, and findings notes. The Bio-Bi-LSTM-CRF framework was developed using Bidirectional Long Short-term Memory (Bi-LSTM) and Conditional Random Fields (CRF) to extract several clinical features from these free-text reports, including indications for the colonoscopy, findings during the colonoscopy, and pathology of the resected material. We then trained the Bio-Bi-LSTM-CRF and existing Bi-LSTM-CRF models on 80% of 4,000 manually annotated notes obtained from the colonoscopy reports of 3,867 patients. The clinical notes were from a group of patients aged over 40 years old enrolled in four Veterans Affairs Medical Centers. A total of 10% of the remaining annotated notes were used to train hyperparameter, while the remaining 10% were used to evaluate the accuracy of our model (Bio-Bi-LSTM-CRF) and to compare the results with the outcomes obtained using Bi-LSTM-CRF. The results of our experiments showed that the bidirectional encoder representations by integrating dictionary function vector from Bio-Bi-LSTM-CRF and strategies character sequence embedding approach is an effective way to identify colonoscopy features from EHR-extracted clinical notes. Therefore, the Bio-Bi-LSTM-CRF model is concluded to be capable of creating new opportunities to identify patients at risk for colon cancer and to study their health outcomes.

Hate Speech Detection in Arabic presents a multifaceted challenge due to the broad and diverse linguistic terrain. With its multiple dialects and rich cultural subtleties, Arabic requires particular measures to address hate speech online successfully. To address this issue, academics and developers have used natural language processing (NLP) methods and machine learning algorithms adapted to the complexities of Arabic text. However, many proposed methods were hampered by a lack of a comprehensive dataset/corpus of Arabic hate speech. In this research, we propose a novel multi-class public Arabic dataset comprised of 403,688 annotated tweets categorized as extremely positive, positive, neutral, or negative based on the presence of hate speech. Using our developed dataset, we additionally characterize the performance of multiple machine learning models for Hate speech identification in Arabic Jordanian dialect tweets. Specifically, the Word2Vec, TF-IDF, and AraBert text representation models have been applied to produce word vectors. With the help of these models, we can provide classification models with vectors representing text. After that, seven Machine learning classifiers have been evaluated: Support Vector Machine (SVM), Logistic Regression (LR), Naive Bays (NB), Random Forest (RF), AdaBoost (Ada), XGBoost (XGB), and CatBoost (CatB). In light of this, the experimental evaluation revealed that, in this challenging and unstructured setting, our gathered and annotated datasets were rather efficient and generated encouraging assessment outcomes. This will enable academics to delve further into this crucial field of study.

This paper presents our approaches for the SMM4H’24 Shared Task 5 on the binary classification of English tweets reporting children’s medical disorders. Our first approach involves fine-tuning a single RoBERTa-large model, while the second approach entails ensembling the results of three fine-tuned BERTweet-large models. We demonstrate that although both approaches exhibit identical performance on validation data, the BERTweet-large ensemble excels on test data. Our best-performing system achieves an F1-score of 0.938 on test data, outperforming the benchmark classifier by 1.18%.

Large language model (LLM) is a representation of a major advancement in AI, and has been used in multiple natural language processing tasks. Nevertheless, in different business scenarios, LLM requires fine-tuning by engineers to achieve satisfactory performance, and the cost of achieving target performance and fine-tuning may not match. Based on the Baidu STI dataset, we study the upper bound of the performance that classical information retrieval methods can achieve under a specific business, and compare it with the cost and performance of the participating team based on LLM. This paper gives an insight into the potential of classical computational linguistics algorithms, and which can help decision-makers make reasonable choices for LLM and low-cost methods in business R&D.

This study explores advanced feature engineering and semantic enrichment methods to enhance text classification, focusing on detecting figurative language in tweets. The novel features introduced, Syno\_Lower\_Mean and Syn\_Mean, measure the use of uncommon synonyms and the mean frequency of synonyms, capturing semantic richness crucial for detecting figurative expressions. Using resources like SenticNet and Framester, we enrich our feature set with sentiment and frame semantic information. Our approach includes extensive data preprocessing, sophisticated feature selection, and implementing various classification models, such as SVM, KNN, Logistic Regression, Decision Trees, Random Forest, BERT, and LSTM networks. We rigorously evaluate each model's performance to assess the effectiveness of our features and enrichment methods. Putting emphasis on model explainability, we use decision tree analysis, feature importance analysis, and the TREPAN algorithm to approximate SVM decisions. Although we focus on figurative language detection, our methods have broader implications for various NLP text classification tasks. Our findings demonstrate significant improvements in classification accuracy and interpretability through innovative feature design and dataset enrichment.

Ongoing COVID-19 Pandemic has resulted into massive damage to various platforms of global economy which has caused disruption to human livelihood. Natural Language Processing has been extensively used in different organizations to categorize sentiments, perform recommendation, summarizing information and topic modelling. This research aims to understand the non-medical impact of COVID-19 on global economy by leveraging the natural language processing methodology. This methodology comprises of text classification which includes topic modelling on unstructured COVID-19 media articles dataset provided by Anacode. Like other Natural Language Processing algorithms, Latent Dirichlet allocation (LDA) and Non-negative matrix factorization (NMF) has been proposed to classify the media articles dataset in order to analyze COVID-19 pandemic impacts in the different sectors of global economy. Model Accuracy was examined based on the coherence and perplexity score which came out to be 0.51 and -10.90 using LDA algorithm. Both the LDA and NMF algorithm identified similar prevalent topics that was impacted by COVID-19 pandemic in multiple sectors of economy. Through intertopic distance map visualization produced by LDA algorithm, it can be reciprocated that general industries which includes children schooling, parental care, and family gatherings had the major impact followed by business sector and the financial industry.

Humans have a unique cognitive ability known as relational abstraction, which allows us to identify logical rules and patterns beyond basic perceptual characteristics. This ability represents a key difference between how humans and other animals learn and interact with the world. With current large language models rivaling human intelligence in many regards, we investigated whether relational abstraction was an emergent chat completion capacity in various models. We find that despite their impressive language processing skills, all tested language models failed the relational match-to-sample (RMTS) test, a benchmark for assessing relational abstraction. These results challenge the assumption that advanced language skills inherently confer the capacity for complex relational reasoning. The paper highlights the need for a broader evaluation of AI cognitive abilities, emphasizing that language proficiency alone may not be indicative of certain higher-order cognitive processes thought to be supported by language.

Software is increasingly vital, with automated systems regulating critical functions. As development demands grow, manual code review becomes more challenging, often making testing more time-consuming than development. A promising approach to improving defect detection at the source code level is the use of artificial intelligence combined with natural language processing (NLP). Source code analysis, leveraging machine-readable instructions, is an effective method for enhancing defect detection and error prevention. This work explores source code analysis through NLP and machine learning, comparing classical and emerging error detection methods. To optimize classifier performance, metaheuristic optimizers are used, and a modified algorithm is introduced to meet the study’s specific needs. The proposed two-tier framework uses a convolutional neural network (CNN) in the first layer to handle large feature spaces, with AdaBoost and XGBoost classifiers in the second layer to improve error identification. Additional experiments using Term Frequency-Inverse Document Frequency (TF-IDF) encoding in the second layer demonstrate the framework’s versatility. Across five experiments with public datasets, the CNN achieved an accuracy of 0.768799. The second layer, using AdaBoost and XGBoost, further improved these results to 0.772166 and 0.771044, respectively. Applying NLP techniques yielded exceptional accuracies of 0.979781 and 0.983893 from the AdaBoost and XGBoost optimizers.

The primary cilium, the cell’s sensory and signaling antenna, is a dynamic cellular organelle during the cell cycle. It is resorbed before cells enter mitosis and reformed after cells exit mitosis, and as such acts as a structural barrier to mitosis. Cancer cells that undergo rapid cell cycle and replication have a low ciliation rate. Therefore, promoting cilia formation and elongation and thereby reducing their rates of retraction hold the key to blocking cell entry into mitosis and slowing down cancer cell replication. To perform a comprehensive and efficient literature search on drugs that can promote ciliogenesis, we developed an intelligent process that integrates the GPT-3.5 application programming interface (API) into a PubMed scraper that we coded, enabling the large language model (LLM) to directly query articles for predefined user questions. Among the top candidates identified are two FDA-approved drugs, Alvocidib and Alisertib, that showed strong potential to induce cilia formation and elongation. We first confirmed that these drugs can effectively increase the ciliation rate and the cilia length of DAOY medulloblastoma cells. We then applied Alvocidib and Alisertib individually or in combination to DAOY medulloblastoma and A549 lung cancer cells and observed a statistically significant decrease in the number of viable cells. These results demonstrated the potential of using cilia-promoting drugs to suppress cancer cell replication. Additionally, it shows the massive benefits of integrating accessible large language models to conduct sweeping, rapid, and accurate literature searches.

The increased complexity of modern systems is calling for an integrated and comprehensive approach to system design and development and in particular, a shift towards Model-Based Systems Engineering (MBSE) approaches for system design. The requirements that serve as the foundation for these intricate systems are still primarily expressed in Natural Language (NL), which can contain ambiguities and inconsistencies that hinder their direct translation into models. The colossal developments in the field of Natural Language Processing (NLP) in general and Large Language Models (LLMs) in particular can serve as an enabler for the conversion of NL requirements into semi-machine-readable requirements. This is expected to facilitate their standardization and use in a model-based environment. This paper discusses a two-fold strategy for converting NL requirements into semi-machine-readable requirements using language models. The first approach involves creating a requirements table by extracting information from free-form NL requirements. The second approach is an agile methodology that facilitates the identification of boilerplate templates for different types of requirements based on observed linguistic patterns. For this study, three different LLMs were utilized. Two of these models were fine-tuned versions of Bidirectional Encoder Representations from Transformers (BERT), specifically aeroBERT-NER and aeroBERT-Classifier, which were trained on annotated aerospace corpora. Another LLM, called flair/chunk-english, was utilized to identify sentence chunks present in NL requirements. All three language models were utilized together to achieve the standardization of requirements. To demonstrate the effectiveness of the methodologies, requirements from Parts 23 and 25 of Title 14 Code of Federal Regulations (CFRs) were employed, and a total of two, five, and three boilerplate templates were identified for design, functional, and performance requirements, respectively.

During the last two years the COVID-19 pandemic has affected the world population in several ways. An important increase in mental health problems is a consequence of this pandemic that is ubiquitous worldwide. In this work we study the effect of the pandemic on the mental health of a population of teenagers and youth based on the analysis of natural language processing, machine learning algorithms and expert knowledge. The data analysed was obtained from a chat helpline called Safe time from theIt Get’s Better Foundation in Chile. The data consists of 10,986 conversations gathered from 2018 until 2020 between volunteers from the foundation and users of the platform. We compared the conversationsbefore and during the pandemic in terms of their thematic content. Our analysis found: a significantdecrease in self-image appreciation during the pandemic; a significant decrease in the quality of personalrelationships during the pandemic, and a significant increase of performance appreciation.

Text classification is one of the most important task in natural language processing, In this research, we carried out several experimental research on three (3) of the most popular Text classification NLP classifier in Convolutional Neural Network (CNN), Multinomial Naive Bayes (MNB), and Support Vector Machine (SVN). In the presence of enough training data, Deep Learning CNN works best in all parameters for evaluation with 77% accuracy, followed by SVM with accuracy of 76%, and multinomial Bayes with least performance of 69% accuracy. CNN has the best performance in the presence of large enough training dataset because of the presence of filter/ kernels which help to indentify patterns in text data regardless of their position in the sentence. We repeated the training again with just one-third of our data, at this point SVM comes with the best performance, the performance of CNN noticeably drops but still better than Multinomial Naive Bayes, the reason why SVM works best when we reduce the training data was because of its ability to look for a hyper-plane that creates a boundary between different classes of data so as to properly classify them, so we believed that getting the hyper-plane was more efficient when we reduce the dataset, hence reason for the good performance. Multinomial Naive Bayes have the least performance which we attributed to its assumption of independency between the features which sometimes does not hold true. We concluded that availability of data should be an important factor when choosing classifier for Natural Language Processing Text Classification task. CNN should be use in the presence of enough dataset, and SVM should be use when data is not enough. Multinomial Naive Bayes must not be trusted with state of the art NLP task due to its assumption of independency between the features.

Background: Although electronic health records (EHR) provide useful insights into disease patterns and patient treatment optimisation, their reliance on unstructured data presents a difficulty. Because of their narrative structure, echocardiography reports, which provide extensive pathology information for cardiovascular patients, are particularly challenging to extract and analyse. Although natural language processing (NLP) has been utilised successfully in a variety of medical fields, it is not commonly used in echocardiography analysis. Objectives: To develop an NLP-based approach for extracting and categorizing data from echocardiography reports by accurately converting continuous (e.g. LVOT VTI, AV VTI, and TR Vmax) and discrete (e.g. Regurgitation severity) outcomes in semi-structured narrative format into structured and categorized format, allowing for future research or clinical use. Methods: 135,062 Trans-Thoracic Echocardiogram (TTE) reports were derived from 146967 baseline Echocardiogram reports and split into three cohorts: Training and Validation (n = 1075), Test Dataset (n = 98) and Application Dataset (n = 133,889). The NLP system was developed and iteratively refined using medical expert knowledge. The system was used to curate a moderate-fidelity database from extractions of 133,889 reports. A hold-out validation set of 98 reports was blindly annotated and extracted by two clinicians for comparison with the NLP extraction. Agreement, discrimination, accuracy and calibration of outcome measure extractions were evaluated. Results: Continuous outcomes including LVOT VTI, AV VTI, and TR Vmax exhibited perfect inter-rater reliability using intra-class correlation scores (ICC=1.00, P< 0.05) alongside high R2 values, demonstrating an ideal alignment between the NLP system and clinicians. Good level (ICC =0.75-0.9, P<0.05) of inter-rater reliability were observed for outcomes such as LVOT Diam, Lateral MAPSE, Peak E Velocity, Lateral E' Velocity, PV Vmax, Sinuses of Valsalva, and Ascending Aorta diameters. Furthermore, the accuracy rate for discrete outcome measures was 91.38% in the confusion matrix analysis, indicating effective performance. Conclusions: The NLP-based technique yielded good results when it came to extracting and categorising data from echocardiography reports. The system demonstrated a high degree of agreement and concordance with clinician extractions. This study contributes to the effective use of semi-structured data by providing a useful tool for converting semi-structured text to structured echo report that can be used for data management. Additional validation and implementation in healthcare settings can improve data availability and support research and clinical decision-making.

Highly-skilled migrants and refugees finding employment in low-skill vocations, despite professional qualifications and educational background, has become a global tendency, mainly due to the language barrier. Employment prospects for displaced communities are mostly decided by their knowledge of the sublanguage of the vocational domain they are interested in working. Common vocational domains include agriculture, cooking, crafting, construction, and hospitality. The increasing amount of user-generated content in wikis and social networks provides a valuable source of data for data mining, Natural Language Processing and machine learning applications. This paper extends the contribution of the authors’ previous research on automatic vocational domain identification by further analyzing the results of the machine learning experiments with the domain-specific textual data set, considering 2 research directions: a. predictions analysis and b. data balancing. Wrong predictions analysis and the features that contributed to misclassification, along with correct predictions analysis and the features that were the most dominant, contributed to the identification of a primary set of terms for the vocational domains. Data balancing techniques were applied on the data set to observe their impact on the performance of the classification model. A novel 4-step methodology is proposed in this paper for the first time, consisting of successive applications of SMOTE oversampling on imbalanced data. Data oversampling obtains better results than data undersampling in imbalanced data sets, while hybrid approaches perform reasonably well.

Large language models (LLMs) excel in providing natural language responses that sound authoritative, reflect knowledge of the context area, and can present from a range of varied perspectives. Agent Based Models and Simulation consist of simulated agents that interact within a simulated environment to explore societal, social, and ethical, among other, problems. Agents generate large volumes of data over time and discerning useful and relevant content is an onerous task. LLMs can help in communicating agents’ perspectives on key events by providing natural language narratives. However, these narratives need to be factual, transparent, and reproducible. To this end, we present a structured narrative prompt for sending queries to LLMs. Chi-square tests and Fisher’s Exact tests are applied to assess statistically significant difference in sentiment scores of the narrative messages between simulation generated narratives, ChatGPT-generated narratives, and real tweets. The narrative prompt structure effectively yields narratives with the desired components from ChatGPT. This structure is expected to be extensible across LLMs. In 14 out of 44 categories, ChatGPT generated narratives which has sentiment scores that were not discernibly different, in terms of statistical significance (alpha level of 0.05), from the sentiment expressed in real tweets. Three outcomes are provided: (1) a list of benefits and challenges for LLMs in narrative generation; (2) a structured prompt for requesting narratives of a LLM based on simulated agents’ information; and (3) an assessment of statistical significance in the sentiment prevalence of the generated narratives compared to real tweets. This indicates significant promise in the utilization of LLMs for helping to connect simulated agent’s experiences with real people.

This review seeks to explain four features of viral respiratory illnesses that have perplexed generations of virologists: (1) the seasonal timing of respiratory illness; (2) the common viruses causing respiratory illness worldwide, including year-round disease in the Tropics; (3) the rapid response of outbreaks to weather, specifically temperature; (4) the rapid arrival and termination of epidemics caused by influenza and other viruses. The inadequacy of the popular explanations of seasonality is discussed, and a simple hypothesis is proposed, called Temperature Dependent Viral Tropism (TDVT), that is compatible with the above features of respiratory illness. TDVT notes that viruses can transmit themselves more effectively if they moderate their pathogenicity (thereby maintaining host mobility) and suggests that endemic respiratory viruses accomplish this by developing thermal sensitivity within a range that supports organ-specific viral tropism within the human body, whereby they replicate most rapidly at temperatures below body temperature. This allows them to confine themselves to the upper respiratory tract and to avoid infecting the lungs, heart, gut etc. Biochemical and tissue-culture studies show that “wild” respiratory viruses show such natural thermal sensitivity. The typical early autumn surge of colds and the existence of respiratory illness in the Tropics year-round at intermediate levels are explained by the tendency for strains to adapt their thermal sensitivity to their local climate and season. The TDVT hypothesis has important practical implications for preventing and treating respiratory illness including Covid-19. TVDT is testable with many options for experiments to increase our understanding of viral seasonality and pathogenicity.

Detecting suicidal ideation in adults with major depression is crucial for timely intervention and prevention of self-harm. As suicide is influenced by various biological, socio-cultural and psychological factors, traditional screening methods have accuracy and efficiency limitations. In certain cultures, societal stigma and marginalization can compel individuals with depression to conceal their suffering. Such individuals often turn to online social media platforms and share their experiences with peers under the protection of anonymity. Our research explored the potential of machine learning detection of suicidal ideation among Romanian adults with major depression that contributed to a web-based depression support forum. A trained algorithm (C4.5 decision tree) analyzed 125 posts fed to on a free access online support forum over 5 years (2014 – 2018) and classified them based on suicidal ideation content. 32 texts (25%) were identified as having a high probability of suicidal ideation content. 65% of the authors were male, with a mean age of 36.7±10.3 years and an average duration of illness of 3.4±1.4 years. Texts indicating positive suicidal ideation were generally shorter and elicited more general responses but fewer professional responses compared to those without suicidal ideation content. The study's main limitations include the relatively small number of classified texts, the absence of prospective information and the lack of qualitative evaluation of the excerpts' content. As socio-demographic and linguistic actuarial results were comparable to data reported by real life studies, we may consider basic text mining techniques as a screening tool that is able to detect suicidal ideation in texts written in unstructured Romanian language.

“You should know the words by the company they keep!” has been one of the most famous slogans attributed to John Rubert Firth, 1957. This has ignited a whole school in linguistic research known as the British empiricist contextualism. Sixty years later, many un- or semi-supervised machine learning algorithms have been successfully designed and implemented aiming at extracting word meaning from within the context of a text corpus. These algorithms treat words, more or less, as vectors of real numbers representing frequencies of word occurrences within context and word meaning as positions of words in a high-dimensional vector space model. Word associations, in turn, are treated as calculated distances among them. With the rise of Deep Learning (DL) and other artificial neural networks based architectures, learning the positioning of words and extracting word associations as measured by their distances has further improved. In this paper, however, we revisited the main stream of algorithmic approaches and set the stage for a partly cross-disciplinary evaluation framework to judge about the nature of the extracted word associations by state-of-the-art machine learning algorithms. Our preliminary results are based on word associations extracted from the application of DL framework on a Google News text corpus, as well as on comparisons with human created word association lists such as word collocation dictionaries and psycholinguistic experiments. The results and conclusions provide some insights into the inherited limitations in interpreting the type of word associations and underpinning relations between words with inevitable consequences in other areas, such as extraction of knowledge graphs or image understanding.

This paper presents the findings of an exploratory study on the continuously generating Big Data on Twitter related to the sharing of information, news, views, opinions, ideas, knowledge, feedback, and experiences about the COVID-19 pandemic, with a specific focus on the Omicron variant, which is the globally dominant variant of SARS-CoV-2 at this time. A total of 12028 tweets about the Omicron variant were studied, and the specific characteristics of tweets that were analyzed include - sentiment, language, source, type, and embedded URLs. The findings of this study are manifold. First, from sentiment analysis, it was observed that 50.5% of tweets had the ‘neutral’ emotion. The other emotions - ‘bad’, ‘good’, ‘terrible’, and ‘great’ were found in 15.6%, 14.0%, 12.5%, and 7.5% of the tweets, respectively. Second, the findings of language interpretation showed that 65.9% of the tweets were posted in English. It was followed by Spanish or Castillian, French, Italian, Japanese, and other languages, which were found in 10.5%, 5.1%, 3.3%, 2.5%, and <2% of the tweets, respectively. Third, the findings from source tracking showed that “Twitter for Android” was associated with 35.2% of tweets. It was followed by “Twitter Web App”, “Twitter for iPhone”, “Twitter for iPad”, “TweetDeck”, and all other sources that accounted for 29.2%, 25.8%, 3.8%, 1.6%, and <1% of the tweets, respectively. Fourth, studying the type of tweets revealed that retweets accounted for 60.8% of the tweets, it was followed by original tweets and replies that accounted for 19.8% and 19.4% of the tweets, respectively. Fifth, in terms of embedded URL analysis, the most common domains embedded in the tweets were found to be twitter.com, which was followed by biorxiv.org, nature.com, wapo.st, nzherald.co.nz, recvprofits.com, science.org, and other URLs. Finally, to support similar research and development in this field centered around the analysis of tweets, we have developed an open-access Twitter dataset that comprises tweets about the SARS-CoV-2 omicron variant since the first detected case of this variant on November 24, 2021.

The review of previous works shows this study is the first attempt to analyse the lockdown effect using Natural Language Processing Techniques, particularly sentiment analysis methods applied at large scale. On the other hand, it is also the first of its kind to analyse the impact of COVID 19 on the university community jointly on staff and students and with a multi-country perspective. The main overall findings of this work show that the most often related words were family, anxiety, house and life. On another front, it has also been shown that staff have a slightly less negative perception of the consequences of COVID in their daily life. We have used artificial intelligence models like swivel embedding and the Multilayer Perceptron, as classification algorithms. The performance reached in terms of accuracy metric are 88.8% and 88.5%, for student and staff respectively. The main conclusion of our study is that higher education institutions and policymakers around the world may benefit from these findings while formulating policy recommendations and strategies to support students during this and any future pandemics.

The incidence of gastrointestinal diseases (cancer in particular) has increased progressively with considerable morbidity, mortality, and a high economic impact on the healthcare system. Dietary intake of natural bioactive phytochemicals showed to have cancer-preventing and therapeutic effects. This includes the cruciferous vegetable derivative phenethyl isothiocyanate (PEITC), a bioactive compound from watercress. PEITC antioxidant, anti-inflammatory and anti-cancer properties are of particular importance. This review summarizes the current knowledge on the role of PEITC as a potential natural nutraceutical or an adjuvant against oxidative/inflammatory-related disorders in the gastrointestinal tract. We also discuss the safe and recommended dose of PEITC. Besides, we establish a framework to guide the research and development of sustainable methodologies for obtaining and stabilizing this natural nutraceutical for industrial use. This is a topic that still needs more scientific development, but with the potential to lead to a viable strategy in the prevention of cancer and other associated diseases of the gastrointestinal tract.

The annual budget for the United States National Park Service was roughly three billion dollars in 2016. This is distributed amongst 405 National Parks, 23 national scenic and historic trails, and 60 wild and scenic rivers. Entrance fees and concessions generate millions of dollars in income for the National Park Service; however, this metric fails to account for the total value of the National Parks. In failing to consider the value of the ecosystem services provided by the National Parks we fail to quantify and appreciate the contributions our parks make to society. This oversight allows us to continue to underfund a valuable part of our natural capital and consequently damage our supporting environment, national heritage, monetary economy, and many of our diverse cultures. We explore a simple benefits transfer valuation of the United States national parks using National Land Cover Data from 2011 and ecosystem service values determined by Costanza (et al). This produces an estimate suggesting the parks provide $84 billion / year in ecosystem service value. If the natural infrastructure 'asset' that is our national park system had a budget comparable to a piece of commercial real estate of this value, the annual budget of the National Park Service would be roughly an order of magnitude larger at something closer to $30 billion rather than $3 billion.

New class of biologically active and non-active compounds can be synthesized via transition metal mediated Suzuki cross coupling reaction that has a great impact on the advancement of organic chemistry. These resulted products can lend a helping hand in pharmaceutical and polymer chemistry for the betterment of mankind. Suzuki-Miyaura cross coupling reaction is one of the best tools through which many natural and non-natural compounds can be synthesized.

Natural products (NPs) have been the centre of attention of the scientific community in the last decencies and the interest around them continues to grow incessantly. As a consequence, in the last 20 years, there was a rapid multiplication of various databases and collections as generalistic or thematic resources for NP information. In this review, we establish a complete overview of these resources, and the numbers are overwhelming: over 120 different NP databases and collections were published and re-used since 2000. 98 of them are still somehow accessible and only 50 are open access. The latter include not only databases but also big collections of NPs published as supplementary material in scientific publications and collections that were backed up in the ZINC database for commercially-available compounds. Some databases, even published relatively recently are already not accessible anymore, which leads to a dramatic loss of data on NPs. The data sources are presented in this manuscript, together with the comparison of the content of open ones. With this review, we also compiled the open-access natural compounds in one single dataset a COlleCtion of Open NatUral producTs (COCONUT), which is available on Zenodo and contains structures and sparse annotations for over 400000 non-redundant NPs, which makes it the biggest open collection of NPs available to this date.

A review of the concept of "fitness" as it is used in evolutionary theory.

The Loess Plateau is an important region for vegetation restoration in China, however, changes in soil organic carbon (SOC), soil nutrients, and stoichiometry after restoration in this vulnerable ecoregion are not well understood. Typical restoration types, including orchardland (OL), grassland (GL), shrubland (SL), and forestland (FL) were chosen to examine changes in the stocks and stoichiometry of SOC, soil total nitrogen (TN), and soil total phosphorus (TP) at different soil depths and recovery times. Results showed that SOC stocks first increased and then stabilized in OL, GL, and SL at 0–30 cm depth, while in FL, stocks gradually increased. Soil TN stocks first increased and then decreased in OL, SL, and FL with vegetation age at 0–30 cm depth, while soil TP stocks showed little variation between restoration types. In the later stages of restoration, the stocks of SOC and soil TN at 0–30 cm soil depth were still lower than those in natural grassland (NG) and natural forest (NF). The overall C:N, C:P, and N:P ratios increased with vegetation age. Additionally, the SOC, soil TN and soil TP stocks, and C:N, C:P, and N:P ratios decreased with soil depth. The FL had the highest rate of change in SOC and soil TN stocks, at 0-10 cm soil depth. These results indicate a complex response of SOC, soil TN, and soil TP stocks and stoichiometry to vegetation restoration, which could have important implications for understanding C, N, and P changes and nutrient limitations after vegetation restoration.

Forest managers are often required to restore forest stands following natural disturbances, a situation that may become more common and more challenging under global change. In parts of Central Europe, particularly in mountain regions dominated by mixed temperate forests, the use of relatively low intensity, uneven-aged silviculture is a common management approach. Because this type of management is based on mimicking less intense disturbances, the restoration of more severe disturbance patches within forested landscapes has received little attention within the context of uneven-aged silviculture in the region. The goal of this paper is to synthesize research on the restoration of forests damaged by disturbances in temperate forests of Slovenia and neighbouring regions of Central Europe, where uneven-aged silviculture is practiced. We place particular emphasis on the most important biotic and abiotic drivers of post-disturbance regeneration, and use this information to inform silvicultural decisions about applying natural or artificial regeneration in disturbed areas. We conclude with guidelines for restoration silviculture in uneven-aged forest landscapes.

Geotechnology techniques were used to specialize the occurrences of the species, based on forest inventories and information available in open-access databases, as well as data from herbaria with catalogs available online, and bibliographical references indicating places of occurrence in the Amazon. GIS-integrated Weighted Mean Ordination (WMO) was chosen as the technique for evaluating the topoclimatic index. Thirteen topoclimatic variables were used, applying principal component analysis techniques such as multidimensional preference to compare the participation of each variable in the two components; Biplot to identify the relationships between the variables and cluster to identify the average distance between proximal classes. The interpolated surfaces of the specialized climatic variables were separated into frequency bands that helped calculate the probability of occurrence, from which a scale of 0 to 10 was established, indicating lower and higher probabilities. Three potential zones were identified, classified as high, medium and low, where areas with high potential occupied 32% of the territory of Pará, medium areas 36% and 32% with low potential for cultivation and presence. The intermediate class had the highest percentage, totaling 36% of the state, explained by the average ratio between the weights adopted.

Natural language processing (NLP) is being widely used globally for a variety of value-creation tasks ranging from chat-bots and machine translations to sentiment and topic analysis and multilingual large language models (LLMs). However, most of the advances are initially implemented within the English language framework, and it takes time and resources to develop comparable resources in other languages. The advances in machine translations have enabled the rapid and effective conversion of content in global languages into English and vice-versa. This creates potential opportunities to apply English language NLP methods and tools to other languages via machine translations. However, although this idea is powerful, it needs to be validated and processes and best practices need to be developed and kept updated. The present research is an effort to contribute to the development of best practices and an evaluation framework. We present a systematic and repeatable state-of-the-art process to evaluate the viability of applying English language sentiment analysis tools to Italian text by using multiple English language machine translation mechanisms such that it can be easily extended to other languages. hor[RU,RA]{\large Richard Anderson} \address[RU]{\large Rutgers University, USA} \address[RA]{\large rick.anderson@rutgers.edu} \author[RU]{\large Carmela Scala} \author[RU]{\large Jim Samuel} \author[UC]{\large Vivek Kumar} \address[UC]{\large University of Cagliari, Italy} \author[RU]{\large Parth Jain}

Concern over microplastics (MPs) in the environment is rising. Microplastics are generally known to exist in aquatic settings, but less is known about their occurrence in soil ecosystems. When plastic waste builds up in agricultural areas, it can have a negative impact on the environment and food sources, as well as have an indirect effect on all trophic levels of the food chain. This paper addresses the relationship between microplastics and the management of plastic waste, which contributes to their accumulation, and it describes the sources and primarily the movement processes of microplastics in agricultural soils as a result of natural events. Evaluating the impact of weather on coastal microplastic contamination is critical, as extreme weather events have become more frequent in recent years. This study sheds light on how weather patterns affect the dispersion of plastic waste in terrestrial habitats, including the impacts of seasonality and extreme weather. According to our data, typhoons, monsoons, rainfall, and floods all contribute significantly more microplastics to the surface sediment through surface runoff and wind transport, particle redistribution caused by agitated waves, and fragmentation under intense abrasion forces. Severe weather conditions have the potential to disperse larger and more varied kinds of microplastics.

Rice bran arabinoxylan compound (RBAC) is derived from rice bran enzymatically treated with Lentinus Edodes mycelium. This review explores biologically active compounds and mechanisms of action that support RBAC as an immunomodulating nutraceutical in generally healthy and/or aging individuals. Thirty-seven (n=37) primary research articles fulfiled the selection criteria for review. Most research is based on Biobran MGN-3, which consists of complex heteropolysaccharides with arabinoxylan as its primary structure while also containing galactan and glucan. RBAC was found to invoke immunological activities through direct absorption via the digestive tract and interaction with immune cells at the Peyer’s patches. RBAC was shown to promote the innate defence by upregulating the macrophage phagocytosis and enhancing natural killer cell activity while lowering oxidative stress. Through induction of dendritic cell maturation, RBAC also augments adaptive immunity by promoting T and B lymphocyte proliferation. RBAC acts as an immunomodulator by inhibiting mast cell degranulation during allergic reactions, attenuating inflammation, and downregulating angiogenesis by modulating cytokines and growth factors. RBAC is shown to be a safe and effective neutraceutical for improving immune health, notably in aging individuals with reduced immune function. Human clinical trials with geriatric participants have demonstrated RBAC to have prophylactic benefits against viral infection and may improve their quality of life. Further research should explore RBAC’s bioavailability, pharmacodynamics, and pharmacokinetics of the complex heteropolysaccharides within. Translational research to assess RBAC as an nuetraceutical for the aging population is still required, particularly in human studies with larger sample sizes and cohort studies with long follow-up periods.

Natural capital is the wealth of nations that give them the economic status they represent. Worldwide, vulnerable people depend on natural capital for employment, salaries, wealth, and livelihoods and, in turn, determine the developmental index of the nation to which they belong. The availability of ecological services is crucial for clean water and air, food and fodder, and agricultural development. In this short commentary, we have tried to sum up the ideas and discussions over natural capital's role in ascribing economic status to countries. We have discussed how the prosperity of humans is intertwined with the services ecosystems provide and how poor natural resource management (NRM) has adversely cost human well-being. The paper concludes that to ensure the current and future human well-being, an in-depth understanding of the services ecosystems provide, is essential.

The advent of Large Language Models (LLMs) has significantly advanced natural language processing (NLP), yet their application to historical texts remains challenging due to archaic language, distinct terminologies, and varied contextual backgrounds. This study introduces Historical Domain Large Language Models, designed to bridge this gap by adapting LLMs for better comprehension and processing of historical data. Our approach leverages context-aware and task-specific prompts to enhance model performance in tasks such as named entity recognition (NER), sentiment analysis, and information extraction within historical contexts. We propose an iterative refinement process to improve prompt quality and model outputs continuously. Instruction tuning on newly collected evaluation data ensures our methods' efficacy, avoiding biases from previously used datasets. Evaluations using GPT-4 demonstrate significant improvements in handling historical texts, underscoring the potential of our approach to unlock profound insights from historical data. This work highlights the importance of tailored LLM adaptations for specialized domains, offering a robust framework for future research in historical NLP.

Phytochemicals have a long and successful history in drug discovery. With recent advancements in analytical techniques and methodologies, discovering bioactive leads from natural compounds has become easier. Computational techniques like molecular docking, QSAR modelling and machine learning, and network pharmacology are among the most promising new tools that allow researchers to make predictions concerning natural products' potential targets, thereby guiding experimental validation efforts. Additionally, approaches like LC-MS or LC-NMR speed up compound identification by streamlining analytical processes. Integrating structural and computational biology aids in lead identification, thus providing invaluable information to understand how phytochemicals interact with potential targets in the body. Emerging computational approach is machine learning involving QSAR modelling and deep neural networks that interrelate phytochemical properties with diverse physiological activities such as antimicrobial or anticancer effects.

Natural tourist destinations stand out as the most preferred choice in Rembang Regency compared to cultural and artificial tourist destinations. However, until now, there have been no standard indicators established to assess the potential for natural tourism in Rembang Regency, which could assist the Culture and Tourism Office in determining potential tourist locations. In this research, the grouping of natural tourism potential indicators will be carried out based on six main aspects, namely Attractions, Amenities, Accommodation, Activities, Accessibility and Ancillary Services, together with environmental aspects and Human Resources. The procedure for determining natural tourism potential will be developed from the results of this grouping using a taxonomic model. Indicators and the weight of each indicator will be determined using the hierarchical analysis method. The results of this research will produce a taxonomy model that can overcome challenges in managing and utilizing information and knowledge, which in turn will facilitate the process of sharing and utilizing information. Furthermore, the procedures developed will enable accurate and efficient determination of natural tourism potential in accordance with established procedures. This research method will also enable the development of a comprehensive knowledge management system at the Rembang Regency Culture and Tourism Service, through the next stages in the designed taxonomy model. This research is expected to contribute to the sustainable management of natural tourism, which can contribute to the preservation of nature while improving the tourist experience.

In view of the diminishing contribution of natural products from plants to the discovery of new chemical structures, the aim of this study was to compile the articles from 2021 to 2022, assessing: (1) which classes of compounds these new structures belong to; (2) which plants and families these compounds belong to and (3) assessing the degree of novelty of the compound with an already known structure. The review was elaborate following the Preferred Reporting Items for System-atics Reviews and Meta-analyses (PRISMA) statement checklist for guide reporting of systematic reviews. A total of 464 articles were selected for the new compounds of natural origin survey. We included 117 complete articles in this review and reported approximately 109 new structures elucidated during the years 2021 and 2022. Many of the compounds showed small structural var-iations in relation to already known molecules. For some, however, this small modification was decisive for the biological activity reported, demonstrating the importance of descriptive phytochemical studies.

English based datasets are commonly available from Kaggle, GitHub, or recently published papers. Although benchmark tests with English datasets are sufficient to show off the performances of new models and methods, still a researcher need to train and validate the models on Korean based datasets to produce a technology or product, suitable for Korean processing. This paper introduces 15 popular Korean based NLP datasets with summarized details such as volume, license, repositories, and other research results inspired by the datasets. Also, I provide high-resolution instructions with sample or statistics of datasets. The main characteristics of datasets are presented on a single table to provide a rapid summarization of datasets for researchers.

The sentiment of a word varies based on its context of usage: the words used around it and the part-of-speech it is used as. This paper proposes a technique to suggest the sentiment of a word by combining its part-of-speech and the semantic similarities of its co-occurrences with both context-specific and pre-trained embeddings to achieve powerful and fast results. A study was conducted across domains and sub-domains to measure variance of sentiment by switching domains and switching context within the same domain. Re-scoring a commonly used polarity lexicon showed that 10% of words changed scores while switching domains and 8% changed scores within domains while switching context. Part of Speech analysis on 65,353 commonly used sentiment lexicons showed that 81% of sentiment bearing (non-neutral) lexicons were of the tags NN (Common Noun), JJ (Adjective) or NNS (Proper Noun).

Hepatocellular carcinoma (HCC) is currently the third leading cause of malignancy-related mortalities worldwide. Natural killer (NK) cells are involved in the critical role of first line immunological defense against cancer development. Defects in NK cell functions are recognized as important mechanisms for immune evasion of tumor cells. NK cell function appears to be attenuated in HCC, and many previous reports suggested that NK cells play a critical role in controlling HCC, suggesting that boosting the activity of dysfunctional NK cells can enhance tumor cell killing. However, the detailed mechanisms of NK cell dysfunction in tumor microenvironment of HCC remain largely unknown. A better understanding of the mechanisms of NK cell dysfunction in HCC will help in the NK cell-mediated eradication of cancer cells and prolong patient survival. In this review, we describe the various mechanisms underlying NK cell dysfunction in HCC. Further, we summarize current advances in the approaches to enhance endogenous NK cell function and in adoptive NK cell therapies, to cure this difficult-to-treat cancer.

P2Y2 and P2Y4 receptors are physiologically activated by UTP and are widely expressed in many cell types in humans. They promote an increase in intracellular calcium via PLCβ/ IP3 and act on ion flux and water secretion. P2Y2 plays an important role in inflammation and proliferation of tumor cells, which could be attenuated with the use of antagonists. However, little is known about the physiological functions related to P2Y4 due to the lack of selective ligands for these receptors, which can be solved through the search of novel compounds with antagonistic activity. In the present study, we have applied a methodology of calcium measurement to identify new antagonist candidates for these receptors. Firstly, we established optimal conditions for calcium assay using J774.G8, a murine macrophage cell line, which expresses functional P2Y2 and P2Y4 receptors. J774.G8 cells were loaded with 2 μM of Fluo-4 to test its sensitivity in responding calcium stimuli. ATP and ionomycin, known as inductors of intracellular calcium rise, were used to stimulate cells. The EC50 obtained were 11 μM and 103 nM, respectively. Subsequently, investigation of P2Y2 and P2Y4 expression was performed. These cells responded with EC50 of 1.021 μM to the UTP stimulation. Screening assays were performed and a total of 100 extracts from Brazilian natural products were tested. JA2, RA3, and RB3 extracts stood out for their ability to inhibit UTP-induced responses without causing cytotoxicity and presented IC50 of 32.32 μg/mL, 14.99 μg/mL, and 12.98 μg/mL, respectively. Collectively, our results point to the discovery of potential antagonists candidates from natural products for UTP-activated receptors.

The question of the relevance of human and natural capital, as well as the potential adverse effect of natural capital on economic growth, has gained increased attention in development economics. The aim of this paper is to theoretically and empirically assess the relevance of several forms of capital on economic growth in small economies that are dependent upon tourism or natural resources. The empirical framework is based on Impulse Response Functions obtained from Vector Autoregressive models in which we focus on the model where economic growth is the dependent variable for ten small economies that are dependent upon either tourism or natural resources. We find that there is evidence of the ‘’natural resource curse’’, especially in the economies that have a strong dependence on resources that are easily substitutable and whose prices constantly fluctuate. We further find that in the majority of observed cases the type of capital these small economies are most dependent on for their economic growth causes negative impulses in the majority of the observed periods. The main policy recommendation should be to assure that even these small economies should strive towards further diversification and avoid dependence on only one segment of their economy.

The escalating global population and subsequent demand for agricultural products have led to a surge in agricultural waste generation, posing significant disposal challenges. Conventional disposal methods such as burning and dumping not only harm the environment but also jeopardize human health and safety. Recognizing the urgent need for sustainable waste management, researchers have increasingly focused on repurposing agricultural plant waste as a valuable resource. This paper presents a comprehensive review of the potential of agricultural plant waste in wealth creation and sustainable development. It highlights the detrimental impacts of current disposal methods and emphasizes the necessity for alternative approaches. By analyzing the physical, mechanical, and chemical properties of plant fibers, particularly cellulose, hemicellulose, and lignin, this review underscores their suitability for diverse applications. Moreover, it explores the emerging trend of utilizing pineapple leaf fiber, a sustainable and lightweight material, in structural applications such as UAV construction. With its exceptional mechanical properties and biodegradability, pineapple leaf fiber holds promise as a viable alternative to traditional materials, contributing to a more sustainable future. In conclusion, this review advocates for a paradigm shift towards embracing agricultural plant waste as a valuable asset for economic prosperity and environmental sustainability. It underscores the importance of continued research and technological advancements to unlock the full potential of agricultural waste in fostering a circular economy and driving sustainable development globally.

In the past few decades, the use of agricultural waste has been increasing due to the increasing demand for sustainable materials. This paper aims to review the significance of agricultural waste as a type of wealth and its potential as an alternative material in the composite field. It was found that many agricultural wastes had been utilized in various production of ecological products. The review discusses the physical, mechanical, and chemical properties of the natural fibers made from agricultural waste and the use of Pineapple Leaf Fiber Reinforced Composite to manufacture UAVs (Unmanned Aerial Vehicles). The extracted waste fibers’ physical, mechanical, and chemical properties show that these agricultural wastes can produce better advanced composite materials suitable for structural applications. The use of pineapple leaf fiber in Unmanned Aerial Vehicles manufacturing has the potential to revolutionize this industry and contribute to a more sustainable future.

Postoperative ileus (POI) is a delay in gastrointestinal transit following surgery that leads to various complications. There is limited understanding of its effective treatment options. CKD-495 and eupacidin are natural products licensed for treating mucosal lesions in acute and chronic gastritis; however, little is known about their effects on intestinal permeability. This study evaluated the effects of CKD-495, eupacidin, and its components (eupatilin and cinnamic acid) on intestinal per-meability in an animal model of POI. Guinea pigs underwent surgical procedures and were ran-domly assigned to different treatment groups. Drugs were administered orally prior to surgery. Intestinal permeability, leukocyte count, and the expression of calprotectin and tight junction proteins were measured in the harvested ileum tissue. The intestinal permeability and leukocyte count were higher in the POI group than in the control group. Pre-administration of CKD-495, cinnamic acid, eupacidin, and eupatilin effectively prevented these changes in the POI model. No significant differences were observed in the expression of tight junction proteins. CKD-495, cinnamic acid, eupacidin, and eupatilin exerted protective effects against increased intestinal permeability and inflammation in an animal model of POI. These natural products have potential as therapeutic options for the treatment of POI.

Disaster issue consultation is crucial for effective emergency management, requiring timely and accurate information to support decision-making processes. This paper explores the integration of large language models (LLMs) with advanced prompt engineering to enhance the performance of AI systems in disaster management. We propose a novel multi-round prompt engineering approach that guides LLMs to iteratively refine their responses based on evolving disaster scenarios. Our method leverages diverse disaster-related datasets and employs a combination of accuracy metrics and a customized GPT-4 scoring system for evaluation. We conduct comprehensive experiments across multiple LLM platforms, including Qwen2, ChatGPT, Claude, and GPT-4, comparing our approach with baseline models and the Tree of Thoughts (ToT) method. The results demonstrate significant improvements in both accuracy and response quality, highlighting the effectiveness of our method in providing contextually relevant and actionable insights. Additional analysis confirms the robustness and generalizability of our approach across various disaster scenarios, establishing it as a valuable tool for enhancing disaster management practices.

The interest in obtaining new composite materials with diverse properties has created a growing interest in natural fi-bers as reinforcement in polymers, which has generated an impact in sectors such as automotive and construction, dis-placing synthetic fibers. Properties such as low density, low cost, and rene.wable make these fibers an attractive alterna-tive to reduce environmental impact. Their application in polymers, such as polypropylene, polyethylene, and epoxy resins, has allowed the modification of polymeric composite materials' mechanical and physical properties (NFRP). This review focuses on investigating the status of natural fiber-reinforced polymers. It analyzes their worldwide demand, chemical characteristics, physical and mechanical properties, and various applications in different sectors and indus-tries. In addition, the advantages and disadvantages of NFRPs are highlighted, highlighting their potential for new ap-plications.

Human hair is characterized by significant diversity, which is dictated by the individual genetic makeup. It is estimated that up to 70% of the world’s population has textured hair, with a signif-icant proportion also living in areas with high exposure to ultraviolet radiation (UVR). This highlights the unique requirements for textured hair care products that can protect hair shafts from the harmful effects of the environment whilst enhancing the natural features of the fibre. In this study, we investigated the UV-protective effects of hair conditioner formulated from active ingredients, mangiferin, ferulic acid and naringin. The analysis of UV-irradiated straight and textured hair was performed by measurements of hair thickness and darkness, the uptake of the fluorescent dye, spectral absorbance of keratin extracts, ATR-FTIR and SEM. We found that tex-tured hair was more sensitive to UVR-induced changes than straight hair, with the primary mo-lecular targets represented by chemical groups in keratins. Pre-treatment of the hair with condi-tioner had protective effects against structural damage and oxidative stress caused by UVR. These data indicate the importance of the personalized approach to hair research and the formu-lation of hair care products tailored to the individual demands of textured hair types.

In the dynamic landscape of E-commerce, the proliferation of user-generated queries regarding products highlights the critical need for advanced automatic question answering (AQA) systems. These systems are instrumental in harnessing the vast array of information available online to deliver immediate and informative responses to potential buyers. Recognizing the complexity of such queries, which often require synthesis of reviews, product specifications, and responses to similar questions, we introduce a sophisticated model, the Comprehensive E-commerce Answer Generation System (CEAGS). This model adeptly navigates the challenges posed by irrelevant data and sentiment ambiguity in user-generated content. Our approach leverages a dual-phase process of relevance determination and sentiment clarity, setting the stage for a transformative response generation mechanism. Empirical analyses reveal the superiority of CEAGS, with our relevance assessment framework outstripping existing models by a notable margin in precision metrics, and our answer generation module achieving unprecedented gains in content preservation and coherence. Notably, CEAGS marks a pioneering contribution to the E-commerce domain by integrating disparate information sources to formulate responses that are not only accurate but also contextually rich and user-centric.

Pancreatic cancer (PC) is considered one of the most challenging and formidable malig-nancies to treat because it is usually diagnosed at terminal stage, thus it is characterized with a poor prognosis with 5% of patients living over 5 years. The late diagnosis leads to a lower suc-cess rate of resectability, hence chemotherapy or chemoradiotherapy are the only hopes for most PC patients. However, the available drug combinations for PC treatment did not provide satisfactory clinical outcomes. There is a pressing and urgent need to discover new chemothera-peutics which fight PC with tolerable side effects and less liability for resistance. Pentacyclic triterpenes (PTs) are privileged structures with a multitude of biological activities mitigating several ailments, particularly in neoplasm field. They are characterized by a high therapeutic window and their activity can be highly enhanced through structural modifications. Indeed, several parent PTs such as oleanolic acid, ursolic acid, lupeol, betulinic acid, and celastrol proved effective against different PC phenotypes inhibiting their proliferation, invasion, and metastasis mainly via KRAS modulation. Some PTs worked as adjuvant chemosensitizers in gemcitabine-resistant or TRAIL-resistant cells. Owing to their potential in PC treatment, we pre-sent this review article summarizing PC pathogenesis and the promising role of PTs in the man-agement of PC when used either solely or in combination with other chemotherapies such as gemcitabine and 5-Fluorouracil.

The importance of oxygen role during aging process of wine has been long known. Many articles evaluating oxygen inlet for different wine stoppers have been published. However, none of these have studied the impact of the natural cork stoppers production process over oxygen inlet. At the moment, a standardized methodology widely accepted for measuring the oxygen transfer rate (OTR) and/or oxygen permeability of the stopper does not exist. Thus, this article is focused on the aging process (the final phase of the winemaking) and aims to test how some production process of natural cork stoppers impact on the stoppers permeability using chemiluminescence methodology and how also this affects wine ageing. In this study it has been seen that some of its processes such as the application of a surface treatment modify the permeability of the stopper. Surface plays an important role in the corks stoppers production and allows an easier insertion and extraction of the stopper into the bottle, avoiding leaks and homogenizing the stoppers. It was shown that the cork stoppers sample with surface treatment 1 had three times higher oxygen transfer rate than the cork stoppers sample with surface treatment 2 after one year of evolution. The two groups of stoppers had the same in terms of dimensions, density, visual class, batch and manufacture, the only difference between them was the surface treatment used. A red wine was corked with these two types of cork stoppers and its evolution was monitored up to 30 months of ageing. Differences were observed in the evolution of the wines both in certain oenological parameters such as the free SO2, the colour and the evolution of the polyphenols as well as at the sensory level. The wine corked with the stoppers of treatment 1 presented a faster evolution and a higher valuation in the sensory tastes of months 12th, while from the 18th month it presented an over evolution, and the score was below that of the wine with the corks of treatment 2.The data collected in this study shows that the differences observed with the chemiluminescence methodology of cork permeability test at a laboratory level are transferred to wine at the cellar. Therefore, it paves the way to standardize chemiluminescence as a methodology for permeability testing of cork stoppers. This opens a new field for the regulation of the permeability of natural cork stoppers by type of surface treatment applied.

Bioactive peptides are promising cosmetic active ingredients that can improve skin health and appearance. They exhibit a broad spectrum of activity, including anti–ageing, antioxidant, antimicrobial and anti–inflammatory. The aim of this study was to develop a safe, stable and efficacious environmentaly friendly ("green") emulsion using milk protein hydrolysate as a model active ingredient. Potential emulsions were formulated with biodegradable emollients, stabilised with a naturally-derived mixed emulsifier and prepared by cold process. They were evaluated for rheological behavior (continuous rotation and oscillation tests), physical stability (dynamic mechanical thermal analysis - DMTA test) and texture profiles, as well as for cytotoxic, antioxidant and antimicrobial effects. Rheological characterization revealed shear-thinning flow behaviour with yield point from continuous rotation tests and predominantly elastic character from oscillation (amplitude and frequency sweep) tests, with small structural change detected in the DMTA test. These results implied satisfactory rheological properties and good stability. Texture analysis revealed acceptable spreadability and substantivity of the emulsions. The protein hydrolysate showed antioxidant activity. The developed emulsions showed low antibacterial activity against selected microorganisms, but this was due to the action of preservatives, not peptides. All potential emulsions showed desirable safety profile. The results obtained provide the basis for the next stage of formulation development, i.e. in vivo efficacy tests.

Viral infection activates the transcription factors IRF3 and NF-κB, which synergistically induce type I interferons (IFNs). Here, we identify the E3 ubiquitin ligase RNF138 as an important negative regulator of virus-triggered IRF3 activation and IFN-β induction. Overexpression of RNF138 inhibited virus-induced activation of IRF3 and transcription of the IFNB1 gene, whereas knockout of RNF138 promoted virus-induced activation of IRF3, and transcription of the IFNB1 gene. We further found that RNF138 promotes ubiquitination of PTEN and subsequently inhibits PTEN interactions with IRF3, which is essential for PTEN-mediated nuclear translocation of IRF3, thereby inhibiting IRF3 import into the nucleus. Our findings suggest that RNF138 negatively regulates virus-triggered signaling by inhibiting the interaction of PTEN with IRF3, and these data provide new insights into the molecular mechanisms of cellular antiviral responses.

Skin cancer is a disease that reflects most malignant neoplasms worldwide, whose rate of involvement has increased significantly in recent decades. Treatments that offer efficient results with attenuation of adverse reactions and greater patient compliance have been the subject of many systematic investigations. This review aims to qualitatively present published works that showed new strategies to increase the penetration power of natural substances through the skin in the topical treatment against skin cancer. In this sense, nanoengineering mechanisms, the iontophoresis technique, and photodynamic therapy using natural products (NP) contribute to new knowledge about substance carrier strategies in topical treatments against skin cancer.

In the present study a numerical bifurcation analysis of a thermistor problem is carried out, considering a realistic heat dissipation mechanism due to conduction, nonlinear temperature dependent natural convection and radiation. The electric conductivity is modeled as a strongly nonlinear and smooth function of the temperature between two limiting values, based on measurements. The problem formulated in this way admits multiple steady state solutions that do not depend on the external circuit. The analysis reveals that the conduction-convection parameter and the type of the boundary conditions have a profound effect on the solution structure and the temperature profiles. Depending on the boundary conditions the complex multiplicity pattern appears either as a series of nested cusp points or as enclosed branches emanating from pitchfork bifurcation points.

Kratom (Mitragyna speciosa) is a Southeast Asian plant containing various alkaloids which induce pharmacological effects in humans. In Western countries, online vendors sell a variety of different kratom strains which are marketed to have distinct effect profiles. However, as of yet such marketing claims are unsubstantiated, and therefore the current study investigated whether differently colored kratom products can induce unique effects, as self-reported by users. 644 current kratom users were anonymously surveyed to compare the self-reported effects and motivations for using kratom products sold as red, green, and white strains. Most of the survey respondents were customers of the same kratom vendor, the products of which had been assessed for their alkaloid content by an independent laboratory. The survey respondents reported distinct subjective experiences for different kratom strains, in a manner congruent with common marketing descriptions. However, the product analyses revealed no significant cross-strain differences in alkaloid content, suggesting that the reported effect differences might be disproportionally influenced by marketing narratives and anecdotal reports. Future studies should engage a more diverse population and include kratom strains from various vendors. Controlled, blinded experiments could assess whether the reported effect differences stem from a placebo effect or from alternative factors, e.g. minor alkaloids and terpenes.

The daVinci Surgical Robot has revolutionized minimally invasive surgery by enabling greater accuracy and less invasive procedures. However, the system lacks advanced features and autonomy necessary for it to function as a true partner. To enhance its usability, we introduce the implementation of a ChatGPT-based natural language robot interface. Overall, our integration of a ChatGPT-enabled daVinci Surgical Robot has potential to expand the utility of the surgical platform by supplying a more accessible interface. Our system can listen to the operator speak and, through the ChatGPT-enabled interface, translate the sentence and context to execute specific commands to alter the robot’s behavior or to activate certain features. For instance, the surgeon could say (even in Spanish) “please track my left tool” and the system will translate the sentence into a specific track command. This specific error-checked command will then be sent to the hardware which will respond by controlling the camera of the system to continuously adjust to center the left tool in the field of view. We have implemented many commands including “Find my tools” (tools that are not in the field of view) or start/stop recording that can be triggered based on a natural conversational context. Here, we present details of our prototype system, give some accuracy results, and explore its potential implications and limitations. We also discuss how artificial intelligence tools (such as ChatGPT) of the future could be leveraged by robotic surgeons to reduce errors and enhance the efficiency and safety of surgical procedures and even ask for help.

Insulin resistance, as a common pathological process of many metabolic diseases, including diabetes and obesity, has attracted much attention due to its relevant influencing factors. To date, studies have mainly focused on the mechanisms between mitochondrial stress and insulin resistance, and they are now pursued as a very attractive therapeutic target due to their extensive involvement in many human clinical settings. In view of the complex pathogenesis of diabetes, natural drugs have become new players in diabetes prevention and treatment because of their wide targets and few side effects. In particular, plant phenolics have been paid more attention because of their close relationship with oxidative stress. In this review, we briefly review the mechanisms by which mitochondrial stress leads to insulin resistance. Moreover, we list some cytokines and genes that have recently been found to play roles in mitochondrial stress and insulin resistance. Furthermore, we describe several natural drugs that are currently widely used and give a brief overview of their therapeutic mechanisms. Finally, we suggest possible ideas for future research related to the unique role that natural drugs play in the treatment of insulin resistance through the above targets.

Unusual outbreak of Covid 19 has put the whole new challenges around the globe. In a short span of time, the world has been changed, lifestyles, social events, cultural, political events everything has been put on hold as number of countries has enforced partial or complete lockdown that resulted positive in context of controlling spread and contamination of COVID-19. Such activities have also put some effects on environment in both positive and negative way. In this study only positive impacts of COVID-19 on Environment have been highlighted that played role in regeneration of natural systems i.e., reduced air emissions, cleaner air, beaches &water bodies, reduced noise levels, biodiversity rehabilitation etc.

The cosmetics industry is currently looking for innovative ingredients with higher bioactivity and bioavailability for the masses of natural and organic cosmetics. Bioferments are innovative ingredients extracted from natural raw materials by carrying out a fermentation process with appropriate strains of microorganisms. The review was conducted using the SciFinder database with the keywords fermented plant, cosmetics, fermentation. Mainly bioferments are made from plant-based raw materials. The review covers a wide range of fermented raw materials from waste materials (whey with beet pulp) to plant oils (F-Shiunko, F-Artemisia, F-Glycyrrhiza). The spectrum of applications for bioferments is broad and includes properties such as skin whitening, antioxidant properties (blackberry, soybean, goji berry), anti-ageing, anti-aging (red ginseng, black ginseng, Citrus unshiu peel), hydrating and anti-allergic (aloe vera, skimmed milk). Fermentation increases the biochemical and physiological activity of the substrate by converting high-molecular compounds into low-molecular structures, this makes fermented raw materials more compatible compared to unfermented raw materials.

Natural compounds have diverse structures and are present in different forms of life. Metabolites such as tannins, anthocyanins, and alkaloids, among others, serve as a defense mechanism in live organisms and are undoubtedly compounds of interest for the food, cosmetic and pharmaceutical industries. Plants, bacteria, and insects represent a source of biomolecules with diverse activities, poorly studied in many cases. To use these molecules for different applications, it is essential to know their structure, concentrations, and biological activity potential. In vitro techniques that evaluate the biological activity of the molecules of interest have been developed since the 1950s. Currently, different methodologies have emerged to overcome some of the limitations of these traditional techniques, mainly the reduction of time and costs. However, emerging technologies continue to appear due to the urgent need to expand the analysis capacity of a growing number of reported biomolecules and the lack of therapeutic options to treat various diseases. This review presents an updated summary of the conventional and current methods to evaluate natural compounds' biological activity, including a diagram that summarizes the minimum techniques essential for correctly assessing molecules with biological potential.

The recent revival of the study of organic natural products as renewable sources of medicinal drugs, cosmetics, dyes, and materials motivated the creation of general-purpose structural databases. Dereplication, the efficient identification of already reported compounds, relies on the grouping of structural, taxonomic and spectroscopic databases that focus on a particular taxon (species, genus, family, order…). A set of freely available python scripts, CNMRPredict, is proposed for the quick supplementation of taxon-oriented search results from the LOTUS database (lotus.naturalproducts.net) with predicted carbon-13 NMR data from the ACD/Labs (acdlabs.com) CNMR predictor and DB software to provide easily searchable databases. The database construction process is illustrated using Brassica rapa as taxon example.

Acquired Immunodeficiency Syndrome (AIDS) which is chiefly originated by a retrovirus named Human Immunodeficiency Virus (HIV), has influenced about 70 million populations worldwide. Even though several advancements have been invented in the field of antiretroviral combination therapy, still HIV has become the dominant reason for death in South Africa, for example. The current antiretroviral therapies have achieved success in providing instant HIV suppression but with countless undesirable adverse effects. In the present day, the biodiversity of the plant kingdom is being explored by several researchers for the discovery of potent anti-HIV drugs with different mechanisms of action. The primary challenge is to afford a treatment that is free from any sort of risk of drug resistance and serious side effects. Hence, there is a strong demand to evaluate the drugs obtained from natural plants as well as the synthetic derivatives that have been derived from the natural compounds by various chemical reactions. Several plants such as Andrographis paniculata, Dioscorea bulbifera, Aegle marmelos, Wistaria floribunda, Lindera chunii, Xanthoceras sorbifolia and others have displayed significant anti-HIV activity showing more potent anti-HIV activity along with their structures, SARs & important key findings.

In this review, we discuss novel natural products discovered within the last decade that are reported to have antifungal activity against pathogenic species. Nearly a hundred natural products were identified that originate from bacteria, alga, fungi, sponges and plants. Fungi were the most prolific source of antifungal compounds discovered during the period of review. The structural diversity of these antifungal leads encompasses all the major classes of natural products including polyketides, shikimate metabolites, terpenoids, alkaloids and peptides.

A twin prime numbers are two prime numbers which have the difference of 2 exactly. In other words, twin primes is a pair of prime that has a prime gap of two. Sometimes the term twin prime is used for a pair of twin primes; an alternative name for this is prime twin or prime pair. Up to date there is no any valid proof/disproof for twin prime conjecture. Through this research paper, my attempt is to provide a valid disproof for twin prime conjecture.

We examine the extensions of the basic arithmetical operations of addition and multiplication on the natural numbers into higher-rank hyper-operations also on the natural numbers. We go on to define the concepts of prime and composite numbers under these hyper-operations and derive some results about factorisation, resulting in fundamental theorems analogous to the Fundamental Theorem of Arithmetic.

Natural hazards such as earthquakes take place around the world and when combined with humans create natural disasters. Earthquakes, a form of natural hazard, have, in recent years, caused damage and destruction in many rural areas due to the lack of sustainability in political, economic, social, physical and operational criteria. Thus, to overcome the damage caused by earthquakes in rural areas, an assessment of sustainability status seems necessary to plan and strengthen in relation to the status of sustainability indicators. Data collection was performed through field methods and questionnaires. To test the hypothesis, T statistical methods, correlation method and F-test were performed using SPSS software (V22.0, IBM Corporation, Armonk, NY, USA). The results of the study showed that villages were at a low and undesirable level for all aspects, except social index in terms of sustainability. Comparisons showed that there was a significant mean difference among villages in terms of sustainability. The multi-criteria decision-making analysis has been considered and applied to a ranking of villages in terms of sustainability against the hazard of earthquakes. Finally, in order to improve the sustainability indicators of villages, some strategies have been presented.