The deep neural network - BERT model (Bidirectional Encoder Representations from Transformers) and the stocks cumulative abnormal return is used in this article to analyze the sentiment of financial texts. The proposed approach, unlike those used so far, does not require the creation of dictionaries, takes into account the broad context of words and their meaning in financial texts, eliminates the problem of ambiguity of words in various contexts, does not require manual labelling of data and is free from the subjective assessment of the researcher. The sentiment of financial texts in the meaning presented in this paper is directly related to the market reaction to the information contained in these texts. For texts belonging to one of the two classes (positive or negative) with the highest probability the BERT model gives the results of predictions with a precision level of 62.38% for the positive class and 55% for the negative class. The results at this level can be used in event study, market efficiency research, investment strategy development or support of investment analysts using fundamental analysis.

The COVID-19 pandemic measures have negatively impacted education worldwide via travel restrictions, student visas, and physical attendanc,e among many other fac-tors. As one of the first places to impose strict pandemic measures and one of the last places to lift the measures, Mainland China provided a unique venue to investigate the effect of public health pandemic control policies on tertiary education. Considering the large portion of international students in medical schools and the higher susceptibility to the pandemic measures due to the natural synergy with teaching hospitals, medical schools can be an early forefront indicator of the impact of the pandemic on tertiary education. We surveyed 513 participants international medical students from Wen-zhou Medical University’s school of international studies in 2019 and 2022 about their satisfaction and demographic and cultural adaptation parameters. We found that the pandemic restrictions did not generally impact student satisfaction. Further analyzing the associated parameters, we found teaching satisfaction to be independent of age (P=.159), years in China (P=.896) and Chinese Level (P=.577) in the medical university. Teaching satisfaction is associated with the region of origin (P <0.001), acceptance of local social norms (P <0.001), satisfaction with the core values of Chinese culture (P <0.001), acclimatization to life in China (P <0.001), can easily make Chinese friends (P <0.001) among other factors. The findings of this study provide an understanding of the effects of pandemic measures on tertiary education satisfaction and other factors that can aid in international student satisfaction.

Artificial intelligence (AI) driven language models have seen a rapid rise in development, deployment, and adoption over the last few years. This surge has sparked many discussions about their societal and political impact, including political bias. Bias is a crucial topic in the context of large models due to its far-reaching consequences on technology, politics, and society. It significantly influences public perception, decision-making, political discourse, and AI policy governance and ethics. This study investigates political bias through a comparative analysis of four prominent AI models: ChatGPT-4, Perplexity, Google Gemini, and Claude.Through a comprehensive analysis by systematically and categorically evaluating their responses to politically and ideologically charged tests and prompts, utilizing the Pew Research Center’s Political Typology Quiz, the Political Compass assessment, and ISideWith political party quiz, this study identifies significant ideological leanings and the nature of political bias within these models. The findings revealed that ChatGPT-4 and Claude exhibit a liberal bias, Perplexity is more conservative, while Google Gemini adopts more centrist stances. The presence of such biases underscores the critical need for transparency in AI development and the incorporation of diverse training datasets, regular audits, and user education to mitigate these biases. This analysis also advocates for more robust practices and comprehensive frameworks to assess and reduce political bias in AI, ensuring these technologies contribute positively to society and support informed, balanced, and inclusive public discourse, which will point towards neutrality.The results of this study add to the ongoing discourse about the ethical implications and development of AI models, highlighting the critical need to build trust and integrity in AI models. Additionally, future research directions have been outlined to explore and address the complex issue of bias in AI.

In recent years, the implementation of artificial intelligence (AI) in accounting has grown in many domains, including auditing. AI permits auditors to evaluate large data sets and rapidly identify discrepancies and sequences in audit. This means auditors can review all of a client's transactions via a low time and effort. This entails auditing firms investing heavily in technological infrastructure as well as training their human resources to use cutting-edge AI technologies. Thus, this research sought to investigate the impact of the use of AI techniques by Jordanian external auditors in fraud risk assessment, the moderating effect of auditor size. The descriptive analytical method was used by distributing 280 questionnaires electronically to auditors employed in auditing firms operating in Jordan, The result reveals that AI techniques are extremely beneficial in fraud risk assessment at all levels, and the relationship between the use of AI techniques and the assessment of fraud risk has improved as auditor size has increased.

False news refers to false, fake, or misleading information presented as real news. In recent years, there has been a noticeable increase in false news on the Internet. The goal of this paper was to study the automatic detection of such false news using machine learning and natural language processing techniques and to determine which techniques work the most effectively. This article first studies what constitutes false news, and how it differs from other types of misleading information. We also study the results achieved by other researchers on the same topic. After building a foundation to understand false news, and the various ways of automatically detecting it, this article provides its own experiments. These experiments were done on four different datasets, one that was made just for this article, and using 10 different machine learning methods. The results of this article were satisfactory and provided answers to the original research questions set up at the beginning of this article. This article could determine from the experiments that passive-aggressive algorithms, support vector machines, and random forests are the most efficient methods for automatic false news detection. This article also concluded that more complex experiments, such as using multiple levels of identifying false news or detecting computer-generated false news, require more complex machine learning models.

Large language models (LLMs) have shown impressive performance and versatility. However, their billions of parameters and high computational costs hinder the development of personalized and privacy-preserving AI assistants operating locally on user devices. In this work, we explored the potential of pruning LLMs to create lightweight models suitable for user devices, using the moderate-sized Llama-2 7B model as an example. By adopting a simple yet effective pruning method, we found that up to 60% of the weights in the Llama-2 7B model could be pruned without significantly impairing its language modeling capabilities. Furthermore, despite occasional factual inaccuracies, the pruned model at the sparsity limit generated fluent and helpful answers to daily queries, demonstrating its feasibility of on-device AI assistants. These inaccuracies might originate from forgetting or hallucination due to pruning. We proposed a simple protocol to distinguish between the two mechanisms, as well as future directions to improve the pruned models for local AI assistants.

The digital world is increasingly invading our reality, which leads to the formation of a significant reflection of the processes and activities taking place in the smart city. Such activities include well-known urban events, celebrations, and those with a very local character. Due to the mass occurrence, events have a comparable influence on the formation of the spirit and the urban atmosphere. This work presents an enhanced semantic version of the ConvTree algorithm - SemConvTree. It allows considering the semantic component of the data obtained by using semi-supervised learning of topic modeling ensemble (consisting of improved models BERTopic, TSB-ARTM, SBert-Zero-Shot). We also present an improved event search algorithm based on both statistical evaluations and semantic analysis of posts. This algorithm allows fine-tuning the mechanism of discovering the required entities with the specified particularity (such as a particular topic). Experimental studies were conducted within the area of New York City. They showed an improvement in the detection of posts devoted to events (about 40% higher f1-score) due to the accurate handling of events of different scales. These results lead in the long term to talk about the potential perspective in creating a semantic platform for the analysis and monitoring of urban events in the future.

Accurate crop diseases classification is crucial for ensuring food security and enhancing agricultural productivity. However, existing crop disease classification algorithms primarily focus on a single image modality and typically require a large number of samples. Our research counters these issues by using pre-trained Vision-Language Models (VLMs), which enhances multimodal synergy for better crop disease classification than traditional unimodal approaches. Firstly, we apply the multimodal model Qwen-VL to generate meticulous textual descriptions for representative disease images selected through clustering from the training set, which will serve as prompt text for generating classifier weights. Compared to using solely the language model for prompt text generation, this approach better captures and conveys fine-grained and image-specific information, thereby enhancing prompt quality. Secondly, we integrate the cross-attention and the SE (Squeeze-and-Excitation) attention into the training-free mode VLCD (Vision-Language model for Crop Diseases classification) and the training-required mode VLCD-T (VLCD-Training) respectively for prompt text processing, enhancing classifier weights by emphasizing key text features. Experimental outcomes conclusively prove our method’s heightened classification effectiveness in few-shot crop disease scenarios, tackling data limitations and intricate disease recognition issues. It offers a pragmatic tool for agricultural pathology and reinforces the smart farming surveillance infrastructure.

This paper integrates carrier manifolds from control theory and hybrid systems modeling to develop a novel mathematical framework for Artificial General Intelligence (AGI). Carrier manifolds represent the state space of complex AGI systems, while hybrid systems model discrete and continuous dynamics together. The proposed architecture embeds carrier manifold into GPTProX, a hybrid AI solver combining conversational AI, logic programming, and optimization.

Effective communication in English is crucial for marketing professionals in the highly competitive global business landscape. This article emphasizes the importance of English language proficiency and the need for a tailored needs analysis for marketing professionals in the field of Business English. The comprehensive exploration of the needs analysis process outlines its methods and steps, highlighting its relevance in designing targeted language programs. By utilizing surveys, interviews, and observations, trainers and language instructors gain valuable insights into the specific challenges faced by marketing professionals, enabling them to develop customized skill-building approaches. The article also underscores the pedagogical implications of the needs analysis, stressing the significance of a personalized training program that addresses identified language gaps. Recognizing the collaborative nature of the process, the article concludes by discussing the implementation of the training program and the importance of tracking progress, ultimately displaying the tangible benefits of conducting a needs analysis in Business English for marketing professionals in terms of enhancing competitiveness and driving business growth.

Cognitive Warfare (CogWar) is another form of warfare where the goal is to exploit cognition facets to disrupt, undermine, influence or modify human decisions. Famous examples include “Operation Gidlock” meddling with the US 2016 election, and CogWar campaigns assisting the annexation of Crimea. As Large Language Model(LLM)-based applications expand, reaching more users and their cognitive states, stealth Malicious Cognitive Behavioral Tactics (MCBT) can be embedded in trusted application sessions to systematically profile, then alter, each individual’s cognition over time. Successful MCBT can create more cases like Snowden, mass shootings, or January6. This short-form paper discusses a novel MCBT threat model, a novel kill chain, and an on-going prototype for demonstration.

We review the literature on medical discourse and attempt to build a computational model of it. Medical discourse sheds a light on communication structure of patient-doctor and other communication scenarios in healthcare and should be leveraged to facilitate and automate this communication when it is possible and practical. We propose a unified framework to represent communication discourse at the meta-level, where the subject of the communication is expressed in a language object. So far, the broad range of work on medical discourse is detached from computational discourse analysis, and we explore the possibilities of filling this gap and computationally treat the peculiarities of how information is passed between the agents in a hospital setting. We select the domain of question answering (QA) against a corpus of medical documents of diverse nature to evaluate our computational model of medical discourse. It turns out that applying specific structures obtained in medical discourse studies improves the relevance and efficiency of question answering.

This study is to explore the feasibility using neural network (NN) and deep learning to diagnose three common respiratory diseases with only few symptom words. These three diseases are nasopharyngitis, upper respiratory infection, and bronchitis/bronchiolitis. Through natural language processing, the symptom word vectors are encoded by GPT-2 and classified by the last linear layer of the NN. The experimental results are promising, showing that this model achieves a high performance in predicting all these three diseases. They reach 90% in accuracy, which suggests the implications of the developed model, highlighting its potential use in assisting patients understanding their conditions via a remote diagnosis. Unlike previous studies that focus on extracting various categories of information from medical records, this study directly extracts sequential features from unstructured text data, reducing the effort required for data pre-process.

There are few studies of the psychological effects of language brokering (speaking on behalf of) among minors migrated to Europe, even though language brokering is becoming more current in many migrant families. As the psychological implications of language brokering remain controversial, further investigation is needed. Earlier studies have documented that language brokering is sometimes linked with emotional maladjustment and developmental drawbacks, but other studies have shown faster acquisition of social and Language skills. The present study assessed the relation of language brokering with psychological well-being in a sample of Latino migrant adolescents living in Italy; the dependent variables were depression, anxiety, and emotions. Statistically significant differences between boys and girls confirmed the sex-specificity of language brokering and the lack of statistically significant negative association between language brokering and psychological well-being.

In the last decade and a half, the world has experienced the outbreak of a range of viruses such as COVID-19, H1N1, flu, Ebola, Zika Virus, Middle East Respiratory Syndrome (MERS), Measles, and West Nile Virus, just to name a few. During these virus outbreaks, the usage and effectiveness of social media platforms increased significantly as such platforms served as virtual communities, enabling their users to share and exchange information, news, perspectives, opinions, ideas, and comments related to the outbreaks. Analysis of this Big Data of conversations related to virus outbreaks using concepts of Natural Language Processing such as Topic Modeling has attracted the attention of researchers from different disciplines such as Healthcare, Epidemiology, Data Science, Medicine, and Computer Science. The recent outbreak of the MPox virus has resulted in a tremendous increase in the usage of Twitter. Prior works in this field have primarily focused on the sentiment analysis and content analysis of these Tweets, and the few works that have focused on topic modeling have multiple limitations. This paper aims to address this research gap and makes two scientific contributions to this field. First, it presents the results of performing Topic Modeling on 601,432 Tweets about the 2022 Mpox outbreak, which were posted on Twitter between May 7, 2022, and March 3, 2023. The results indicate that the conversations on Twitter related to Mpox during this time range may be broadly categorized into four distinct themes - Views and Perspectives about MPox, Updates on Cases and Investigations about Mpox, MPox and the LGBTQIA+ Community, and MPox and COVID-19. Second, the paper presents the findings from the analysis of these Tweets. The results show that the theme that was most popular on Twitter (in terms of the number of Tweets posted) during this time range was - Views and Perspectives about MPox. It is followed by the theme of MPox and the LGBTQIA+ Community, which is followed by the themes of MPox and COVID-19 and Updates on Cases and Investigations about Mpox, respectively. Finally, a comparison with prior works in this field is also presented to highlight the novelty and significance of this research work.

Appropriate techniques for promoting reading fluency are difficult to implement in the classroom. There is little time to provide students with individualized feedback on reading aloud or to moti-vate them to do so. In this context, VR can be beneficial for learning, to provide individualized feedback and for increasing learners' engagement. Studies analyzing established methods of lan-guage learning in school in VR seem to be lacking so far. Therefore, this study project was the first to analyze the acceptance of students towards the implementation of a concept of reading fluency training with students at a secondary school in VR. The study method was developed based on the Technology Acceptance Model. The VR environment developed is web-based and provides indi-vidual and collaborative opportunities for training reading fluency, giving, and receiving feed-back, and deepening content understanding of the reading texts. To analyze the acceptance of the VR environment, 5 guided interviews were conducted. The results show that despite technical challenges with the VR environment, students accepted and appreciated the reading fluency training in VR. The integration of established concepts of reading fluency training in foreign lan-guage classrooms has great potential as additional added value can be created to address the challenges of face-to-face instruction.

Benchmarks for general language understanding have been rapidly developing in recent years of NLP research, particularly because of their utility in choosing strong-performing models for practical downstream applications. While benchmarks have been proposed in the legal language domain, virtually no such benchmarks exist for privacy policies despite their increasing importance in modern digital life. This could be explained by privacy policies falling under the legal language domain, but we find evidence to the contrary that motivates a separate benchmark for privacy policies. Consequently, we propose PrivacyGLUE as the first comprehensive benchmark of relevant and high-quality privacy tasks for measuring general language understanding in the privacy language domain. Furthermore, we release performances from multiple transformer language models and perform model-pair agreement analysis to detect tasks where models benefited from domain specialization. Our findings show the importance of in-domain pretraining for privacy policies. We believe PrivacyGLUE can accelerate NLP research and improve general language understanding for humans and AI algorithms in the privacy language domain, thus supporting the adoption and acceptance rates of solutions based on it.

Requirements are predominantly written in Natural Language (NL), which makes them accessible to stakeholders with varying degrees of experience, as compared to a model-based language which requires special training. However, despite its benefits, NL can introduce ambiguities and inconsistencies in requirements, which may eventually result in system quality degradation and system failure altogether. The system complexity that characterizes current systems warrants an integrated and comprehensive approach to system design and development. This need has brought about a paradigm shift towards Model-Based Systems Engineering (MBSE) approaches to system design and a departure from traditional document-centric methods. While, MBSE shows great promise, the ambiguities and inconsistencies present in NL requirements hinder their conversion to models directly. The field of Natural Language Processing (NLP) has demonstrated great potential in facilitating the conversion of NL requirements into a semi-machine-readable format that enables their standardization and use in a model-based environment. A first step towards standardizing requirements consists of classifying them according to the ``type'' (design, functional, performance, etc.) they represent. To that end, a language model capable of classifying requirements needs to be fine-tuned on labeled aerospace requirements. This paper presents the development of an annotated aerospace requirements corpus and its use to fine-tune BERT$_\text{BASE-UNCASED}$ to obtain aeroBERT-Classifier: a new language model for classifying aerospace requirements into design, functional, or performance requirements. A comparison between aeroBERT-Classifier and bart-large-mnli (zero-shot text classification) showcased the superior performance of aeroBERT-Classifier on classifying aerospace requirements despite being fine-tuned on a small labeled dataset.

Convolutional neural network (CNN), a class of artificial neural network (ANN) is attracting interests of researchers in all research domain. CNN was invented for computer vision. They have also shown to be useful for semantic parsing, sentence modeling and other natural language processing related tasks. Here in this paper we discuss the basics of CNN models and their scope to provide a reference/baseline to the researchers interested in using CNN models in their research.

The herd effect is a common phenomenon in social society. The detection of this phenomenon is of great significance in many tasks based on social network analysis such as recommendation. However, the research on social network and natural language processing seldom focuses on this issue. In this paper, we propose an unsupervised data mining method to detect herding in social networks. Taking shopping review as an example, our algorithm can identify other reviews which are affected by some previous reviews and detect a herd effect chain. From the overall perspective, the cross effects of all views form the herd effect graph. This algorithm can be widely used in various social network analysis methods through graph structure, which provides new useful features for many tasks.

Nowadays, an analysis of virtual media to predict society’s reaction to any events or processes is a task of great relevance. Especially it concerns meaningful information on healthcare problems. Internet sources contain a large amount of pharmacologically meaningful information useful for pharmacovigilance purposes and repurposing drug use. An analysis of such a scale of information demands developing the methods that require the creation of a corpus with labeled relations among entities. Before, there have been no such Russian language datasets. This paper considers the first Russian language dataset where labeled entity pairs are divided into multiple contexts within a single text (by used drugs, by different users, by the cases of use, etc.), and a method based on the XLM-RoBERTa language model, previously trained on medical texts to evaluate the state-of-the-art accuracy for the task of indication of the four types of relationships among entities: ADR–Drugname, Drugname–Diseasename, Drugname–SourceInfoDrug, Diseasename–Indication. As shown based on the presented dataset from the Russian Drug Review Corpus, the developed method achieves the F1-score of 81.2% (obtained using cross-validation and averaged for the four types of relationships), which is 7.8% higher than the basic classifiers.

We transformed the existing learning program Language Shower, which is used in some Norwegian day-care centers in the Grorud district of Oslo municipality, into a digital solution using an app for smartphone or tablet with the option for further enhancement of presentation by a NAO robot. The solution was tested in several iterations and multiple day-care centers over several weeks. Measurements of the children’s progress across learning sessions indicate a positive impact of the program using a robot as compared to the program without robot. In-situ observations and interviews with day care center staff confirmed the solution’s many advantages, but also revealed some important areas for improvement. In particular, the speech recognition needs to be more flexible and robust, and special measures have to be in place to handle children speaking simultaneously.

Over the years, there has been a significant rise in the world's scientific knowledge. However, most of it lacks structure and is often termed as Dark Data. Both humans and expert systems have continually faced difficulty in analyzing and comprehending such overwhelming amounts of information which is crucial in solving several real-world problems. Information and data visualization techniques proffer a promising solution to explore such data by allowing quick comprehension of information, the discovery of emerging trends, identification of relationships and patterns, etc. In this tutorial, we utilize the rich corpus of PubMed comprising of more than 30 million citations from biomedical literature to visually explore and understand the underlying key-insights using various information visualization techniques. With this study, we aim to diminish the limitation of human cognition and perception in handling and examining such large volumes of data by speeding up the process of decision making and pattern recognition and enabling decision-makers to fully understand data insights and make informed decisions.

The effects of cognate synonymy in L2 word learning are explored. Participants learned the names of well-known concrete concepts in a new fictional language following a picture-word association paradigm. Half of the concepts (set A) had two possible translations in the new language (i.e., both words were synonyms): one was a cognate in participants’ L1 and the other one was not. The other half of the concepts (set B) had only one possible translation in the new language, a non-cognate word. After learning the new words, participants’ memory was tested in a picture-word matching task and a translation recognition task. In line with previous findings, our results clearly indicate that cognates are much easier to learn, as we found that the cognate translation was remembered much better than both its non-cognate synonym and the non-cognate from set B. Our results also seem to suggest that non-cognates without cognate synonyms (set B) are better learned than non-cognates with cognate synonyms (set A). This suggests that, at early stages of L2 acquisition, learning a cognate would produce a poorer acquisition of its non-cognate synonym, as compared to a solely learned non-cognate. These results are discussed under the light of different theories and models of bilingual mental lexicon.

Studies in the area of cross-linguistic influence (CLI) have attracted the focus of multi-linguistic learners. However, little research on CLI deals with Asian learners, particularly Chinese-speaker with knowledge of two or more foreign languages. The present study explores CLI in L1 Chinese learners with both English (L2) and Spanish (L3) as foreign languages who are studying in Madrid, a Spanish-speaking community; their studies coincided with data collection. English learners were instructed to speak for analysis purposes, with the following aims: (i) to observe the most frequent category (functional transfer, code-switching, borrowing and coinage) in the CLI instances; (ii) to determine the source language of CLI; (iii) to investigate whether CLI factors, including language distance, L2 status, proficiency and recency of use, intervene in the appearance of CLI instances in the participants. Data was gathered from 16 female Chinese students at Complutense University of Madrid (UCM). These were master students aged 22 to 26, who visited Spain for more than 5 months when they participated in the present study. The instrument used was an English semi-structured interview. Results primarily reveal that (a) borrowing is the most prevalent category, accounting for 70% of the CLI instances; (b) Spanish is the main source language of CLI while Chinese plays a functional role in the transfer process; (c) language distance proves to be the strongest predictor of CLI.

With the widespread Application of Virtual Reality (VR) in education, optimizing foreign language learning in VR has become a focal point of research. This paper introduces a comprehensive theoretical framework (VR-CCL) based on constructivism and cognitive load theory to enhance foreign language learning in VR. Through a literature review, we explore the applications of VR in education, foreign language learning theories, and prior works on technology-assisted language learning. We further detail the three main components of the VR-CCL framework and validate its effectiveness through two case studies: Duolingo VR and Rosetta Stone VR. Finally, we discuss the strengths and limitations of the framework and its implications for educators and developers.

Colonoscopy is used for colorectal cancer (CRC) screening. Extracting details of the colonoscopy findings from free text in electronic health records (EHRs) can be used to determine patient risk for CRC and colorectal screening strategies. In this study, we developed and evaluated the accuracy of a deep learning model framework to extract information for the clinical decision support system to analyze relevant free-text colonoscopy reports, including indications, pathology, and findings notes. The Bio-Bi-LSTM-CRF framework was developed using Bidirectional Long Short-term Memory (Bi-LSTM) and Conditional Random Fields (CRF) to extract several clinical features from these free-text reports, including indications for the colonoscopy, findings during the colonoscopy, and pathology of the resected material. We then trained the Bio-Bi-LSTM-CRF and existing Bi-LSTM-CRF models on 80% of 4,000 manually annotated notes obtained from the colonoscopy reports of 3,867 patients. The clinical notes were from a group of patients aged over 40 years old enrolled in four Veterans Affairs Medical Centers. A total of 10% of the remaining annotated notes were used to train hyperparameter, while the remaining 10% were used to evaluate the accuracy of our model (Bio-Bi-LSTM-CRF) and to compare the results with the outcomes obtained using Bi-LSTM-CRF. The results of our experiments showed that the bidirectional encoder representations by integrating dictionary function vector from Bio-Bi-LSTM-CRF and strategies character sequence embedding approach is an effective way to identify colonoscopy features from EHR-extracted clinical notes. Therefore, the Bio-Bi-LSTM-CRF model is concluded to be capable of creating new opportunities to identify patients at risk for colon cancer and to study their health outcomes.

The accurate diagnosis and effective treatment of mental health disorders such as depression remain challenging owing to the complex underlying causes and varied symptomatology. Traditional information extraction methods struggle to adapt to evolving diagnostic criteria such as the Diagnostic and Statistical Manual of Mental Disorders fifth edition (DSM-5) and to contextualize rich patient data effectively. This study proposes a novel approach for enhancing information extraction from mental health data by integrating medical knowledge graphs and large language models (LLMs). Our method leverages the structured organization of knowledge graphs specifically designed for the rich domain of mental health combined with the powerful predictive capabilities and zero-shot learning abilities of LLMs. This research enhances the quality of knowledge graphs through entity linking and demonstrates superiority over traditional information extraction techniques, making a significant contribution to the field of mental health. It enables a more fine-grained analysis of the data and the development of new applications. Our approach redefines the manner in which mental health data are extracted and utilized. By integrating these insights with existing healthcare applications, the groundwork is laid for the development of real-time patient monitoring systems. The performance evaluation of this knowledge graph highlights its effectiveness and reliability, indicating significant advancements in automating medical data processing and depression management.

Software is increasingly vital, with automated systems regulating critical functions. As development demands grow, manual code review becomes more challenging, often making testing more time-consuming than development. A promising approach to improving defect detection at the source code level is the use of artificial intelligence combined with natural language processing (NLP). Source code analysis, leveraging machine-readable instructions, is an effective method for enhancing defect detection and error prevention. This work explores source code analysis through NLP and machine learning, comparing classical and emerging error detection methods. To optimize classifier performance, metaheuristic optimizers are used, and a modified algorithm is introduced to meet the study’s specific needs. The proposed two-tier framework uses a convolutional neural network (CNN) in the first layer to handle large feature spaces, with AdaBoost and XGBoost classifiers in the second layer to improve error identification. Additional experiments using Term Frequency-Inverse Document Frequency (TF-IDF) encoding in the second layer demonstrate the framework’s versatility. Across five experiments with public datasets, the CNN achieved an accuracy of 0.768799. The second layer, using AdaBoost and XGBoost, further improved these results to 0.772166 and 0.771044, respectively. Applying NLP techniques yielded exceptional accuracies of 0.979781 and 0.983893 from the AdaBoost and XGBoost optimizers.

This study examines the balancing between urban transportation security and supply chain efficiency amid global disruptions like the COVID-19 pandemic, attacks on maritime lanes, and geopolitical conflicts. The authors combine bibliometric network analysis and natural language processing (NLP) to review scholarly literature from 2017 to 2023. This approach identifies and visualizes evolving thematic trends. Findings reveal a shift towards integrating advanced technologies such as blockchain, AI, and IoT to enhance security without compromising efficiency. This study highlights the significance of integrating urban planning principles and sustainable practices to enhance transportation security and supply chain efficiency within urban environments. Actionable insights for policymakers and supply chain managers emphasize the adoption of integrated, technology-driven security solutions to foster resilient and sustainable supply chains. This research contributes to academic discourse by refining the understanding of evolving priorities in transportation security and supply chain management, offering both theoretical and practical implications for secure and efficient global supply chains.

(1) Background: Artificial intelligence (AI) has existed in some form for decades, but recent rapid advances in a subset called machine learning (ML) — and more specifically deep learning (DL), a neural network-based approach — have made headlines for the potential to revolutionize and automate multiple large sectors of society, including scientific research and the healthcare field. Furthermore, large language models (LLMs) — which are built on DL — could lead to a more seamless, natural interaction between humans and computers. (2) Methods: We reviewed numerous publications on this subject from recent years. (3) Results: We found these studies collectively show that AI is positively disrupting both biomedical research and medical practice, such as optical imaging in surgery guidance. (4) Conclusions: However, we recommend caution in over-reliance on AI in the laboratory or the clinic due to anticipated risks and current limitations.

Context: Anomaly detection in a data center is a challenging task, having to consider different services on various resources. Current literature shows the application of artificial intelligence techniques to either log files or monitoring data: the former created by services at run time, while the latter produced by specific sensors directly on the physical or virtual machine. Objectives: We propose a model that exploits information both in log files and monitoring data to identify patterns and detect anomalies over time. Methods: The key idea is to use on one side natural language processing solutions to detect problems at service level, extracting words that represent anomalies. Clustering and topic modeling techniques have been used to identify patterns and group them with respect to topics. On the other side time series anomaly detection technique has been applied to sensors data in order to combine problems found in the log files with problems stored in the monitoring data. Results: We have tested our approach on a real data center equipped with log files and monitoring data that can characterize the behaviour of physical and virtual resources in production. We have observed a correspondence between anomalies in log files and monitoring data, e.g. an increase in memory usage or machine load. The results are extremely promising. Conclusion: Our model requires to integrate site administrators' expertise in order to consider all critical scenario in the data center and understand results properly.

Text recognition is an important area of the pattern recognition field. Natural language processing (NLP) and pattern recognition have been utilized efficiently in script recognition. Much research has been done on handwritten script recognition. However, the research on the Arabic language for handwritten text recognition received little attention compared with other languages. Therefore, it is crucial to develop a new model that can recognize Arabic handwritten text. Most of the existing models used to acknowledge Arabic text are based on traditional machine learning techniques. Therefore, we implemented a new model using deep machine learning techniques by integrating two deep neural networks. The architecture of the Residual Network (ResNet) model is used to extract features from raw images. Then, the Bidirectional Long Short-Term Memory (BiLSTM) and connectionist temporal classification (CTC) are used for sequence modeling. Our system improved the recognition rate of Arabic handwritten text compared to other models of similar type with a character error rate of 13.2% and character error rate of 27.31%. In conclusion, the domain of Arabic handwritten recognition is advancing swiftly with the use of sophisticated deep learning methods.

In modern agriculture, decision-making is deeply intertwined with data, yet essential agricultural knowledge remains encased within dense scientific texts such as journals, manuals, and free-text reports. This necessitates specialized search systems capable of distilling and delivering precise information in response to specific queries from agricultural users. This study introduces AgriQuery, a sophisticated agent designed to field natural language questions from the agricultural sector by exploring vast troves of scientific documents. A comprehensive review and analysis of farmers' information needs have been conducted, leading to the creation of an information retrieval test collection that includes actual queries, a vast array of scientific documents segmented into passages, and a set of ground truth relevance assessments that map these passages to corresponding queries. We explore and benchmark several information retrieval models, highlighting the efficacy of advanced neural ranking models in this context. AgriQuery's proposed deployment architecture features a client interface on the Telegram platform and a backend model on standard hardware. This test collection aims to catalyze further research into matching natural language queries with scientific text answers, with implications extending beyond agriculture.

Interaction with social agents employing natural language have been discussed especially since Weizenbaum (1966) observed the social effects of his chatbot named 'Eliza', which imitated a cli-ent-centered conversation. With Nass and Reeves’ media equation theory and computers as social actors paradigm, a well-tested framework has been introduced to the study of human-computer interaction. In the 1990s, there was a renewed focus on natural language analysis, which has be-come a crucial area of research in machine learning. Recent advancements in data processing and storage capacities have led to the development of AI-generated utterances that closely resemble human utterances. As a result, AI-based systems can now mimic social relationships to a signifi-cant extent. In light of these technological developments, the article explores whether quasi-social relationships should be considered within the field of social psychology and examines the poten-tial advantages and challenges of this approach.

Generating executable code from natural language instructions using Large Language Models (LLMs) presents challenges such as semantic understanding and handling ambiguous input. This study focuses on the SantaCoder model and explores the impact of in-context learning on code generation using the MBPP and HumanEval datasets for evaluation. Our results demonstrate significant improvements in three key metrics (defined in the paper): correctness@k, similarity@k and pass@k. To address the problem of selecting optimal demonstrations to maximize correctness and pass rates, we investigate two methods: latent concept selection and random selection in this paper. These findings highlight the effectiveness of in-context learning and the critical role of demonstration selection in enhancing the accuracy, efficiency, and versatility of the SantaCoder model in code generation.

Background: Real-world data (RWD) related to the health status and care of cancer patients reflect the ongoing medical practice, and their analysis yields essential real-world evidence. Advanced information technologies are vital for their collection, qualification, and reuse in research projects. Methods: UNICANCER, the French federation of comprehensive cancer centres, has innovated a unique research network : Consore. This potent federated tool enables the analysis of data from millions of cancer patients across eleven French hospitals. Results: Currently operational within eleven French cancer centres, Consore employs natural language processing to structure the therapeutic management data of approximately 1.3 million cancer patients. This data originates from their electronic medical records, encompassing about 65 millions of medical records. Thanks to the structured data, which is harmonized within a common data model, and its federated search tool, Consore can create patient cohorts based on patient or tumor characteristics, and treatment modalities. This ability to derive larger cohorts is particularly attractive when studying rare cancers. Conclusions: Consore serves as a tremendous data mining instrument that propels French cancer centres into the big data era. With its federated technical architecture and unique shared data model, Consore facilitates compliance to regulations and acceleration of cancer research projects.

Biosynthetic gene clusters are specific genomic regions in microorganisms, like bacteria and fungi, responsible for producing bioactive compounds. Identifying these clusters is complex due to their diverse nature. This research presents a comprehensive approach to effective BGC identification. The study focuses on five classes of Natural Products: PKS , NRPS, RiPP, Terpenes, and Hybrid PKS-NRPS. Data was gathered from the MiBIG database in GBK format. Protein sequences from each file were extracted, and sequences under the same BGC ID were combined. Physicochemical properties were calculated, and sequence embeddings were generated using NLP techniques like CountVec, TFIDF, and Word2Vec specific to each NP class. An integrated feature matrix was created by merging physicochemical properties and generated embeddings. This matrix was used for training and testing of nine ML models such SVM, RF and many more. The study explored data balancing techniques with and without SMOTE and employed Grid Search for parameter optimization. This led to six datasets and 54 models. The LR model, using TFIDF with SMOTE, emerged as the most effective, achieving an accuracy of 0.96, AUC of 0.9912, and other strong metrics. This method enhances BGC identification for drug development, offering a broader understanding of their applications in medicine and biotechnology.

Generative artificial intelligence (AI), in particular large language models such as ChatGPT have reached public consciousness with a wide-ranging discussion of their capabilities and suitability for various professions. Following the printing press and internet, generative AI language models are the third transformative technological invention with truly cross-sectoral impact on knowledge transmission. While the printing press allowed for the transmission of knowledge that is independent of the physical presence of the knowledge holder with publishers acting as gatekeepers, the internet added levels of democratization allowing anyone to publish, along with global immediacy. The development of social media resulted in an increased fragmentation and tribalization of on-line communities on their ways of knowing, resulting in alternative truths propagated in echo chambers. It is against this background that generative AI language models have entered public consciousness. Using strategic foresight methodology, this paper will examine the polemic proposition that the age of generative AI will emerge as an age of public ignorance.

Social media platforms are increasingly enabling the propagation of content from groups related to drug use, thus posing risks for the wider population and, in particular, individuals who are amenable to drug use and drug addiction. The detection of drug use content on social media platforms is a priority for governments, technology companies, and drug law enforcement organizations. To counter this issue, various techniques have been developed to identify and promptly remove drug use content, while also blocking its creators from network access. In this paper, we introduce a manually annotated Twitter dataset, comprising 156,521 tweets published between 2008 and 2022, specifically compiled for the purpose of drug use detection. The dataset underwent annotation by several group of expert annotators who classified the tweets as either drug use or non-drug use. Exploratory data analysis was conducted to comprehend the dataset's characteristics. Various classification algorithms, including SVM, XGBoost, RF, NB, LSTM, and BERT were employed using the dataset. Among the traditional machine learning models, SVM utilizing term frequency-inverse document frequency features achieved the highest F1-Score (0.9017). However, BERT with textual features concatenated with numerical and categorical features in ensemble method surpassed the performance of traditional models, attaining F1-Score of 0.9112. To facilitate future research and enhance English online drug use classification accuracy, the dataset will be made publicly available.

Modern language models are designed to generate text so realistic that it could easily be mistaken for human-authored content. Additionally, they can engage in conversations with humans in a manner that appears coherent and reasonable. The epitome of this technological advancement is ChatGPT, a model based on OpenAI's Generative Pretrained Transformer (GPT) language model. With its ability to produce high-quality content in mere seconds, ChatGPT surpasses other chatbots in terms of capabilities, drawing significant interest and excitement from both the business community and academic researchers. This study offers a comprehensive review of current research on ChatGPT, delving into its technological foundation, supportive mechanisms, and findings regarding its benefits across various fields and application areas. We evaluate and discuss the strengths and weaknesses of ChatGPT based on this review and suggest potential avenues for future research.

Depressive disorder is a disease that causes a decrease in daily function, and the prevalence of depressive disorder in Korea is the highest among OECD countries. However, due to lack of manpower and negative social awareness, timely treatment is not being performed properly. As a solution to this, AI counseling chatbots are emerging, and it is essential to use labeled datasets to create chatbots. Currently, many countries around the world, including Korea, use the Diagnostic and Statistical Manual of Mental Disorders Fifth Edition, DSM-5, but there are no nine labeled datasets according to the DSM-5 depression disorder diagnosis criteria. This study collects sympathetic datasets, analyzes morphemes using Kind Korean Morpheme Analyzer and augments and builds a word dictionary using Word2Vec. As a result, we have labeled the dataset with nine criteria for diagnosing DSM-5 depressive disorder, which will enhance the performance of the counseling chatbot.

This primer provides an overview of the rapidly evolving field of generative artificial intelligence, specifically focusing on large language models like ChatGPT (OpenAI) and Bard (Google). Large language models have demonstrated unprecedented capabilities in responding to natural language prompts. The aim of this primer is to demystify the underlying theory and architecture of large language models, providing intuitive explanations for a broader audience. Learners seeking to gain insight into the technical underpinnings of large language models must sift through rapidly growing and fragmented literature on the topic. This primer brings all the main concepts into a single digestible document. Topics covered include text tokenization, vocabulary construction, token embedding, context embedding with attention mechanisms, artificial neural networks, and objective functions in model training. The primer also explores state-of-the-art methods in training large language models to generalize on specific applications and to align with human intentions. Finally, an introduction to the concept of prompt engineering highlights the importance of effective human-machine interaction through natural language in harnessing the full potential of artificial intelligence chatbots. This comprehensive yet accessible primer will benefit students and researchers seeking foundational knowledge and a deeper understanding of the inner workings of existing and emerging artificial intelligence models. The author hopes that the primer will encourage further responsible innovation and informed discussions about these increasingly powerful tools.

With the increasing use of cloud-based services for training and deploying machine learning models, data privacy has become a major concern. This is particularly important for natural language processing (NLP) models, which often process sensitive information such as personal communications and confidential documents. In this study, we propose a method for training NLP models on encrypted text data to mitigate data privacy concerns while maintaining similar performance to models trained on non-encrypted data. We demonstrate our method using two different architectures, namely Doc2Vec+XGBoost and Doc2Vec+LSTM, and evaluate the models on the 20 Newsgroups dataset. Our results indicate that both encrypted and non-encrypted models achieve comparable performance, suggesting that our encryption method is effective in preserving data privacy without sacrificing model accuracy. In order to replicate our experiments, we have provided a Colab notebook at the following address: https://t.ly/lR-TP

The abundance of information in academic articles, reports, and studies can make it challenging for researchers to gain insights from the existing literature. To address this issue, there is a growing demand for tools that can help researchers effectively parse and analyze large volumes of data. One such tool is DataDiscoveryLab, a software system that utilizes computer vision algorithms and NLP techniques to parse academic articles into text and figures, creating three separate databases. These databases allow researchers to quickly identify articles that may be relevant to their research questions, gain a deeper understanding of the research presented, and analyze visual data. The integration of article mining and computer vision in the DataDiscoveryLab software system provides researchers with a powerful tool for navigating the vast amount of scientific literature available today. Yet, as we will discuss in the latter papers these databases’ purpose is to create a bridge between researchers’ data and practically unlimited scientific publications. Yet, in this article, we will discuss how we plan to do that, and our efforts on integrating deep learning modes. After all, unlike already existing AI models, DataDiscoveryLab can be their combination and the first Generative AI in academia that can encompass every part of the natural sciences.

Currently the integration of Kazakhstan into the world community requires the training of highly qualified specialists fluently speaking and having a good command of foreign language. The study is devoted to the problem of development of foreign language professional skills of students of non-linguistic specialty. The aim of the research is to identify the efficiency of integrated approach use for shaping foreign language communicative skills of non-linguistic specialty students. The methodological basis of the research was communicative approach to foreign language teaching. In the framework of the research scientific and theoretical literary sources on the problem of the development of foreign language professional skills of non-linguistic specialty students were studied and summarized; the analysis of the empirical material obtained in the questioning and testing of students. To determine the level of formation of foreign language professional competence of international relations specialty students we have developed the following components: linguistic, cognitive, pragmatic. In the course of the experimental study, the authors revealed that the use of problem-based methods such as discussion, project and case technologies, debates in the framework of integrated approach to professional foreign language teaching promote students’ motivation increase and contribute to the improvement of their foreign language professional skills. The results of the study can be used in application of CLIL technology for the formation of foreign language professional competence of non-linguistic specialty students at the university.

On review of neuroscience literature extreme capsule considered as a whiter matter tract. Nevertheless it is not clear that extreme capsule itself is a association fiber pathway or is o bottleneck for passing other association fiber. By a systematic search with investigating anatomical position, dissection, connectivity and cognitive role of extreme capsule it can be argued that extreme capsule probably is a bottleneck for passing uncinated fasciculus (UF) and inferior fronto – occipital fasciculus(IFOF), And its different role of language processing is duo to different tract that passing it.

A novel method for finding linear mappings among word embeddings for several languages, taking as pivot a shared, universal embedding space, is proposed in this paper. Previous approaches learn translation matrices between two specific languages, but this method learn translation matrices between a given language and a shared, universal space. The system was first trained on bilingual, and later on multilingual corpora as well. In the first case two different training data were applied; Dinu’s English-Italian benchmark data, and English-Italian translation pairs extracted from the PanLex database. In the second case only the PanLex database was used. The system performs on English-Italian languages with the best setting significantly better than the baseline system of Mikolov et al. [1], and it provides a comparable performance with the more sophisticated systems of Faruqui and Dyer [2] and Dinu et al. [3]. Exploiting the richness of the PanLex database, the proposed method makes it possible to learn linear mappings among an arbitrary number of languages.

Objective: To evaluate the effects of left intraparietal sulcus (IPS) inhibition by repetitive transcranial magnetic stimulation (rTMS) on grip force modulation (GFM) for both hands during a unimanual task. Methods: GFM induced by manual action-verb listening was evaluated for each hand in a unimanual task, and the motor-evoked potentials (MEP) were recorded for both left and right hemispheres prior to and following the left IPS inhibition. Left IPS inhibition was obtained by rTMS (5 min of 1.0 Hz, 60% of maximal stimulator output) of the international 10–20 system P3 point. Seven healthy right-handed subjects were evaluated. Results: One-way repeated measures ANOVA found that MEP amplitude and duration increased following IPS inhibition in the left hemisphere and did not change in the right hemisphere. Language-induced modulation did not change in the left hemisphere, while it was significantly attenuated in the right hemisphere. Since IPS inhibition increased the left primary motor cortex (M1) excitability, the maintenance of language-induced modulation intensity suggests it was also attenuated. Conclusion: Left IPS inhibition increased left M1 excitability without changing right M1 excitability, while attenuating the language-induced GFM for both the left and right hands.

This article propose a didactic, through games, tool based on information and communication technologies, in order to eliminate possible communication barriers and to promote the inclusion of students with hearing impairment in Physical Education classes. To this end, a dossier of traditional games has been developed. These are structured in turn into objectives, materials, organisation, graphic description and a QR code for each game. These codes are linked to different videos hosted on the YouTube platform, in which the explanation of the games, mentioned above, can be visualised graphically using sign language. The whole creative process is described in the article, as well as possible pedagogical applications of the use of the tools created for this purpose in other educational contexts.

In the dynamic field of mental health care, the nuanced application of Artificial Intelligence (AI) through Natural Language Processing (NLP) and Automatic Speech Recognition (ASR) is a pivotal innovation in patient empowerment and service optimization. This study introduces a distinctive online therapy platform that capitalizes on the synergy of NLP and ASR to offer unprecedented levels of interactive and personalized therapeutic interventions. The architecture of our system is meticulously detailed, featuring an ASR component with an impressive Word Error Rate (WER) of 14% when trained on the diverse French subsets of the Mozilla Common Voice dataset, complemented by a high-precision NLP framework skilled in processing and responding to user inputs. The evaluation of our system highlights its efficacy in enhancing therapy sessions and user satisfaction, with an emphasis on the qualitative aspects of user feedback. The paper addresses challenges such as dataset representativeness and language model refinement and articulates the strategic solutions employed to overcome them. The paper concludes with forward-looking perspectives on AI's role in mental health services, advocating for the creation of sophisticated, language-specific datasets and models to satisfy the increasing demands of online therapy, reflecting a growing commitment of patients in the management of their therapy. This research underscores the transformative impact of AI in advancing mental health care into the digital age, representing a significant evolution over existing methodologies.

Background: Although electronic health records (EHR) provide useful insights into disease patterns and patient treatment optimisation, their reliance on unstructured data presents a difficulty. Because of their narrative structure, echocardiography reports, which provide extensive pathology information for cardiovascular patients, are particularly challenging to extract and analyse. Although natural language processing (NLP) has been utilised successfully in a variety of medical fields, it is not commonly used in echocardiography analysis. Objectives: To develop an NLP-based approach for extracting and categorizing data from echocardiography reports by accurately converting continuous (e.g. LVOT VTI, AV VTI, and TR Vmax) and discrete (e.g. Regurgitation severity) outcomes in semi-structured narrative format into structured and categorized format, allowing for future research or clinical use. Methods: 135,062 Trans-Thoracic Echocardiogram (TTE) reports were derived from 146967 baseline Echocardiogram reports and split into three cohorts: Training and Validation (n = 1075), Test Dataset (n = 98) and Application Dataset (n = 133,889). The NLP system was developed and iteratively refined using medical expert knowledge. The system was used to curate a moderate-fidelity database from extractions of 133,889 reports. A hold-out validation set of 98 reports was blindly annotated and extracted by two clinicians for comparison with the NLP extraction. Agreement, discrimination, accuracy and calibration of outcome measure extractions were evaluated. Results: Continuous outcomes including LVOT VTI, AV VTI, and TR Vmax exhibited perfect inter-rater reliability using intra-class correlation scores (ICC=1.00, P< 0.05) alongside high R2 values, demonstrating an ideal alignment between the NLP system and clinicians. Good level (ICC =0.75-0.9, P<0.05) of inter-rater reliability were observed for outcomes such as LVOT Diam, Lateral MAPSE, Peak E Velocity, Lateral E' Velocity, PV Vmax, Sinuses of Valsalva, and Ascending Aorta diameters. Furthermore, the accuracy rate for discrete outcome measures was 91.38% in the confusion matrix analysis, indicating effective performance. Conclusions: The NLP-based technique yielded good results when it came to extracting and categorising data from echocardiography reports. The system demonstrated a high degree of agreement and concordance with clinician extractions. This study contributes to the effective use of semi-structured data by providing a useful tool for converting semi-structured text to structured echo report that can be used for data management. Additional validation and implementation in healthcare settings can improve data availability and support research and clinical decision-making.

Hate Speech Detection in Arabic presents a multifaceted challenge due to the broad and diverse linguistic terrain. With its multiple dialects and rich cultural subtleties, Arabic requires particular measures to address hate speech online successfully. To address this issue, academics and developers have used natural language processing (NLP) methods and machine learning algorithms adapted to the complexities of Arabic text. However, many proposed methods were hampered by a lack of a comprehensive dataset/corpus of Arabic hate speech. In this research, we propose a novel multi-class public Arabic dataset comprised of 403,688 annotated tweets categorized as extremely positive, positive, neutral, or negative based on the presence of hate speech. Using our developed dataset, we additionally characterize the performance of multiple machine learning models for Hate speech identification in Arabic Jordanian dialect tweets. Specifically, the Word2Vec, TF-IDF, and AraBert text representation models have been applied to produce word vectors. With the help of these models, we can provide classification models with vectors representing text. After that, seven Machine learning classifiers have been evaluated: Support Vector Machine (SVM), Logistic Regression (LR), Naive Bays (NB), Random Forest (RF), AdaBoost (Ada), XGBoost (XGB), and CatBoost (CatB). In light of this, the experimental evaluation revealed that, in this challenging and unstructured setting, our gathered and annotated datasets were rather efficient and generated encouraging assessment outcomes. This will enable academics to delve further into this crucial field of study.

We live in a complex world characterised by complex people, complex times, and complex social, technological, and ecological environments. There is clear evidence that governments are failing at most public matters. The recent COVID-19 pandemic is a high example of global governance failure both at preventing such pandemics and managing the COVID-19 pandemic. It is time that all of us take responsibility and look into ways of collaboratively improving the governance of public matters, our matters. While there are many reasons for government failures, we believe the lack of information availability is a fundamental reason that limits the government’s ability to act smartly and allows the lack of transparency to creep into policy and action leading to corruption and failure. To this end, this paper introduces the concept of deep journalism, a data-driven deep learning-based approach for discovering multi-perspective parameters related to a topic of interest. We build three datasets (a newspaper, a technology magazine, and a Web of Science dataset) and discover the academic, industrial, public, governance, and political parameters for the transportation sector as a case study to introduce deep journalism and our tool DeepJournal (Version 1.0) that implements our proposed approach. We elaborate on 89 transportation parameters and hundreds of dimensions reviewing 400 technical, academic, and news articles. The findings related to the multi-perspective view of transportation reported in this paper show that there are many important problems seen by the public that industry and academia seem to not place their focus on. On the other hand, academia produces much broader and deeper knowledge on the subject such as a wide range of pollutions affecting the people and planet do not get to reach the public eye. Our deep journalism approach could find the gaps and highlight them to the public and other stakeholders.

The exoskeleton technology has been rapidly advancing in the recent past due to its multitude of applications and diverse use-cases in assisted living, military, healthcare, firefighting, and industry 4.0. The exoskeleton market is projected to increase by multiple times of its current value within the next two years. Therefore, it is crucial to study the degree and trends of user interest, views, opinions, perspectives, attitudes, acceptance, feedback, engagement, buying behavior, and satisfaction, towards exoskeletons, for which the availability of Big Data of conversations about exoskeletons is necessary. The Internet of Everything style of today's living, characterized by people spending more time on the internet than ever before, with a specific focus on social media platforms, holds the potential for the development of such a dataset, by the mining of relevant social media conversations. Twitter, one such social media platform, is highly popular amongst all age groups, where the topics found in the conversation paradigms include emerging technologies such as exoskeletons. To address this research challenge, this work makes two scientific contributions to this field. First, it presents an open-access dataset of about 140,000 tweets about exoskeletons that were posted in a 5-year period from May 21, 2017, to May 21, 2022. Second, based on a comprehensive review of the recent works in the fields of Big Data, Natural Language Processing, Information Retrieval, Data Mining, Pattern Recognition, and Artificial Intelligence that may be applied to relevant Twitter data for advancing research, innovation, and discovery in the field of exoskeleton research, a total of 100 Research Questions are presented for researchers to study, analyze, evaluate, ideate, and investigate based on this dataset.

Artificial intelligence (AI) techniques have grown rapidly in recent years in the context of computing with smart mobile phones that typically allows the devices to function in an intelligent manner. Popular AI techniques include machine learning and deep learning methods, natural language processing, as well as knowledge representation and expert systems, can be used to make the target mobile applications intelligent and more effective. In this paper, we present a comprehensive view on mobile data science and intelligent apps in terms of concepts and AI-based modeling that can be used to design and develop intelligent mobile applications for the betterment of human life in their diverse day-to-day situation. This study also includes the concepts and insights of various AI-powered intelligent apps in several application domains, ranging from personalized recommendation to healthcare services, including COVID-19 pandemic management in recent days. Finally, we highlight several research issues and future directions relevant to our analysis in the area of mobile data science and intelligent apps. Overall, this paper aims to serve as a reference point and guidelines for the mobile application developers as well as the researchers in this domain, particularly from the technical point of view.

Large language models (LLMs) are essential to the field of natural language processing, and as their applications expand, security risks have become increasingly prominent. This paper introduces a novel benchmark for evaluating LLMs security, termed CS-Eval, designed to effectively assess the models' ability to address vulnerabilities. CS-Eval targets seven key security risks: ethical dilemmas, marginal topics, error detection, detailed event handling, cognitive bias, logical reasoning, and privacy identification, and establishes a Multi-Security Hazard Dataset (MSHD). The evaluated models include GPT-4o, Llama-3-70B, Claude-3-Opus, ERNIE-4.0, Abab-6.5, Qwen1.5-110B, Gemini-1.5-Pro, Doubao-Pro, SenseChat-V5, and GLM-4. We analyzed each model's performance in relation to these security risks and provided recommendations for improvement. Experimental results demonstrate varying levels of effectiveness across models, with GPT-4o exhibiting the best overall performance. Moreover, the relationship between security enhancement and model capa-bility is nonlinear, indicating that improving safety requires a multifaceted approach, considering various factors in both development and application.

Artificial intelligence methods, especially artificial neural networks (ANNs), have increasingly been utilized for the mathematical description of physical phenomena in (metallic) material processing. Traditional methods often fall short in explaining the complex, real-world data ob-served in production. While ANN models, typically functioning as "black boxes," improve pro-duction efficiency, a deeper understanding of the phenomena, akin to that provided by explicit mathematical formulas, could enhance this efficiency further. This article proposes a general framework that leverages (CAE) ANNs to explain predicted results alongside their graphical presentation, marking a significant improvement over previous approaches and those relied on expert assessments. Unlike existing Explainable AI (XAI) methods, the proposed framework mimics the standard scientific methodology, utilizing minimal parameters for the mathematical representation of physical phenomena and their derivatives. Additionally, it analyzes the relia-bility and accuracy of the predictions using well-known statistical metrics, transitioning from deterministic to probabilistic descriptions for better handling of real-world phenomena. The proposed approach addresses both aleatory and epistemic uncertainties inherent in the data. The concept is demonstrated through the hot extrusion of aluminum alloy 6082, where CAE ANN models and predicts key parameters, and ChatGPT explains the results, enabling researchers and/or engineers to better understand the phenomena and outcomes obtained by ANNs.

Given the widespread use of AI language models such as ChatGPT, there is an urgent need 1 to understand their political biases in different languages. This study aims to uncover such biases. To 2 investigate this issue, we applied IDRLabs’ Political Coordinates Test to ChatGPT based on GPT-4 3 in four languages - English, French, German, and Italian. The results confirm previous studies that 4 identified a left-libertarian bias in ChatGPT. There was remarkable consistency in political orientation 5 across all four languages, although minor variations were found. Differences in ChatGPT response 6 distributions across languages could indicate culturally determined differences in interpretation 7 of political questions. The results highlight the need to diversify and optimize data collection and 8 model training methods to ensure greater fairness and neutrality and minimize the influence of bias. 9 Our study highlights the importance of cultural differences in the processing and interpretation of 10 political information by AI models.

The deaf-mute and individuals with hearing disabilities who communicate through sign language should not be overlooked or excluded. It is a social responsibility to strive for an inclusive world without inequality. Advances in technology offer various solutions to address the communication gap, one of which is the use of computer-based sign language recognition systems. This project proposes a Malaysian Sign Language recognition model utilizing MobileNetV1, a convolutional neural network-based algorithm, to interpret sign language in real-time settings through a website application using Streamlit. The outcome of the model test shows that it has achieved a recognition rate of 96 percent. Although the proposed model has demonstrated the ability to recognize sign language, it is suggested that further improvement can be achieved by enhancing the quality and diversity of the dataset. The implementation of a more comprehensive dataset would lead to improved performance and increased accuracy of the model. This project underscores the importance of considering and accommodating the needs of the deaf-mute and individuals with hearing disabilities and highlights the potential of technology to bridge communication barriers and achieve a more inclusive society.

The field of program classification, a critical aspect of software engineering, facilitates understanding and categorization of code across various applications, including anomaly detection, and code quality assessment. The advancement of cross-language program classification opens up avenues for efficient code translation among different programming languages, significantly aiding developers in rapid coding and reducing development cycles. Existing research primarily focuses on semantic code analysis, with limited emphasis on cross-linguistic challenges. To address this, we introduce an innovative neural network model, CodeSemanticsNN, which leverages a refined Syntax Structure (SS) approach. This model consists of two integral mechanisms: first, it adopts a novel SS representation that combines sequential and graph-based SS structures, enhancing semantic feature capture. Second, it employs a 'unified vocabulary' strategy to bridge the gap between diverse programming languages, facilitating efficient cross-language classification. Additionally, we have compiled a comprehensive dataset of 20,000 files spanning five programming languages, serving as a benchmark for cross-language classification. Our experiments on this dataset demonstrate that CodeSemanticsNN surpasses existing models in four key metrics: Precision, Recall, F1-score, and Accuracy.

This study leverages transformer-based models and focuses on data representation strategies in the named entity recognition task, including "single" (one sentence per vector), "merged" (multiple sentences per vector), and "context" (sentences joined with attention to context). Performance analysis reveals that models trained with a single strategy may not perform well on different data representations. A combined training procedure is proposed to address this limitation, using all three strategies to enhance the stability and adaptability of the model. The results of this approach are presented and discussed for various datasets for four languages (English, Polish, Czech, and German), demonstrating the effectiveness of the combined strategy.

In the realm of mathematics education, self-explanation stands as a crucial learning mechanism, allowing learners to articulate their comprehension of intricate mathematical concepts and strategies. As digital learning platforms grow in prominence, there are mounting opportunities to collect and utilize mathematical self-explanations. However, these opportunities are met with challenges in automated evaluation. Automatic scoring of mathematical self-explanations is crucial for preprocessing tasks, including the categorization of learner responses, identification of common misconceptions, and the creation of tailored feedback and model solutions. Nevertheless, this task is hindered by the dearth of ample sample sets. Our research introduces a semi-supervised technique using the Language Learning Model (LLM), specifically its Japanese variant, to enrich datasets for the automated scoring of mathematical self-explanations. We rigorously evaluated the quality of self-explanations across five datasets, ranging from human-evaluated originals to ones devoid of original content. Our results show that combining LLM-based explanations with mathematical material significantly improves the model's accuracy. Interestingly, there's an optimal limit to how much synthetic self-explanation data can bene-fit the system. Exceeding this limit doesn't further improve outcomes. This study thus highlights the need for careful consideration when integrating synthetic data into solutions, especially within the mathematics discipline.

This paper proposes the utilization of large language models as recommendations systems for museums. Since the aforementioned models lack the notion of context, they can’t work with temporal information that is often present in recommendations for cultural environments (e.g. special exhibitions or events). In this respect, the current work aims at enhancing the capabilities of large language models through a fine-tuning process that incorporates contextual information and user instructions. The resulting models are expected to be capable of providing personalized recommendations, aligned with user preferences and desires. More specifically, Generative Pre-trained Transformer 4, a knowledge-based large language model is fine-tuned and turned into a context-ware recommendation system, adapting its suggestions based on user input and specific contextual factors such as location, time of visit, and other relevant parameters. The effectiveness of the proposed approach is evaluated through certain user studies, which ensure an improved user experience and engagement within the museum environment.

Dialogue State Tracking is an essential component in multi-domain dialogue systems, aiming to accurately determine the current dialogue state based on the dialogue history. Existing research has addressed the issue of multiple mappings in dialogues by employing slot self-attention as a data-driven approach. However, learning the relationships between slots from a single sample has limitations and introduces noise. In this paper, we propose an External Slot Relation Memory-based Dialogue State Tracking model (ER-DST). By utilizing an external memory storage, we learn the relationships between slots as a dictionary of multi-domain slot relations. Additionally, we employ a small filter to discard slot information irrelevant to the current dialogue state. Experimental results on the MultiWOZ2.0 and MultiWOZ2.1 benchmarks demonstrate significant improvements while reducing the time complexity to O(n).

Background: This study presents a graph-based and purely structural analysis to detect echo chambers on Twitter. Echo chambers are a concern as they can spread misinformation and reinforce harmful stereotypes and biases in social networks. Methods: The study recorded the German-language Twitter stream over two months, recording about 180.000 accounts and their interactions. The study focuses on retweet interaction patterns in the German-speaking Twitter stream and found that the greedy modularity maximization and HITS metric are the most effective methods for identifying echo chambers. Results: The purely structural detection approach was able to identify an echo chamber (red community) that was focused on a few topics with a triad of Anti-Covid, right-wing populism, and pro-Russian positions (very likely reinforced by Kremlin-orchestrated troll accounts). In contrast, a blue community was much more heterogeneous and showed "normal" communication interaction patterns. Conclusions: The study highlights the effects of echo chambers as they can make political discourse dysfunctional and foster polarization in open societies. The presented results contribute to identifying problematic interaction patterns in social networks often involved in the spread of disinformation by problematic actors. It is important to note that not the content but only the interaction patterns would be used as a decision criterion, thus avoiding problematic content censorship.

This paper investigates if Corporate Social Responsibility (CSR) reports published by a selected group of Nordic companies are aligned with the Global Reporting Initiative (GRI) standards. To achieve this goal, several natural language processing, and text mining techniques were implemented and tested. We extracted strings, corpus, and hybrid semantic similarities from the reports and evaluated the models through the intrinsic assessment methodology. A quantitative ranking score based on index matching was developed to complement the semantic valuation. The final results show that Latent Semantic Analysis (LSA) and Global Vectors for Word Representation (GloVE) are the best methods for our study. Our findings will open the door to the automatic evaluation of sustainability reports which could have a strong impact on the environment.

Background: In the present study, we assessed the feasibility and success outcomes of voice prosthesis (VP) changes when performed by speech-language pathologist (SLP). Methods: Patients treated with total laryngectomy (TL) from January 2020 to December 2020 were prospectively recruited from our medical center. Patients benefited from tracheoesophageal puncture. The VP changes were performed by the senior SLP and the following data were collected for each VP change: date of placement; change or removal; VP type and size; reason for change or removal; and use of a washer for periprosthetic leakage. A patient-reported outcome questionnaire including 6 items was proposed to patients at each VP change (Appendix 1). Items were assessed with a 10-point Likert-scale. Results: Fifty-two VP changes were performed by the senior SLP during the study period. The mean duration of the SLP consultation, including patient history, examination and VP change procedure was 20 min (range: 15-30). The median prosthesis lifetime was 88 days. The main reasons for VP changes were transprosthetic (N=34; 79%) and periprosthetic (N=7; 21%) leakages, respectively. SLP successfully performed all VP changes. He did not change one VP but used a periprosthetic silastic to stop the periprosthetic leakages. In two cases, SLP needed the surgeon examination to discuss about the following indication: implant mucosa inclusion and autologous fat injection. The patient satisfaction was high according to the speed and the quality of care by the SLP. Conclusion: The delegation of VP change from the otolaryngologist-head and neck sur-geon to the speech-language pathologist (SLP) may be done without significant complications. The delegation of VP change procedure to SLP may be interesting in some rural regions with otolaryngologist shortage.

The computer network world is changing and the NetDevOps approach has brought the dynamics of applications and systems into the field of communication infrastructure. Businesses are changing and businesses are faced with difficulties related to the diversity of hardware and software that make up those infrastructures. The "Intent-Based Networking - Concepts and Definitions" document describes the different parts of the ecosystem that could be involved in NetDevOps. The recognize, generate intent, translate and refine features need a new way to implement algorithms. This is where artificial intelligence comes in.

Abstract: Understanding social media networks and group interactions are crucial to the ad-vancement of linguistic and cultural behaviour. This includes the manner in which people ac-cessed advice on health, especially during the global lockdown periods. Some people turned to social media to access information on health where most activities were curtailed with isolation rules, especially for older generations. Facebook public pages, groups and verified profiles, using "senior citizen health", "older generations", and "healthy living" keywords were analysed over a 12-month period to analyse the engagement promoting good mental health. CrowdTangle was used to source English language status updates, photo and video sharing information which resulted in an initial 116,321 posts and 6,462,065 interactions Data analysis and visualisation were used to explore large datasets, including natural language processing for “Message” content discovery, word frequency and correlational analysis and co-word clustering. Preliminary results indicate strong links to healthy aging information shared on social media which showed correla-tions to global daily confirmed case and daily death totals. The results can be used to identify public concerns early on and address mental health issues in the senior generation on Facebook.

For any molecule, network, or process of interest, to keep up with new publications on these, is becoming increasingly difficult. For many cellular processes, molecules and their interactions that need to be considered can be very large. Automated mining of publications can support large scale molecular interaction maps and database curation. Text mining and Natural Language Processing (NLP)-based techniques are finding their applications in mining the biological literature, handling problems such as Named Entity Recognition (NER) and Relationship Extraction (RE). Both rule-based and machine learning (ML)-based NLP approaches have been popular in this context, with multiple research and review articles examining the scope of such models in Biological Literature Mining (BLM). In this review article, we explore self-attention based models, a special type of neural network (NN)-based architectures that have recently revitalized the field of NLP, applied to biological texts. We cover self-attention models operating either at a sentence level or an abstract level, in the context of molecular interaction extraction, published from 2019 onwards. We conduct a comparative study of the models in terms of their architecture. Moreover, we also discuss some limitations in the field of BLM that identifies opportunities for the extraction of molecular interactions from biological text.

What does the way autistics bypass, learn, and eventually master language tell us about humans’ genetically encoded linguistic ability? In this theoretical review, we argue that autistic non-social acquisition of language, as well as autistic savant abilities, provide a strong argument for an innate, human-specific orientation toward (and mastery of) complex embedded structures. Autistic non-social language learning may represent a widening of the material processed during development beyond oral language. Structure detection and manipulation and generative production of non-linguistic embedded and chained material (savant abilities in calendar calculation, musical composition and interpretation, three-dimensional drawing) may thus represent an application of such innate mechanisms to non-standard materials. Typical language learning through exposure to the child’s mother tongue may represent but one of many possible achievements of the same capacity. The deviation from typical language development in autism may ultimately allow access to oral language, sometimes in its most elaborate forms, but also explains the possibility of the absence of its development when applied exclusively to non-linguistic structured material. Such an extension of human capacities beyond, or in parallel to, their usual limits call into question what we consider to be specific or expected in humans and, therefore, does not necessarily represent a genetic “error”. Regardless of the adaptive success or failure of non-social language learning, it is up to science and ethical principles to strive to maintain autism as a human potentiality to further foster our vision of a plural society.

What does the way autistics bypass, learn, and eventually master language tell us about human linguistic ability? Here, we argue that non-social acquisition of language, in addition to representing a strong argument for nativist models of human language, may be encompassed within the human-specific orientation and mastery of complex embedded structures, of which language represents one realization. Non-social language learning could thus represent the extension of available linguistic, and non-linguistic material processed by human genetic constraints, allowing language acquisition. This deviation from typical developmental language acquisition may ultimately allow access to language, sometimes in its most elaborate forms, and also explains the possibility of the absence of its development when applied to primarily non-linguistic structured material. However, such enlargement of material-specificity does not cast doubts about its human nature. Regardless of the adaptive success or failure of non-social language learning, it is up to science, legal policies, and ethical principles to strive to maintain autism as a human potentiality to further foster our vision of a plural society.

This article presents a dataset of tweets in the Urdu language. There are 1,140,824 tweets in the dataset, collected from Twitter for September and October 2020. This large-scale corpus of tweets is generated by performing pre-processing which includes removing columns containing user information, retweet’s count, followers information, duplicate tweets, removing unnecessary punctuation, links, symbols, and spaces, and finally extracting emojis if present in the tweet text. In the final dataset each tweet record contains columns for tweet id, text, and emoji extracted from the text with a sentiment score. Emojis are extracted to validate Machine Learning models used for the multilingual sentiment and behavior analysis. These are extracted using a Python script that searches for an emoji from the list of 751 most frequently used emojis. If an emoji is present in the text, a column with the emoji description and sentiment score is added.

Motivated by the #Metoo movement, we explore in this paper people’s perception of female bullying at workplace. We looked at #workplacebullying and found that 1) people were split between identifying the prevalence of workplace bullying against female and the view that such bullying simply does not exist and is a nuisance, 2) The tweets also showed the existence of psychological effects of cyberbullying, and 3) the tweets showed many intervention techniques that can minimize the effects of such bullying. We further explored the top three recurring hashtags mentioned under the #workplacebullying and found that the three top hashtags were #sexism, #feminism and #equality. Our results showed that the above hashtags represent the positive and negative approach to workplace bullying i.e. #feminism hashtag was mostly used by people who denied that workplace bullying against females exist while # sexism was mentioned as the prime cause by people who agree that such bullying exist. #equality overwhelmingly comprises of techniques to minimize workplace bullying against females.

Exploiting the linguistic knowledge of the source language for neural machine translation (NMT) has recently achieved impressive performance on many large-scale language pairs. However, since the Turkish→English machine translation task is low-resource and the source-side Turkish is morphologically-rich, there are limited resources of bilingual corpora and linguistic information available to further improve the NMT performance. Focusing on the above issues, we propose a multi-source NMT approach that models the word feature in parallel to external linguistic features by using two separate encoders to explicitly incorporate linguistic knowledge into the NMT model. We extend the word embedding layer of the knowledge-based encoder to accommodate for each word’s linguistic annotations in the context. Moreover, we share all parameters across encoders to enhance the representation ability of the NMT model on the source language. Experimental results show that our proposed approach achieves substantial improvements of up to 2.4 and 1.1 BLEU scores in Turkish→English and English→Turkish machine translation tasks, respectively, which points to a promising way to utilize the source-side linguistic knowledge for the low-resource NMT.

The violation of privacy, others people or personal, is a very current problem, which concerns not only on the web but also in private life. In the years 1990 it was expected that nowadays, that any routine operation was carried out "manually", and it would be performed through mobile phones or personal computers. The problem pertains the distribution network that allows to share and bring together information and as result the network becomes unsafe, if subjected to attacks. Nowaday we put personal information on web because otherwise we are seen as “weak”. This work aims to measure and analyze how much information are shared by users of a pre-established social network and it is carried out through a set of algorithms techniques of machine learning.

The language we use to describe the past can have a strong influence on the audience’s interpretation of our story. In our experiment, we explore, using 3 different conditions, how the framing and language of an accident report can affect the audience’s proposed solutions to manage the problems found. We find that the approach used to create an accident report can have a powerful influence on the audience’s decision making. Whether we are describing an accident in a similar manner to a crime, using a systems approach or we are accepting of multiple stories which are not linear or coherent, the methods we use to capture and communicate the story have a profound impact on the actions decided upon by the reader.

This paper presents an approach to the application of the Model-Based Systems Engineering (MBSE) and Model-Based Systems Architecting (MBSA) principles to develop a Model-Based Pattern Language (MBPL). It takes too long for systems engineers and architects to develop a new system from scratch, particularly new space-based systems derived from the existing space systems architectures. A pattern language is a holistic view of reusable logical model artifacts; many are interdisciplinary and introductory, if at all. The results are mostly a combination of the application-specific logical solution, which further results in the best possible overall solution. The main benefit of the pattern language is reducing the time and validation required to generate a new space-based system architecture; this approach will develop top-level requirements in the initial phase of the system development. The rationale of the methodology proposed by the paper is as follows, collect, and decompose published literature and other open-source information available on space system architectures and system models; develop SysML models for systems, subsystems, products, assembly, subassembly level, and mission-specific requirements using CAMEO SysML software. Arrange these patterns to develop a functional ontology and construct a logical architecture pattern library. This approach created, updated, and managed SysML pattern language, which evaluated the expedited new model construction. Again, our objective is to develop a logical pattern language using public domain information and evaluate patterns by constructing a new space mission concept—for example, planetary surface habitat.

The work presented in this paper presents several novel findings from a comprehensive analysis of about 50,000 Tweets about online learning during COVID-19, posted on Twitter between November 9, 2021, and July 13, 2022. First, the results of sentiment analysis from VADER, Afinn, and TextBlob show that a higher percentage of these tweets were positive. The results of gender-specific sentiment analysis indicate that for positive tweets, negative tweets, and neutral tweets, between males and females, males posted a higher percentage of the tweets. Second, the results from subjectivity analysis show that the percentage of least opinionated, neutral opinionated, and highly opinionated tweets were 56.568%, 30.898%, and 12.534%, respectively. The gender-specific results for subjectivity analysis indicate that for each subjectivity class, males posted a higher percentage of tweets as compared to females. Third, toxicity detection was performed on the tweets to detect different categories of toxic content - toxicity, obscene, identity attack, insult, threat, and sexually explicit. The gender-specific analysis of the percentage of tweets posted by each gender in each of these categories revealed several novel insights. For instance, for the sexually explicit category, females posted a higher percentage of tweets as compared to males. Fourth, gender-specific tweeting patterns for each of these categories of toxic content were analyzed to understand the trends of the same. The results unraveled multiple paradigms of tweeting behavior, for instance, the intensity of obscene content in tweets about online learning by males and females has decreased since May 2022. Fifth, the average activity of males and females per month was calculated. The findings indicate that the average activity of females has been higher in all months as compared to males other than March 2022. Finally, country-specific tweeting patterns of males and females were also performed which presented multiple novel insights, for instance, in India a higher percentage of the tweets about online learning during COVID-19 were posted by males as compared to females.

To proactively manage information security, enterprises often employ information security risk assessment techniques. Asset value - which is used to calculate the financial impact of possible threats - is one of the key parameters of information security risk. However, assets in a system are rarely independent, and their values are typically interdependent. Asset owners and IT teams may hold different views as regards these values, and there is thus the need to reduce subjectivity in a qualitative risk assessment. The research entails the development of a conceptual framework derived from the literature to minimize subjectivity, and the design of a system based on those concepts. The study uses the Unified Modeling Language as a design tool and puts forward an object-oriented model for defining asset values, in which the relationships between assets, vulnerabilities and related threats are identified. A “segregation of duties” approach is integrated into the risk management system to mitigate against subjectivity and better determine asset values. Survey responses from 16 practitioners working in the private and public sectors confirm the validity of the approach, but suggest it may be more workable in larger organisations where resources allow dedicated risk professionals to operate.

When animals evolve sufficient intelligence and dexterity to be able to learn to fabricate utility products (UPs) like tools, the UP's they produce become part of an induced-reproduction system that intrinsically shares many life-like traits with biological organisms, including genome-like fabrication and operation information that is physically-encoded in the animal fabricator’s neural networks. When this set of life- like traits includes a sufficient capacity for system-improving cultural evolution (UP-evolvability), the UPs become ‘para-alive’, i.e., nearly alive, or a form of non-biological UP-paralife that is equivalent to the life- status of biological viruses, plasmids, and transposons. In the companion paper I focus on the evolution of UP-paralife in the context of modern, language-capable humans and its predicted evolution going forward in time (Rice 2022). Here I look backward in time and focus on the origin of UP-paralife and its subsequent coevolution with human intelligence. I begin by determining the pathways leading to the evolution of large brains in the rare lineages of biological life that have sufficient intelligence to learn to fabricate tools –a critical first step in the evolution of UP-paralife. The simplest forms of these learning- based UPs, made by species like chimpanzees and New Caledonian crows, represent only proto-UP- paralife because they lack sufficient UP-evolvability. Expanded UP-evolvability required a combination of three attributes that enabled continuous niche-expansion of the animal fabricator via a new and advanced form of UP-mediated teamwork (TW): i) self-domestication that facilitated TW among low-related individuals, ii) learned volitional words (protolanguage) that represent ephemeral UPs that coordinate TW, and iii) learned fabrication of simple flaked-stone tools with cutting and chopping capabilities (a UP to make other structural UPs) that expanded teammate phenotypes and TW capabilities. This specific triad of attributes is synergistic because each one acts as a TW-enhancer that can gradually erode different components of the three major constraints on TW operation and expansion: too much selfishness, insufficient coordination signals, and insufficient physical traits of teammates. The increase in UP- evolvability was transformative and marked the origin of UP-paralife and the initiation of coevolution between UP-paralife (cultural evolution) and the intelligence of its hominin/human symbiont (genetic evolution) that fostered 2.5 million years of: i) continuous brain size increase and niche-expansion within the genus Homo, and ii) parallel advances in the diversity, complexity and uses of UP-paralife. This coevolution also fostered evolutionary expansion of word-based communication, and eventually language, that acted in a catalyst-like manner to facilitate the evolution of increasingly complex forms of imagination, reasoning, mentalizing, and UP-generating technology. I next focus on the evolution of creativity in the human lineage –in the form of divergent thinking and creative imagination. I conclude that the evolution of this advanced cognitive feature required a preadaptation of sufficient intelligence and is the component of human cognition that was the major causal factor generating the greatly expanded diversity and complexity of UP-paralife currently associated with modern humans. Lastly, I apply my findings to the issue of the prevalence of extraterrestrial intelligent life. I conclude that any exoplanets with detected chemical life will very rarely (e.g., probability ~10-5 for a planet closely matching Earth’s characteristics) have evolved intelligence equalling or exceeding that of humans.

The advent of Large Language Models like Generative Pre-trained Transformer 4 (GPT-4) has introduced a revolutionary approach to bridging the communication gap between complex radiology reports and patient comprehension. This review article explores the pivotal role of GPT-4 in generating patient-friendly summaries of radiology reports, aiming to demystify medical jargon and enhance patient engagement and understanding. Through an examination of the technological underpinnings of GPT-4, this article highlights its capability to accurately interpret and simplify radiological findings into layman's terms. It assesses the impact of such advancements on patient satisfaction, adherence to treatment plans, and overall healthcare outcomes. Furthermore, the review delves into the potential challenges and ethical considerations associated with implementing AI-driven summaries in clinical practice, including accuracy, privacy, and the need for human oversight. By offering insights into the current applications, benefits, and limitations of GPT-4 in radiology, this short review underscores the transformative potential of AI in fostering a more inclusive and patient-centric healthcare communication paradigm.

The integration of sign language recognition systems into digital platforms has the potential to bridge communication gaps between the deaf community and the broader population. This paper introduces an advanced Israeli Sign Language (ISL) recognition system designed to interpret dynamic motion gestures, addressing a critical need for more sophisticated and fluid communication tools. Unlike conventional systems that focus solely on static signs, our approach incorporates both Deep Learning and Computer Vision techniques to analyze and translate dynamic gestures captured in real-time video. We provide a comprehensive account of our preprocessing pipeline, detailing every stage from video collection to the extraction of landmarks using MediaPipe, including the mathematical equations used for preprocessing these landmarks and the final recognition process. The dataset utilized for training our model is unique in its comprehensiveness and is publicly accessible, enhancing the reproducibility and expansion of future research. The deployment of our model on a publicly accessible website allows users to engage with ISL interactively, facilitating both learning and practice. We discuss the development process, the challenges overcome, and the anticipated societal impact of our system in promoting greater inclusivity and understanding.

Visualising textual content could be helpful to professionals as well as amateurs across several fields. However, training a text-to-image generator in the mainstream domain requires large amounts of paired text-image and data, which is too expensive to collect since labeling millions of images and videos can be tiresome. GANs like StackGAN and StyleGAN can be considered as solutions to generate images from text. But the images generated may be of low accuracy and resolution, and the entire processing can be highly time-consuming. Moreover, image generation is a notion that is still being researched. Hence, the process of developing a Video Generation model necessitates substantial research. Despite the need for such a model, modern technology has lagged behind the solutions to this problem. This proposal suggests combining two methods, Text modification for Action Definition (TexAD) and SeQuential Image Generation for Video Synthesis (SQIGen). The proposed solution synthesises a sequence of images from textual information feeds and combines these images to create a video. TexAD uses Natural Language Processing and Deep Learning techniques to process, classify and modify text data. SQIGen is an extension of the VQGAN+CLIP neural network architecture that generates a sequence of images from the modified text data

Interactions between proteins and ions are essential for various biological functions like structural stability, metabolism, and signal transport. Given that more than half of all proteins bind to ions, it becomes crucial to identify ion-binding sites. Accurate identification of protein-ion binding sites helps us to understand proteins’ biological functions and plays a significant role in drug discovery. While several computational approaches have been proposed, this remains a challenging problem due to the small size and high versatility of metals and acid radicals. In this study, we propose IonPred, a sequence-based approach that employs ELECTRA (Efficiently Learning an Encoder that Classifies Token Replacements Accurately) to predict ion binding sites using only raw protein sequences. We successfully fine-tuned our pretrained model to predict the binding sites for nine metal ions (Zn2+, Cu2+, Fe2+, Fe3+, Ca2+, Mg2+, Mn2+, Na+, and K+) and four acid radical ion ligands (CO32−, SO42−, PO43−, NO2−). IonPred surpassed six current state-of-the-art tools by over 44.65% and 28.46% respectively in F1 score and MCC when compared on an independent test dataset. Our method is more computationally efficient than existing tools producing prediction results for a hundred sequences for a specific ion in under ten minutes.

A reduced ability to work with information contained in a text is usually registered in low-achieving students. One important internal factor influencing reading comprehension concerns the child’s executive functioning. The current study investigated whether the domain-specific intervention ExeFun-READ targeting language abilities related to reading comprehension and executive functioning in primary school children would be effective in improving their scholastic performance in their reading domain and executive functioning. ExeFun-READ is designed to address the relations between domain-specific versus thinking-skill-oriented (domain-general) instruction. A child’s active learning is focused on semantic, phonetic, morphological and syntactical comprehension of linguistic material. In total, 151 students attending grade four from seven elementary schools took part in the project. The study concerned a pretest-intervention-posttest experimental design with three conditions: the experimental condition, an active, and a passive control group. To assess the children’s level of EF, the Delis–Kaplan Executive Function System test battery was used; to assess children’s language ability in reading domain, the Cognitive Abilities Test (the verbal battery, Thorndike &amp; Hagan, 1986 [1]), was used. In the current study, the intervention led to improved language abilities related to reading comprehension, but in terms of executive functioning the improvement only extended to switching fluency. Regarding the effects of the ExeFun-READ intervention on children’s reading abilities, specified as language abilities related to reading comprehension, significant improvements were found in vocabulary, completion of sentences, and classification of terms in the group of children that received the ExeFun-READ intervention.

This paper presents four key results in the philosophy of language. Firstly, it distinguishes between partial and consistent assertion of a sentence, and introduces the concept of an equivocal sentence, which is both partially asserted and partially denied. Secondly, it proposes a novel definition of truth, stating that a true sentence is one that is consistently asserted. This definition avoids the Liar paradox, does not restrict classical logic, and applies to declarative sentences in the language used by any particular person. Thirdly, the paper introduces an epistemic model of language, called assertional language, which formalizes the definition of truth. Finally, it provides an argument for the falsity of so-called Liar sentences. The proposed definition of truth can be viewed as a formal account of the correspondence theory. The epistemic model is a powerful concept that allows for combining different languages in a meaningful way. This model is uniquely capable of reflecting on epistemic inconsistencies, such as logical paradoxes, in a consistent manner and without resorting to non-classical solutions.

Open domain question answering (OpenQA) tasks have been recently attracting more and more attention from the natural language processing (NLP) community. In this work, we present the first free-form multiple-choice OpenQA dataset for solving medical problems, MedQA, collected from the professional medical board exams. It covers three languages: English, simplified Chinese, and traditional Chinese, and contains 12,723, 34,251, and 14,123 questions for the three languages, respectively. We implement both rule-based and popular neural methods by sequentially combining a document retriever and a machine comprehension model. Through experiments, we find that even the current best method can only achieve 36.7%, 42.0%, and 70.1% of test accuracy on the English, traditional Chinese, and simplified Chinese questions, respectively. We expect MedQA to present great challenges to existing OpenQA systems and hope that it can serve as a platform to promote much stronger OpenQA models from the NLP community in the future.

Google play store allow the user to download a mobile application (app) and user get inspired by the rating and reviews of the mobile app. A recent study analyzes that user preferences, user opinion for improvement, user sentiment about particular feature and detail with descriptions of experiences are very useful for an application developer. However, many application reviews are very large and difficult to process manually. Star rating is given of the whole application and the developer cannot analyze the single feature. In this research, we have scrapped 282,231 user reviews through different data scraping techniques. We have applied the text classification on these user reviews. We have applied different algorithms and find the precision, accuracy, F1 score and recall. In evaluated results, we have to also find the best algorithm.

The high demand for liquefied natural gas (LNG) requires more LNG carriers (LNGCs) to be in operation. During transportation, there is a high risk due to the required extremely low temperatures and the explosive nature of LNG cargo. Moreover, when there is a lack of experience in operating old LNGCs, there is a serious concern regarding operational accidents. A systematic maintenance strategy, especially for LNG cargo containment systems, is crucial for maintaining safe LNG transportation at sea. The purpose of this study is to develop preventive LNG cargo containment system maintenance models by using LNGC dock specifications from LNGCs of various ages. The dock specifications from a conventional LNGC repairing dock were analyzed using natural language processing techniques in order to develop preventive maintenance models of the LNG cargo containment system. From these results, and by considering the ship’s age, it was found that for young LNGCs the priority for repair should focus on checking routine consumable spare parts by tank inspections, whereas for older LNGCs the focus should be on tank condition maintenance rather than on other facilities. These results are expected to be useful in the development of a maintenance strategy of preventive LNG cargo containment systems in maritime LNG transportation.

As digitalization expands across all sectors, the economic toll of software defects on the U.S. economy reaches up to $2.41 trillion annually. High-profile incidents like the Boeing 787-Max 8 crash have shown the devastating potential of these defects, highlighting the critical importance of software testing within quality assurance frameworks. However, due to its complexity and resource intensity, the exhaustive nature of comprehensive testing often surpasses budget constraints. This research utilizes a machine learning (ML) model to enhance software testing decisions by pinpointing areas most susceptible to defects and optimizing scarce resource allocation. Previous studies have shown promising results using cost-sensitive training to refine ML models, improving predictive accuracy by reducing false negatives through addressing class imbalances in defect prediction datasets. This approach facilitates more targeted and effective testing efforts. Nevertheless, the generalizability of these models across different projects (cross-project) and programming languages (cross-language) remained untested. This study validates the model's applicability across diverse development environments by integrating various datasets from distinct projects into a unified, using a more interpretable ML approach. The results demonstrate that ML can support software testing decisions, enabling teams to identify up to seven times more defective modules with the same testing effort as a benchmark.

Artificial Intelligence (AI) is revolutionizing head and neck cancer (HNC) care by providing innovative tools that enhance diagnostic accuracy and personalize treatment strategies. This review highlights the advancements in AI technologies, including deep learning and natural language processing, and their applications in HNC. The integration of AI with imaging techniques, genomics, and electronic health records is explored, emphasizing its role in early detection, biomarker discovery, and treatment planning. Despite noticeable progress, challenges such as data quality, algorithmic bias, and the need for interdisciplinary collaboration remain. Emerging innovations like explainable AI, AI-powered robotics, and real-time monitoring systems are poised to further advance the field. Addressing these challenges and fostering collaboration among AI experts, clinicians, and researchers is crucial for developing equitable and effective AI applications. The future of AI in HNC holds significant promise, offering potential breakthroughs in diagnostics, personalized therapies, and improved patient outcomes.

Background: Open AI developed ChatGPT, a language model based on the GPT architecture, designed for text-based communication. Trained on diverse internet texts, ChatGPT generates contextually appropriate responses using machine learning. It understands input through analysis and context interpretation, generating coherent and contextually relevant responses. Interaction is possible through messaging platforms. Materials and Methods: In November 2023, we utilized ChatGPT 3.5, the default version at that time, to answer questions from the Italian National Residency Program Admission Tests (SSMs) of 2021, 2022, and 2023. The questions cover clinical, diagnostic, analytical, therapeutic, and epidemiological scenarios, sometimes accompanied by images. The study compared ChatGPT's answers to the official corrections on the Italian Ministry of University and Research (MUR) website. The scoring method used for evaluation was 1 point for correct answers, 0 points for unanswered questions, and -0.25 points for incorrect answers, reflecting the SSM test scoring system. Results: In summary, ChatGPT was tested with a total of 420 questions, 140 for each test. It achieved an overall accuracy of 80.48%, providing correct answers for 338 questions and incorrect answers for 82 questions. When faced with questions containing both text and images, it answered 55% correctly and 45% incorrectly. The model's performance varied over time, with an 82.14% accuracy rate in 2021 and 2022 (115 correct out of 140) and a 77.14% accuracy rate in 2023 (108 correct out of 140). Applying thisscoring method to the SSM test, ChatGPT would have scored 105 points in 2021 and 2022, and 100 points in 2023. Conclusions: ChatGPT has exhibited above-average performance in the last three SSM tests, highlighting its robust capability to interpret clinical scenarios and offer precise diagnostic and therapeutic guidance. Despite this, some limitations persist, notably the software's inability to interpret non-textual information.

This paper presents the findings of an exploratory study on the continuously generating Big Data on Twitter related to the sharing of information, news, views, opinions, ideas, knowledge, feedback, and experiences about the COVID-19 pandemic, with a specific focus on the Omicron variant, which is the globally dominant variant of SARS-CoV-2 at this time. A total of 12028 tweets about the Omicron variant were studied, and the specific characteristics of tweets that were analyzed include - sentiment, language, source, type, and embedded URLs. The findings of this study are manifold. First, from sentiment analysis, it was observed that 50.5% of tweets had the ‘neutral’ emotion. The other emotions - ‘bad’, ‘good’, ‘terrible’, and ‘great’ were found in 15.6%, 14.0%, 12.5%, and 7.5% of the tweets, respectively. Second, the findings of language interpretation showed that 65.9% of the tweets were posted in English. It was followed by Spanish or Castillian, French, Italian, Japanese, and other languages, which were found in 10.5%, 5.1%, 3.3%, 2.5%, and <2% of the tweets, respectively. Third, the findings from source tracking showed that “Twitter for Android” was associated with 35.2% of tweets. It was followed by “Twitter Web App”, “Twitter for iPhone”, “Twitter for iPad”, “TweetDeck”, and all other sources that accounted for 29.2%, 25.8%, 3.8%, 1.6%, and <1% of the tweets, respectively. Fourth, studying the type of tweets revealed that retweets accounted for 60.8% of the tweets, it was followed by original tweets and replies that accounted for 19.8% and 19.4% of the tweets, respectively. Fifth, in terms of embedded URL analysis, the most common domains embedded in the tweets were found to be twitter.com, which was followed by biorxiv.org, nature.com, wapo.st, nzherald.co.nz, recvprofits.com, science.org, and other URLs. Finally, to support similar research and development in this field centered around the analysis of tweets, we have developed an open-access Twitter dataset that comprises tweets about the SARS-CoV-2 omicron variant since the first detected case of this variant on November 24, 2021.

In recent times, using image-based deep learning techniques has been very useful for classifying fruits. However, mango is a particular challenge because its shelf life is directly related to the degree of maturity at the time of harvest, which is determined mainly through the visual assessment of the operators when sorting them, doing it incorrectly, coupled with the blows and compressions exposed during storage and transport, trigger the deterioration in their quality, hence the importance of this operation. In this sense, the purpose of this study focuses on designing a computational model based on Deep Learning that uses a convolutional neural network (CNN) parameterized to select mangoes according to their color tone based on their maturity stage. A dataset was established from 201 labeled images, then a CNN architecture was built, obtaining a model on which 3 criteria were evaluated: the number of convolution and grouping layers, the resolution of the input images and the number of training epochs required. As a result, an input image resolution of 32 x 32 pixels was achieved, the process included a convolution layer followed by pooling that fed another layer that processed the results and ended in an output layer with 2 neurons under the One Hot Encoding representation. The model required 20 epochs to perfect its training, achieving 96.04 % accuracy in mango image selection. This study supports the potential of CNNs in quality analysis through mango color selection, even in uncertainty scenarios.

In 2021, Japan's medical expenses will exceed 45 trillion yen, and the shortage of doctors, especially in remote and mountainous areas, is becoming serious, making it difficult to maintain the medical system. We have conducted a study of 800 health consultation text data. We developed an on-premise health counseling LLM system by constructing a dialogue flow based on 800 health counseling text data. We conducted a Turing test of this system using 200 test data and verified its effectiveness with three medical professionals. The Turing test was a comparison experiment between this system and a conventional LLM system. The health counseling LLM infrastructure focuses on exercise guidance and analyzes gender, height, weight, body fat percentage, and muscle mass. While the accuracy of the conventional LLM system was 87.5%, this system showed a higher accuracy of 93.1%. Although telemedicine has been slow to spread in Japan, the introduction of a health consultation system using Personal Health Record and Large Language Models has the potential to reduce the burden on physicians. In the future, we aim to improve the accuracy of the system by using Japanese language and medical-specific evaluation scales.

This study investigated the influence of Teacher Availability -TAV (Number of Available Teachers, Teacher Punctuality -TP, Teacher Promptness to Class -TPC) on Student Academic Achievement (SAA) in Public Senior Secondary Schools (PSSS) in Southwestern Nigeria. The descriptive survey research design of correlational type was adopted while the multi-stage sampling procedure was used in the study. A simple random sampling technique was used to select three (Oyo, Ogun, and Ekiti) states out of the six in Southwestern Nigeria, as well as one Senatorial District (SD) from each state. The proportionate-to-size sampling technique was used to select 40% of the Local Government Areas (LGAs) in each SD and 50% (101) of the schools in the sampled LGAs. A class of 3,030 PSSS II was used; 202 Mathematics and English Language teachers and 202 Heads of Department (101 each from Science and Arts) were purposively sampled, while 101 school administrators were enumerated. The instruments were TP ( =0.75); TPC ( =0.82); English Language Achievement Test-ELAT (KR-20=7.47) and Mathematics Achievement Test-MAT (KR-20=7.46). Data were analysed using descriptive statistics. Respondents’ ages were 46.5±5.20 years (teachers) and 17.60±1.60 years (students). There were 59.0% male teachers and 57.0% female students. The SAA (ELAT=45.7% and MAT=38.4%) was low. Also, TAV ( =3.36) was high against the threshold of 2.5, and TAV (ß=0.59, t=7.29) significantly contributed to SAA. Teacher availability influenced the student academic achievement in public senior secondary schools in Southwestern Nigeria. Hence, all the education stakeholders should pay attention to this for improved student academic achievement.

This research explores the transformative impact of artificial intelligence (AI) on personalizing marketing campaigns, highlighting how AI technologies are reshaping modern marketing practices. AI tools such as machine learning, natural language processing (NLP), predictive analytics, deep learning, and computer vision are integral to enhancing customer engagement and optimizing marketing strategies. Machine learning algorithms enable precise customer segmentation and personalized recommendations, leading to more targeted and effective marketing messages. NLP facilitates the analysis of customer sentiment and enhances communication through advanced language processing and AI-powered chatbots. Predictive analytics and deep learning provide businesses with the capability to forecast customer behaviors and recognize complex data patterns, further refining marketing efforts. Computer vision technology contributes to personalization through innovations like visual search and augmented reality, creating immersive customer experiences. Despite the numerous benefits, the adoption of AI in marketing presents several challenges. Data privacy and security concerns, integration complexities, and the potential for algorithmic bias are critical issues that need to be addressed. Ethical considerations, including transparency and fairness in data usage, are also paramount to maintaining customer trust and ensuring responsible AI application. The future of AI in marketing promises continued advancements, with trends such as hyper-personalization and enhanced integration with technologies like the Internet of Things and voice search expected to drive further innovation. Overall, AI significantly enhances marketing effectiveness by offering tailored solutions and strategic insights while necessitating a thoughtful approach to ethical and practical challenges.

The aim of this study is to develop a software solution for real-time recognition of sign language words using two arms. This will enable communication between hearing-impaired individuals and those who can hear. Several sign language recognition systems have been developed using different technologies, including cameras, armbands, and gloves. The system developed in this study utilizes surface electromyography (muscle activity) and inertial measurement unit (motion dynamics) data from both arms. Other methods often have drawbacks, such as high costs, low accuracy due to ambient light and obstacles, and complex hardware requirements, which have prevented their practical application. A software has been developed that can run on different operating systems using digital signal processing and machine learning methods specific to the study. For the test, we created a dataset of 80 words based on their frequency of use in daily life and performed a thorough feature extraction process. We tested the recognition performance using various classifiers and parameters and compared the results. The Random Forest algorithm was found to have the highest success rate with 99.875% accuracy, while the Naive Bayes algorithm had the lowest success rate with 87.625% accuracy. Feedback from a test group of 10 people indicated that the system is user-friendly, aesthetically appealing, and practically useful. The new system enables smoother communication for people with hearing disabilities and promises seamless integration into daily life without compromising user comfort or lifestyle quality.