Recommender Systems (RecSys) are crucial in managing information overload and enhancing user satisfaction across various digital platforms, including e-commerce and entertainment. Evolving from traditional models to Deep Neural Networks (DNNs) and, more recently, Large Language Models (LLMs), these systems leverage sophisticated algorithms to analyze user behaviors and preferences. LLMs, such as GPT-4, are trained on extensive datasets to comprehend and generate natural language, significantly advancing their ability to deliver personalized recommendations. This tutorial explores the transformative impact of LLMs on RecSys, discussing their development, application in handling complex datasets, and the integration of contextual insights. Real-world examples illustrate how LLMs enhance recommendation accuracy and user experience, highlighting challenges and future directions in the field.

Accurate stock market predictions following earnings reports are crucial for investors. Traditional methods, particularly classical machine learning models, struggle with these predictions because they cannot effectively process and interpret extensive textual data contained in earnings reports and often overlook nuances that influence market movements. This paper introduces an advanced approach by employing Large Language Models (LLMs) instruction fine-tuned with a novel combination of instruction-based techniques and quantized low-rank adaptation (QLoRA) compression. Our methodology integrates ‘base factors’, such as financial metric growth and earnings transcripts, with ‘external factors’, including recent market indices performances and analyst grades, to create a rich, supervised dataset. This comprehensive dataset enables our models to achieve superior predictive performance in terms of accuracy, weighted F1, and Matthews correlation coefficient (MCC), especially evident in the comparison with benchmarks such as GPT-4. We specifically highlight the efficacy of the llama-3-8b-Instruct-4bit model, which showcases significant improvements over baseline models. The paper also discusses the potential of expanding the output capabilities to include a ‘Hold’ option and extending the prediction horizon, aiming to accommodate various investment styles and time frames. This study not only demonstrates the power of integrating cutting-edge AI with fine-tuned financial data but also paves the way for future research in enhancing AI-driven financial analysis tools.

Sign language recognition technology can help people with hearing impairments to communicate with those who are hearing impaired. At present, with the rapid development of society, deep learning technology also provided certain technical support for sign language recognition work. In sign language recognition tasks, the use of traditional convolutional neural networks to extract spatio-temporal features from sign language videos suffers from insufficient feature extraction, resulting in low recognition rates. Nevertheless, video-based sign language datasets are very large and require a lot of computational resources for training and generalisation must be ensured, which poses a challenge for recognition. In this paper, we have presented a video-based sign language recognition method based on resnet and lstm. As the number of network layers increases, the ResNet network can effectively solve the granularity explosion problem and obtain better time series features. We use the Resnet convolutional network as the backbone model. At the initialisation stage, we obtain sign language features using ResNet; then, the learned feature space is used as the input of LSTM network to obtain long sequence features. The experimental results show that the accuracy of the above model is better than the mainstream model, and it can effectively extract the spatio-temporal features in sign language videos and improve the recognition rate of sign language actions.

The rapid development of specific-purpose Large Language Models (LLMs), such as Med-PaLM, MEDITRON-70B, and Med-Gemini, has significantly impacted healthcare, offering unprecedented capabilities in clinical decision support, diagnostics, and personalized health monitoring. This paper reviews the advancements in medicine-specific LLMs, the integration of Retrieval-Augmented Generation (RAG) and prompt engineering, and their applications in improving diagnostic accuracy and educational utility. Despite the potential, these technologies present challenges, including bias, hallucinations, and the need for robust safety protocols. The paper also discusses the regulatory and ethical considerations necessary for integrating these models into mainstream healthcare. By examining current studies and developments, this paper aims to provide a comprehensive overview of the state of LLMs in medicine and highlight the future directions for research and application. The study concludes that while LLMs hold immense potential, their safe and effective integration into clinical practice requires rigorous testing, ongoing evaluation, and continuous collaboration among stakeholders.

Natural language processing (NLP) is being widely used globally for a variety of value-creation tasks ranging from chat-bots and machine translations to sentiment and topic analysis and multilingual large language models (LLMs). However, most of the advances are initially implemented within the English language framework, and it takes time and resources to develop comparable resources in other languages. The advances in machine translations have enabled the rapid and effective conversion of content in global languages into English and vice-versa. This creates potential opportunities to apply English language NLP methods and tools to other languages via machine translations. However, although this idea is powerful, it needs to be validated and processes and best practices need to be developed and kept updated. The present research is an effort to contribute to the development of best practices and an evaluation framework. We present a systematic and repeatable state-of-the-art process to evaluate the viability of applying English language sentiment analysis tools to Italian text by using multiple English language machine translation mechanisms such that it can be easily extended to other languages. hor[RU,RA]{\large Richard Anderson} \address[RU]{\large Rutgers University, USA} \address[RA]{\large rick.anderson@rutgers.edu} \author[RU]{\large Carmela Scala} \author[RU]{\large Jim Samuel} \author[UC]{\large Vivek Kumar} \address[UC]{\large University of Cagliari, Italy} \author[RU]{\large Parth Jain}

The purpose of this systematic review is to provide second language acquisition (SLA) researchers with an overview of research trends in this field in the last ten years (2009-2019). In doing so, three international peer-reviewed journals, Studies in Second Language Acquisition, Language Teaching Research, and The Modern Language Journal, were selected. 150 articles were systematically selected and analyzed. The analysis of data resulted in identifying six descriptive themes. Results showed that some areas of second language acquisition still need further exploration while some areas are of great interest for researchers. Some suggestions for future research as well as implications of the study were discussed in detail.

This study presents a strategic approach to developing applications focused on implementing Large Language Models using the Langchain framework in Python. Three language models are highlighted: GPT-3.5 (turbo mode), LLaMA 2, and Vicuna 7B, each with their distinctive features and capabilities. The methodology used is described in detail, including data extraction from medical reports using zero-shot prompting data extraction techniques, interaction with language models, and structured storage of results. The performance of the models in data extraction is evaluated, presenting metrics such as precision, recall, and F1 score. The results demonstrate high model capability in extracting information, although areas for improvement are identified, particularly in data extraction precision. In conclusion, the efficacy of the models in extracting information from medical histories is not considerably acknowledged, with an emphasis on the importance of improving precision and increasing the volume of trained data for future research in healthcare digitalization.

Teaching and learning a new language is a complex process that requires more than just memorizing vocabulary and grammar rules. Immersing oneself in the target language's culture and history is essential for achieving fluency and accuracy. In recent years, researchers have explored the potential of music as a tool for language learning. This paper discusses the benefits of using music in language learning, including improved listening comprehension, pronunciation and fluency, and cultural understanding. The theoretical framework of sociocultural theory, cognitive load theory, and task-based language learning is presented to support the use of music in language learning. This paper also provides practical recommendations for learners to incorporate music into their language learning routine, as well as resources for finding music in the target language, such as online music platforms and language learning apps. The article concludes by encouraging language learners to incorporate music into their language learning routine and providing resources for finding music in the target language, such as online music platforms and language learning apps. Overall, this paper demonstrates that music can be a powerful and enjoyable tool for enhancing language learning outcomes.

This paper explores how Artificial Intelligence (AI) can help reduce the communication gap and streamline the distribution of resources. It uses an exploratory case study to examine the current state of the communication gap and the potential opportunities AI can bring to close it. The paper will discuss the current state of the communication gap, the current methods of resource distribution, and the potential opportunities AI can bring to reduce the communication gap. It will also explore the potential implications of AI on resource distribution and the communication gap. The paper will review the existing literature on the communication gap, resource distribution, and AI. It will then focus on the opportunities AI can bring to the communication gap. It will analyze the use of machine learning, natural language processing, and other AI-based technologies to reduce the communication gap. It will also examine the potential implications of AI on resource distribution, such as developing more efficient distribution channels, increasing transparency, and reducing costs. Finally, the paper will analyze the impact of AI on the communication gap and resource distribution. It will discuss the potential challenges and benefits of using AI, such as the need for data security, the potential for bias, and the limitations of AI technology. The paper will also explore the potential for AI to improve the distribution of resources and reduce the communication gap. Overall, this paper provides an exploratory case study on the opportunities of how AI can contribute to reducing the communication gap and streamlining the distribution of resources. It discusses the potential implications of AI on the communication gap and resource distribution, and it reviews the potential challenges and benefits of using AI. The paper provides an in-depth analysis of the potential opportunities of using AI to reduce the communication gap and streamline the distribution of resources.

This publication delves into the intricate world of human communication, extending beyond the realm of spoken and written language to explore the profound influence of non-verbal communication. Focusing on body language—comprising gestures, facial expressions, postures, and movements—it reveals the pivotal role it plays in conveying emotions, intentions, and psychological states. The rapidly evolving fields of neuroscience and cognitive science are investigating the neural mechanisms and cognitive processes that underpin the interpretation and utilization of these non-verbal cues. Notably, the amygdala's involvement in processing emotional facial expressions has provided a neurological foundation for our emotional understanding in non-verbal communication. Concurrently, cognitive psychology sheds light on how perception, attention, and memory influence our interpretation of non-verbal cues and communication strategies.In our modern, technologically advancing society characterized by global interconnectivity and cultural diversity, the significance of non-verbal communication, especially in digital and virtual contexts, is paramount. The transformation of non-verbal expression into digital symbols like emoticons and emojis raises questions regarding its ability to maintain authenticity and emotional understanding. This publication endeavors to comprehensively explore the fundamental role of body language and non-verbal communication in contemporary society. By integrating insights from psychology, neuroscience, social sciences, and digital technologies, it aims to elucidate the underlying mechanisms guiding non-verbal communication. Additionally, it delves into the implications of non-verbal communication across diverse domains, including interpersonal communication, the workplace, politics, advertising, and the virtual world.The research presented herein strives to offer a thorough understanding of interpersonal dynamics, relationships, and social behavior, with the goal of promoting the development of more effective, conscious, and ethically guided communication strategies. Ultimately, this analysis aspires to inspire further interdisciplinary research and reflection, addressing emerging challenges and fully leveraging the potential of non-verbal communication in modern society. This, in turn, guides our path towards a communication landscape that is more inclusive, authentic, and empathetic.

Children with hearing loss have been found to have significantly more behavioral and emotional challenges than their typically hearing peers, though these outcomes are variable at the individual level. Working memory deficits have been found to relate to executive functioning and overall emotion regulation, leading to behavior challenges. Language development is essential for development of social relationships and communicating one’s needs - this may lead to distress when children cannot communicate effectively. Based on prior findings in children with hearing loss and their typically hearing peers, working memory and language skills were hypothesized to be related to parent and teacher report of socioemotional functioning. Participants were 35 children with hearing loss (66% female, M = 5.17 years old, SD = ±1.97) whose language, working memory, and socioemotional functioning were evaluated during the course of treatment and educational planning. Bivariate analyses indicated that working memory was related to a number of socioemotional domains (e.g., functional communication, atypicality, withdrawal), as were language scores (e.g., social skills, inattention). The direction of these associations was such that stronger working memory and language skills were related to more regulated socioemotional functioning. A call to action of the current study includes more education with regard to profiles and presentations of children with hearing loss, and an early focus on socioemotional learning to foster the development of regulatory skills.

Retweet prediction is an important task related to different problems such as information spreading analysis, the automatic detection of fake news, social media monitoring, etc. In this study we explore the possibilities of retweet prediction based on heterogeneous data sources. In order to classify the tweet according to the amount of retweets, we combine features extracted from the multilayer network and the text. More specifically, we introduce a multilayer framework that proposes the multilayer network representation of Twitter. This formalism captures different users' actions and complex relationships as well as other key properties of communication on Twitter. We select a set of local network measures from each layer and construct a set of multilayer network features. In addition, we adopt a BERT-based language model, namely Cro-CoV-cseBERT to capture high-level semantics and structure of tweets as a set of text features. Then, we train six machine learning (ML) algorithms: random forest, multilayer perceptron, light gradient boosting machine, category embedding model, neural oblivious decision ensembles and attentive interpretable tabular learning model in the task of retweet prediction. We compare the performance of all six algorithms in three different setups (i) using only text features, (ii) using only multilayer network features and (iii) using both sets of features. We evaluate all setups in terms of standard evaluation measures i.e. precision, recall, F1-score and accuracy. For this task, we first prepare and use an empirical dataset of 199,431 tweets in the Croatian language posted during the period between January 1, 2020 and May 31, 2021. Our results indicate that by integrating multilayer network features with text features the prediction model would perform better than using just one set of features.

This work describes the orthographic content in grammars of European languages in the 17th and the 18th century. Reviewed were 17 grammars for 7 languages in Rationalism, 15 grammars for 11 languages in the Enlightenment, and 12 Latin orthographies. As for orthographic entities in the broader sense (orthography as a way to write down speech), our starting point were orthographic grapheme units which are contrasted to meaning (i.e. orthographic entities in the narrower sense, e.g. punctuation). Contrary to the traditional description which focused on spelling, this work observes the beginnings of orthographic content in grammars and its development into an autonomous language phenomenon and norm. The strong connection between orthography and grammar is described and it is established that, from the diachronic point of view, orthography cannot be integrally reviewed without studying the grammatical teachings.

Purpose. This article examines the use of English medium instruction (EMI) for teaching Japanese as a foreign language (JFL) by non-native speakers with a focus on multilingual classrooms. The study also explores teachers’ positive and negative beliefs about using EMI in classroom settings for JFL instruction.Methods and procedure. Two hundred sixty-one non-native Japanese language teachers worldwide voluntarily participated in the survey, answering the questionnaire (Google Forms and Jotforms) used to gather data. Both qualitative and quantitative methods were employed. The research instrument was piloted before the main study and was found to be effective and adequate to elicit the desired data. The research questions aimed to identify whether there were any relationships between the use of EMI and the multilingual classroom. Findings. The results showed a clear correlation between the extensive use of EMI and the multilingual character of JFL multilingual classrooms. Translanguaging turned out to be a common practice adopted by non-native Japanese teachers regardless of the primary language of instruction. The article concludes that EMI can be a valuable tool for JFL instruction in multilingual classrooms. Based on the investigation of the teachers’ beliefs, the study results showed a changing positive attitude towards English employed in JFL classrooms. Implications for research and practice. The findings can be used further to investigate EMI in JFL instructional practices in multilingual classrooms, to improve the quality of JFL instruction, and to facilitate the integration of multilingual education into foreign language teaching. Future research can explore the effectiveness of EMI in different JFL contexts and investigate the impact of EMI on students’ language learning outcomes.

According to a recent study by OpenAI, Open Research, and the University of Pennsylvania, large language models (LLMs) based on artificial intelligence (AI), such as Generative Pretrained Transformers (GPTs), may have potential implications on the job market, specifically regarding job occupations that demand writing or programming skills. The research points out Interpreters and Translators as one of the main job occupations with greater exposure to AI in the US job market (76.5%). This article, following a mixed-methods survey-based research, provides insights into the Portuguese Language Service Providers (LSPs) awareness and knowledge about AI, specifically regarding neural machine translation (NMT) and large language models (LLM), its actual use and usefulness, as well as their potential influence on work performance and labour market. The results show that most professionals are unable to identify if AI and/or automation technologies support the tools that are most used in the profession. The usefulness of AI is essentially low to moderate and the professionals who are less familiar with it and less knowledgeable also demonstrate lack of trust in it. Two thirds of the sample estimate negative or very negative effects of AI in the profession, expressing as main concerns the devaluation and replacement of experts, the reduction of income, and the reconfiguration of the career of translator to mere post-editors.

The dominance of social media has added to the channels of bullying to perpetrators. Unfortunately, cyberbullying (CB) is the most prevalent phenomenon in today’s cyber world and is a severe threat to the mental and physical health of citizens. This opens the need to develop a robust system to prevent bullying content from online forums, blogs, and social media platforms to manage the impact in our society. Several machine learning (ML) algorithms have been proposed for this purpose. However, their performances are not consistent due to high class imbalance issue and generalisation. In recent years, large language models (LLM) like BERT and RoBERTa have achieved state of the art (SOTA) results in several natural language processing (NLP) tasks. Unfortunately, the LLMs have not been applied extensively. In our paper, we explored the use of these models for cyberbullying (CB) detection. We have prepared a new dataset (D2) from existing studies (Formspring and Twitter). Our experimental results for dataset D1 and D2 showed RoBERTa outperformed other models.

This paper addresses the grammatical challenges associated with the development of clause complexity, focusing on the performance of a group of monolingual Spanish-speaking schoolchildren with Specific Language Impairment/Developmental Language Disorder (SLI/DLD) in a longitudinal corpus of oral narrative samples. The study examines the presence of interclause relations of subordination and equivalence (hypotaxis and parataxis) in language samples of two groups: an experimental group made up of 24 schoolchildren with SLI/DLD and a control group made up of 24 schoolchildren with typical development (TD). The results show that while both groups use parataxis as the most common relation between clauses in all school grades, there is a significant decrease in paratactic relations and a significant increase in hypotactic relations from first to fourth grade of primary education. Although the development patterns are highly similar, the SLI/DLD group shows greater difficulties in mastering more complex (hypotactic) relations in fourth grade compared to the control group, indicating that they are less sophisticated in the use of these types of complex relations. These findings suggest that focused support on the most complex structures is needed towards the fourth grade of primary education, given the demands of the school academic register from 6 and 7 years of age, and the potential problems that the development of clause complexity can cause in school-age children.

Large language model (LLM) is a representation of a major advancement in AI, and has been used in multiple natural language processing tasks. Nevertheless, in different business scenarios, LLM requires fine-tuning by engineers to achieve satisfactory performance, and the cost of achieving target performance and fine-tuning may not match. Based on the Baidu STI dataset, we study the upper bound of the performance that classical information retrieval methods can achieve under a specific business, and compare it with the cost and performance of the participating team based on LLM. This paper gives an insight into the potential of classical computational linguistics algorithms, and which can help decision-makers make reasonable choices for LLM and low-cost methods in business R&D.

Recent research has suggested that working memory training interventions may benefit children with Developmental Language Disorder (DLD). The current study investigated a short and engaging adaptive working memory intervention that targeted executive skills and aimed to improve both language comprehension and working memory abilities in children with DLD. Forty-seven 6- to 10-year-old children with DLD were randomly allocated to an executive working memory training intervention (n=24) or an active control group (n=23). A pre-test/intervention/post-test/9-month-follow-up design was used. Outcome measures included assessments of language (to evaluate far transfer of the training) and working memory (to evaluate near transfer of the training). Hierarchical multiple regression analyses controlling for pre-intervention performance and age found group to be a significant predictor of sentence comprehension and of performance on six untrained working memory measures at post-intervention and 9-month follow-up. Children in the intervention group showed significantly higher language comprehension and working memory scores at both time points than children in the active control group. The intervention programme showed potential to improve working memory and language comprehension in children with DLD and demonstrated several advantages: it involved short sessions over a short period; caused little disruption in the school day; and was enjoyed by children.

Coronavirus, also known as COVID-19, has been declared a pandemic by the World Health Organization (WHO). At the time of conducting this study, it had recorded over 1.6 million cases while more than 105,000 have died due to it, with these figures rising on a daily basis across the globe. The burden of this highly contagious respiratory disease is that it presents itself in both symptomatic and asymptomatic patterns in those already infected, thereby leading to an exponential rise in the number of contractions of the disease and fatalities. It is therefore crucial to expedite the process of early detection and diagnosis of the disease across the world. The case-based reasoning (CBR) model is an effective paradigm that allows for the utilization of cases’ specific knowledge previously experienced, concrete problem situations or specific patient cases for solving new cases. This study therefore aims to leverage the very rich database of cases of COVID-19 to solve new cases. The approach adopted in this study employs the use of an improved CBR model for state-of-the-art reasoning task in classification of suspected cases of Covid19. The CBR model leverages on a novel feature selection and semantic-based mathematical model proposed in this study for case similarity computation. An initial population of the archive was achieved with 68 cases obtained from the Italian Society of Medical and Interventional Radiology (SIRM) repository. Results obtained revealed that the proposed approach in this study successfully classified suspected cases into their categories at an accuracy of 97.10%. The study found that the proposed model can support physicians to easily diagnose suspected cases of Covid19 base on their medical records without subjecting the specimen to laboratory test. As a result, there will be a global minimization of contagion rate occasioned by slow testing and as well reduce false positive rates of diagnosed cases as observed in some parts of the globe.

In the early decades of the 19th century, the deaf population in the eastern US and Canada was distributed across a vast area. After the 1817 founding of the American School for the Deaf (ASD) in Hartford, CT and the subsequent establishment of schools for the deaf in New York City (NYSD), Philadelphia, and many other US states, hundreds of deaf students called these schools home for several years. After leaving school, the early American Deaf community faced a challenge: How would the community maintain its social and linguistic ties across a vast geographical area once community members had dispersed to their hometowns? In this paper we analyze the attendance registries of two large gatherings of deaf individuals in Hartford in the years 1850 and 1854. These were among the largest and earliest known gatherings of deaf adults. The demographic data included in these registries open a window onto the evolving American Deaf community of the mid-19th century. Our analyses of the attendees’ school affiliations, ages, and marital status show that the signing community that had taken root among students at schools in Hartford and New York persisted among the adult graduates of those schools in towns across the northeastern US. We compare the places of residence of ASD and NYSD alumni in 1850 and 1854 to their hometowns when they first enrolled at school. Our comparisons suggest the mid-19th-century signing community had become more urban; it was centered to a greater extent in populous cities such as New York, Boston, and Hartford than had been true when the attendees had enrolled in school. We consider how the geography of deafness in the 19th century might inform our understanding of the sources of regional variation in ASL. We also consider how early cross-regional interactions may have inhibited such regional variation.

The purpose of this paper is to explore the implementation of Retrieval-Augmented Gen- 14 eration (RAG) technology with open-source Large Language Models (LLMs). For this purpose, a 15 web-based application named PaSSER that integrates RAG with three models - Mistral:7b, 16 Llama2:7b: Orca2:7b, is developed. In its development various technologies are used, including 17 Blockchain for managing and storing assessment results of built-in testing modules. PaSSER em- 18 ploys a set of evaluation metrics for LLMs’ performance - METEOR, ROUGE, BLEU, Perplexity, 19 Cosine similarity, Pearson correlation, and F1 score. The specialized knowledge base is in the smart 20 agriculture domain. As an illustration, the paper presents results and analysis of two tests. First one 21 is assessing the performance of LLMs across different hardware configurations, the other is deter- 22 mining the model that delivers most accurate and contextually relevant responses within the RAG. 23 The paper also discusses the integration of blockchain technology with LLMs to manage and store 24 assessment results within a blockchain environment. The tests revealed that Mistral:7b demon- 25 strates the best results across most of the evaluated metrics. The discussion section comments on 26 technical and hardware considerations that affect the performance of LLMs. Future development 27 will focus in leveraging new larger pre-trained open-source LLMs, exploring different finetuning 28 approaches, and further integration with Blockchain and IPFS.

This paper explores the role of open-source large language models in IoT cybersecurity world. The threats of malicious activity on the Internet and the loss of private information are very real and lead to serious consequences. The purpose of this paper is to investigate how open source-large language models can help to defend against the growing threat of cyber-crimes. We conducted our experiments in two directions. The first one is a security assistant that helps with cybersecurity best practices advices. The second one is a how large language model can simulate a vulnerable IoT system. For both types of experiments, the interactive mode of operation of the language model is used. In the context of the cybersecurity research, a major advantage of the locally installed open-sourced large language models is that they do not share sensitive data with a remote system in a cloud. The paper concludes by discussing the potential impact of open-source large language models on cybersecurity research and recommends future research directions.

Among the most popular learning management systems available worldwide is Moodle [1]. This current study examines how learners' attitudes toward English as a foreign language (EFL) and their language proficiency are affected by Moodle's interactive language learning activities. Thirty-three undergraduate students participated in this study. We investigated the effects of engaging language learning exercises that were practiced on Moodle using an experimental re-search design. To find out if the experimental and control groups differed significantly from one another on pre- and post-measures regarding the development of language skills and attitudes toward language classrooms, a number of statistical tests were employed. We conducted data analysis using SPSS software. Results demonstrated that there were differences favoring the ex-perimental group in the language skills developments and attitudes of learners toward the lan-guage classroom. There were no apparent differences in the forming structures, speaking, or listening of the control group's learners. On the other hand, there were notable differences in the overall score, writing and reading skills, and lexical item mastery. Additionally, significant dif-ferences in the language acquisition growth of the experimental and control groups were found using an Independent Samples T-test in the post-test, with the experimental group benefiting.

The proliferation of wearable technology enables the generation of vast amounts of sensor data, offering significant opportunities for advancements in health monitoring, activity recognition, and personalized medicine. However, the complexity and volume of this data present substantial challenges in data modeling and analysis, which have been tamed with approaches spanning time series modeling to deep learning techniques. The latest frontier in this domain is the adoption of Large Language Models (LLMs), such as GPT-4 and Llama, for data analysis, modeling, understanding, and generation of human behavior through the lens of wearable sensor data. This survey explores current trends and challenges in applying LLMs for sensor-based human activity recognition and behavior modeling. We discuss the nature of wearable sensors data, the capabilities and limitations of LLMs to model them and their integration with traditional machine learning techniques. We also identify key challenges, including data quality, computational requirements, interpretability, and privacy concerns. By examining case studies and successful applications, we highlight the potential of LLMs in enhancing the analysis and interpretation of wearable sensors data. Finally, we propose future directions for research, emphasizing the need for improved preprocessing techniques, more efficient and scalable models, and interdisciplinary collaboration. This survey aims to provide a comprehensive overview of the intersection between wearable sensors data and LLMs, offering insights into the current state and future prospects of this emerging field.

This paper explores the integration of multiple intelligences and artificial intelligence (AI) in language learning, focusing on its potential to enhance personalization and engagement. Drawing from existing research and studies conducted in various contexts, including the Philippines, this study aims to contribute to the understanding of the benefits, challenges, and effectiveness of this integration. The paper begins with an introduction that highlights the background and significance of integrating multiple intelligences and AI in language learning, identifying research gaps, objectives, research questions, and the theoretical framework. A literature review provides an overview of multiple intelligences theory by Howard Gardner, the role of AI in language learning, and identifies gaps in the existing literature. The methodology section outlines the research design and approach, participant selection, data collection methods, validity and reliability measures, and ethical considerations. Findings and results are presented through the analysis of qualitative data, exploring emergent themes and patterns. The discussion section critically examines the identified research gaps, discusses the validity and reliability of the study, addresses the scope and limitations, and explores the implications of the findings for theory, practice, and future research. The conclusion summarizes the key findings and contributions of the study, reflects on the achievement of research objectives, offers recommendations for further research, and provides final remarks tying together the main points of the study. This paper contributes to the existing body of knowledge by providing insights into the integration of multiple intelligences and AI in language learning and its impact on personalization, engagement, and language learning outcomes.

This paper proposes an interpretable geometry solution based on the formal language set of text and diagram. Geometry problems are solved by machines, which still poses challenges in natural language processing and computer vision. Significant progress promotes existing methods in the extraction of geometric formal languages. However, the neglect of the graph structure information in the formal language and the lack of further refinement of the extracted language set can lead to the poor effect of the theorem prediction and affect the accuracy in problem solving. In this paper, the formal language graph is constructed by the extracted formal language set and used to theorem prediction by graph convolutional network. So as to better extract the relationship set of diagram elements, an improved diagram parser was proposed. The test results indicate that the improved method has good results in solving the problem with interpretability geometry.

The circular economy (CE) has emerged as a viable alternative for tackling the problems caused by rising consumption, including solid waste (SW). The present study conducted a meta-analysis of research published between 2012 and 2022 on CE and solid waste management (SWM). A bibliometric analysis was used from the Web of Science (WoS) and Scopus databases. By studying the articles, we briefly discussed the connections between them and how one contributes to the evolution of the other. Some findings point to greater collaboration between Italy and Bolivia, followed by China and Malaysia. However, they move away from the traditional axes as the United States and Canada. In addition, it was found that the adoption of reuse and selective collection, in fact, allow the reduction of the volume of discarded materials. In this way, it was possible to conclude that a greater connection between CE and GRS makes it possible to optimize the useful life of landfills through the treatment of organic waste and recycling, to encourage waste picker cooperatives and selective collection programs, and to reduce the financial costs of the system as a whole, making it more durable and sustainable.

In bilingual communities, social interactions take place in both single- and mixed-language con-texts. Some of the information shared in multilingual conversations is often required in conse-quent social encounters, like interlocutors’ personal information. In this study we explored whether the autobiographical information provided in a single-language context is better re-membered than in an equivalent mixed-language situation. More than 400 Basque-Spanish bilin-gual (pre-)teenagers were presented with new persons who introduced themselves by either using only Spanish or only Basque, or by inter-sententially mixing both languages. Different memory measures were collected immediately after the initial exposure to the new pieces of information (immediate recall and recognition) and on the day after (delayed recall and recognition). In none of the time points was the information provided in a mixed-language fashion worse remembered than that provided in a strict one-language context. Interestingly, the variability across partici-pants in their sociodemographic and linguistic variables had a negligible impact on the effects. These results are discussed considering their social and educational implications for bilingual communities.

This research presents the Cross-Cultural Intelligent Language Learning System (CILS), a novel approach integrating Artificial Intelligence (AI) into language education to enhance cross-cultural communication. CILS utilizes advanced AI technologies to provide adaptive, personalized learning experiences that cater to the unique linguistic and cultural backgrounds of each learner. By dynamically adjusting content and methodology, CILS significantly improves linguistic proficiency and cultural understanding, essential for effective global interactions. The implementation of CILS in platforms such as Busuu and HelloTalk has demonstrated marked improvements in engagement and communication skills among learners. Empirical studies validate the system's effectiveness in real-world settings, showing enhanced learner performance and increased intercultural competence. Additionally, the Technology Acceptance Model (TAM) applied confirms that the usability and perceived usefulness of AI-driven systems strongly influence learner acceptance and sustained use. This study not only underscores the potential of AI in transforming language education but also highlights the critical role of cultural sensitivity in designing educational technologies.

In this paper, we introduce Syntax-Enhanced Transformer Model (SET), a groundbreaking approach in the realm of Transformer-based language modeling that seeks to redefine the boundaries of linguistic analysis and comprehension. SET innovatively combine (i) the well-established high-level performance, scalability, and adaptability of traditional Transformers with (ii) a sophisticated analysis of syntactic structures. This synergy is enabled by a novel attention mechanism tailored to parse syntactic nuances and a deterministic process adept at transforming linearized parse trees into meaningful linguistic representations. Our comprehensive experiments reveal that SET significantly advance the field by surpassing existing benchmarks in sentence-level language modeling perplexity. They exhibit exceptional proficiency in tasks that require an acute awareness of syntax, setting new standards for language models in understanding complex linguistic structures. Furthermore, SET demonstrate an enhanced capability to grasp nuanced linguistic patterns that have traditionally been challenging for standard Transformer models. However, our studies also uncover a unique aspect of SET: while they excel in sentence-level tasks, their representation of sentences as singular vectors—owing to the syntactic composition constraints intrinsic to their design—introduces certain limitations in document-level language modeling. This observation points to an intriguing area for future exploration; it suggests the potential need for an alternative or complementary memory mechanism within Transformer models, one that functions independently from, yet in harmony with, syntactic structures. Such a mechanism could be pivotal in enhancing the model's ability to comprehend and process long-form texts effectively. In conclusion, SET mark a significant stride in the journey towards more sophisticated, syntax-aware language models. They offer promising insights into the integration of deep linguistic knowledge with cutting-edge machine learning techniques, potentially opening doors to a new era of natural language understanding and processing.

In this article, we discuss problems that exist in modern SCADA systems and present a Controls-kt (formerly DataForge-controls) software development kit, that allows both to create a control system from scratch and provide integration with existing systems via Magix specification and connector.

English based datasets are commonly available from Kaggle, GitHub, or recently published papers. Although benchmark tests with English datasets are sufficient to show off the performances of new models and methods, still a researcher need to train and validate the models on Korean based datasets to produce a technology or product, suitable for Korean processing. This paper introduces 15 popular Korean based NLP datasets with summarized details such as volume, license, repositories, and other research results inspired by the datasets. Also, I provide high-resolution instructions with sample or statistics of datasets. The main characteristics of datasets are presented on a single table to provide a rapid summarization of datasets for researchers.

The sentiment of a word varies based on its context of usage: the words used around it and the part-of-speech it is used as. This paper proposes a technique to suggest the sentiment of a word by combining its part-of-speech and the semantic similarities of its co-occurrences with both context-specific and pre-trained embeddings to achieve powerful and fast results. A study was conducted across domains and sub-domains to measure variance of sentiment by switching domains and switching context within the same domain. Re-scoring a commonly used polarity lexicon showed that 10% of words changed scores while switching domains and 8% changed scores within domains while switching context. Part of Speech analysis on 65,353 commonly used sentiment lexicons showed that 81% of sentiment bearing (non-neutral) lexicons were of the tags NN (Common Noun), JJ (Adjective) or NNS (Proper Noun).

Background: Over the past decade, the use of digital tools has grown and research evidence suggests that traditional media and new media offer both benefits and health risks for young children. The abilities to understand and use language represent two of the most important competencies developed during the first 3 years of life through the interaction of the child with people, objects, events, and other environmental factors. The main goal of our study is to evaluate the relationship between digital devices use and language abilities in children between 8-36 month, considering also the influence of several variables. Materials and Methods: We conducted a cross-sectional observational study on 260 healthy children (140 males = 54%) aged between 8-36 months (mean=23.5±7.18 months). All the parents completed a self-report questionnaire investigating the use of digital devices by their children, and a standardized questionnaire for the assessment of language skills (MacArthur). Multiple linear regression was used to evaluate the relationship between different variables. Subsequent moderation analysis were performed to verify the influence of other factors. Results: W found a statistically significant negative correlation between the total daily time of exposure to digital devices and the Actions and Gestures Quotient (ß=-0.397) in children between 8-17 months, and between the total daily time of exposure to digital devices and Language Quotient (ß=-0.224) in children between 18-36 months. Sex, level of education/job of parents, modality of use/content of digital device do not significantly affect these relationships. Conclusion: In our study we found that a longer time of exposure to digital devices was related to lower mimic-gestural skills in children from 8-17 months and to lower language skills in children between 18-36 months, regardless of age, sex, socio-economic status, content and modality of use. Further studies are needed to confirm and better understand this relationship, but parents and pediatricians are advised to limit the use of digital devices by children and encourage the social interaction to support the learning of language and communication skills in this age group.

The choice associated with words is a fundamental property of natural languages. It lies at the heart of quantitative linguistics, computational linguistics, and language sciences more generally. Information-theory gives us tools at hand to measure precisely the average amount of choice associated with words—the word entropy. Here we use three parallel corpora—encompassing ca. 450 million words in 1916 texts and 1259 languages—to tackle some of the major conceptual and practical problems of word entropy estimation: dependence on text size, register, style and estimation method, as well as non-independence of words in co-text. We present three main results: 1) a text size of 50K tokens is sufficient for word entropies to stabilize throughout the text, 2) across languages of the world, word entropies display a unimodal distribution that is skewed to the right. This suggests that there is a trade-off between the learnability and expressivity of words across languages of the world. 3) There is a strong linear relationship between unigram entropies and entropy rates, suggesting that they are inherently linked. We discuss the implications of these results for studying the diversity and evolution of languages from an information-theoretic point of view.

Wave and tidal energy, recognized as vital renewable resources, harness the ocean's kinetic and potential power. This study aims to provide an in-depth patent analysis of the technological landscape within these sectors. We applied a dual approach: first, a descriptive analysis was conducted to explore patent publication trends, technology lifecycle stages, patent activity by country, top assignees, and IPC classifications. Our analysis provided a detailed overview of the sector's growth and the key players involved. Second, we utilized topic modeling, specifically BERTopic enhanced with large language models (LLMs), to identify and fine-tune key technolog-ical themes within the patent data. In this study, we identified seven distinct clusters each for wave and tidal energy using this approach. This method led to a novel categorization of the pa-tents, revealing latent themes within the patent data. Although our categorization differs from traditional methods, it provides deeper insights into the thematic focus of the patents, highlight-ing emerging trends and areas of innovation within wave and tidal energy technologies to better exploit and optimize ocean energy conversion infrastructure.

Human language and social cognition are two key disciplines that have traditionally been studied as separate domains. However, emerging research from detailed studies of comparative animal behavior, human social behavior, language acquisition in children, social cognitive neuroscience, and the cognitive neuroscience of language suggest that language and social cognition are two deeply interrelated capacities of the human species. For instance, recent developmental studies on the acquisition of language in infants and young children, draw attention to the important crucial benefits associated with several different aspects of social stimulation for youngsters, including the quantity and quality of linguistic input, dyadic infant/child-to-parent verbal and non-verbal social interactions, and other important social cues integral for facilitating language learning and social bonding. Studies of the adult human brain further suggest a high degree of specialization for sociolinguistic information processing, memory retrieval, and comprehension, suggesting the function of these regions may link language with social cognition and social bonding. In effect, the social brain and social complexity hypotheses may jointly help to explain how neurotypical children and adults learn language, why autistic adults and children exhibit simultaneous deficits in language and social cognition, and why nonhuman primates and other animals with significant computational abilities do not acquire the capacity for language. But perhaps most critically, the following article argues that this and related research will allow scientists to generate a holistic profile and deeper understanding of the healthy adult social brain, while developing more innovative and effective diagnoses, prognoses, and treatments for maladies and deficits also associated with the social brain.

The world health organisation (WHO) revealed approximately 280 million people in the world suffer from depression. Yet, existing studies on early-stage depression detection using machine learning (ML) techniques are limited. Prior studies have applied a single stand-alone algorithm which are unable to deal with data complexities, prone to overfitting and limited in generalisation. To this end, our paper examined the performance of several ML algorithms for early-stage depression detection using two benchmark social media datasets (D1 and D2). More specifically, we incorporated sentiment indicator to improve our model performance. Our experimental results showed that sentence bidirectional encoder representations from transformers (SBERT) numerical vectors fitted into stacking ensemble model achieved comparable F1 scores of 69% in dataset (D1) and 76% in dataset (D2). Our findings suggest that utilising sentiment indicators as additional feature for depression detection yields an improved model performance and thus, we recommend the development of depressive term corpus for future work.

Human language is a prime example of a complex system characterized by multiple scales of description. Understanding its origins and distinctiveness has sparked investigations with very different approaches, ranging from the Universal Grammar to statistical analyses of word usage, all of which highlight, from different angles, the potential existence of universal patterns shared by all languages. Yet, a cohesive perspective remains elusive. In this paper we address this challenge. First, we provide a basic structure of universality, and define recursion as a special case thereof. We cast generative grammars of formal languages, the Universal Grammar and the Greenberg Universals in our basic structure of universality, and compare their mathematical properties. We then define universality for writing systems and show that only those using the rebus principle are universal. Finally, we examine Zipf's law for the statistics of word usage, explain its role as a complexity attractor, and explore its relation to universal writing systems as well as its similarities with universal Turing machines. Overall, we find that there are two main kinds of universality, termed {\it mechanistic} and {\it emergent}, and unveil some connections between them.

In the intricate tapestry of our ever-evolving world, where complexities abound and change unfurls with unyielding speed, the amalgamation of values, critical thinking, and moral reasoning within the realm of language and literature education emerges as an imperious necessity. For it is through this harmonious integration that we fortify the minds of our students, bestowing upon them the indispensable tools to traverse the labyrinthine paths of multifaceted ethical quandaries, while shaping them into steadfast guardians of our shared global community. This article highlights the connection between language, literature, critical thinking, moral reasoning, and values integration in education. Through language and literature, teachers can incorporate values education in their classroom, which can benefit not only individual students but also society as a whole. Theoretical frameworks such as character education, moral education, and values education provide the basis for this approach. The researcher recommends strategies for incorporating values integration in language and literature curricula, including the use of literary texts that promote critical thinking and moral reasoning skills. The limitations of this approach, including the challenges in assessing the effectiveness of values integration and potential resistance from some stakeholders, are also discussed. Ultimately, this article aims to call on educators to take a proactive role in promoting values integration in language and literature education, guided by the principles of Jesus Christ and the belief that education is not only about acquiring knowledge but developing character as well. Moreover, this concept has a significant and lasting impact on students' overall development that highlights the importance of values and moral reasoning needed to live a better life.

Digital recruitment systems have revolutionized the hiring paradigm, imparting exceptional efficiencies and extending the reach for both employers and job seekers. This investigation scrutinizes the efficacy of classical machine learning methodologies alongside advanced large language models (LLMs) in aligning resumes with job categories. Traditional matching techniques, such as Logistic Regression, Decision Trees, Naïve Bayes, and Support Vector Machines, are constrained by the necessity of manual feature extraction, limited feature representation, and performance degradation, particularly as dataset size escalates, rendering them less suitable for large-scale applications. Conversely, LLMs like GPT-4, GPT-3, and LLAMA, adeptly process unstructured textual content, capturing nuanced language and context with greater precision. We evaluate these methodologies utilizing two datasets comprising resumes and job descriptions to ascertain accuracy, efficiency, and scalability. Our results reveal that while conventional models excel with structured data, LLMs significantly enhance the interpretation and matching of intricate textual information. This study highlights the transformative potential of LLMs in recruitment, offering insights into their application and future research avenues.

The increased complexity of modern systems is calling for an integrated and comprehensive approach to system design and development and in particular, a shift towards Model-Based Systems Engineering (MBSE) approaches for system design. The requirements that serve as the foundation for these intricate systems are still primarily expressed in Natural Language (NL), which can contain ambiguities and inconsistencies that hinder their direct translation into models. The colossal developments in the field of Natural Language Processing (NLP) in general and Large Language Models (LLMs) in particular can serve as an enabler for the conversion of NL requirements into semi-machine-readable requirements. This is expected to facilitate their standardization and use in a model-based environment. This paper discusses a two-fold strategy for converting NL requirements into semi-machine-readable requirements using language models. The first approach involves creating a requirements table by extracting information from free-form NL requirements. The second approach is an agile methodology that facilitates the identification of boilerplate templates for different types of requirements based on observed linguistic patterns. For this study, three different LLMs were utilized. Two of these models were fine-tuned versions of Bidirectional Encoder Representations from Transformers (BERT), specifically aeroBERT-NER and aeroBERT-Classifier, which were trained on annotated aerospace corpora. Another LLM, called flair/chunk-english, was utilized to identify sentence chunks present in NL requirements. All three language models were utilized together to achieve the standardization of requirements. To demonstrate the effectiveness of the methodologies, requirements from Parts 23 and 25 of Title 14 Code of Federal Regulations (CFRs) were employed, and a total of two, five, and three boilerplate templates were identified for design, functional, and performance requirements, respectively.

This paper presents our approaches for the SMM4H’24 Shared Task 5 on the binary classification of English tweets reporting children’s medical disorders. Our first approach involves fine-tuning a single RoBERTa-large model, while the second approach entails ensembling the results of three fine-tuned BERTweet-large models. We demonstrate that although both approaches exhibit identical performance on validation data, the BERTweet-large ensemble excels on test data. Our best-performing system achieves an F1-score of 0.938 on test data, outperforming the benchmark classifier by 1.18%.

Converting natural language into machine language that can be recognized by distributed systems is the core challenge of intelligent interactive interfaces and human-machine dialogue systems. The human-machine interface interaction of large distributed SCADA measurement and control system is tedious and the operation and maintenance cost is high, so it is significant to design an intelligent natural language interaction interface for distributed measurement and control system. In this paper, we design the intermediate language format of SCADA system, i.e., Key-value logic form, and then formulate the Text2SCADA framework and propose the TICS algorithm and SDPA algorithm, the former adopts the keyword extraction and cosine similarity optimization algorithm to complete the structured extraction of natural language for basic natural language instructions, and the latter adopts the keyword extraction and cosine similarity optimization algorithm to complete the structured extraction of natural language for relatively The latter one adopts the algorithm of dependent syntactic analysis for the structured representation of natural language instructions with relatively complex natural language instructions. Based on the above algorithms, a lightweight information extraction model based on DGCNN and probabilistic graph ideas is constructed, aiming to enhance the scientific generalization ability of the framework on unknown instruction sets. The experimental results show that the proposed intelligent natural language interface can better solve the human-machine interface interaction problem of distributed SCADA measurement and control system. The average accuracy, recall and F-value of instruction parsing reach 89.27\%, 89.28\% and 89.27\%, respectively. The average response time is 1.593 s. Especially, it provides a more convenient means of interaction for industrial and agricultural information control.

Authors such as Schnoebelen (2012: 12) suggest that in some languages (cf. Navajo) certain dependent clauses are frequently used independently to “mark emotional evaluation and background information”. Evans (2007) uses the term insubordination to refer to this phenomenon. Our study focuses on a particular insubordinate construction introduced by the sequence ni que in Spanish, as in the example [¡Una carta cada día!] Ni que yo fuese Umbral. (CORPES 100), used as an independent clause with a sociopragmatic meaning which is different from that of its subordinate counterpart (cf. No escribiría una carta cada día ni que yo fuese Umbral). Our research questions ask about the potential for ni que to be used as a discourse marker fulfilling an expressive function when it introduces this type of construction, and the derived hypothesis is then oriented to test whether Schnoebelen's (2012) observation about insubordinate constructions applies also to this Spanish construction. In order to test this hypothesis, we performed a functional-discourse analysis of more than 2000 concordances (and their extended contexts) in Mark Davies' Corpus del Español and the Real Academia CORPES XXI. Our findings show that the insubordinate construction differs in function and meaning from its subordinate counterpart, the former fulfilling a stronger emotive function, often combined with other discourse-pragmatic functions, such as evaluation or the organization of discourse.

Communication is indispensable for today's lifestyle, and thanks to technology, millions of people can communicate as quickly as possible. The effect of this breakthrough has transformed organizations to the degree that they generate billions of emails daily to facilitate their operations. There is implicit information behind this vast corpus of human-generated content that can be mined and used for their benefit. This paper tries to address the opportunity that email logs can bring to organizations and propose an approach to discover process models by combining supervised text classification and process mining. This framework consists of two main steps, text classification, and process mining. First, Emails will be classified with supervised machine learning, and to mine, the processes fuzzy Miner is used. To further investigate the application of this framework, we also applied this framework over a real-life dataset from a case study organization.

Music and language are hypothesized to share neural resources, particularly at the level of syntax processing. Recent reports suggest that attention modulates this sharing of neural resources, but the time-course of the effects of attention, and the degree to which attention operates similarly on music and language, are yet unclear. In this EEG study we manipulate the syntactic structure of simultaneously presented musical chord progressions and garden-path sentences in a modified rapid serial visual presentation paradigm, while varying top-down attentional demands to the two modalities. The Early Right Anterior Negativity (ERAN) was observed in response to both attended and unattended musical syntax violations. In contrast, an N400 was only observed in response to attended linguistic syntax violations, and a P3 only in response to attended musical syntax violations. Results show that top-down allocation of attention indeed affects the processing of syntax in both music and language, with different neural resources acting upon the two modalities particularly at later stages of cognitive processing. However, the processing of musical syntax at an earlier stage of the perceptual-cognitive pathway, as indexed by the ERAN, is partially automatic, and is strongly indicative of separate neural resources for music and language.

The recent past has witnessed a growing interest in technologies for creating chatbots. Advances in Large Language Models for natural language processing are underpinning rapid progress in chatbot development, and experts predict revolutionary changes in the labour market as many manual tasks are replaced by virtual assistants in a range of business functions. As the new technology becomes more accessible and advanced, more companies are exploring the possibilities of implementing virtual assistants to automate routine tasks and improve service. This article reports on qualitative inductive research undertaken within a chatbot development team operating in a major international enterprise. The findings identify critical success factors for chatbot projects, and, based on the in-depth case study, a model is put forward to aid the manageability of chatbot implementation. The presented model can serve as an exemplar guide for researchers and practitioners working on the design, development and implementation of virtual assistants. It is flexible and applicable in a wide range of business contexts, linking strategic business goals with execution steps. It is particularly applicable for teams with no experience of chatbot implementation, reducing uncertainty and managing decisions and risks throughout the project lifecycle, thereby increasing the likelihood of project success.

This research aims to explore the integration method of deep learning and large language models in speech recognition to improve the system’s recognition accuracy and ability to handle complex contexts. Deep neural network (DNN), convolutional neural network (CNN), long short-term memory network (LSTM) and Transformer-based large language model are used to build an integrated acoustic and language model framework. Experiments on TIMIT, LibriSpeech and Common Voice datasets show that the ensemble model shows significant improvements in both word error rate (WER) and real-time factor (RTF) compared to traditional models. Especially in terms of adaptability to multiple languages and accent changes, the model shows superior performance. The conclusion shows that through technology integration, the performance of the speech recognition system in complex environments can be effectively improved, providing a new direction for the future development of speech recognition technology.

This paper documents the development of a special case of multilingual Automatic Speech Recognition model, specifically tailored to attend two languages spoken by the majority of Latin America, Portuguese and Spanish. The bilingual model combines Language Identification and Speech Recognition developed with the Wav2Vec2.0 architecture and trained on several open and private speech datasets. In this model, the feature encoder is trained jointly for all tasks and different context encoders are trained for each task. The model is evaluated separately on two tasks: language identification and speech recognition. The results indicate that this model achieves good performance on speech recognition and average performance on language identification, training on a low quantity of speech material. The average accuracy of the language identification module on the MLS dataset is 66.75%. The average Word Error Rate in the same scenario is 13.89%, which is better than average 22.58% achieved by the commercial speech recognizer developed by Google.

The goal of the next generation World Wide Web is machine readability through linked databases. To improve web search, integration, and mining in local languages like Urdu, there is a growing need to develop ontologies and vocabulary in these languages. The majority of people use the web in local languages for agriculture, social media interaction, news, etc. How to create agents for the integration of web data. In our country, the literacy ratio is very low and IT literacy is negligible. More comprehensive information for its target audience is only possible through the World Wide Web. Our first target is to improve and enhance the use of social media and the web in local languages. That will encourage its constructive use in Urdu for society and the economy. The Web in natural languages is the source of income for small and medium enterprises. The semantic web is concerned with linked databases and structured data. In this work, we are focused on some selected ontologies to be translated into natural languages. Expertise in Ontology Engineering helps us in job production. Ontology Engineering has extensive freelancing opportunities. Only if the web is correctly interpreted in regional languages is an economic boost achievable. A standardized foundation for data sharing and reuse on the internet is provided by the Semantic Web. In other words, a group of standards and technology that enables computers to comprehend the semantics (meaning) of material on the Web.

The deaf impairment is among the most substantial health problem worldwide, that can lead to various personal, economical, and social crisis. Therefore, it is critical for developing an efficient way to facilitate communication between deaf-dumb impaired and normal people. Herein, we have rationally designed a new digitally computerized and mobile smart system as an efficient communication tool between deaf impaired and normal Arabian people. This is based on two main steps, including creating a digital output for the hand gestures using gloves flex sensors equipped with a three-axis accelerometer that is controlled using a microcontroller. The digital results are compared to that in a words-based “database”, where Arabs use expressions not alphabet in their communication. The second step is translation or conversion the outputs of the first stage into written texts and voices. The newly developed system allows Arabian deaf to translate words of ordinary people into gestures using a speech recognition system with an impressive accuracy over 90 % without the needing for a webcam, colored gloves, and/or online translator. The presented system can be used on any android or windows.

Language barriers exacerbate health disparities among minorities. This study highlights the efficacy of simple interventions in mitigating language barriers, optimizing clinic efficiency, and enhancing preparedness for surgical procedures in Spanish-speaking (SS) females diagnosed with breast cancer in a safety net community hospital. A bilingual questionnaire was given to English and SS patients during their initial clinic visit. Additionally, a bilingual handout on surgical options and postoperative care was provided to selected surgical patients. Among the 41 patients studied, those who completed the questionnaire had an average encounter time of 27.06 minutes, compared to 45.26 minutes for those who did not. For SS patients, the average encounter time with the questionnaire was 34.07 minutes versus 46.54 minutes without it. The average cost of a medical interpreter was $17.04 with the questionnaire, versus $23.27 without. All SS patients who received the educational handout expressed greater satisfaction and understanding of their treatment plans and were less likely to require additional pre-surgery visits. This study demonstrated how the simple implementation of a translated questionnaire can reduce interpretation cost, encounter time, and improve clinic flow. Furthermore, utilizing a bilingual surgical educational handout enhances patient understanding, surgery readiness and reduces unnecessary additional visits.

This survey provides a comprehensive overview of in-context learning (ICL) in large language models (LLMs), a phenomenon where models can adapt to new tasks without parameter updates by leveraging task-relevant information within the input context. We explore the definition and mechanisms of ICL, investigate the factors contributing to its emergence, and discuss strategies for optimizing and effectively utilizing ICL in various applications. Through a systematic review of recent literature, we first clarify what ICL is, distinguishing it from traditional fine-tuning approaches and highlighting its unique characteristics. We then delve into the underlying causes of ICL, examining theories ranging from implicit meta-learning during pre-training to the emergence of task vectors in LLMs. The survey also covers various approaches to enhance ICL performance, including prompt engineering techniques, demonstration selection strategies, and methods for improving generalization across diverse tasks. Additionally, we discuss the limitations and challenges of ICL, such as its sensitivity to demonstration ordering and potential biases. By synthesizing findings from numerous studies, we aim to provide researchers and practitioners with a clear understanding of the current state of ICL research, its practical implications, and promising directions for future investigation. This survey serves as a valuable resource for those seeking to leverage ICL capabilities in LLMs and contributes to the ongoing discourse on the remarkable adaptability of these models.

Only languages with abundant resources are given the opportunity to build speech recognition systems, whereas low resource languages are disregarded. This project attempts to create a system that can normally convert speech to text in the Myanmar (Burmese) language, a language part of low resource languages. The Burmese language is extremely intricate and is made up of vowels, consonants, tones, and stress. There are 10 numbers, 12 vowels, and 33 letters in the Myanmar alphabet. Deep learning allows for the evolution of numerous algorithms while eradicating ignorance and even low-resource languages may be turned into speech-to-text systems with a small quantity of data. The procedures required to construct a successful speech recognition system that can assist both the corporate sector and society will be covered in this project, including data collecting, preprocessing, modeling, prototyping, assessment, and ultimately deployment.

In the dynamic landscape of E-commerce, the proliferation of user-generated queries regarding products highlights the critical need for advanced automatic question answering (AQA) systems. These systems are instrumental in harnessing the vast array of information available online to deliver immediate and informative responses to potential buyers. Recognizing the complexity of such queries, which often require synthesis of reviews, product specifications, and responses to similar questions, we introduce a sophisticated model, the Comprehensive E-commerce Answer Generation System (CEAGS). This model adeptly navigates the challenges posed by irrelevant data and sentiment ambiguity in user-generated content. Our approach leverages a dual-phase process of relevance determination and sentiment clarity, setting the stage for a transformative response generation mechanism. Empirical analyses reveal the superiority of CEAGS, with our relevance assessment framework outstripping existing models by a notable margin in precision metrics, and our answer generation module achieving unprecedented gains in content preservation and coherence. Notably, CEAGS marks a pioneering contribution to the E-commerce domain by integrating disparate information sources to formulate responses that are not only accurate but also contextually rich and user-centric.

This paper will argue that memory from early childhood underlies many practices and beliefs that we commonly refer to as “religious”. The consciousness of young children does not yet have certain features that characterizes adult consciousness. This paper will concentrate on four of these: (I) a reality that is recognizable; (II) a sense of temporal duration; (III) a sense of self; (IV) an experience of the world that is deeply affected by our acquaintance with (a) language. Absence of these features presumably characterizes the consciousness of infants. It also often characterizes mystical experiences. The paper will argue that the human tendency to engage in so-called religious practices and beliefs makes most sense on the assumption that adults somehow preserve the memory of their state of being in childhood.

In this experiment, an efficient and accurate network of detecting automatically disseminated (bot) content on social platforms is devised. Through the utilisation of parallel convolutional neural network (CNN) which processes variable n-grams of text 15, 20, and 25 tokens in length encoded by Byte Pair Encoding (BPE), the complexities of linguistic content on social platforms are effectively captured and analysed. With validation on two sets of previously unexposed data, the model was able to achieve an accuracy of around 96.6% and 97.4% respectively — meeting or exceeding the performance of other comparable supervised ML solutions to this problem. Through testing, it is concluded that this method of text processing and analysis proves to be an effective way of classifying potentially artificially synthesized user data — aiding the security and integrity of social platforms.

Sentiment analysis is a technique used to understand the publics’ opinion towards an event, product, or organization. For example, positive or negative opinion or attitude towards electric vehicle (EV) brands. This provides companies with valuable insight about the public's opinion of their products and brands. In the field of natural language processing (NLP), transformer models have shown great performances over the traditional machine learning algorithms. However, these models have not been explored extensively in the EV domain. EV companies are becoming signif-icant competitors in the automotive industry and are projected to cover up to 30% of the United States light vehicle market by 2030 [1]. In this study, we present a comparative study of large language models (LLMs) including bidirectional encoder representations from transformers (BERT), robustly optimized BERT approach and generalized autoregressive pretraining for language un-derstanding using Lucid motors and Tesla motors YouTube datasets. Results evidenced LLMs like BERT and her variants are off-the-shelf algorithms for sentiment analysis, specifically, when fi-ne-tuned. Furthermore, our findings presents the need for domain adaptation whilst utilizing LLMs. Finally, the experimental results showed that RoBERTa achieved consistent performance across the EV datasets with a F1 score of at least 92%.

Large language models (LLMs) excel in providing natural language responses that sound authoritative, reflect knowledge of the context area, and can present from a range of varied perspectives. Agent Based Models and Simulation consist of simulated agents that interact within a simulated environment to explore societal, social, and ethical, among other, problems. Agents generate large volumes of data over time and discerning useful and relevant content is an onerous task. LLMs can help in communicating agents’ perspectives on key events by providing natural language narratives. However, these narratives need to be factual, transparent, and reproducible. To this end, we present a structured narrative prompt for sending queries to LLMs. Chi-square tests and Fisher’s Exact tests are applied to assess statistically significant difference in sentiment scores of the narrative messages between simulation generated narratives, ChatGPT-generated narratives, and real tweets. The narrative prompt structure effectively yields narratives with the desired components from ChatGPT. This structure is expected to be extensible across LLMs. In 14 out of 44 categories, ChatGPT generated narratives which has sentiment scores that were not discernibly different, in terms of statistical significance (alpha level of 0.05), from the sentiment expressed in real tweets. Three outcomes are provided: (1) a list of benefits and challenges for LLMs in narrative generation; (2) a structured prompt for requesting narratives of a LLM based on simulated agents’ information; and (3) an assessment of statistical significance in the sentiment prevalence of the generated narratives compared to real tweets. This indicates significant promise in the utilization of LLMs for helping to connect simulated agent’s experiences with real people.

In this paper we analyse spatial variation in Japanese dialectal lexicon by assembling a set of methodologies using theories in variationist linguistics and GIScience, and tools used in historical GIS. Based on historical dialect atlas data, we calculate a linguistic distance matrix across survey localities. The linguistic variation expressed through this distance is contrasted with several measurements, based on spatial distance, utilised to estimate language contact potential across Japan, historically and at present. Further, administrative boundaries are tested for their separation effect. Measuring aggregate association within linguistic variation can contrast previous notions of dialect area formation by detecting continua. Depending on local geographies in spatial subsets, great circle distance, travel distance and travel times explain a similar proportion of the variance in linguistic distance despite the limitations of the latter two. While they explain the majority, two further measurements estimating contact have lower explanatory power: least cost paths modelling contact before the industrial revolution, based on DEM and seafaring, and a linguistic influence index based on settlement hierarchy. Historical domain boundaries and present day prefecture boundaries are found to have a statistically significant effect on dialectal variation. However, the interplay of boundaries and distance is yet to be identified. We claim that a similar methodology can address spatial variation in other digital humanities, given a similar spatial and attribute granularity.

Background: Mental synthesis is the conscious purposeful process of synthesizing a novel mental image from objects stored in memory. In our everyday use of language, we rely on mental synthesis to communicate an infinite number of images with a finite number of words. In typical children, the timeline of mental synthesis acquisition is highly correlated with an increasing vocabulary. Children with ASD, on the other hand, may learn hundreds of words but never acquire mental synthesis. In these individuals, tests assessing vocabulary comprehension may fail to demonstrate the profound deficit in mental synthesis and the resulting inability to understand flexible syntax and spatial prepositions. Objective: We developed a 20-question parent-reported evaluation tool designed to quantitatively assess mental synthesis ability and to serve as a complimentary scale for Autism Treatment Evaluation Checklist (ATEC). Results: Internal reliability was good (Cronbach’s alpha > .9), and the MSEC exhibited adequate test-retest reliability after a three- and nine-months follow up period. The MSEC results positively correlated with the ATEC communication subscale, providing support for construct validity. Moreover, MSEC scores were significantly different for children of different ASD severity levels confirming the known groups validity. Conclusions: This study represents the first step toward the development of an instrument to measure mental synthesis in children with ASD. Although the current empirical evaluation demonstrated strong evidence of excellent psychometric properties, such as validity and reliability, additional studies should be performed to replicate these findings.

Confusion, fear and mixed sentiments prevail in the minds of people towards what is arguably one of the most important of dynamics of modern human society: Artificial Intelligence (AI). This study aims to explore the contributions of news media towards this phenomenon - we analyze nearly seventy thousand recent news headlines on AI, using natural language processing (NLP) informatics methods, machine learning (ML) and large language models (LLMs) to draw insights and discover dominant themes. Our theoretical framework was derived from extant literature which posits the power of fear producing articles and news headlines which produce significant impacts on public behavior even when available in small quantities. We applied extensive textual informatics methods using word and phrase frequency analytics, sentiment analysis and human experts based thematic analysis to discover insights on AI phobia inducing news headlines. Our rigorous analysis of nearly seventy thousand headlines using multiple validation methods in NLP (exploratory informatics including BERT, Llama 2 and Mistral based topic identification), ML (supervised informatics) and LLMs (neural nets for sentiment classification, with BERT, Llama 2 and Mistral) demonstrates the presence of an unreasonable level of emotional negativity and fear inducing verbiage in AI news headlines. The framing of AI as being dangerous or as being an existential threat to humanity can have a profound impact on public perception, and the resulting AI phobia and confusion in public perceptions are inherently detrimental to the science of AI. Furthermore, this can also impact AI policy and regulations, and harm society. We conclude with a discussion deducing implications for society and make recommendations for education and policies that could support human identity and dignity.

While adequate for English-speaking users in the United States, as well as many Commonwealth countries and other English-speaking jurisdictions (e.g., Canada, Australia, New Zealand or South Africa among others), typing in Romance Languages (Spanish, French, Portuguese and Italian) by using a standard US-QWERTY Keyboard is not easy since it is not adapted to special characters such as accented vowels, tildes and cedillas or ligatures, used in Romance Languages. With regard to the International Layout, intended to enable access to the most common diacritics used in Western European Languages, the problem comes from the fact that accented vowels are spread throughout the Keyboard layout, and their uppercase versions need chord combinations which can require good manual dexterity. This paper will analyze how the Spanish or Portuguese Keyboards are the best options for these users since they are QWERTY-based and the most compatible ones for the different character sets in Spanish, French, Portuguese and Italian Languages.

This study mostly analyzes the pragmatic viewpoints of speech acts and language functions through Halliday’s (1975) language functions and Searle’s (1976) speech acts were adapted to analyze the functional aspects of the conversations and it was also intended to explore the teachers’ perception toward teaching and learning English as a Foreign Language (EFL) learners’ textbooks and the teacher’s components of communicative knowledge regarding the functions of language in daily activity. The participants of this paper consisted of thirteen Sunrise 10, 11, 12 grades of Kurdish teachers at high school English in Iraqi Kurdistan. Through semi-structured interview, it was found that the conversations in the mentioned textbooks are insufficient from the pragmatic point of view. Some recommendation for the textbook designers, teachers, material developer were raised to make up the shortcomings of the textbooks. The findings reveal that the conversation texts in Sunrise textbooks are not meeting the systematic standard of pragmatic competence the English language learners and the book designer must be recommended to be aware of those shortcomings of the textbook series if they are required to develop their speaking skills in both student and activity series. The implications of this paper can be helpful in comparing the results of this study with other similar studies to check if there is a universal pattern in performing the speech acts and language functions and the interest to Kimberley Education for Life learners in increasing their knowledge of pragmatics in general and the role of language functions and speech acts investigated in this study.

During the last two years the COVID-19 pandemic has affected the world population in several ways. An important increase in mental health problems is a consequence of this pandemic that is ubiquitous worldwide. In this work we study the effect of the pandemic on the mental health of a population of teenagers and youth based on the analysis of natural language processing, machine learning algorithms and expert knowledge. The data analysed was obtained from a chat helpline called Safe time from theIt Get’s Better Foundation in Chile. The data consists of 10,986 conversations gathered from 2018 until 2020 between volunteers from the foundation and users of the platform. We compared the conversationsbefore and during the pandemic in terms of their thematic content. Our analysis found: a significantdecrease in self-image appreciation during the pandemic; a significant decrease in the quality of personalrelationships during the pandemic, and a significant increase of performance appreciation.

ChatGPT, a Large Language Model (LLM) utilizing Natural Language Processing (NLP), has caused concerns about its impact on job sectors, including cybersecurity. In this study, we assessed ChatGPT’s impacts in non-managerial cybersecurity roles using the NICE Framework and Technological Displacement theory. We also explored its potential in passing top cybersecurity certification exams. Findings revealed ChatGPT’s promise in streamlining some jobs, especially those requiring memorization. Moreover, we highlighted ChatGPT’s challenges and limitations, such as ethical implications, LLM limitations, and Artificial Intelligence (AI) security. The study suggests that LLMs like ChatGPT could transform the cybersecurity landscape, causing job losses, skill obsolescence, labor market shifts, and mixed socioeconomic impacts. We recommend a shift in focus from memorization to critical thinking, and collaboration between LLM developers and cybersecurity professionals.

News on the stock market contains positive or negative sentiments depending on whether the information provided is favorable or unfavorable to the stock market. This study aims to discover the news sentiment and classify news according to its sentiments with the application of PhoBERT, a Natural Language Processing model designed for the Vietnamese language. A collection of nearly 40,000 articles on financial and economic websites is used to train the model. After training, the model succeeds in assigning news to different classes of sentiments with an accuracy level of over 81%. The research also aims to investigate how investors concern about the daily news by testing the movements of the market before and after the news is released. The analysis results show that there is an insignificant difference in the stock price as a response to the news. However, investors tend to overreact to negative and positive news in the Vietnam stock market.

This study aimed to compare procedural learning skills between Spanish-speaking preschool children (ages 4 years to 4 years, 11 months) with Developmental Language Disorder (DLD) and their typically developing (TD) peers. Using the Serial Reaction Time task, participants (30 DLD and 30 TD children) respond to visual stimuli in a sequenced manner over four blocks, followed by a random order block. The task assessed reaction time (RT) and accuracy. Results showed a significant interaction between group and block for reaction time (RT) and accuracy, with children with DLD exhibiting longer RTs and accuracy deficits across blocks. In contrast, the TD group showed higher RT efficiency and accuracy in the sequential blocks and as expected, decreased performance in the random block according to the experimental manipulation. Overall, the results of this investigation suggest that there was no implicit learning in the DLD group, as indicated by the SRT task paradigms of procedural memory. These findings align with the Procedural Deficit Hypothesis (PDH), suggesting that linguistic deficits in the TD population may derive from a general dysfunction of the procedural memory system domain in the Spanish context.

Due to the substantial growth of internet users and its spontaneous access via electronic devices, the amount of electronic contents is growing enormously in recent years through instant messaging, social networking posts, blogs, online portals, and other digital platforms. Unfortunately, the misapplication of technologies has boosted with this rapid growth of online content which leads to the rise in suspicious activities. People misuse the web media to disseminate malicious activity, perform the illegal movement, abuse other people, and publicize suspicious contents on the web. The suspicious contents usually available in the form of text, audio or video, whereas text contents have been used in most of the cases to perform suspicious activities. Thus, one of the most challenging issues for NLP researchers is to develop a system that can identify suspicious text efficiently from the specific contents. In this paper, a Machine Learning (ML)-based classification model is proposed (hereafter called STD) to classify Bengali text into non-suspicious and suspicious categories based on its original contents. A set of ML classifiers with various features has been used on our developed corpus, consisting of 7000 Bengali text documents where 5600 documents used for training and 1400 documents used for testing. The performance of the proposed system is compared with the human baseline and existing ML techniques. The SGD classifier `tf-idf’ with the combination of unigram and bigram features are used to achieve the highest accuracy of 84.57%.

Pedagogical translanguaging (PTL) refers to the use of educational techniques which incorporate learners’ entire linguistic repertoire. Recent studies indicate that PTL is efficient in the teaching of morphological awareness to bilingual children. The question remains whether it can successfully be applied in the highly specific context of adult forced migrants' classrooms. This study describes a new protocol developed within the framework of PTL to teach derivational morphology to L2 French and Greek adults. We used questionnaires to assess quantitatively and qualitatively the feasibility of the protocol, teachers' and learners' attitudes, and learners' emotions in the PTL lesson. A total of 141 migrant learners (79 forced migrants) and 13 teachers were involved in 23 2-hour lessons. Teachers and learners gave overall high evaluations of the feasibility of the PTL protocol and of their pleasure to teach and learn using PTL tools. Learners’ ease to learn and learning benefits were positively influenced by their perception of the proximity between their L1 and L2. Learners reported higher positive emotions and lower negative emotions during the PTL lesson, while forced migrants showed globally higher hope and shame than voluntary migrants, as well as higher benefits from PTL on enjoyment. These findings suggest that the use of pedagogical translanguaging in migrants’ classrooms is feasible and develops positive attitudes and emotions, which are more pronounced in forced migrants.

Crowdsourced Data (CSD) generated by citizens is becoming more popular as its potential utilisation in many applications is increasing due to its currency and availability. However, the quality of CSD, including its relevance, is often questioned as the data is not generated by professionals nor follows standard data collection procedures. The quality of CSD can be assessed according to a range of attributes including its relevance. Information relevance has been explored through using in Geographic Information Retrieval (GIR) techniques to identify relevant information. This research tested a relevance assessment approach for CSD by adapting relevance assessment techniques available in the GIR domain. The thematic and geographic relevance were assessed using the Term Frequency-Inverse Document Frequency (TF-IDF), Vector Space Model (VSM) and Natural Language Processing (NLP) techniques. The thematic and geographic specificities of the queries were calculated as 0.44 and 0.67 respectively, which indicates the queries used were more geographically specific than thematically specific. The Spearman's rho value of 0.62 indicated that the final ranked relevance lists showed reasonable agreement with a manually classified list and confirmed the potential of the approach for CSD relevance assessment for other possible crowdsourced data analysis.

In an ever-evolving landscape of higher education, this study delves into the transformative potential of merging deep learning principles and meaningful pedagogy in language acquisition, aided by artificial intelligence (AI) technologies. Drawing from a qualitative research design, it navigates the post-pandemic educational landscape, examining shifts in language education, student perspectives, and adaptations. Through comprehensive data collection methods, including literature review, interviews, and classroom observations, the study presents insights from 30 participants from SMC. The qualitative findings reveal emerging themes related to deep learning, meaningful learning, AI integration, and language acquisition, underscoring their profound impact on teaching methods and student engagement. This research contributes to the field by shedding light on innovative approaches that elevate language acquisition in an AI-evolving educational environment. The study concludes with implications for school administrators, teachers, and students, offering recommendations for future research directions, ultimately striving to enhance language education in the modern era.

(1) Background: Children with autism spectrum disorder (ASD) show certain characteristics in visual attention which generate difficulties in the integration of relevant social information to set the basis of communication. Gaze following and pupil dilation could be used to identify signs for the early detection of ASD. Eye-tracking methodology allows objective measurement of these anomalies in visual attention. The aim is to determine whether measurements of gaze following and pupillary dilation in a linguistic interaction task, captured using eye-tracking methodology, are objective for early diagnosis of ASD. (2) Methods: 20 children between 17 and 24 months of age, made up of 10 neurotypical children and 10 children with ASD were paired together according to chronological age. A human face on a monitor pronounced pseudowords associated with pseudo-objects. Gaze following and pupil dilation was registered during the task. (3) Results: Significant statistical differences were found in the time of gaze fixation on the human face and on the object, as well as in the number of gazes. Also, there were significant differences in the maximum peak of pupil dilation, this being found in the neurotypical group at the moment of processing of the pseudoword, and in the ASD group in the baseline prior to the task (4) Conclusions: The registration and the duration of gaze, and the measurement of pupil dilation with ‘eye-tracker’ are objective measures for early detection of ASD.

Potocki-Lupski Syndrome (PTLS) is a rare condition associated with a duplication of 17p11.2 that may underlie a wide range of congenital abnormalities and heterogeneous behavioral phenotypes. Along with developmental delay and intellectual disability, autism-specific traits are often reported to be the most common among patients with PTLS. To contribute to the discussion of the role of autism spectrum disorder (ASD) in the PTLS phenotype, we present a case of a female adolescent with a de novo dup(17)(p11.2p11.2) without ASD features, focusing on in-depth clinical, behavioral, and electrophysiological (EEG) evaluations. Among EEG features, we found the atypical peak-slow wave patterns and a unique saw-like sharp wave of 13 Hz that was not previously described in any other patient. The power spectral density of the resting state EEG was typical in our patient with only the values of non-linear EEG dynamics: Hjorth complexity and Fractal dimension were drastically attenuated compared with the patient’s neurotypical peers. Here we also summarize results from previously published reports of PTLS that point to the about 21% occurrence of ASD in PTLS that might be biased, taking into account methodological limitations. More consistent among PTLS patients were intellectual disability and speech and language disorders.

We present improvements in n-best rescoring of code-switched speech achieved by n-gram augmentation as well as optimised pretraining of long short-term memory (LSTM) language models with larger corpora of out-of-domain monolingual text. In addition, we consider the application of large pretrained transformer-based architectures. Our experimental evaluation is performed on an under-resourced corpus of code-switched speech comprising four bilingual code-switched sub-corpora, each containing a Bantu language (isiZulu, isiXhosa, Sesotho, or Setswana) and English. We find in our experiments that, by combining n-gram augmentation with the optimised pretraining strategy, speech recognition errors are reduced for each individual bilingual pair by 3.51% absolute on average over the four corpora. Importantly, we find that even speech recognition at language boundaries improves by 1.14% even though the additional data is monolingual. Utilising the augmented n-grams for lattice generation, we then contrast these improvements with those achieved after fine-tuning pretrained transformer-based models such as distilled GPT-2 and M-BERT. We find that, even though these language models have not been trained on any of our target languages, they can improve speech recognition performance even in zero-shot settings. After fine-tuning on in-domain data, these large architectures offer further improvements, achieving a 4.45% absolute decrease in overall speech recognition errors and a 3.52% improvement over language boundaries. Finally, a combination of the optimised LSTM and fine-tuned BERT models achieves a further gain of 0.47% absolute on average for three of the four language pairs compared to M-BERT. We conclude that the careful optimisation of the pretraining strategy used for neural network language models can offer worthwhile improvements in speech recognition accuracy even at language switches, and that much larger state-of-the-art architectures such as GPT-2 and M-BERT promise even further gains.

The link between language processing and motor systems has been the focus of increasing interest to Cognitive Neuroscience. Some classical papers studying Event Related Potentials (ERPs) induced by linguistic stimuli have found differences in electrophysiological activity when comparing action and non-action words; more specifically, a bigger p200 for action words. On the other hand, a series of studies have validated the use of a grip force sensor (GFS) to measure language-induced motor activity during both isolated words and sentence listening, finding that action words induce an augmentation in the grip force around 250-300 ms after the onset of the stimulus. The purpose of the present study is to combine both techniques to assess if the p200 is related to the augmentation of the grip force measured by a GFS. We measured ERP and GFS changes elicited by listening to action and non-action words while maintaining an active grasping task in 10 healthy subjects. Our results show that the amplitude of the p200 in central electrodes is correlated to the augmentation in the GFS around 300 ms induced by linguistic stimuli. To our knowledge, this is the first study where the electrophysiological activity and the changes in the grip force induced by auditory language processing are put together, opening new venues of interpretation for the sensorimotor interaction in language processing.

In the digital age, social media platforms have become a significant source of both information and misinformation, presenting challenges and opportunities for threat intelligence. Natural Language Processing (NLP) has emerged as a powerful tool for extracting actionable insights from the vast amounts of unstructured text generated on these platforms. This paper explores the application of NLP techniques to enhance social media threat intelligence, focusing on methodologies for detecting and analyzing threats such as disinformation, cyberbullying, and extremist content. We examine various NLP approaches, including sentiment analysis, topic modeling, and entity recognition, and their effectiveness in identifying and mitigating potential risks. The paper also addresses the challenges associated with processing social media data, such as dealing with slang, context, and multilingual content. By leveraging NLP, organizations can improve their ability to monitor and respond to emerging threats in real-time, ultimately enhancing their overall security posture. The findings suggest that while NLP offers significant benefits, it must be complemented by human expertise and ethical considerations to ensure accurate and responsible threat assessment.

Limiting training data in low-resource languages is a barrier to Natural Language Processing (NLP). Regardless, languages with thousands of users worldwide require improved NLP capabilities. The Table-to-Text task—typically develops natural language descriptions using data tables, tests model reasoning abilities—although it is especially tough in multi-language settings. System output frequently lack credit to their underlying data. Intermediate planning strategies—which include Question-Answer (QA) blueprints—improving summarization tasks by presenting related QA pair prior to verbalization. Therefore, this study analyses whether QA blueprints improve multilingual Table-to-Text output attribution. An enlarged multilingual dataset, encompassing African languages, contains QA blueprints that were produced and filtered heuristically. This dataset is used to fine-tune sequence-to-sequence model (transformers)—both with and without blueprints. Two configurations are evaluated—English reference blueprints with language target verbalization and modified blueprints. These results show that English-only models benefit from blueprints, whereas multi language models cannot. Errors in machine-translating blueprints provide challenges, as do models that rely on their generated blueprints.

As Large Language Models (LLMs) increasingly accommodate larger inputs, context windows spanning hundreds of thousands or even millions of tokens are touted as promising for a wide array of applications. However, the potential decay in reasoning ability for larger inputs may compromise their utility. This study introduces a new benchmark called Find the Origin, which progressively tests the efficacy of LLMs on a simple intellectual task as the size of the context window increases. The test, conducted on 14 different LLMs for comparative analysis, demonstrated that reasoning ability is dependent on input size. Additionally, three independent tests were performed with the GPT-4 Turbo model to demonstrate its reasoning degradation in different contexts as input size increases.

Word Sense Disambiguation (WSD) stands as a persistent challenge within the Natural Language Processing (NLP) community. While various NLP packages exist, the Lesk algorithm in the NLTK library, a widely recognized tool, demonstrates suboptimal accuracy. Conversely, the application of deep neural networks offers heightened classification precision, yet their practical utility is constrained by demanding memory requirements. This research paper introduces an innovative method addressing WSD challenges by optimizing memory usage without compromising state-of-the-art accuracy. The presented methodology facilitates the development of WSD system that seamlessly integrates into NLP tasks, resembling the functionality offered by the NLTK library. Furthermore, this paper advocates treating the BERT language model as a gold standard, proposing modifications to manually annotated datasets and semantic dictionaries such as WordNet to enhance WSD accuracy. The empirical validation through a series of experiments establishes the effectiveness of the proposed method, achieving state-of-the-art performance across multiple WSD datasets. This contribution represents advancement in mitigating the challenges associated with WSD, offering a practical solution for integration into NLP applications.

The exploration and understanding of sentiments and emotions through textual analysis are foundational to advancements in natural language processing (NLP). While sentiment analysis, which involves discerning the polarity of text, has been extensively explored, the nuanced detection of complex emotions within textual content is still an emerging area of study. In this paper, we introduce EmoLeverage, a model leveraging Transformer architecture and enhanced with a novel Fusion Adapter module. This model aims to deepen emotion detection capabilities by drawing insights from fundamental sentiment analysis tasks, focusing exclusively on textual data. EmoLeverage sets a new standard in the field by demonstrating that deep, nuanced understanding of emotions is achievable through text alone, challenging and surpassing existing methodologies in emotion identification on key datasets. This is a significant step forward, considering the complexity of human emotions and the subtleties involved in their expression through language. By concentrating on textual input, EmoLeverage offers a promising avenue for applications where audio or visual data is not available, highlighting the versatility and potential of text-based emotional analysis. Our approach illustrates the untapped potential of leveraging sophisticated NLP techniques to enhance the detection and comprehension of a wide array of emotions from text. The success of EmoLeverage in outperforming conventional models in emotion recognition tasks underscores the model's effectiveness in parsing and understanding the intricate expressions of human emotions through linguistic cues alone. This achievement paves the way for more accurate, efficient, and nuanced emotion detection tools, potentially transforming various sectors by providing deeper insights into human emotional states through text.

Language bias stands as a noteworthy concern in Visual Question Answering (VQA), wherein models tend to rely on spurious correlations between questions and answers for prediction. This prevents the models from effectively generalizing, leading to a decrease in performance. To address this bias, we propose a novel modality fusion collaborative de-biasing algorithm (CoD). In our approach, bias is considered as the model’s neglect of information from a particular modality during prediction. We employ a collaborative training approach to facilitate mutual modeling between different modalities, achieving efficient feature fusion and enabling the model to fully leverage multi-modal knowledge for prediction. Our experiments on various datasets, including VQA-CP v2, VQA v2, and VQA-VS, using different validation strategies, demonstrate the effectiveness of our approach. Notably, employing a basic baseline model resulted in an accuracy of 60.14% on VQA-CP v2.

Our natural language approach concerns syntactic analysis using a dedicated Javascript library - wink-nlp - and semantic analysis based on Prolog programming language, facilitated by another Javascript library - tau-prolog - that allows defining logical programs, declaring rules and checking for goals inside Javascript language. Firstly, our program splits the original text into sentences, than into tokens and identifies each part of the sentence, dynamically maps entities into Prolog rules, then check the spelling accordingly to the Definite Clause Grammar (DCG) by querying the pre-defined program for initial goals (the sentence itself). Basically, we let the parser infer its own rules from the syntactic point of view, then check the grammar from a semantic perspective against the DCG inside the same work flow or pipeline of steps.The provided article combine the usage of wink-nlp and tau-prolog packages for natural language processing (NLP) and understanding (NLU).

Abstract: Background: Restless Legs Syndrome /Willis-Ekbom disease (RLS/WED) has occasionally -but not consistently- been associated with cognitive, and most notably, language and executive impairment. The present study was conducted to investigate the cognitive trajectories of older individuals with RLS/WED. Methods: Participants were drawn from the randomly selected, older (>64 years), population-based HELIAD cohort. Individuals without dementia, with available neuropsychological evaluations at baseline and follow-up were considered for potential eligibility. A comprehensive assessment examining five principal components of cognition (memory, visuo-spatial ability, attention, executive function, and language) was administered to the partici-pants. Generalized estimating equations analysis was used to examine the unadjusted and adjusted (for critical factors and covariates) effects of RLS/WED on cognition over time. Results: A total of 1003 predominantly female, older (72.9 ±4.9 years) partici-pants, with follow-up evaluations after a mean of 3.09 ±0.85 years and without demen-tia at baseline and follow-up were included in the present study. Among them, 81 were diagnosed with RLS/WED at baseline. Global cognition, memory, attention, executive and visuo-perceptual skills did not differ between those with and without RLS/WED. However, the RLS/WED group performed worse on language at baseline by 0.249 of a standard deviation, while demonstrating a mitigated language decline over time, by 0.063 of a standard deviation. The unadjusted models yielded similar results. Conclu-sions: Our findings were indicative of a baseline language disadvantage among older individuals with RLS/WED, but the initial discrepancy tends to dissolve over time.

Recent advancements in Natural Language Processing (NLP), particularly in Large Language Models (LLMs), associated with deep learning-based computer vision techniques, have shown substantial potential for automating a variety of tasks. One notable model is Visual ChatGPT, which combines ChatGPT’s LLM capabilities with visual computation to enable effective image analysis. The model’s ability to process images based on textual inputs can revolutionize diverse fields. However, its application in the remote sensing domain remains unexplored. This is the first paper to examine the potential of Visual ChatGPT, a cutting-edge LLM founded on the GPT architecture, to tackle the aspects of image processing related to the remote sensing domain. Among its current capabilities, Visual ChatGPT can generate textual descriptions of images, perform canny edge and straight line detection, and conduct image segmentation. These offer valuable insights into image content and facilitate the interpretation and extraction of information. By exploring the applicability of these techniques within publicly available datasets of satellite images, we demonstrate the current model’s limitations in dealing with remote sensing images, highlighting its challenges and future prospects. Although still in early development, we believe that the combination of LLMs and visual models holds a significant potential to transform remote sensing image processing, creating accessible and practical application opportunities in the field.

A novel hypothesis concerning language evolution is advanced. It posits that languages have evolved as a means of binding individuals to a group, as well as for defining those groups. This means that language evolution has to be considered on the level of groups and not only on the level of individuals. This hypothesis helps to explain the huge diversity of human languages, as well as their complexity. Perhaps more importantly, it explains why adults lose the ability to learn languages with the ease that children possess.

Evolutionary perspectives have generated many questions and some answers in the study of human health and disease. The field of evolutionary medicine, and related analytics of evolutionary psychiatry and evolutionary psychology have extended and expanded the way health disorders are viewed by searching for why humans, as a species, are vulnerable to certain pathological conditions. The search is organized into four domains that apply proximate and evolutionary explanations to human traits and developmental sequences. This framework opens inquiry to the ontogeny, phylogeny, mechanism, and adaptive significance of human health conditions. In this paper I argue that evolutionary medicine seems to parallel biomedicine in its primarily pathogenic focus. That is, conditions of pain, suffering, and disorder have received the most attention. Some work has used the architecture of evolutionary medicine to take a salutogenic approach, evaluating the proximate and evolutionary explanations of human well-being. I propose that an evolutionary understanding of human well-being requires a survey of emotions and their relationship with neurobiology, language, and culture. My anthropology based, multidisciplinary review of biopsychosocial processes reveals the way evolution has shaped modern human understanding of well-being through sociolinguistic learning processes and thereby our individual experiences of well-being. These insights have the power to contextualize human suffering and flourishing as we progress toward the goal of attenuating the former and expanding the latter.

Many children have suspected delayed language development and need extensive support from parents and the health care team. This study aimed to investigate suspected delayed language development and factors associated with suspected delayed language development among early childhood in Southern Thailand. Children aged 24 to 60 months were recruited as study samples using stratified random sampling conducted in 23 districts and simple randomized seven sections (425 children). Instruments comprised demographic data of the children and families, The preschool temperament questionnaire, and the Language Development Screening questionnaire using developmental surveillance and promotion manual. I was collecting data from July 2020 to January 2021. Data analysis used descriptive statistics and logistic regression. The results showed that 40.9 percent suspected delayed development. Daily screen time exceeding 2 hours per day (A.O.R. = 17.30, 95% CI: 7.35-40.72), and regarding a child's temperament, moderate-to-difficult temperament (A.O.R. = 9.56, 95% CI: 5.12-17.85) were significantly associated with a suspected delay of language development. The study suggested two-way communication and appropriate responses will help develop children's language.

Documenting cultural heritage by using artificial intelligence (AI) is crucial for preserving the memory of the past and a key point for future knowledge. However, modern AI technologies make use of statistical learners that lead to self-empiricist logic, which, unlike human minds, use learned non-symbolic representations. Nevertheless, it seems that it is not the right way to progress in AI. If we want to rely on AI for these tasks, it is essential to understand what lies behind these models. Among the ways to discover AI there are the senses and the intellect. We could consider AI as an intelligence. Intelligence has an essence, but we do not know whether it can be considered “something” or “someone”. Important issues in the analysis of AI concern the structure of symbols -operations with which the intellectual solution is carried out- and the search for strategic reference points, aspiring to create models with human-like intelligence. For many years, humans, seeing language as innate, have carried out symbolic theories. Everything seems to have skipped with the advent of Machine Learning. In this paper, after a long analysis of history, the rule-based and the learning-based vision, we propose KERMIT as a unit of investigation for a possible meeting point between the different learning theories. Finally, we propose a new vision of knowledge in AI models based on a combination of rules, learning and human knowledge.

Deep neural networks are hegemonic approaches to many machine learning areas, including natural language processing (NLP). Thanks to the availability of large corpora collections and the capability of deep architectures to shape internal language mechanisms in self-supervised learning processes (also known as "pre-training"), versatile and performing models are released continuously for every new network design. But these networks, somehow, learn a probability distribution of words and relations across the training collection used, inheriting the potential flaws, inconsistencies and biases contained in such a collection. As pre-trained models have found to be very useful approaches to transfer learning, dealing with bias has become a relevant issue in this new scenario. We introduce bias in a formal way and explore how it has been treated in several networks, in terms of detection and correction. Also, available resources are identified and a strategy to deal with bias in deep NLP is proposed.

The aim of the existing study is to investigate the influence of teacher expectation on students’ achievement and their attitudes towards English lesson and to increase the students’ academic success and positive attitudes towards this issue. In the study, a process which defined the existing situtation and which provided the educational processes to improve by changing the existing situation could be seen. For this reason, emancipatory/improving/critical action research model was used. The study was carried out on a sample group consisting of 87 students; 43 6th graders and 44 8th graders attending a school located in the city center of Düzce during the 2015-2016 academic year. In order to collect the data, “Teacher Expectancy Scale” developed by the researchers, “Attitude Scale towards English Course” and 7 test exams prepared by Turkish Ministry of National Education (MoNE) were used. The study was conducted for a total 48 hours in 12 weeks, 4 hours a week. As the result of the study, it was revealed that teacher expectation influenced the attitudes of the students towards the English lesson in a positive way and increased their academic achievements.

Distributional word vector representation orword embedding has become an essential ingredient in many natural language processing (NLP) tasks such as machine translation, document classification, information retrieval andquestion answering. Investigation of embedding model helps to reduce the feature space and improves textual semantic as well as syntactic relations.This paper presents three embedding techniques (such as Word2Vec, GloVe, and FastText) with different hyperparameters implemented on a Bengali corpusconsists of180 million words. The performance of the embedding techniques is evaluated with extrinsic and intrinsic ways. Extrinsic performance evaluated by text classification, which achieved a maximum of 96.48% accuracy. Intrinsic performance evaluatedby word similarity (e.g., semantic, syntactic and relatedness) and analogy tasks. The maximum Pearson (ˆr) correlation accuracy of 60.66% (Ssˆr) achieved for semantic similarities and 71.64% (Syˆr) for syntactic similarities whereas the relatedness obtained 79.80% (Rsˆr). The semantic word analogy tasks achieved 44.00% of accuracy while syntactic word analogy tasks obtained 36.00%

The speech-to-song illusion is a type of auditory illusion that the repetition of a part of a sentence would change people’s perception tendency from speech-like to song-like. The study aims to examine how pace, emotion, and language tonality affect people’s experience of the speech-to-song illusion. It uses a between-subject (Pace: fast, normal, vs. slow) and within-subject (Emotion: positive, negative, vs. neutral; language tonality: tonal language vs. non-tonal language) design. Sixty Hong Kong college students were randomly assigned to one of the three conditions characterized by pace. They listened to 12 audio stimuli, each with repetitions of a short excerpt, and rated their subjective perception of the presented phrase, whether it sounded like a speech or a song, on a five-point Likert-scale. Paired-sample t-tests and repeated measures ANOVAs were used to analyze the data. The findings reveal that a faster speech pace could strengthen the tendency of the speech-to-song illusion. Neither emotion nor language tonality show a statistically significant influence on the speech-to-song illusion. This study suggests that the perception of sound should be in a continuum and facilitates the understanding of song production in which speech can turn into music by having repetitive phrases and to be played in a relatively fast pace.

This paper presents the current lexical, morphological, syntactic and rule-based machine translation work for Erzya and Moksha that can and should be used in the development of a roadmap for Mordvin linguistic research. We seek to illustrate and outline initial problem types to be encountered in the construction of an Apertium-based shallow-transfer machine translation system for the Mordvin language forms. We indicate reference points within Mordvin Studies and other parts of Uralic studies, as a point of departure for outlining a linguistic studies with a means for measuring its own progress and developing a roadmap for further studies.

This research investigates the potential application of generative language models, especially ChatGPT, in aviation safety analysis as a means to enhance the efficiency of safety analyses and accelerate the time it takes to process incident reports. In particular, ChatGPT was leveraged to generate incident synopses from narratives, which were subsequently compared with ground truth synopses from the Aviation Safety Reporting System (ASRS) dataset. The comparison was facilitated by using embeddings from Large Language Models (LLMs), with aeroBERT demonstrating the highest similarity due to its aerospace-specific fine-tuning. A positive correlation was observed between synopsis length and their cosine similarity. In a subsequent phase, human factor issues involved in incidents as identified by ChatGPT were compared to human factor issues identified by safety analysts. A concurrence rate of 61% was found, with ChatGPT demonstrating a cautious approach towards attributing human factor issues. Finally, the model was used to attribute incidents to relevant parties. As no dedicated ground truth column existed for this task, a manual evaluation was conducted. ChatGPT attributed the majority of incidents to the Flight Crew, ATC, Ground Personnel, and Maintenance. This study opens new avenues for leveraging AI in aviation safety analysis.

: Multimodal Large Language Models (MLLMs) harness comprehensive knowledge spanning text, images, and audio to adeptly tackle complex problems, including zero-shot in-context learning scenarios. This study explores the ability of MLLMs in visually solving the Traveling Salesman Problem (TSP) and Multiple Traveling Salesman Problem (mTSP) using images that portray point distributions on a two-dimensional plane. We introduce a novel approach employing multiple specialized agents within the MLLM framework, each dedicated to optimizing solutions for these combinatorial challenges. Our experimental investigation includes rigorous evaluations across zero-shot settings and introduces innovative multi-agent zero-shot in-context scenarios. The re-sults demonstrated that both multi-agent models—Multi-Agent 1, which includes the Initializer, Critic, and Scorer agents, and Multi-Agent 2, which comprises only the Initializer and Critic agents—significantly improved solution quality for TSP and mTSP problems. Multi-Agent 1 ex-celled in environments requiring detailed route refinement and evaluation, providing a robust framework for sophisticated optimizations. In contrast, Multi-Agent 2, focusing on iterative re-finements by the Initializer and Critic, proved effective for rapid decision-making scenarios. These experiments yield promising outcomes, showcasing the robust visual reasoning capabilities of MLLMs in addressing diverse combinatorial problems. The findings underscore the potential of MLLMs as powerful tools in computational optimization, offering insights that could inspire further advancements in this promising field.

Different factors seemingly account for the emergence of present-day languages in our species. Human self-domestication has been recently invoked as one important force favouring language complexity mostly via a cultural mechanism. As a consequence, evolutionary changes impacting on aggression levels are expected to have fostered this process. Here we hypothesise about a positive effect of dog-human interactions on aggression management and more generally, on our self-domestication, ultimately, contributing to aspects of language evolution. We review evidence of diverse sort (ethological mostly, but also archaeological, genetic, and physiological) supporting a positive feedback loop between dog domestication and human-self domestication that might have favoured the mechanisms promoting structural complexity in human languages.

Introduction: Around a million people are reported to die by suicide every year, and due to the stigma associated with the nature of the death, this figure is usually assumed to be an underestimate. Suicide may be prevented if prompt intervention is taken to mitigate risk. Machine learning and artificial intelligence-based modelling, such as natural language processing (NLP) and other text analytics approaches, has the potential to become a major technique for the detection, diagnosis, and treatment of people who are suffering from mental health issues. The primary aims of this research are to determine whether NLP techniques have been utilised in the field of suicide prevention, and if so, were they effective? What were their limitations? Methods: PubMed, EMBASE, MEDLINE, PsycInfo, and Global Health databases were searched for studies that reported use of NLP for suicide ideation or self-harm. Thematic analysis was used to synthesise and analyse the included studies. Findings were reported using the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement, and the Mixed Methods Appraisal Tool (MMAT) was used in assessing paper quality. Result: The preliminary search of five databases generated 387 results. Removal of duplicates resulted in 158 potentially suitable studies. Twenty papers were finally included in this review. Discussion: Studies show that combining structured and unstructured data in NLP data modelling yielded more accurate results than utilizing either alone. Also, to reduce suicides, people with mental problems must be continuously and passively monitored. Further, NLP and other machine learning/artificial intelligence technologies can be used to address health inequities and electronic health records provide valuable data for creating suicide risk tools. Finally, Online, social media, and smartphone applications can be leverage in detecting people with suicide ideation. Conclusion: The use of artificial intelligence and machine learning opens new avenues for considerably guiding risk prediction and advancing suicide prevention frameworks. The review's analysis of the included research revealed that the use of NLP may result in low-cost and effective alternatives to existing resource-intensive methods of suicide prevention. To summarise, there is substantial evidence that NLP is useful in identifying people who have suicide ideation.