Large Language Models (LLMs) like GPT-4 and mBERT have revolutionized natural languageprocessing (NLP) by providing multilingual capabilities, making it possible to develop models thathandle diverse linguistic inputs across various languages. However, despite these advances, thereremains a noticeable performance gap between how well these models perform in high-resourcelanguages such as English and low-resource languages such as Nepali or Malagasy. We term thisphenomenon the "Babel Effect," highlighting the disproportionate performance that arises fromdifferences in resource availability across languages.This paper aims to explore the root causes of these performance discrepancies in LLMs, focusingon the underlying challenges in tokenization, training, and data scarcity. We utilize cross-lingualbenchmarks, such as XGLUE and TyDiQA, to quantify these performance variations and examinethem in detail. Furthermore, we propose solutions, including enhancing tokenization strategies,employing data augmentation techniques, and refining fine-tuning methods. The paper concludeswith a discussion on how these improvements can mitigate the Babel Effect and lead to more equitablelanguage modeling across diverse linguistic contexts.

In today's world, news events are emerging incessantly. Classifying the same event reported by different countries is of significant importance for public opinion control and intelligence gathering. Due to the diverse types of news, relying solely on translators would be costly and inefficient, while depending solely on translation systems would incur considerable performance overheads in invoking translation interfaces and storing translated texts. To address this issue, we mainly focus on the clustering problem of cross-lingual news. To be specific, we use a combination of sentence vector representations of news headlines in a mixed semantic space and the topic probability distributions of news content to represent a news article. In the training of cross-lingual models, we employ knowledge distillation techniques to fit two semantic spaces into a mixed semantic space. We abandon traditional static clustering methods like K-Means and AGNES in favor of the incremental clustering algorithm Single-Pass, which we further modify to better suit cross-lingual news clustering scenarios. Our main contributions are as follows: (1) We adopt the English standard BERT as the teacher model and XLM-Roberta as the student model, training a cross-lingual model through knowledge distillation that can represent sentence-level bilingual texts in both Chinese and English. (2) We use the LDA topic model to represent news as a combination of cross-lingual vectors for headlines and topic probability distributions for content, introducing concepts such as topic similarity to address the cross-lingual issue in news content representation. (3) We adapt the Single-Pass clustering algorithm for the news context to make it more applicable. Our optimizations of Single-Pass include adjusting the distance algorithm between samples and clusters, adding cluster merging operations, and incorporating a news time parameter.

Studies in the area of cross-linguistic influence (CLI) have attracted the focus of multi-linguistic learners. However, little research on CLI deals with Asian learners, particularly Chinese-speaker with knowledge of two or more foreign languages. The present study explores CLI in L1 Chinese learners with both English (L2) and Spanish (L3) as foreign languages who are studying in Madrid, a Spanish-speaking community; their studies coincided with data collection. English learners were instructed to speak for analysis purposes, with the following aims: (i) to observe the most frequent category (functional transfer, code-switching, borrowing and coinage) in the CLI instances; (ii) to determine the source language of CLI; (iii) to investigate whether CLI factors, including language distance, L2 status, proficiency and recency of use, intervene in the appearance of CLI instances in the participants. Data was gathered from 16 female Chinese students at Complutense University of Madrid (UCM). These were master students aged 22 to 26, who visited Spain for more than 5 months when they participated in the present study. The instrument used was an English semi-structured interview. Results primarily reveal that (a) borrowing is the most prevalent category, accounting for 70% of the CLI instances; (b) Spanish is the main source language of CLI while Chinese plays a functional role in the transfer process; (c) language distance proves to be the strongest predictor of CLI.

Multimodal emotion classification (MEC) involves analyzing and identifying human emotions by integrating data from multiple sources, such as audio, video, and text. This approach leverages the complementary strengths of each modality to enhance the accuracy and robustness of emotion recognition systems. However, one significant challenge is effectively integrating these diverse data sources, each with unique characteristics and levels of noise. Additionally, the scarcity of large, annotated multimodal datasets in Bangla limits the training and evaluation of models. In this work, we unveiled a pioneering multimodal Bangla dataset, MAViT-Bangla (Multimodal Audio Video Text Bangla dataset). This dataset, comprising 1002 samples across audio, video, and text modalities, is a unique resource for emotion recognition studies in the Bangla language. It features emotional categories such as anger, fear, joy, and sadness, providing a comprehensive platform for research. Additionally, we developed a framework for emotion recognition that employs a cross-modal attention mechanism among unimodal features. This mechanism fosters the interaction and fusion of features from different modalities, enhancing the model’s ability to capture nuanced emotional cues. The effectiveness of this approach was demonstrated by achieving an F1-score of 0.64, a significant improvement over unimodal methods.

As digitalization expands across all sectors, the economic toll of software defects on the U.S. economy reaches up to $2.41 trillion annually. High-profile incidents like the Boeing 787-Max 8 crash have shown the devastating potential of these defects, highlighting the critical importance of software testing within quality assurance frameworks. However, due to its complexity and resource intensity, the exhaustive nature of comprehensive testing often surpasses budget constraints. This research utilizes a machine learning (ML) model to enhance software testing decisions by pinpointing areas most susceptible to defects and optimizing scarce resource allocation. Previous studies have shown promising results using cost-sensitive training to refine ML models, improving predictive accuracy by reducing false negatives through addressing class imbalances in defect prediction datasets. This approach facilitates more targeted and effective testing efforts. Nevertheless, the generalizability of these models across different projects (cross-project) and programming languages (cross-language) remained untested. This study validates the model's applicability across diverse development environments by integrating various datasets from distinct projects into a unified, using a more interpretable ML approach. The results demonstrate that ML can support software testing decisions, enabling teams to identify up to seven times more defective modules with the same testing effort as a benchmark.

The field of program classification, a critical aspect of software engineering, facilitates understanding and categorization of code across various applications, including anomaly detection, and code quality assessment. The advancement of cross-language program classification opens up avenues for efficient code translation among different programming languages, significantly aiding developers in rapid coding and reducing development cycles. Existing research primarily focuses on semantic code analysis, with limited emphasis on cross-linguistic challenges. To address this, we introduce an innovative neural network model, CodeSemanticsNN, which leverages a refined Syntax Structure (SS) approach. This model consists of two integral mechanisms: first, it adopts a novel SS representation that combines sequential and graph-based SS structures, enhancing semantic feature capture. Second, it employs a 'unified vocabulary' strategy to bridge the gap between diverse programming languages, facilitating efficient cross-language classification. Additionally, we have compiled a comprehensive dataset of 20,000 files spanning five programming languages, serving as a benchmark for cross-language classification. Our experiments on this dataset demonstrate that CodeSemanticsNN surpasses existing models in four key metrics: Precision, Recall, F1-score, and Accuracy.

The spread of fake news poses a serious threat to public trust and informed decision-making. The emergence of AI-generated fake news exacerbates this issue, as it can be produced more rapidly and convincingly than human-generated content. Addressing this issue, our paper introduces a robust approach to detect AI-generated fake news that is applicable across major disinformation domains: Politics and Elections, Health and Medicine, Science and Technology, and Entertainment and Celebrities. Our models differentiate between AI-generated and human-generated news articles while assessing their truthfulness. Utilizing large language models such as ChatGPT, we curated datasets spanning both AI and human generated fake and genuine news. Following extensive data preprocessing and the application of diverse feature extraction techniques, our models were trained using multiple machine learning algorithms. Our results show the feasibility of accurately identifying AI-generated fake news, thereby adding a significant layer of defense in combating misinformation across various sectors. In addition, we have explored the potential utility of transferable machine learning models trained on data from one domain (e.g., politics), when tested on another domain (e.g., health).

This research presents the Cross-Cultural Intelligent Language Learning System (CILS), a novel approach integrating Artificial Intelligence (AI) into language education to enhance cross-cultural communication. CILS utilizes advanced AI technologies to provide adaptive, personalized learning experiences that cater to the unique linguistic and cultural backgrounds of each learner. By dynamically adjusting content and methodology, CILS significantly improves linguistic proficiency and cultural understanding, essential for effective global interactions. The implementation of CILS in platforms such as Busuu and HelloTalk has demonstrated marked improvements in engagement and communication skills among learners. Empirical studies validate the system's effectiveness in real-world settings, showing enhanced learner performance and increased intercultural competence. Additionally, the Technology Acceptance Model (TAM) applied confirms that the usability and perceived usefulness of AI-driven systems strongly influence learner acceptance and sustained use. This study not only underscores the potential of AI in transforming language education but also highlights the critical role of cultural sensitivity in designing educational technologies.

Over the years, machine learning has emerged as a tool for automated translation and has been studied relentlessly for decades. RBMT, SMT, and NMT models have been used to achieve machine translation and the results have drastically improved from when research in this field first began. Although a few general-purpose translators such as Google Translate or Microsoft Translator have accurate translations compared to that of a human translator, many pieces of text containing highly technical terms or homonyms are often mistranslated completely. When considering the necessity and importance of translating technical patents from different domains, accuracy in translation is not something that can be compromised. This motivates the need to improve the performance of machine translation further. The scope of this paper covers three open-source machine translation models for the purpose of patent documentation translation from English to Japanese, evaluates their performance on patent data, and proposes a methodology that enabled us to improve one of the model’s BLEU score by 41.22%, achieving a BLEU score of 46.18.

The essence of cross-modal generation and retrieval modeling for image-text interactions lies in semantic consistency. Among these, cross-modal representation alignment serves as the foundational requirement for achieving cross-modal semantic consistency. The crux of our proposed method entails the collaborative training of an image captioning model(referred to as the ’captioner’) and a pair of contrastive encoders for image-text matching(referred to as the ’concoder’). This synergistic approach yields concurrent enhancements in concoder’s performance, captioner’s proficiency, and cross-modal semantic coherence. We coin the proposed method as ‘ReCap’. To begin, we initialize the concoder through knowledge distillation from a pre-trained model. During the training process, we use the output of the initialized concoder as input to a residual attention network, jointly training it with the captioner to achieve semantic consistency. Subsequently, we iteratively update the concoder during the image-text momentum encoding phase using the residual attention network, creating a closed-loop for semantic consistency resolution. Upon completion of training, the concoder and captioner modules can be used independently to perform tasks related to cross-modal retrieval and cross-modal generation of text and images. In order to substantiate the efficacy of our proposed method, we initially conducted empirical experiments encompassing image-text retrieval and image captioning tasks, employing a widely recognized benchmark dataset, MSCOCO. Subsequently, we assessed the fine-grained cross-modal alignment performance of the concoder through an image classification task on the iNaturalist 2018 dataset. The achieved performance metrics notably surpassed those achieved by several incumbent state-of-the-art models, thus validating the proficiency of our method. Finally, motivated by the practical requirements of handling the nature conservation image data, we performed caption annotation for the iNaturalist 2018 dataset. Subsequently, we trained the ReCap on this annotated data. Experimental results demonstrate that our proposed method can maintain semantic consistency between cross-modal retrieval and image caption generation for species with similar visual features but distinct semantics. This achievement signifies a meaningful exploration in the field of cross-modal semantic consistency representation, holding significant practical value in the domain of biological research.

Disaster issue consultation is crucial for effective emergency management, requiring timely and accurate information to support decision-making processes. This paper explores the integration of large language models (LLMs) with advanced prompt engineering to enhance the performance of AI systems in disaster management. We propose a novel multi-round prompt engineering approach that guides LLMs to iteratively refine their responses based on evolving disaster scenarios. Our method leverages diverse disaster-related datasets and employs a combination of accuracy metrics and a customized GPT-4 scoring system for evaluation. We conduct comprehensive experiments across multiple LLM platforms, including Qwen2, ChatGPT, Claude, and GPT-4, comparing our approach with baseline models and the Tree of Thoughts (ToT) method. The results demonstrate significant improvements in both accuracy and response quality, highlighting the effectiveness of our method in providing contextually relevant and actionable insights. Additional analysis confirms the robustness and generalizability of our approach across various disaster scenarios, establishing it as a valuable tool for enhancing disaster management practices.

The predominance of English and Latin-based large language models (LLMs) has led to a notable deficit in native Arabic LLMs. This discrepancy is accentuated by the prevalent inclusion of English tokens in existing Arabic models, detracting from their efficacy in processing native Arabic's intricate morphology and syntax. Consequently, there is a theoretical and practical imperative for developing LLMs predominantly focused on Arabic linguistic elements. To address this gap, this paper proposes ArabianGPT, a series of transformer-based models within the ArabianLLM suite designed explicitly for Arabic. These models, including ArabianGPT-0.1B and ArabianGPT-0.3B, vary in size and complexity, aligning with the nuanced linguistic characteristics of Arabic. The AraNizer tokenizer, integral to these models, addresses the unique morphological aspects of Arabic script, ensuring more accurate text processing. Empirical results from fine-tuning the models on tasks like sentiment analysis and summarization demonstrate significant improvements. For sentiment analysis, the fine-tuned ArabianGPT-0.1B model achieved a remarkable accuracy of 95%, a substantial increase from the base model's 56%. Similarly, in summarization tasks, fine-tuned models showed enhanced F1 scores, indicating improved precision and recall in generating concise summaries. Comparative analysis of fine-tuned ArabianGPT models against their base versions across various benchmarks reveals nuanced differences in performance, with fine-tuning positively impacting specific tasks like question answering and summarization. These findings underscore the efficacy of fine-tuning in aligning ArabianGPT models more closely with specific NLP tasks, highlighting the potential of tailored transformer architectures in advancing Arabic NLP.

Decision-making is a complex process of selecting an option from the given choices by analyzing the background information like risk, loss, and gain within the alternative options presented. It has been observed in earlier studies that people are prompt to make less rational decisions when choices are given in a language less known to them. Therefore, to understand the effect of languages on decision-making, we have questioned native Hindi speakers in French and English. French being the foreign language, and English as their second language. Thus, this effect of a non-native language brings to light the important role that the native language plays routinely in judgment and decision-making. In this paper, we developed a Neuropsychological assessment to decipher the effects on decision-making between choices when given in foreign language and second language in comparison with the native language of an individual, which is termed as foreign language effect(Fle). We have explored various possible situations to understand the foreign language effect(Fle) in decision-making and does this change translates when the decision is to be made in the second language. Our study concludes that the Foreign language is least affected by the intuitive biases, followed by the second language, and the native language is most affected by it.

Cross-linked polyethylene (XLPE) is a highly all-important material renowned for its exceptional physical and chemical properties, and it is extensively utilized in various industries such as con-struction, piping, cable insulation and medical equipment. The cross-linking process of polyethylene involves chemical or physical bonding of polymer chains to enhance its resistance to heat, chemicals and mechanical stress. This study offers a comprehensive overview of recent research and potential advancements in this field, with a particular focus on the development of efficient techniques and environmentally sustainable cross-linking systems. It evaluates the opportunities and challenges faced by cross-linked polyethylene materials across diverse applications, providing valuable insights for future research in this area.

Programming languages drive most if not all of modern problem- solving using computational methods and power. Research into new programming languages and methods is essential to the furthering or improvement of computational problem-solving by making the design, implementation, and application of automation to general or particu- lar problem-solving ever easier, more accessible, and more performant. General-purpose Programming Languages (GPLs) typically are designed to be purely domain agnostic—meaning they can be applied in any field, for any kind of problem. However, this typically also makes them hard and difficult to apply in problems where non-programmers or even ex- perts with little or no GPL programming skills are required to leverage programmatic problem solving capabilities, which is why Domain Specific Languages (DSLs) come into play; they are generally more fine-tuned to- wards improving human productivity and performance than that of the machine, while making solving particular, domain-oriented problems sim- pler. In this paper, we review the literature concerning how to design and then fully implement a new DSL, with special focus on a DSL for generic problem-solving leveraging Text Processing methods—essentially, a Text Processing Language (TPL). We consider leveraging the design research paradigm and philosophy as a systematic framework for guiding research into the development of new TPLs. This work presents for the first time, new unifying theory concerning general, but also TPL-specific language engineering theory and guiding frameworks—UPLT, PLEF & PLEf. We consider quantitative but also qualitative evaluation of programming lan- guages. The SOE framework is re-introduced for this purpose too. Finally, we set the pace for future theoretical and practical research into the field of programming language engineering especially with focus on TPLs.

Sign Language Recognition (SLR) aims to bridge speech-impaired and general communities by recognizing signs from given videos. Researchers still face challenges developing efficient SLR systems because of the video’s complex background, light illumination, and subject structures. Recently many researchers developed a skeleton-based sign language recognition system to overcome the subject and background variation of hand gesture signs. However, skeleton-based SLR is still under exploration due to the lack of information and annotations on hand key points. More recently, researchers included body and face information with the hand gesture for the SLR, but their performance and efficiency are unsatisfactory. We proposed a Multi-Stream Graph-based Deep Neural Network (SL-GDN) for a skeleton-based SLR system to overcome the problems. The main purpose of the proposed SL-GDN approach is to improve the efficiency and performance of the SLR system with a low computational cost based on the human body pose in the form of 2D landmark locations. In the procedure, firstly, we constructed a skeleton graph based on the selected 27 whole-body key points among 67 key points to solve the inefficiency problems. Then we proposed multi-stream SL-GDN to extract features from the whole-body skeleton graph for four streams. Finally, we concatenated the four different features and applied a classification module to refine the feature and recognize corresponding sign classes. Our data-driven and graph construction method increases the system’s flexibility and brings high generability to adapt various data samples. We used three large-scale benchmark SLR datasets to evaluate the proposed model: WLASL, AUTSL and CSL. The demonstrated performance accuracy table proved the superiority of the proposed model, and we believe this will be considered a great invention in the SLR domain.

Long unpunctuated texts containing complex linguistic sentences are a stumbling block to processing any low-resource languages. Thus, approaches that attempt to segment lengthy texts with no proper punctuation into simple candidate sentences are a vitally important preprocessing task in many hard-to-solve NLP applications. In this paper, we propose (PDTS) a punctuation detection approach for segmenting Arabic text, built on top of a multilingual BERT-based model and some generic linguistic rules. Furthermore, we showcase how PDTS can be effectively employed as a text tokenizer for unpunctuated documents (i.e., mimicking the transcribed audio-to-text documents). Experimental findings across two evaluation protocols (involving an ablation study and a human-based judgment) demonstrate that PDTS is practically effective in both performance quality and computational cost.

The development of language and communication patterns has been significantly impacted by the internet's quick advancement. The ability to instantly communicate globally and engage with people of different linguistic origins is one of the main advantages of using the internet. Internet use has significant positive effects on language growth, but it also brings with it drawbacks that need to be addressed. Online communication's casual atmosphere can occasionally cause grammar norms to deteriorate and non-standard language patterns to proliferate. With the information stated in this paper, the aim now is to collect literature on the benefits of internet usage and the evolution of language to provide substantive information in regard to this matter. In order to assist students in navigating the complexity of Internet communication, educational institutions should incorporate digital literacy into their curricula. This involves upholding strict requirements for traditional language proficiency while teaching students how to use digital technologies efficiently. The Internet should be used to support the revitalization and preservation of endangered languages. This can entail setting up community forums, digital archives, and online learning portals where language users can interact and exchange resources.

Natural language processing model (NLP) are used in chatbots to understand user input, interpret its meaning, and generate conversational responses to provide immediate and consistent assistance. This reduces problem-solving time and staff workload and increases user satisfaction. There are both rule-based chatbots, which use decision trees and are programmed to answer specific questions, and self-learning chatbots, which can handle more complex conversations through continuous learning about data and user interactions. However, only a few chatbots have been developed specifically for the Italian language. This work proposes an NLP model to develop a powerful and efficient Italian QA (Question Answering) chatbot that is easy to use for Italian Public Administration (PA). The proposed model is based on BERT (Bidirectional Encoder Representations from Transformer) architecture, where an Encoder/Decoder module and a Highway Network module have been added to perform more efficient filtering of input text. The Italian version of the Stanford Question Answering Dataset (SQuAD-IT) is used to test the proposed model. The proposed model is one of the first models developed for Italian language-specific chatbots.

This critical review delves into the often-overlooked aspect of early childhood language development: the potential impact of exposure to foreign languages. While multilingualism is widely celebrated for its cognitive and cultural benefits, emerging research suggests that early exposure to foreign languages may pose challenges for young children's linguistic development. The review synthesizes findings from 17 studies to explore the complexities surrounding this issue, including linguistic confusion, language delay, reduced vocabulary growth, impaired language processing, and socio-emotional implications. Additionally, mitigating factors and future directions for research and intervention are discussed. By shedding light on this topic, the review aims to inform educators, parents, and policymakers about the nuances of bilingual language acquisition and the importance of providing tailored support to optimize early childhood language development in multilingual contexts.

This review paper investigates the influence of gestures on foreign language (FL) vocabulary learning through a series of experiments conducted in our laboratory. The manipulation of the gesture-word relationship was a consistent factor across the studies. Firstly, we examined the impact of gestures on noun and verb learning. The results revealed that participants exhibited better learning outcomes when FL words were accompanied by congruent gestures compared to a no gesture condition. This suggests that gestures have a positive effect on FL learning when there is a meaningful connection between the words and the accompanying gestures. However, in general, the recall of words in conditions where gestures were incongruent or lacked meaning was lower than in the no gesture condition. This indicates that under certain circumstances, gestures may have a detrimental impact on FL learning. We analyzed these findings in terms of their implications for facilitating or interfering with FL acquisition. Secondly, we addressed the question of whether individuals need to physically perform the gestures themselves to observe the effects of gestures on vocabulary learning. To explore this, participants were divided into two experimental groups. In one group, participants learned the words by actively performing the gestures ("do" learning group), while the other group simply observed the gestures performed by others ("see" learning group). The processing of congruent gestures facilitated the recall of FL words in both the "see" and "do" learning groups. However, the interference effect associated with processing incongruent gestures was more pronounced in the "see" learning group than in the "do" learning group. Thus, the performance of gestures appears to mitigate the negative impact that gestures may have on the acquisition of FL vocabulary. In conclusion, our findings suggest that iconic gestures can serve as an effective tool for learning vocabulary in a FL, particularly when the gestures align with the meaning of the words. Furthermore, the active performance of gestures helps counteract the negative effects associated with inconsistencies between gestures and word meanings. Consequently, if a choice must be made, a FL learning strategy in which learners acquire words while making gestures congruent with their meaning would be highly desirable.

Stop words are very important for information retrieval and text analysis investigation. This study aimed to automatically analyze and detect stop words in texts in the Uzbek language. Because of the limited availability of methods for automatic search of stop words of texts in Uzbek we analyzed a newly prepared corpus. The Uzbek language belongs to the family of agglutinative languages. As with all agglutinative languages, we can explain that the detection of stop words in Uzbek texts is a more complex process than in inflected languages: In inflected languages, words such as auxiliary words, articles, prepositions can be included in the stop words group. In agglutinative languages, the meanings of such words are hidden in the text. Therefore, it is not appropriate to apply all known methods of stop words detection in inflected languages directly to agglutinative languages. In this work, the “School corpus” which contains 731156 Uzbek words has been investigated. The bigram method of analysis was applied to the corpus. We proposed the collocation method of detecting stop words of the corpus. We proposed the method of automatically detecting stop words of texts in Uzbek. It is shown that the collocation method is 6 times better than the bigram method.

Arabic is present in the Arab world and beyond. It is used as an official (or co-official) language in the Arab World (this refers to the twenty-two member states of the Arab League). Also, Arabic has the status of a national language in Mali, Niger, and Senegal. Besides, it is spoken in linguistic enclaves in Nigeria, Cyprus, Turkey, Uzbekistan, Iran, and Afghanistan. In addition, it is employed as the liturgical language in Muslim countries and countries with a Muslim minority all over Africa and Asia. As a result of the migration to Western countries since the end of the nineteenth century, Arabs and Arabic has been present in such countries. The presence of Arabs in Western countries raises the following question: Are these Arabs language maintainers or language shifters? The present article is an attempt to answer this question through reviewing a number of studies that have dealt with Arabic language maintenance among the Arabs living in Western countries (namely the United States of America, the United Kingdom, Canada, Australia, New Zealand, Sweden, Greece, and France), deducing from these studies the major trends in Arabic language maintenance among these Arabs, and providing a critique of the studies.

Hallyu or the Korean wave has sweeped through nations especially the Philippines. This exploratory study offers a dip into the effects of the Hallyu wave on a Filipino speaker through ambient exposure, consequently on the development of a Korean proto-lexicon through indirect vocabulary acquisition. Finally, a focus group discussion and a preliminary assessment tested out the waters of the effects of Hallyu on casual Filipino speakers. A thorough statistically comprehensive qualitative study on the acquisition framework is recommended to provide substantial evidence to support the framework.

The rise of abusive language on social media is a significant threat to mental health and 1 social cohesion. For Bengali speakers, the need for effective detection is critical. However, current 2 methods fall short in addressing the massive volume of content. Improved techniques are urgently 3 needed to combat online hate speech in Bengali. Traditional machine learning techniques, while 4 useful, often require large, linguistically diverse datasets to train models effectively. This paper 5 addresses the urgent need for improved hate speech detection methods in Bengali, aiming to fill the 6 existing research gap. Contextual understanding is crucial in differentiating between harmful speech 7 and benign expressions. Large language models (LLMs) have shown state-of-the-art performance in 8 various natural language tasks due to their extensive training on vast amounts of data. We explore the 9 application of LLMs, specifically GPT-3.5 Turbo and Gemini 1.5 Pro, for Bengali hate speech detection 10 using Zero-Shot and Few-Shot Learning approaches. Unlike conventional methods, Zero-Shot 11 Learning identifies hate speech without task-specific training data, making it highly adaptable to new 12 datasets and languages. Few-Shot Learning, on the other hand, requires minimal labeled examples, 13 allowing for efficient model training with limited resources. Our experimental results show that 14 LLMs outperform traditional approaches. In this study, we evaluated GPT-3.5 Turbo and Gemini 1.5 15 Pro on multiple datasets. To further enhance our study, we considered the distribution of comments 16 in different datasets and the challenge of class imbalance, which can affect model performance. The 17 BD-SHS dataset consists of 35,197 comments in the training set, 7,542 in the validation set, and 7,542 18 in the test set. The Bengali Hate Speech Dataset v1.0 & v2.0 includes comments distributed across 19 various hate categories: personal hate (629), political hate (1,771), religious hate (502), geopolitical hate 20 (1,179), and gender abusive hate (316). The Bengali Hate Dataset comprises 7,500 non-hate and 7,500 21 hate comments. GPT-3.5 Turbo achieved impressive results with 97.33%, 98.42%, and 98.53% accuracy. 22 In contrast, Gemini 1.5 Pro showed lower performance across all datasets. Specifically, GPT-3.5 Turbo 23 excelled with significantly higher accuracy compared to Gemini 1.5 Pro. These outcomes highlight a 24 6.28% increase in accuracy compared to traditional methods, which achieved 92.25%. Our research 25 contributes to the growing body of literature on LLM applications in natural language processing, 26 particularly in the context of low-resource languages.

The era of digital technology has brought about a substantial shift in language development, especially for younger generations who have grown up surrounded by it. Language development is impacted by digital media exposure in both positive and bad ways. Positively, users can interact with a variety of linguistic communities across the globe by using digital platforms, which offer a wealth of options for linguistic exposure and practice. This exposure can promote imaginative language use, increase vocabulary, and improve reading comprehension. Since the brevity and informality of digital communication frequently stress speed over correctness, there are worries that digital media could encourage shallow communication, shorter attention spans, and a deterioration in professional writing skills. This paper aims to gather literature about language development in the digital age. In order to make sure that technical breakthroughs support language development, standards for the responsible and balanced use of digital media in educational settings must also be developed. Teachers can better support their students' language development in a constantly changing digital environment by remaining knowledgeable and flexible.

Securing funding is a critical yet complex task for organizations and individuals. This study presents an innovative chatbot designed to streamline the process using advanced Natural Language Processing (NLP) techniques and, specifically, a Retrieval-Augmented Generation (RAG) pipeline optimized for real-world applications. Our chatbot assists users in identifying suitable public tenders for financial support through natural language queries and a comprehensive public data database. The chatbot operates in a two-stage interaction model, initially providing summarized tender information for exploratory brainstorming, followed by detailed data upon user selection. A custom filtering mechanism ensures that the user interface elements responsible for swapping the interaction stages are consistent with the responses generated by the conversational agent. Human-evaluation tests demonstrated an average accuracy of 90.4% in document retrieval, with an average of 2.11 interactions required to find a specific tender. User satisfaction, rated on a scale of 1 to 5, averaged 3.14 (±1.73), indicating generally positive user experience with room for improvement. This approach addresses challenges of relevance, accuracy, and conversational flow, resulting in a reliable chatbot that simplifies the process of finding funding opportunities.

In an era marked by rapid technological progress and global dynamics, the Neo-Language Acquisition and Learning Theory challenges conventional language acquisition paradigms through its conceptualization of 'Grit: The Unyielding Will to Connect,' emphasizing determination, motivation, and adaptability as the primary drivers of language learning, transcending age-related constraints and critical periods. This theory also underscores 'Self-Preservation: Language as the Canvas of Reality,' as language plays a pivotal role in preserving and conveying our individual and collective experiences. Recent global events have underscored the theory's relevance, prompting a reevaluation of language education in response to changing circumstances. Moreover, 'Techno-Training: Language Acquisition and Learning in the Digital Age' is integral to the theory, as it recognizes the influence of technology on modern language education. Beyond traditional methods, these three reshape our fundamental understanding of said theory. Drawing from historical evidence, psychological principles, and contemporary applications, they supported the conceptualization of the theory itself. Overall, the Neo-Language Acquisition and Learning Theory revolutionizes language education, spotlighting the power of motivation, determination, and adaptability to navigate the evolving landscape of language learning and acquisition.

This systematic review examines the potential of digital language learning in contributing to students' cognitive gains. The study reviews existing research on the relationship between digital language learning and cognitive benefits, with a focus on enhanced problem-solving skills, memory, and multitasking ability. The findings indicate that higher levels of digital competences correlate positively with language proficiency outcomes, suggesting that participants with greater digital skills achieve better language learning outcomes. Digital technologies offer interactive and engaging methods of learning, which can positively impact retention and understanding. However, the study also acknowledges the limitations of digital foreign language learning, such as the lack of face-to-face interaction and the need for high motivation and discipline. The research questions explored in this study are: (1) Does digital language learning contribute to cognitive gains in foreign language education? and (2) What are the pedagogical implications for cognitive improvement in digital foreign language education? The study employs the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) methodology to identify and analyze relevant research articles. The results of the review suggest that working with printed texts may be more effective for cognitive gains compared to electronic texts. Additionally, implementing more senses through digital language education appears to be beneficial for cognitive gains. The article concludes by discussing the implications of these findings and the need for further research in this area.

There is a serious concern regarding framing rules and guidelines to regulate the content on OTT platforms that needs urgent attention. In the Current Scenario, the use of vulgar language in the public domain on OTT platforms needs to take seriously. Some OTT platforms heavenly use foul language, which is open to children that cause a huge psychological impact on them. The use of vulgar language, including profanity and bad words, has to be regulated strictly. Web series uses obscene, abusive words and foul language with excessive usage. This review paper highlights the excessive use of swear words, profane language, and vulgar expletives on OTT platforms.

This study provides a detailed examination of Natural Language Processing (NLP) for the complexscript of Nepali. We analyze available data resources today and discuss relevant points includingcharacter encoding, advanced tokenization methods and morphological complexity. This allows us tocontrast Nepal’s unique language and technology ecosystem with Hindi and Thai in terms of NLPadvancements. Quantitative assessment of existing tools and resources is offered by this investigationwhich highlights immediate weaknesses as well as areas that need more effort. Various ethicalconcerns are addressed here while potential topics for future research as e-governance, healthcare oreducation with a focus on new domain-specific applications, and cross-lingual transfer learning aresuggested. The objective of this attempt is to enhance understanding of natural language processing(NLP) in Nepali language and beyond aimed at developing NLP technologies that are more efficient,inclusive, culturally appropriate across diverse linguistic communities.

In an era where the proliferation of large language models blurs the lines between human and machine-generated content, discerning text authenticity is paramount. This study investigates transformer-based language models—BERT, RoBERTa, and DistilBERT—in distinguishing human-written from machine-generated text. By leveraging a comprehensive corpus, including human-written text from sources such as Wikipedia, WikiHow, various news articles in different languages, and texts generated by OpenAI's GPT-2, we conduct rigorous comparative experiments. Our findings highlight the superior effectiveness of ensemble learning models over single classifiers in this critical task. This research underscores the versatility and efficacy of transformer-based methodologies for a wide range of natural language processing applications, significantly advancing text authenticity detection systems. The results demonstrate competitive performance, with the transformer-based method achieving an F-score score of 0.83 with RoBERTa-large (monolingual) and 0.70 with DistilBERT-base-uncased (multilingual).

LLMs are a compressed repository of a vast corpus of valuable information on which they are trained. Therefore, this work hypothesizes that LLMs such as Llama, Orca, Falcon, and Mistral can be used for misinformation detection by making them cross-check new information with the repository on which they are trained. Accordingly, this paper describes the findings from the investigation of the abilities of LLMs in detecting misinformation on multiple datasets. The results are interpreted using explainable AI techniques such as LIME, SHAP, and Integrated Gradients. The LLMs themselves are also asked to explain their classification. These complementary approaches aid in better understanding the inner workings of misinformation detection using LLMs and lead to conclusions about their effectiveness at the task.

In this review paper, we discuss the use of BERT, one of the most well-liked deep learning-based language models. The model's operation mechanism, key areas of applicability to text analytics tasks, comparisons with related models for each activity, and a description of certain proprietary models are all covered in this work. The data from several dozen original scientific studies that have been published in the last few years and have garnered the greatest interest from the scientific community were systematized in order to prepare this review. All researchers and students who wish to learn about the most recent developments in the field of natural language text analysis may find this survey helpful. Bidirectional Encoder Representations from Transformers, or BERT for short, is the subject of a thorough investigation that we present. The area of natural language processing holds significant importance in the creation of intelligent systems. To do a variety of activities, one must comprehend the sentence's correct meaning in order to produce the desired result. Computers have a hard time understanding languages because of how context constantly changes. The main challenge in natural language processing tasks is getting computers to understand text context, and BERT is seen as a revolution in this regard. It picks up the language and its meaning in a manner that is quite similar to how the human brain processes meaning from sentences. Its capacity to identify a word from both the left and right contexts of a sentence makes it special. A new era in the perception and comprehension of natural languages has been ushered in with the development of BERT, which could help computers understand natural languages more fully. This study aims to provide readers with a deeper knowledge of the BERT language model and how it is applied to different NLP tasks.

(1) Background: Attention Deficit Hyperactivity Disorder (ADHD) and Developmental Language Disorder (DLD) are neurodevelopmental disorders that affect various areas of chil-dren’s development, such as language. There is an emerging idea that ADHD is characterised by the presence of language difficulties, which could be explained by the high comorbidity between ADHD and DLD. The purpose of this study is to analyse the empirical evidence of language com-petence in children aged 6–17 years old, diagnosed with ADHD and/or DLD. (2) Method: Fifteen studies with experimental designs were identified from Scopus, PsycINFO and WoS databases, reporting on language skills in children diagnosed with ADHD and/or DLD. Studies relating ex-ecutive functioning to language skills in this target population were also included. (3) Results: The literature is heterogeneous and different components of language are also examined. Even though the results are contradictory they convincingly demonstrate that there are overlapping symptoms between ADHD and DLD, such as language skills and executive functions. (4) Conclusions: the differences in the samples limit the generalisability of the results. Therefore, this review highlights the importance of considering language skills when designing individualised interventions for the population with ADHD and DLD, both in comorbidity and in isolation.

while enjoying a relative positive revival in the digital age, Esperanto and the assessment of its language vitality is often problematic and prone to gross errors, and therefore a theoretical re-flection is required. Unlike other lesser-used languages, Esperanto is intergenerationally trans-mitted mainly outside the family, and so Fishman’s GIDS and subsequent scales such as the EGIDS cannot be applied straightforwardly for language vitality diagnosis and estimation. In particular, it is the social movement with its language activists who guarantee its vitality and developing, for more than a century. A key aspect is the digital domain, where the relatively good positioning of Esperanto does not reflect in a parallel increase in the number of activists. This paper critically assesses the digital language vitality of Esperanto on the basis of its language ide-ology and other sociolinguistic data as a starting point for a discussion to overcome the limits of Blanke’s (2006) scale of language vitality of Esperanto and its rivals. This assessment eventually leads to a more general reflection on the role of ‘coolification’, i.e., the positive effects on language attitudes and development thanks to digital visibility, its limits and the issue of placing it in the context of language vitality in general.

In this work, two plasmonic structures with two different periodic nanostructures (nanodisk and nanostrip arrays) separated from the gold layer by an ultrathin dielectric Al2O3 layer are proposed, and their optical properties are simulated as 3-dimensional models using COMSOL Multiphysics software tool. The optical responses, such as the amplification of the electric field and the scattering, absorption and extinction cross sections of the two structures, are investigated and compared. The results show that both structures show strong field enhancement in their gap layer, and the structure with the periodic array of metal nanodisks shows stronger field enhancement and larger absorption, extinction, and scattering cross sections in its dipole resonance wavelength, which is defined as a bright plasmonic mode. In addition, some weaker resonant modes are observed for both structures and the reason for their generation is dis-cussed. The analysis of different possible modes in such structures is crucial for their application in various fields.

Current language models have achieved remarkable success in NLP tasks. Nonetheless, individual decoding methods face difficulties in realizing the immense potential of these models. The challenge is primarily due to the lack of a decoding framework that can integrate language models and decoding methods. We introduce the DecoStrat which bridges the gap between language modeling and the decoding process in D2T generation. By leveraging language models, DecoStrat facilitates the exploration of alternative decoding methods tailored to specific tasks. We fine-tune the model on the MultiWOZ dataset to meet task-specific requirements and employ it to generate output(s) through multiple interactive modules of the framework. The Director module orchestrates the decoding processes, engaging the Generator to produce output(s) text based on the selected decoding method and input data. The Manager module enforces a selection strategy, integrating Ranker and Selector to identify the optimal result. Evaluations on the stated dataset show that DecoStrat effectively produces diverse and accurate output, with MBR variants consistently outperforming other methods. DecoStrat with the T5-small model surpasses some baseline. Generally, the findings highlight DecoStrat's potential for optimizing decoding methods in diverse real-world applications.

Patient symptoms play a critical role in disease progression and diagnosis, yet they are most often captured in unstructured clinical notes. This study explores use of large language models (LLMs) for extracting patient symptoms from clinical notes, comparing their performance against rule-based information extraction (IE) systems, like BioMedICUS. By fine-tuning an LLM on diverse corpora from multiple healthcare institutions, we aimed to improve symptom extraction accuracy and efficiency with symptoms related to acute and post-acute sequelae of SARS-CoV-2. We also conducted prevalence analysis to highlight significant differences in symptom prevalence across corpora and performed fairness analysis to assess the model's equity across race and gender. Our findings indicate that while LLMs can match the effectiveness of rule-based IE methods, they face significant challenges related to demographic bias and generalizability due to variability in training corpora. This evaluation revealed overfitting and insufficient generalization, especially when models were trained predominantly on limited datasets with single annotator bias. This study also revealed that LLMs offer substantial advantages in efficiency, adaptability, and scalability for biomedical IE, marking a transformative shift in clinical data extraction processes. These results provide real-world evidence of the necessity for diverse, high-quality training datasets and robust annotation processes to enhance LLM’s performance and reliability in clinical applications.

Despite the growing capabilities of large language models, concerns exist about the biases they develop. In this paper, we propose a novel, automated mechanism for debiasing through specified dataset augmentation in the lens of bias producers that can be useful in a variety of industries, especially ones that are “restricted” and have limited data. We consider that bias can occur due to intrinsic model architecture and dataset quality. The two aspects are evaluated using two different metrics we created. We show that our dataset augmentation algorithm reduces bias as measured by our metrics.

Kinetic modeling is an essential tool in systems biology research, enabling the quantitative analysis of biological systems and predicting their behavior. However, the development of kinetic models is a complex and time-consuming process. In this article, we propose a novel approach called KinModGPT, which generates kinetic models directly from natural language text. KinModGPT employs GPT-3 as a natural language interpreter and Tellurium as an SBML generator. We demonstrate the effectiveness of KinModGPT in creating SBML models from complex natural language descriptions of biochemical reactions. KinModGPT successfully generates valid SBML models from a range of natural language model descriptions of metabolic pathways, protein-protein interaction networks, and heat shock response. This article demonstrates the potential of KinModGPT in kinetic modeling automation.

Cross-cultural mobility is a phenomenon that is increasingly growing, and the resulting stress has become a severe health issue. Thus, we conducted a systematic review of articles reporting research on stress measures of cross-cultural mobility or acculturative stress, emphasizing its internal structure. We adopted the PRISMA procedures for scoping reviews (e.g., searching articles in databases), resulting in the inclusion 20 articles in the final analysis that present evidence of validity based on the internal structure of 16 measures. The most common factors identified were related to cultural stressors, language stressors, and discrimination stressors. After analyzing a cross-cultural mobility stress concept implicit in the definitions used in the articles, we found that most measures of acculturative stress did not evaluate it according to the Stress and Coping Model of Lazarus and Folkman. Most measures only focused on part of the phenomena (some estimated the stressors, others the coping strategies). Few took into account the physiological and psychological responses to internal or external stressors, and even fewer considered its positive aspects (eustress). Consequently, it is pivotal to develop measures that take into account the multiple dimensions of the cross-cultural mobility stress. Other results (e.g., validity evidence of the measures) and limitations of this systematic scoping review are presented and discussed.

The advancement of agricultural technology is intrinsically linked to the evolution of the agricultural industry, with the latter being contingent upon technological progress for its sustained enhancement. In the context of China, a nation of significant agricultural stature, the globalization of agricultural science and technology (Agri-Sci-Tech) has emerged as a pivotal narrative within the country's agricultural growth trajectory. The strategic alignment of China's Agri-Sci-Tech industry with its global counterparts is driven by the ambition to assimilate sophisticated agricultural production techniques and managerial acumen from its Western counterparts, thereby catalyzing the international expansion of the nation's Agri-Sci-Tech endeavors. This scholarly discourse delves into the imperative of interdisciplinary convergence, underscoring the paradigm and intrinsic attributes associated with the cultivation of agricultural expertise. It scrutinizes the prevailing state of foreign language instruction within the academic curriculum, positing strategic interventions and recommendations for the development of a robust agricultural foreign language talent cultivation framework. The treatise accentuates the criticality of cultivating a multifaceted agricultural talent pool proficient in foreign languages, advocating for a "professional+foreign language" model that facilitates international dialog within China's Agri-Sci-Tech industry and bolsters the creation of globally recognized brands. Moreover, the cultivation of a "foreign language+professional" composite talent model is posited as a transformative solution to the existing impasse in foreign language education in China, offering a novel pathway for educational innovation and global competitiveness within the agricultural domain.

The rapid advancement of technology has revolutionized language learning, introducing innovative methods that depart from traditional instructional approaches. This study employs a mixed-methods research design to examine the impact of chatbot-based language learning support, adaptive learning algorithms, and virtual reality language immersion on the language learning proficiency and self-regulated learning skills of English as a Foreign Language (EFL) learners. The research design includes quantitative analysis of language proficiency scores and qualitative exploration of learner experiences with the technological interventions. The theoretical implications of this study are rooted in constructivist and socio-cultural learning theories, which underpin the design and implementation of the technological interventions. The triangulation of qualitative and quantitative data revealed that the participants' positive perceptions of the effectiveness of chatbot-based language learning support were supported by the quantitative results, with the variable "chat-bot based support" demonstrating a substantial mean difference compared to other groups. This convergence of findings reinforces the positive influence of chatbot-based support on language learning outcomes and highlights the importance of integrating theoretical perspectives with empirical evidence to gain a comprehensive understanding of the impact of technological interventions on language learning outcomes for EFL learners. The study's findings provide insights into the potential of these technological interventions to optimize language learning outcomes for EFL learners and promote autonomous learning behaviors.

Large Language Models (LLMs) have emerged as powerful tools in the domain of artificial intelligence, specifically enhancing natural language processing capabilities. These models leverage extensive datasets and sophisticated algorithms to automate and enhance tasks traditionally performed by humans, thereby revolutionizing innovation and entrepreneurship. LLMs accelerate product development, streamline business operations, and enable precise and rapid decision-making, all of which are crucial for maintaining competitiveness in dynamic markets. This paper categorizes the applications of LLMs in innovation and entrepreneurship into three main areas: technological innovation, strategic decision-making, and process automation. By exploring various integrations of LLMs in entrepreneurial ventures, this work offers both theoretical insights and practical examples, underscoring the transformative impact of LLMs in shaping modern business landscapes.

Texture has long been considered an important attribute for food acceptance. However, which specific textural characteristics contribute to overall acceptance of a food is not well understood. It has been suggested that texture contrasts and combinations are a universal feature in giving foods a desirable texture, yet this notion is largely based upon anecdotal data. This study uses multiple survey research methods to assess the importance of texture contrast and combinations across cultures (Poland, U.S.A., and Singapore). Participants (n = 288) completed a survey that included overt measures of food texture contrast importance as well as free response questions regarding texture. The overall importance of texture for food liking was not different across the populations. However, the participants from Singapore and Poland gave more importance to a desirable food having multiple textures than the U.S.A. cohort. When looking at free responses, participants were twice as likely to mention combinations (multiple textures) with a texture contrast when describing foods they liked, in comparison to foods they disliked. This was observed across all 3 cultures. However, the type and quantity of texture terms used within combinations were different among cultures. For instance, Asians enjoyed more texturally diverse food combinations than the other two cultures. These findings highlight the importance of texture contrasts and combinations in three distinct cultures.

This paper presents a novel CNN-based architecture, referred to as Q-Net, to learn local feature descriptors that are useful for matching image patches from two different spectral bands. Given correctly matched and non-matching cross-spectral image pairs, a quadruplet network is trained to map input image patches to a common Euclidean space, regardless of the input spectral band. Our approach is inspired by the recent success of triplet networks in the visible spectrum, but adapted for cross-spectral scenarios, where for each matching pair there are always two possible non-matching patches; one for each spectrum. Experimental evaluations on a public cross-spectral VIS-NIR dataset shows that the proposed approach improves the state-of-the-art. Moreover, the proposed technique can also be used in mono-spectral settings, obtaining a similar performance to triplet network descriptors, but requiring less training data.

As large language models (LLMs) continue to advance, evaluating their comprehensive capabilities becomes significant for their application in various fields. This research study comprehensively evaluates the language, vision, speech, and multimodal capabilities of GPT-4o. The study employs standardized exam questions, reasoning tasks, and translation assessments to assess the model's language capability. Additionally, GPT-4o's vision and speech capabilities are tested through image classification and object recognition tasks, as well as accent classification. The multimodal evaluation assesses the model's performance in integrating visual and linguistic data. Our findings reveal that GPT-4o demonstrates high accuracy and efficiency across multiple domains in language and reasoning capabilities, excelling in tasks that require few-shot learning. GPT-4o also provides notable improvements in multimodal tasks compared to its predecessors. However, the model shows variability and faces limitations in handling complex and ambiguous inputs, particularly in audio and vision capabilities. This paper highlights the need for more comprehensive benchmarks and robust evaluation frameworks, encompassing qualitative assessments involving human judgment as well as error analysis. Future work should focus on expanding datasets, investigating prompt-based assessment, and enhancing few-shot learning techniques to test the model's practical applicability and performance in real-world scenarios.

Sustainable development and education in sustainable development (ESD) are crucial and interconnected topics under wide discussion today. Young adults need to be educated in how to help bring about change. Thus, the dynamic relationship between school and home is important. In education, use could be made of English language classes, especially since English is a global language that enables access to the sustainability literature and facilitates discussion in global conferences and meetings. Consequently, English as a foreign language (EFL) students could gain confidence from being able to understand and use the terminology of, for example, sustainability. In this paper, the use of competence-based language teaching (CBLT) is proposed as a means of introducing sustainability topics into EFL writing classes at a university in Saudi Arabia. Students’ competence in sustainable development is therefore considered based on their ability to write about suggested sustainable development topics, measured on a scale for five dimensions of ESD proposed by Michelsen and Fischer (2017). The results demonstrate that the students possessed competence in sustainable development and intended to participate in its implementation. Thus, recommendations are made for the stakeholders in the education sector to include sustainable development topics as an initial offering in the curricula of various specialties using the CBLT approach.

Natural language processing (NLP) is being widely used globally for a variety of value-creation tasks ranging from chat-bots and machine translations to sentiment and topic analysis and multilingual large language models (LLMs). However, most of the advances are initially implemented within the English language framework, and it takes time and resources to develop comparable resources in other languages. The advances in machine translations have enabled the rapid and effective conversion of content in global languages into English and vice-versa. This creates potential opportunities to apply English language NLP methods and tools to other languages via machine translations. However, although this idea is powerful, it needs to be validated and processes and best practices need to be developed and kept updated. The present research is an effort to contribute to the development of best practices and an evaluation framework. We present a systematic and repeatable state-of-the-art process to evaluate the viability of applying English language sentiment analysis tools to Italian text by using multiple English language machine translation mechanisms such that it can be easily extended to other languages. hor[RU,RA]{\large Richard Anderson} \address[RU]{\large Rutgers University, USA} \address[RA]{\large rick.anderson@rutgers.edu} \author[RU]{\large Carmela Scala} \author[RU]{\large Jim Samuel} \author[UC]{\large Vivek Kumar} \address[UC]{\large University of Cagliari, Italy} \author[RU]{\large Parth Jain}

Large Language Models (LLMs) have revolutionized the field of Artificial Intelligence with their ability to understand and generate natural language discourse. This has led to the use of LLMs in various creative fields such as music, art, and storytelling, which has sparked a debate on the impact of LLMs on human creativity. This article explores the cyclic effect of LLMs on human creativity, where LLMs can generate an ever-evolving cycle of creative output from both humans and machines. The article also highlights the importance of responsible and ethical use of LLMs, including privacy and copyright issues with the training data used by LLMs. The article emphasizes the need for transparency, data security measures, and AI governance policies to protect user data and ensure the safe use of LLMs. It also calls for the development of educational materials and resources to increase public understanding of LLMs and their ethical implications. The article concludes by highlighting the potential of LLMs as powerful tools for communication and education, but also emphasizes the need for ethical considerations to ensure the responsible and beneficial use of LLMs in society.

Micro-level language policy and planning (LPP) primarily concerns local actors' decision-making on matters in relation to language(s) and its users. Despite a growing body of literature focusing on micro language planning in educational settings, there is a scarcity of research examining early childhood education settings such as micro-level LPP context for young English language learners. By adopting a case study approach, the present study examined the educators' enactment of agency in micro-planning the English language education policy (LEP) in one Chinese kindergarten and the associated factors shaping their agency. Our study revealed that the sustainable implementation of the kindergarten English LEP depended on the principal, native English-speaking teachers, and the Chinese assistant teachers' different degrees of agency. Also, the research findings indicated an array of contextual and individual factors nested in a hierarchical structure that facilitated, guided, and constrained the educators' agency in a role-and circumstance-dependent manner. This study contributes to the pertinent literature by casting nuanced light on the different educators' contributions to the micro-level LPP against a national policy that does not endorse early-year English language education.

Paraphrase Generation is one of the most important and challenging tasks in the field of Natural Language Generation. The paraphrasing techniques help to identify or to extract/generate phrases/sentences conveying the similar meaning. The paraphrasing task can be bifurcated into two sub-tasks namely, Paraphrase Identification (PI) and Paraphrase Generation (PG). Most of the existing proposed state-of-the-art systems have the potential to solve only one problem at a time. This paper proposes a light-weight unified model that can simultaneously classify whether given pair of sentences are paraphrases of each other and the model can also generate multiple paraphrases given an input sentence. Paraphrase Generation module aims to generate fluent and semantically similar paraphrases and the Paraphrase Identification systemaims to classify whether sentences pair are paraphrases of each other or not. The proposed approach uses an amalgamation of data sampling or data variety with a granular fine-tuned Text-To-Text Transfer Transformer (T5) model. This paper proposes a unified approach which aims to solve the problems of Paraphrase Identification and generation by using carefully selected data-points and a fine-tuned T5 model. The highlight of this study is that the same light-weight model trained by keeping the objective of Paraphrase Generation can also be used for solving the Paraphrase Identification task. Hence, the proposed system is light-weight in terms of the model’s size along with the data used to train the model which facilitates the quick learning of the model without having to compromise with the results. The proposed system is then evaluated against the popular evaluation metrics like BLEU (BiLingual Evaluation Understudy):, ROUGE (Recall-Oriented Understudy for Gisting Evaluation), METEOR, WER (Word Error Rate), and GLEU (Google-BLEU) for Paraphrase Generation and classification metrics like accuracy, precision, recall and F1-score for Paraphrase Identification system. The proposed model achieves state-of-the-art results on both the tasks of Paraphrase Identification and paraphrase Generation.

The purpose of this systematic review is to provide second language acquisition (SLA) researchers with an overview of research trends in this field in the last ten years (2009-2019). In doing so, three international peer-reviewed journals, Studies in Second Language Acquisition, Language Teaching Research, and The Modern Language Journal, were selected. 150 articles were systematically selected and analyzed. The analysis of data resulted in identifying six descriptive themes. Results showed that some areas of second language acquisition still need further exploration while some areas are of great interest for researchers. Some suggestions for future research as well as implications of the study were discussed in detail.

Chaotic theory is commonly being researched for application in image encryption scheme (IES). In this paper, a novel two-dimensional cross hyperchaotic Sine-modulation-Logistic map (2D-CHSLM) based on the famous Sine and Logistic maps. The hyperchaotic behaviors of 2D-CHSLM is testified with the help of their bifurcation diagrams, trajectory plots, Lyapunov exponents, sample entropy, C0 complexity, permutation entropy and 0-1 test. A new bit-level IES with traditional encryption structure is proposed utilizing 2D-CHSLM. The 2D-CHSLM-IES performs a 2D-CHSLM-based bit-level confusion using zig-zag transform and a 2D-CHSLM-based cross coupled diffusion operations for generating a highly secure cipher-image. Then the simulations and security analyses are further carried out with the help of key space, key sensitivity, histogram, correlation, information entropy, differential attack, noise and data loss attacks, prove that the security of the proposed 2D-CHSLM-IES

Since the introduction of Cross-laminated Timber (CLT) in Austria in the early 1990s, the adoption of this 90°-crosswise-laminated product has seen exponential growth worldwide. Compared to traditional laminated timber products (e.g. glulam), CLT provides improved dimensional stability, but with reduced out-of-plane bending stiffness. To improve the bending stiffness, while maintaining relative dimensional stability, a modified orientation of the inner layers in a diagonal direction can be used. This novel product is Diagonal-Cross-laminated Timber (DCLT), a composite timber product, consisting of inner layers which are rotated at different angle-ply orientations between 0 and 90 degrees to the outer layers. To properly model the out-of-plane bending behavior of the DCLT, analytical models and Finite Element Analysis (FEA) were used and the results were validated by third-point bending tests performed on DCLT panels with angle-ply orientations of 10°, 20°, 40°, 70°, and a conventional CLT 90° panel. The results indicate that DCLT panels with angle-ply cross-layers have a structural advantage in out-of-plane bending over traditional CLT (90°) panels. The development of DCLT and its introduction to the industry could enable the use of lower-quality timber that would not otherwise satisfy structural requirements for CLT.

In cross-country skiing the time difference between a race winner and the person coming second is typically very small. Since much of the energy is spent on overcoming resistive forces, a relatively small reduction of these can have a significant impact on the results. The resistive forces come partly from the friction in the tribological interface, between the ski and the snow, and as with many tribological applications the characterisation of its origin, plays an important role in determining the frictional properties. Also in cross-country ski friction, there are several scales impacting the frictional performance, with the major contributors being the ski-camber profile and ski-base structure. Macro-scale measurements of the ski's camber profile under load, are often used to determine how adequate the ski is for a specific condition. The characteristic properties usually obtained are, the force required to collapse the ski to a certain camber height, the topography of the kick-wax zone, and by simple means a determined lengths of the frictional interface, i.e., the apparent contact length. To this date, there are some mathematical models, but there is no robust way of determining the macro-scale contact properties between a cross-country ski and a counter surface using simulations. In the present paper an Artificial neural networks (ANN) is trained to predict the ski-camber profile for various loads placed at different positions, and a well established deterministic approach is used to simulate the contact between the ANN-predicted ski-camber profile and a linearly elastic body with a flat surface, representing the snow. The results suggest that this method is feasible for the determination of the apparent contact characteristics of different skis. Moreover, we show that the apparent contact area does not linearly depend on the load, and that the elastic properties of the counter surface also has a large impact on the apparent contact area and the average apparent contact pressure.

This study explores advanced feature engineering and semantic enrichment methods to enhance text classification, focusing on detecting figurative language in tweets. The novel features introduced, Syno\_Lower\_Mean and Syn\_Mean, measure the use of uncommon synonyms and the mean frequency of synonyms, capturing semantic richness crucial for detecting figurative expressions. Using resources like SenticNet and Framester, we enrich our feature set with sentiment and frame semantic information. Our approach includes extensive data preprocessing, sophisticated feature selection, and implementing various classification models, such as SVM, KNN, Logistic Regression, Decision Trees, Random Forest, BERT, and LSTM networks. We rigorously evaluate each model's performance to assess the effectiveness of our features and enrichment methods. Putting emphasis on model explainability, we use decision tree analysis, feature importance analysis, and the TREPAN algorithm to approximate SVM decisions. Although we focus on figurative language detection, our methods have broader implications for various NLP text classification tasks. Our findings demonstrate significant improvements in classification accuracy and interpretability through innovative feature design and dataset enrichment.

Purpose. This article examines the use of English medium instruction (EMI) for teaching Japanese as a foreign language (JFL) by non-native speakers with a focus on multilingual classrooms. The study also explores teachers’ positive and negative beliefs about using EMI in classroom settings for JFL instruction.Methods and procedure. Two hundred sixty-one non-native Japanese language teachers worldwide voluntarily participated in the survey, answering the questionnaire (Google Forms and Jotforms) used to gather data. Both qualitative and quantitative methods were employed. The research instrument was piloted before the main study and was found to be effective and adequate to elicit the desired data. The research questions aimed to identify whether there were any relationships between the use of EMI and the multilingual classroom. Findings. The results showed a clear correlation between the extensive use of EMI and the multilingual character of JFL multilingual classrooms. Translanguaging turned out to be a common practice adopted by non-native Japanese teachers regardless of the primary language of instruction. The article concludes that EMI can be a valuable tool for JFL instruction in multilingual classrooms. Based on the investigation of the teachers’ beliefs, the study results showed a changing positive attitude towards English employed in JFL classrooms. Implications for research and practice. The findings can be used further to investigate EMI in JFL instructional practices in multilingual classrooms, to improve the quality of JFL instruction, and to facilitate the integration of multilingual education into foreign language teaching. Future research can explore the effectiveness of EMI in different JFL contexts and investigate the impact of EMI on students’ language learning outcomes.

According to a recent study by OpenAI, Open Research, and the University of Pennsylvania, large language models (LLMs) based on artificial intelligence (AI), such as Generative Pretrained Transformers (GPTs), may have potential implications on the job market, specifically regarding job occupations that demand writing or programming skills. The research points out Interpreters and Translators as one of the main job occupations with greater exposure to AI in the US job market (76.5%). This article, following a mixed-methods survey-based research, provides insights into the Portuguese Language Service Providers (LSPs) awareness and knowledge about AI, specifically regarding neural machine translation (NMT) and large language models (LLM), its actual use and usefulness, as well as their potential influence on work performance and labour market. The results show that most professionals are unable to identify if AI and/or automation technologies support the tools that are most used in the profession. The usefulness of AI is essentially low to moderate and the professionals who are less familiar with it and less knowledgeable also demonstrate lack of trust in it. Two thirds of the sample estimate negative or very negative effects of AI in the profession, expressing as main concerns the devaluation and replacement of experts, the reduction of income, and the reconfiguration of the career of translator to mere post-editors.

The dominance of social media has added to the channels of bullying to perpetrators. Unfortunately, cyberbullying (CB) is the most prevalent phenomenon in today’s cyber world and is a severe threat to the mental and physical health of citizens. This opens the need to develop a robust system to prevent bullying content from online forums, blogs, and social media platforms to manage the impact in our society. Several machine learning (ML) algorithms have been proposed for this purpose. However, their performances are not consistent due to high class imbalance issue and generalisation. In recent years, large language models (LLM) like BERT and RoBERTa have achieved state of the art (SOTA) results in several natural language processing (NLP) tasks. Unfortunately, the LLMs have not been applied extensively. In our paper, we explored the use of these models for cyberbullying (CB) detection. We have prepared a new dataset (D2) from existing studies (Formspring and Twitter). Our experimental results for dataset D1 and D2 showed RoBERTa outperformed other models.

This paper addresses the grammatical challenges associated with the development of clause complexity, focusing on the performance of a group of monolingual Spanish-speaking schoolchildren with Specific Language Impairment/Developmental Language Disorder (SLI/DLD) in a longitudinal corpus of oral narrative samples. The study examines the presence of interclause relations of subordination and equivalence (hypotaxis and parataxis) in language samples of two groups: an experimental group made up of 24 schoolchildren with SLI/DLD and a control group made up of 24 schoolchildren with typical development (TD). The results show that while both groups use parataxis as the most common relation between clauses in all school grades, there is a significant decrease in paratactic relations and a significant increase in hypotactic relations from first to fourth grade of primary education. Although the development patterns are highly similar, the SLI/DLD group shows greater difficulties in mastering more complex (hypotactic) relations in fourth grade compared to the control group, indicating that they are less sophisticated in the use of these types of complex relations. These findings suggest that focused support on the most complex structures is needed towards the fourth grade of primary education, given the demands of the school academic register from 6 and 7 years of age, and the potential problems that the development of clause complexity can cause in school-age children.

Large language model (LLM) is a representation of a major advancement in AI, and has been used in multiple natural language processing tasks. Nevertheless, in different business scenarios, LLM requires fine-tuning by engineers to achieve satisfactory performance, and the cost of achieving target performance and fine-tuning may not match. Based on the Baidu STI dataset, we study the upper bound of the performance that classical information retrieval methods can achieve under a specific business, and compare it with the cost and performance of the participating team based on LLM. This paper gives an insight into the potential of classical computational linguistics algorithms, and which can help decision-makers make reasonable choices for LLM and low-cost methods in business R&D.

The purpose of this study was to analyze the cross-linguistic influence of previously learned languages and working memory capacities on the vocabulary performance of two different typological languages. The objectives of this study were (1) to compare the working memory capacities of bilingual adults in relation to the vocabulary performance of two different languages never learned by the participants, and (2) to analyze to what extent the typology of previously learned languages influences working memory capaci-ties in relation to the vocabulary performance of French and Nahuatl. A group of 43 Mexican-Spanish college students participated in this experimental study. The participants completed a series of working memory tasks in Nahuatl and French. The results showed that working memory capacities were lower in Nahuatl than in French. Thus, a correlation was found between their first and second language and vo-cabulary performance in French. We can consider the influence of previously learned languages as a significant factor in vocabulary acquisition in accordance with the participants' working memory capacities.

We formulate a more straightforward, symmetry-based techniques in manually computing the determinant of any n×n matrix by revisiting Dodgson’s condensation method and strategically applying elementary row operations and the definition and properties of determinants. The result yields a more simplified mnemonical algorithm than the usual reduction by elementary row operations and co-factor expansion and with minimal terminal divisions performed compared to Dodgson’s internal divisions.

This article presents the results of a cross-disciplinary applied study exploring investors’ protections in the context of distributed ledger technology (DLT) smart contracts. Fusing legal, business, and technical perspectives, we developed a framework for protection from non-commercial risks for stablecoins, taking advantage of DLT and AI. A key concept we propose is the monitoring of disinformation and fake news to prevent malicious parties from abusing our solution. Based on the similarities between central bank digital currencies (CBDCs) and stablecoins, we propose scaling up our results to all future internet investments performed without face-to-face contact between the investor and the company.

The danger is still very large from cross site scripting attacks. When designing web applications We must follow as much as we can prevention rules and don’t leave any loophole to our programs. Experience is a great factor for programmers to know these attacks and for a trainee programmer is a difficult task to spot all the weak points. In this article we present a tutorial on launching an XSS attack and also we propose simple solutions.

Sentinel-1 (S1) extra-wide (EW) swath data in cross-polarization (horizontal-vertical, HV or vertical-horizontal, VH) are strongly affected by the scalloping effect and thermal noise, particularly over areas with weak backscattered signals, such as sea surfaces. Although noise vectors in both the azimuth and range directions are provided in the standard S1 EW data for subtraction, the residual thermal noise still significantly affects sea ice detection by the EW data. In this paper, we improve the denoising method developed in previous studies to remove the additive noise for the S1 EW data in cross-polarization. Furthermore, we propose a new method for eliminating the residual noise (i.e. multiplicative noise) at the sub-swath boundaries of the EW data, which cannot be well processed by simply subtracting the reconstructed 2-D noise field. The proposed method of removing both the additive and multiplicative noise was applied to EW HV-polarized images processed using different Instrument Processing Facility (IPF) versions. The results suggest that the proposed algorithm significantly improves the quality of EW HV-polarized images under various sea ice conditions and sea states in marginal ice zone (MIZ) of the Arctic. This is of great support for the utilization of cross-polarization SAR images in wide swaths for intensive sea ice monitoring in polar regions.

Chikungunya virus (CHIKV) is an alphavirus that causes febrile illness punctuated by severe polyarthralgia. After the emergence of CHIKV in the Western Hemisphere, multiple reports of congenital infections were published that documented neurological complications, cardiac defects, respiratory distress, and miscarriage. The Western Hemisphere is endemic to several alphaviruses and whether antigenic cross-reactivity can impact the course of infection has not been explored. Recent advances in biomedical engineering have produced cell co-culture models that replicate the cellular interface at the maternal fetal axis. We employed a trans-well assay to determine if cross-reactive antibodies affected the movement and replication of CHIKV across placental cells and into an embryoid body. The data show that antibodies to Venezuelan equine encephalitis virus (VEEV) significantly reduced CHIKV viral load in embryoid bodies. The data highlight that viral pathogenesis can be cell-specific and that exploiting antigenic cross-reactivity could be an avenue for reducing the impact of congenital CHIKV infections.

The advent of Large Language Models (LLMs) has significantly advanced natural language processing (NLP), yet their application to historical texts remains challenging due to archaic language, distinct terminologies, and varied contextual backgrounds. This study introduces Historical Domain Large Language Models, designed to bridge this gap by adapting LLMs for better comprehension and processing of historical data. Our approach leverages context-aware and task-specific prompts to enhance model performance in tasks such as named entity recognition (NER), sentiment analysis, and information extraction within historical contexts. We propose an iterative refinement process to improve prompt quality and model outputs continuously. Instruction tuning on newly collected evaluation data ensures our methods' efficacy, avoiding biases from previously used datasets. Evaluations using GPT-4 demonstrate significant improvements in handling historical texts, underscoring the potential of our approach to unlock profound insights from historical data. This work highlights the importance of tailored LLM adaptations for specialized domains, offering a robust framework for future research in historical NLP.

This study evaluates the ability of six popular chatbots; ChatGPT-3.5, ChatGPT-4.0, Gemini, Copilot, Chatsonic, and Perplexity to provide reliable answers to questions concerning keratoconus. Methods: Chatbots responses were assessed using mDISCERN and Global Quality Score (GQS) metrics. Readability was evaluated using nine validated readability assessments. We also addressed the quality and accountability of websites from which the questions originated. Results: We analyzed 20 websites, 65% "Private practice or independent user" and 35% "Official patient education materials." The mean JAMA Benchmark score was 1.5±0.68, indicating low accountability. Reliability, measured using mDISCERN, ranged from 42.9±3.16 (ChatGPT-3.5) to 46.95±3.53 (Copilot). The most frequent question was "What is Keratoconus?" with 70% of websites providing relevant information. This received the highest mDISCERN score (49.33±4.96) and a relatively high GQS score (3.50±0.55), with an Automated Readability Level Calculator score of 13.17±2.13. Moderate positive correlations were determined between the website numbers and both mDISCERN (?=0.265,?=0.25) and GQS (?=0.453,?=0.05) scores. The quality of information, assessed using the GQS, ranged from 3.01±0.51 (ChatGPT-3.5) to 3.3±0.65 (Gemini) (p=0.34). The differences between the texts were statistically significant. Gemini emerged as the easiest to read, while ChatGPT-3.5 and Perplexity were the most difficult. Based on mDISCERN scores, Gemini and Copilot exhibited the highest percentage of responses in the "Good" range (51-62 points). For the GQS, the Gemini model exhibited the highest percentage of responses in the "Good" quality range, with 40% of its responses scoring 4-5. Conclusions: While all chatbots performed well, Gemini and Copilot showed better reliability and quality. However, their readability often exceeded recommended levels. Continuous improvements are essential to match information with patients' health literacy for effective use in ophthalmology.

RNA sequencing techniques, like bulk RNA-seq and Single Cell (sc) RNA-seq, are critical tools for the biologist looking to analyze the genetic activity/transcriptome of a tissue or cell during an experimental procedure. Platforms like Illumina's next-generation sequencing (NGS) are used to produce the raw data for this experimental procedure. This raw FASTQ data must then be prepared via a complex series of data manipulations by bioinformaticians. This process currently takes place on an unwieldy textual user interface like a terminal/command line that requires the user to install and import multiple program packages, preventing the untrained biologist from initiating data analysis. Open-source platforms like Galaxy have produced a more user-friendly pipeline, yet the visual interface remains cluttered and highly technical, remaining uninviting for the natural scientist. To address this, SeqMate is a user-friendly tool that allows for one-click analytics by utilizing the power of a large language model (LLM) to automate both data preparation and analysis (differential expression, trajectory analysis, etc). Furthermore, by utilizing the power of generative AI, SeqMate is also capable of analyzing such findings and producing written reports of upregulated/downregulated/user-prompted genes with sources cited from known repositories like PubMed, PDB, and Uniprot.

In this paper, we introduce Syntax-Enhanced Transformer Model (SET), a groundbreaking approach in the realm of Transformer-based language modeling that seeks to redefine the boundaries of linguistic analysis and comprehension. SET innovatively combine (i) the well-established high-level performance, scalability, and adaptability of traditional Transformers with (ii) a sophisticated analysis of syntactic structures. This synergy is enabled by a novel attention mechanism tailored to parse syntactic nuances and a deterministic process adept at transforming linearized parse trees into meaningful linguistic representations. Our comprehensive experiments reveal that SET significantly advance the field by surpassing existing benchmarks in sentence-level language modeling perplexity. They exhibit exceptional proficiency in tasks that require an acute awareness of syntax, setting new standards for language models in understanding complex linguistic structures. Furthermore, SET demonstrate an enhanced capability to grasp nuanced linguistic patterns that have traditionally been challenging for standard Transformer models. However, our studies also uncover a unique aspect of SET: while they excel in sentence-level tasks, their representation of sentences as singular vectors—owing to the syntactic composition constraints intrinsic to their design—introduces certain limitations in document-level language modeling. This observation points to an intriguing area for future exploration; it suggests the potential need for an alternative or complementary memory mechanism within Transformer models, one that functions independently from, yet in harmony with, syntactic structures. Such a mechanism could be pivotal in enhancing the model's ability to comprehend and process long-form texts effectively. In conclusion, SET mark a significant stride in the journey towards more sophisticated, syntax-aware language models. They offer promising insights into the integration of deep linguistic knowledge with cutting-edge machine learning techniques, potentially opening doors to a new era of natural language understanding and processing.

This paper discusses some of the most common misconceptions about large language models (LLMs), including the belief that they are sentient or conscious, that they are always accurate, and that they can replace human creativity. The paper also proposes a strategy for overcoming these misbeliefs, which involves educating the public about the capabilities and limitations of LLMs, developing guidelines for the responsible use of LLMs, and conducting more research to understand the potential impact of LLMs on society.

Sign language recognition is essential in hearing-impaired people’s communication. Sign language recognition is an important concern in computer vision and has been developed with rapid progress in image recognition technology. However, sign language recognition using a general monocular camera has problems with occlusion and recognition accuracy in sign language recognition. In this research, we aim to improve accuracy by using a 2-axis bending sensor as an aid in addition to image recognition. We aim to achieve higher recognition accuracy by acquiring hand keypoint information of sign language actions captured by a monocular RGB camera and adding sensor assist. To improve sign language recognition, we need to propose new AI models. In addition, the amount of dataset is small because it uses the original data set of our laboratory. To learn using sensor data and image data, we used MediaPipe, CNN, and BiLSTM to perform sign language recognition. MediaPipe is a method for estimating the skeleton of the hand and face provided by Google. In addition, CNN is a method that can learn spatial information, and BiLSTM can learn time series data. Combining the CNN and BiLSTM methods yields higher recognition accuracy. We will use these techniques to learn hand skeletal information and sensor data. Additionally, the 2-axis Bending sensor glove data support training AI model. Using these methods, we aim to improve the recognition accuracy of sign language recognition by combining sensor data and hand skeleton data. Our method performed better than using skeletal information, achieving 96.5% accuracy in Top-1.

In this article, we discuss problems that exist in modern SCADA systems and present a Controls-kt (formerly DataForge-controls) software development kit, that allows both to create a control system from scratch and provide integration with existing systems via Magix specification and connector.

English based datasets are commonly available from Kaggle, GitHub, or recently published papers. Although benchmark tests with English datasets are sufficient to show off the performances of new models and methods, still a researcher need to train and validate the models on Korean based datasets to produce a technology or product, suitable for Korean processing. This paper introduces 15 popular Korean based NLP datasets with summarized details such as volume, license, repositories, and other research results inspired by the datasets. Also, I provide high-resolution instructions with sample or statistics of datasets. The main characteristics of datasets are presented on a single table to provide a rapid summarization of datasets for researchers.

Early childhood is important for future cognitive and educational outcomes. Programs overcoming barriers to engagement in early education for Indigenous children must address family cultural needs and target developmental delays. This systematic review identifies culturally adapted programs to improve cognitive, emotional and developmental delays among young children, in response to an identified priority of a remote Indigenous community. Five databases (the Cochrane Library, Embase, Medline, Scopus and CINAHL) were searched for English language papers in January 2018. Study quality was assessed and findings analysed thematically. Findings were presented to the community at an event with key stakeholders, to determine their inclusion and face validity. Seven relevant studies, published between 1997-2013, were identified by the researchers and each study was supported by the community for inclusion. Two studies focused on Native American children and five studies included children from non-Indigenous disadvantaged backgrounds. Findings were reported narratively across four themes: Storytelling to improve educational outcomes; Family involvement improved development; Culturally adapted Cognitive Behavioral Therapy to reduce trauma; Rewards-based teaching to improve child attention. Limited published research on culturally adapted and safe interventions for children with cognitive, emotional and developmental delay exists but these four themes from seven studies identify useful components.

The sentiment of a word varies based on its context of usage: the words used around it and the part-of-speech it is used as. This paper proposes a technique to suggest the sentiment of a word by combining its part-of-speech and the semantic similarities of its co-occurrences with both context-specific and pre-trained embeddings to achieve powerful and fast results. A study was conducted across domains and sub-domains to measure variance of sentiment by switching domains and switching context within the same domain. Re-scoring a commonly used polarity lexicon showed that 10% of words changed scores while switching domains and 8% changed scores within domains while switching context. Part of Speech analysis on 65,353 commonly used sentiment lexicons showed that 81% of sentiment bearing (non-neutral) lexicons were of the tags NN (Common Noun), JJ (Adjective) or NNS (Proper Noun).

Since matter, energy and information are the three major components of the world, is there an interaction between information and matter? In the present work, the coevolution of human language and brain is taken as a case of interaction between information and brain. Some evidence that may show interactions between human language and brain revealed by previous researches is summarized in this paper, such as the language areas in the cerebral cortex of the modern human brain, the evolution of human language and brain in human history, and the genetic basis for the evolution of language. Based on the evidence, a dynamic model is developed to investigate the possible mechanism of coevolution of human language and brain. In the model, human language development and brain development reinforce each other: the developmental level of language can be promoted by advances in brain function due to language-related gene mutations, in turn, whether such mutations are selected positively can be influenced by the current developmental level of language. The coevolution of human language and brain can be taken as a case of interaction between information and matter.

The primary cilium, the cell’s sensory and signaling antenna, is a dynamic cellular organelle during the cell cycle. It is resorbed before cells enter mitosis and reformed after cells exit mitosis, and as such acts as a structural barrier to mitosis. Cancer cells that undergo rapid cell cycle and replication have a low ciliation rate. Therefore, promoting cilia formation and elongation and thereby reducing their rates of retraction hold the key to blocking cell entry into mitosis and slowing down cancer cell replication. To perform a comprehensive and efficient literature search on drugs that can promote ciliogenesis, we developed an intelligent process that integrates the GPT-3.5 application programming interface (API) into a PubMed scraper that we coded, enabling the large language model (LLM) to directly query articles for predefined user questions. Among the top candidates identified are two FDA-approved drugs, Alvocidib and Alisertib, that showed strong potential to induce cilia formation and elongation. We first confirmed that these drugs can effectively increase the ciliation rate and the cilia length of DAOY medulloblastoma cells. We then applied Alvocidib and Alisertib individually or in combination to DAOY medulloblastoma and A549 lung cancer cells and observed a statistically significant decrease in the number of viable cells. These results demonstrated the potential of using cilia-promoting drugs to suppress cancer cell replication. Additionally, it shows the massive benefits of integrating accessible large language models to conduct sweeping, rapid, and accurate literature searches.

In this paper, we propose "Synergized Efficiency Optimization for Large Language Models" (SEO-LLM), a groundbreaking approach that integrates advanced data utilization and model compression techniques to significantly enhance the performance, efficiency, and scalability of large language models (LLMs). Our method synergistically combines Adaptive Data Augmentation (ADA), Transfer- Active Learning (TAL), Adaptive Iterative Pruning (AIP), and Synergistic Quantization and Distillation (SQD). These components work together to reduce the training data requirement by 30%, compress model size by 67.6%, and improve inference speed by up to 50%, while preserving or even enhancing model accuracy across various NLP tasks. ADA dynamically adjusts augmentation strategies to optimize model generalization, while TAL leverages pre-trained models to focus learning on the most informative data samples. AIP intelligently prunes less significant weights, and SQD harmonizes quantization with knowledge distillation to achieve high compression rates without significant performance loss. The synergy between these techniques makes SEO-LLM a robust solution for deploying LLMs in resource-constrained environments, maintaining state-of-the-art performance with a fraction of the computational and data resources.

The world health organisation (WHO) revealed approximately 280 million people in the world suffer from depression. Yet, existing studies on early-stage depression detection using machine learning (ML) techniques are limited. Prior studies have applied a single stand-alone algorithm which are unable to deal with data complexities, prone to overfitting and limited in generalisation. To this end, our paper examined the performance of several ML algorithms for early-stage depression detection using two benchmark social media datasets (D1 and D2). More specifically, we incorporated sentiment indicator to improve our model performance. Our experimental results showed that sentence bidirectional encoder representations from transformers (SBERT) numerical vectors fitted into stacking ensemble model achieved comparable F1 scores of 69% in dataset (D1) and 76% in dataset (D2). Our findings suggest that utilising sentiment indicators as additional feature for depression detection yields an improved model performance and thus, we recommend the development of depressive term corpus for future work.

The increased complexity of modern systems is calling for an integrated and comprehensive approach to system design and development and in particular, a shift towards Model-Based Systems Engineering (MBSE) approaches for system design. The requirements that serve as the foundation for these intricate systems are still primarily expressed in Natural Language (NL), which can contain ambiguities and inconsistencies that hinder their direct translation into models. The colossal developments in the field of Natural Language Processing (NLP) in general and Large Language Models (LLMs) in particular can serve as an enabler for the conversion of NL requirements into semi-machine-readable requirements. This is expected to facilitate their standardization and use in a model-based environment. This paper discusses a two-fold strategy for converting NL requirements into semi-machine-readable requirements using language models. The first approach involves creating a requirements table by extracting information from free-form NL requirements. The second approach is an agile methodology that facilitates the identification of boilerplate templates for different types of requirements based on observed linguistic patterns. For this study, three different LLMs were utilized. Two of these models were fine-tuned versions of Bidirectional Encoder Representations from Transformers (BERT), specifically aeroBERT-NER and aeroBERT-Classifier, which were trained on annotated aerospace corpora. Another LLM, called flair/chunk-english, was utilized to identify sentence chunks present in NL requirements. All three language models were utilized together to achieve the standardization of requirements. To demonstrate the effectiveness of the methodologies, requirements from Parts 23 and 25 of Title 14 Code of Federal Regulations (CFRs) were employed, and a total of two, five, and three boilerplate templates were identified for design, functional, and performance requirements, respectively.

This paper presents our approaches for the SMM4H’24 Shared Task 5 on the binary classification of English tweets reporting children’s medical disorders. Our first approach involves fine-tuning a single RoBERTa-large model, while the second approach entails ensembling the results of three fine-tuned BERTweet-large models. We demonstrate that although both approaches exhibit identical performance on validation data, the BERTweet-large ensemble excels on test data. Our best-performing system achieves an F1-score of 0.938 on test data, outperforming the benchmark classifier by 1.18%.

Natural language Processing (NLP) has significantly transformed in the last decade, especially in the field of Language Modeling. Large Language Models (LLMs) have achieved SOTA performances on Natural Language Understanding (NLU) and Natural Language Generation (NLG) tasks by learning language representation in self-supervised ways. This paper provides a comprehensive survey to capture the progression of advances in Language Models. In this paper, we examine the different aspects of Language Models, which started with a few million parameters but have reached the size of a trillion in a very short time. We also look at how these LLMs transitioned from task-specific to task-independent to task-and-language-independent architectures. This paper extensively discusses different pre-training objectives, benchmarks, and transfer learning methods used in LLMs. It also examines different fine-tuning and In-Context learning techniques used in downstream tasks. It also explores how LLMs can perform well across many domains and datasets if sufficiently trained on a large and diverse dataset. Next, it discusses how, over time, the availability of cheap computational power and large datasets have improved LLM’s capabilities and raised new challenges. As part of our study, we also inspect LLMs from the lens of scalability to see how their performance is affected by the model’s depth, width, and data size. Lastly, we provide an empirical comparison of existing trends and techniques and a comprehensive analysis of where the field of LLM currently stand.

Converting natural language into machine language that can be recognized by distributed systems is the core challenge of intelligent interactive interfaces and human-machine dialogue systems. The human-machine interface interaction of large distributed SCADA measurement and control system is tedious and the operation and maintenance cost is high, so it is significant to design an intelligent natural language interaction interface for distributed measurement and control system. In this paper, we design the intermediate language format of SCADA system, i.e., Key-value logic form, and then formulate the Text2SCADA framework and propose the TICS algorithm and SDPA algorithm, the former adopts the keyword extraction and cosine similarity optimization algorithm to complete the structured extraction of natural language for basic natural language instructions, and the latter adopts the keyword extraction and cosine similarity optimization algorithm to complete the structured extraction of natural language for relatively The latter one adopts the algorithm of dependent syntactic analysis for the structured representation of natural language instructions with relatively complex natural language instructions. Based on the above algorithms, a lightweight information extraction model based on DGCNN and probabilistic graph ideas is constructed, aiming to enhance the scientific generalization ability of the framework on unknown instruction sets. The experimental results show that the proposed intelligent natural language interface can better solve the human-machine interface interaction problem of distributed SCADA measurement and control system. The average accuracy, recall and F-value of instruction parsing reach 89.27\%, 89.28\% and 89.27\%, respectively. The average response time is 1.593 s. Especially, it provides a more convenient means of interaction for industrial and agricultural information control.

Authors such as Schnoebelen (2012: 12) suggest that in some languages (cf. Navajo) certain dependent clauses are frequently used independently to “mark emotional evaluation and background information”. Evans (2007) uses the term insubordination to refer to this phenomenon. Our study focuses on a particular insubordinate construction introduced by the sequence ni que in Spanish, as in the example [¡Una carta cada día!] Ni que yo fuese Umbral. (CORPES 100), used as an independent clause with a sociopragmatic meaning which is different from that of its subordinate counterpart (cf. No escribiría una carta cada día ni que yo fuese Umbral). Our research questions ask about the potential for ni que to be used as a discourse marker fulfilling an expressive function when it introduces this type of construction, and the derived hypothesis is then oriented to test whether Schnoebelen's (2012) observation about insubordinate constructions applies also to this Spanish construction. In order to test this hypothesis, we performed a functional-discourse analysis of more than 2000 concordances (and their extended contexts) in Mark Davies' Corpus del Español and the Real Academia CORPES XXI. Our findings show that the insubordinate construction differs in function and meaning from its subordinate counterpart, the former fulfilling a stronger emotive function, often combined with other discourse-pragmatic functions, such as evaluation or the organization of discourse.

KeraVio is a new portable corneal cross-linking (CXL) treatment modality in which violet light (VL)-emitting spectacles are used along with topical transepithelial riboflavin. We preliminarily identified endogenous riboflavin in the human cornea without the administration of riboflavin drops, and the relatively low intensity of VL irradiation increased corneal stiffness in porcine corneas (TVST 2021). This study was conducted to evaluate the clinical results of KeraVio without riboflavin drops. Patients with progressive keratoconus were enrolled and randomly divided into the VL irradiation alone group (Group 1) and the no irradiation group (Group 2; control group) (jRCTs032190267). The eyes were exposed to VL (375 nm, irradiance 310 μW/cm2)-emitting glasses for 4.5 hours daily for 6 months. The mean changes in the maximum keratometry value (Kmax) from baseline to 6 months were 0.94 ± 2.65 diopters (D) and 1.76 ± 2.75 D in Group 1 and Group 2, respectively (p=0.705). No differences were found between patients who did and did not receive VL irradiation in terms of the clinical outcomes of keratoconus. VL irradiation alone likely does not halt keratoconic progression, and the administration of riboflavin is necessary.

Apart from headwind changes, crosswind changes may be hazardous to the aircraft operation. This paper presents two cases of recently observed crosswind changes from the range height indicator scans of ground-based remote-sensing meteorological equipment, namely, an X-band microwave radar and a short-range LIDAR. Rapidly evolving winds have been observed by the equipment in tropical cyclone situations, and they are found to have high level of turbulence and possibly to be associated with vertically propagating waves. In order to study the feasibility of predicting such disturbed airflow, mesoscale meteorological model and computational fluid dynamics model with high spatial resolution are used in this paper. It is found that the models could capture the rapidly evolving airflow features rather well, including the turbulence level, the waves, the rapidly changing wind speeds and the presence of reverse flow. This paper aims at providing a reference to the airports to consider the feasibility of performing high resolution numerical simulation of rapidly evolving airflow to alert the pilots in advance for airports in complex terrain and setup of buildings.

Multimodal sentiment analysis is rapidly gaining traction due to its ability to comprehensively interpret opinions expressed in video content, which is ubiquitous across various digital platforms. Despite its promising potential, the field is hindered by the limited availability of high-quality, annotated datasets, which poses substantial challenges to the generalizability of predictive models. Models trained on such scarce data often inadvertently assign excessive importance to irrelevant features, such as personal attributes (e.g., eyewear), thereby diminishing their accuracy and robustness. To address this issue, we propose an Enhanced Modal Fusion Learning (EMFL) methodology aimed at significantly improving the generalization capabilities of neural networks. EMFL achieves this by optimizing the integration and interpretation processes of multimodal data, ensuring that sentiment-relevant features are prioritized over confounding attributes. Through extensive experiments conducted on multiple benchmark datasets, we demonstrate that EMFL consistently elevates the accuracy of sentiment predictions across verbal, acoustic, and visual modalities. These findings underscore EMFL's efficacy in mitigating the impact of non-relevant features and enhancing the overall performance of multimodal sentiment analysis models.

Recent advancements in machine learning have ushered in innovative techniques for augmenting datasets, particularly through contrastive learning in the computer vision domain. This study pioneers the application of contrastive learning for sentiment analysis, introducing a novel approach termed EmoConLearn. By fine-tuning contrastive learning embeddings, EmoConLearn significantly surpasses BERT-based embeddings in sentiment analysis accuracy, as evidenced by our evaluations on the DynaSent dataset. This research further delves into the efficacy of EmoConLearn across various domain-specific datasets, highlighting its versatility. Additionally, we investigate upsampling strategies to mitigate class imbalance, further enhancing EmoConLearn's performance in sentiment analysis benchmarks.

Background: Given the extensive translation of the Prolapse Quality of Life Questionnaire (P-QoL) into many languages, it is imperative to develop an Arabic version to facilitate study on Pelvic organ health within the Arabian culture. Objective: To investigate, cross culturally adapt and validate Arabic version of the P-QoL. Study Design: Cross-cultural adaptation and psychometric testing. Methods: A total of 90 participants were included in the study. This cross-sectional study went through two phases; during phase I, the P-QoL was translated and adapted from English into Arabic. The Arabic version was psychometrically validated during phase II using the test-retest reliability internal consistency with Cronbach’s alpha coefficient, convergent construct validity (CC) among the four study tools using Spearman’s coefficient (r) and discriminative validity using Mann-Whitney test to find differences between the means of the two samples. Results: A satisfactory level of semantic, conceptual, idiomatic, and content comparability was reached in the cross-cultural adaptation of the Arabic version of the P-QoL questionnaire. The internal consistency was high in terms of psychometric validation, with a Cronbach’s alpha coefficient of 0.971 for the P-QoL questionnaire. The test-retest results showed a high reliability with interclass correlation coefficient (ICC) of P-QoL = 0.987. The convergent construct validity was highly accepted (moderately strong), reflecting a positive correlation between the Arabic version of the P-QoL and the Australian Pelvic Floor Dysfunction Questionnaire (APFD) r = 0.68 (p < 0.001). Similarly, a significant convergent validity of P-QoL Arabic version and Visual Analogue Scale (VAS) r = 0.47 (p < 0.001) was found, as well as the correlation between the APFD and the VAS r = 0.46 (p < 0.001). However, there were no significant correlation between the SF-12, the P-QoL, the APFD, and the VAS. Conclusion: Based on a significant correlation between the Arabic APFD and the VAS, the results reveal good reliability, internal consistency, and construct validity. It is recommended that Arabic-speaking females with pelvic organ prolapse use the Arabic version of the P-QoL. More research is needed to assess the responsiveness of the P-QoL.

Background: Abdominal wall hernias are a common condition that is seen in daily general surgery patients. However, still more researches are needed to be conducted regarding hernias. The aim of this study is to see the prevalence of hernias among patients admitted to the Department of Surgery of a tertiary care center. Methods: A descriptive cross-sectional study was performed among patients who admitted to the department of surgery in a tertiary care center between 1 August 2023 and 20 September 2023. All patients data were extracted to an excel sheet. Results: We had 760 patients who visited in this period. Only 272 patients (27.9 %) were diagnosed with hernias. We found 52.6 % of patients were male and 47.4 % of patients were female. The age between 46- 60 years old was the most to have hernias (97 patients). Inguinal hernias were the common among other types. Diabetes mellitus, hypertension, COPD, and hydrocele were found in 10.7 % of all patients. Conclusion: The prevalence of hernias in this study was nearly to other studies that conducted in the same conditions. Early diagnosis and patient’s education are the corner stone to prevent morbidities and mortalities.

In the recent decades, per- and polyfluoroalkyl substances (PFAS) have garnered widespread public attention due to their persistence in the environment and detrimental effects on the health of living organisms, spurring the generation of several transcriptome-centered investigations to understand the biological basis of their mechanism. In this study, we collected 2144 publicly available samples from 7 distinct animal species to examine the molecular responses to PFAS exposure and to determine if there are conserved responses. Our comparative transcriptional analysis revealed that exposure to PFAS is conserved across different tissues, molecules and species. We identified and reported several genes exhibiting consistent and evolutionarily conserved transcriptional response to PFAS, such as ESR1, HADHA and ID1, as well as several pathways including lipid metabolism, immune response and hormone pathways. This study provides the first evidence that distinct PFAS molecules induce comparable transcriptional changes and affect the same metabolic processes across inter-species borders. Our findings have significant implications for understanding the impact of PFAS exposure on living organisms and the environment. We believe that this study offers a novel perspective on the molecular responses to PFAS exposure and provides a foundation for future research into developing strategies for mitigating the detrimental effects of these substances in the ecosystem.

This research has critically argued that a vigilant combination of flexibility and certainty in spatial planning can bring about the most optimum planning outcomes. Therefore, to reproachfully evaluate the core argument, this research has tried to empirically respond to the research question of which balance of government intervention and market freedom produces the optimal economic, social and spatial outcomes. This research question has been further translated into an associated central hypothesis i.e., a hybrid planning system with an optimal balance between discretionary and regulatory planning approach can bring about the desired economic, social, and spatial outcomes.

Registry and survey data gave an opportunity to compare possible roles of social attitudes and social values in control and limit the COVID-19 pandemic. We analysed social values and time series of daily R0 (reproduction rate) estimates for 27 European countries. Embedded and affective autonomy are significantly negatively associated (p-Value<0.05) with controlled R0. It could mean that well interconnected societies with high attention to maximize utilities are more likely to couple with COVID-19. Hierarchy is significantly positively associated (p-Value<0.05) with controlled R0. Thus, hierarchical structures could inhibits control of COVID-19. The results emphasize the need to pay more attention to social values context in evaluating the effectiveness of mitigation strategies internationally.

There is tremendous interest, in the economic literature, for the determinants of firms’ capital structure decisions. A rich body of empirical works now exists that purports to identify firm- and country-level factors affecting firms’ financing patterns. In addition, more recently, a new stream of studies has emerged that investigates cross-regional variation in small firms’ capital structure. While small firms’ leverage does seem to vary across regions, at least in countries where significant regional differences in economic and financial development and in the quality of institutions exist, not much yet is known about variation in debt maturity, in debt in relation to equity, and between different types of small firms. The present paper aims to fill this gap through an empirical analysis of cross-regional variation in the capital structure of a sample of about 30,000 Italian small firms over a 13-year period, including the aftermath of the credit crunch that followed the 2007-8 global financial crisis. The findings confirm the view that small firms in underdeveloped regions are more financially constrained, but also amend some of the results shown in the literature, in particular by showing how small firms in Italy’s Southern regions have higher levels of equity and fixed assets than small firms in other regions.

Traditional methods for crawling and parsing web applications predominantly rely on extracting hyperlinks from initial pages and recursively following linked resources. This approach constructs a graph where nodes represent unstructured data from web pages, and edges signify transitions between them. However, these techniques are limited in capturing the dynamic and interactive behaviors inherent to modern web applications. In contrast, the proposed method models each node as a structured representation of the application’s current state, with edges reflecting user-initiated actions or transitions. This structured representation enables a more comprehensive and functional understanding of web applications, offering valuable insights for downstream tasks such as automated testing and behavior analysis.

This project aims to create a virtual assistant with AI integration to improve Siemens Energy's internal processes. Using cloud-based technologies, microservice architecture, and large language models (LLMs), the project seeks to create a reliable, effective, and user-friendly assistant customized to Siemens Energy's requirements. The first significant business difficulty identified by the study was the time engineers had to spend looking for information in large volumes of company papers. The proposed virtual assistant responds with precision and context awareness to optimize productivity. The assistant uses a microservice architecture to guarantee scalability, flexibility, and integration for various use scenarios. Tasks like document retrieval, translation, summarization, and comparison can now be handled effectively. Utilizing Amazon Web Services (AWS) for cost-effectiveness and scalability, the backend is cloud-deployed, backed by a frontend created for natural user interaction. To increase precision and relevance, the system uses cutting-edge AI, such as vector databases and Retrieval Augmented Generation (RAG). The assistant expedites document management procedures, improves data accessibility, and reduces search time. The results highlight how it may enhance workflow efficiency for Siemens Energy engineers and how flexible it can be for future AI-driven applications.