Background: Open AI developed ChatGPT, a language model based on the GPT architecture, designed for text-based communication. Trained on diverse internet texts, ChatGPT generates contextually appropriate responses using machine learning. It understands input through analysis and context interpretation, generating coherent and contextually relevant responses. Interaction is possible through messaging platforms. Materials and Methods: In November 2023, we utilized ChatGPT 3.5, the default version at that time, to answer questions from the Italian National Residency Program Admission Tests (SSMs) of 2021, 2022, and 2023. The questions cover clinical, diagnostic, analytical, therapeutic, and epidemiological scenarios, sometimes accompanied by images. The study compared ChatGPT's answers to the official corrections on the Italian Ministry of University and Research (MUR) website. The scoring method used for evaluation was 1 point for correct answers, 0 points for unanswered questions, and -0.25 points for incorrect answers, reflecting the SSM test scoring system. Results: In summary, ChatGPT was tested with a total of 420 questions, 140 for each test. It achieved an overall accuracy of 80.48%, providing correct answers for 338 questions and incorrect answers for 82 questions. When faced with questions containing both text and images, it answered 55% correctly and 45% incorrectly. The model's performance varied over time, with an 82.14% accuracy rate in 2021 and 2022 (115 correct out of 140) and a 77.14% accuracy rate in 2023 (108 correct out of 140). Applying thisscoring method to the SSM test, ChatGPT would have scored 105 points in 2021 and 2022, and 100 points in 2023. Conclusions: ChatGPT has exhibited above-average performance in the last three SSM tests, highlighting its robust capability to interpret clinical scenarios and offer precise diagnostic and therapeutic guidance. Despite this, some limitations persist, notably the software's inability to interpret non-textual information.

Background: This study addresses the burgeoning impact of Large Language Models (LLMs) such as ChatGPT on the integrity of online examinations and seeks to demonstrate latent and advanced LLM reasoning capabilities. The research devises an iterative self-reflective strategy for invoking critical thinking and higher-order reasoning in LLMs based on multimodal exam questions using visuals and text. Methods: The proposed strategy was demonstrated and evaluated on real exam questions by subject experts and the performance of ChatGPT (GPT-4) with vision was estimated on an additional dataset of 600 text descriptions of multimodal exam questions, focusing on its response to complex, visual, and textual prompts. Results: The results indicate that latent multi-hop reasoning capabilities can be invoked using the proposed self-reflective strategy, which can effectively steer ChatGPT towards correct answers by integrating critical thinking from each modality into the final response. Meanwhile, ChatGPT demonstrated considerable proficiency in being able to answer multimodal exam questions across 12 subjects. Conclusions: This work challenges findings from recent studies which claim that existing LLMs are unable to reason on complex multimodal tasks, and therefore this study underscores the need for enhanced online exam security measures like proctoring software, that can mitigate the potential misuse of AI technologies in educational settings.

first_pagesettingsOrder Article ReprintsOpen AccessArticleThe Carbon Footprint of Spanish University Websitesby Sonia Sanchez-Cuadrado ¹ andJorge Morato ^2,*1Department of Library and Information Science, Complutense University of Madrid, 28010 Madrid, Spain²Department of Computer Science, Carlos III University of Madrid, Leganes, 28911 Madrid, Spain^*Author to whom correspondence should be addressed.Sustainability 2024, 16(13), 5670; https://doi.org/10.3390/su16135670 (registering DOI)Submission received: 31 May 2024 / Revised: 22 June 2024 / Accepted: 23 June 2024 / Published: 3 July 2024(This article belongs to the Special Issue Sustainable Education in the Digital Society: Applying Communication Technologies and Digital Tools to Education) Downloadkeyboard_arrow_down Browse Figures Versions NotesAbstractThe consumption of digital content is essential for economic and scientific development, leading to a high dependence on information and communication technologies, which significantly impacts the environment. Quantifying this ecological impact is challenging due to its intangible nature and the diversity of factors. This research focuses on assessing the energy consumption and CO₂ production of Spanish university websites to evaluate their levels of digital pollution and environmental impact. The calculation of the carbon footprint considers factors related to energy consumption and the use of green or renewable energies. The findings indicate that only 17% of university websites can be considered environmentally friendly. There are significant differences in CO₂ consumption and emissions depending on whether the websites implement environmentally sound practices. This study highlights the lack of initiatives aimed at reducing energy consumption and greenhouse gas emissions associated with web information management. The study shows that Spanish universities have the potential to contribute to the reduction in CO₂ emissions by implementing sustainable development practices on their websites. Furthermore, it fosters awareness about technology usage and its environmental impact, promoting the adoption of green and sustainable approaches.