The adoption of algorithms based on Artificial Intelligence (AI) has been rapidly increasing during the last years. However, some aspects of AI techniques are under heavy scrutiny. For instance, in many use cases, it is not clear whether the decisions of an algorithm are well-informed and conforming to human understanding. Having ways to address these concerns is crucial in many domains, especially whenever humans and intelligent (physical or virtual) agents must cooperate in a shared environment. In this paper, we introduce an application of an explainability method based on the creation of a Policy Graph (PG) based on discrete predicates that represent and explain a trained agent’s behaviour in a multi-agent cooperative environment. We show that from these policy graphs, policies for surrogate interpretable agents can be automatically generated. These policies can be used to measure the reliability of the explanations enabled by the PGs, through a fair behavioural comparison between the original opaque agent and the surrogate one. The contributions of this paper represent the first application of policy graphs in the context of explaining agent behaviour in collaborative multi-agent scenarios and presents experimental results that sets this kind of scenario apart from previous application in single-agent scenarios: when requiring collaborative behaviour, predicates that allow representing observations about the other agents are crucial to replicate the opaque agent’s behaviour and increase the reliability of explanations.

Software defect prediction models enable test managers to predict defect-prone modules and assist with delivering quality products. A test manager would be willing to identify the attributes that can influence defect prediction and should be able to trust the model outcomes. The objective of this research is to create software defect prediction models with a focus on interpretability. Additionally, it aims to investigate the impact of size, complexity, and other source code metrics on the prediction of software defects. This research will also assess the reliability of cross-project defect prediction. Well-known machine learning techniques such as support vector machines, k-nearest neighbors, random forest classifiers, and artificial neural networks were applied to publicly available PROMISE datasets. The interpretability of this approach has been demonstrated by SHapley Additive exPlanations (SHAP) and local interpretable model-agnostic explanations (LIME) techniques. The developed interpretable software defect prediction models showed reliability on independent and cross-project data. Finally, the results demonstrate that static code metrics can contribute to the defect prediction models, and the inclusion of explainability assists in establishing trust in the developed models.

Background: Myalgic encephalomyelitis/chronic fatigue syndrome (ME/CFS) is a complex and debilitating disease with a significant global prevalence of over 65 million individuals. It affects various systems, including the immune, neurological, gastrointestinal, and circulatory systems. Studies have shown abnormalities in immune cell types, increased inflammatory cytokines, and brain abnormalities. Further research is needed to identify consistent biomarkers and develop targeted therapies. A multidisciplinary approach is essential for diagnosing, treating, and managing this complex disease. The current study aims at employing explainable artificial intelligence (XAI) and machine learning (ML) techniques to identify discriminative metabolites for ME/CFS. Material and Methods: The present study used a metabolomics dataset of CFS patients and healthy controls, including 26 healthy controls and 26 ME/CFS patients aged 22-72. The dataset encapsulated 768 metabolites, classified into nine metabolic super-pathways: amino acids, carbohydrates, cofactors, vitamins, energy, lipids, nucleotides, peptides, and xenobiotics. Random forest-based feature selection and Bayesian Approach based-hyperparameter optimization were implemented on the target data. Four different ML algorithms [Gaussian Naive Bayes (GNB), Gradient Boosting Classifier (GBC), Logistic regression (LR) and Random Forest Classifier (RFC)] were used to classify individuals as ME/CFS patients and healthy individuals. XAI approaches were applied to clinically explain the prediction decisions of the optimum model. Performance evaluation was performed using the indices of accuracy, precision, recall, F1 score, Brier score, and AUC. Results: The metabolomics of C-glycosyltryptophan, oleoylcholine, cortisone, and 3-hydroxydecanoate were determined to be crucial for ME/CFS diagnosis. The RFC learning model outperformed GNB, GBC, and LR in ME/CFS prediction using the 1000 iteration bootstrapping method, achieving 98% accuracy, precision, recall, F1 score, 0.01 Brier score, and 99% AUC. Conclusion: RFC model proposed in this study correctly classified and evaluated ME/CFS patients through the selected biomarker candidate metabolites. The methodology combining ML and XAI can provide a clear interpretation of risk estimation for ME/CFS, helping physicians intuitively understand the impact of key metabolomics features in the model.

Blood cell analysis is a crucial diagnostic process in medical practice. In particular, detecting white blood cells (WBCs) is essential for diagnosing of many diseases. The manual screening of blood films is a time-consuming and subjective process, which can lead to inconsistencies and errors. Therefore, automated detection of blood cells can improve the accuracy and efficiency of the screening process. In this study, an explainable Vision Transformer (ViT) model was proposed for the automatic detection of WBCs from blood films. The proposed model utilizes the self-attention mechanism to extract relevant features from the input images and leverages transfer learning by incorporating pre-trained model weights to improve its performance. The proposed model achieved a classification accuracy of 99.40% for five distinct types of WBCs and exhibited potential in reducing the time required for manual screening of blood films by pathologists. Upon examination of the misclassified test samples, it was observed that incorrect predictions were correlated with the presence or absence of granules in the cell samples. To validate this observation, the dataset was divided into two classes, namely Granulocytes and Agranulocytes, and a secondary training process was conducted. The resulting ViT model trained for binary classification achieved an accuracy of 99.70%, recall of 99.54%, precision of 99.32%, and F-1 score of 99.43% during the test phase. To ensure the reliability of the ViT model's multi-class classification of WBCs, the pixel areas that the model focuses on in its predictions are visualized through the Score-CAM algorithm.

Causality is the most important topic in the history of Western Science, and since the beginning of the statistical paradigm, it meaning has been reconceptualized many times. Causality entered into the realm of multi-causal and statistical scenarios some centuries ago. Despite of widespread critics, today Deep Learning and Machine Learning advances are not weakening causality but are creating a new way of finding indirect factors correlations. This process makes possible us to talk about approximate causality, as well as about a situated causality.

In our recent publications, based on strong and electroweak interactions, we have developed a completely new formula for estimating nuclear binding energy. With reference to currently believed Semi Empirical Mass Formula (SEMF), we call our formula as ‘Strong and Electroweak Mass Formula’ (SEWMF). Our formula constitutes 4 simple terms and only one energy coefficient of magnitude 10.1 MeV. First term is a volume term, second term seems to be a representation of free nucleons associated with electroweak interaction, third term is a radial term and fourth one is an asymmetry term about the mean stable mass number. In this paper, we make an attempt to understand and estimate the maximum binding energy associated with any mass number. It can be expressed as, for A > 4, $\left(BE\right)_A\cong \left[A-0.000935A^2-A^{1/3}-A^{-1/2}\right]$ MeV. We are working on refining the 4^th term with even-odd corrections, shell corrections and other microscopic corrections. Proceeding further, stable mass numbers and super heavy mass numbers can be understood with a relation of the form, $\left[\textrm{RoundOff}\left(\left(Z+2.9464\right)^{1.2}-1.7165\right)\right]\pm\left[0,1\right]\pm\left(2n\right)$ where $n \cong 0,1,2$. It needs a review with respect to even-odd proton numbers and other microscopic corrections.Very interesting point to be noted is that based on the concept of “binding energy per nucleon”, the most complicated Avogadro number and Unified atomic mass unit can be estimated in a unified approach.

Current methods for assessing individual well-being in team collaboration at the workplace rely often on manually collected surveys. This limits continuous real-world data collection and proactive measures to improve team member workplace satisfaction. We propose a method to automatically derive social signals related to individual well-being in team collaboration from raw audio and video data collected in teamwork contexts. The goal is to develop computational methods and measurements to facilitate the mirroring of individuals’ well-being to themselves. We are focusing on how speech behavior is perceived by team members to improve their well-being. Our main contribution is the assembly of an integrated toolchain to perform multi-modal extraction of robust speech features in noisy field settings and to find which features are predictors of self-reported satisfaction scores. We apply the toolchain to a case study where we collected videos of 22 teams with 56 participants collaborating over a four-day period in a team project. Our audiovisual speaker diarization extracts individual speech features in a noisy environment. As the dependent variable team members filled out a daily PERMA (positive emotion, engagement, relationships, meaning, and accomplishment) survey. These well-being scores have been predicted with speech features extracted from the videos using machine learning. The results suggest that the proposed toolchain is able to automatically predict individual well-being in teams, leading to better teamwork and happier team members.

Structural integrity is a crucial aspect of engineering components, particularly in the field of additive manufacturing (AM). Surface roughness is a vital parameter that significantly influences the structural integrity of additively manufactured parts. In this study, we present a comprehensive investigation into the relationship between surface roughness and structural integrity of Polyactic Acid (PLA) specimens produced through additive manufacturing. This research work focuses on the prediction of surface roughness of Additive Manufactured Polyactic Acid (PLA) specimens using eight different supervised machine learning regression-based algorithms. For the first time, Explainable AI techniques are employed to enhance the interpretability of the machine learning models. The eight algorithms used in this study are Support Vector Regression, Random Forest, XG Boost, Ada Boost, Catboost, Decision Tree, Extra Tree regressor, and Gradient Boosting regressor. The study analyzes the performance of these algorithms to predict the surface roughness of PLA specimens, while also investigating the impact of individual input parameters through Explainable AI methods. The experimental results indicate that the XG Boost algorithm outperforms the other algorithms with the highest coefficient of determination value of 0.9634. This value demonstrates that the XG Boost algorithm provides the most accurate predictions for surface roughness compared to other algorithms. The study also provides a comparative analysis of the performance of all the algorithms used in this study, along with insights derived from Explainable AI techniques.

In recent years, the demand for coffee has increased tremendously. During the production process, green coffee beans are traditionally screened manually for defective beans before they are packed into coffee bean packages; however, this method is not only time-consuming but also increases the rate of human error due to fatigue. Therefore, this paper proposed a lightweight deep convolutional neural network (LDCNN) for the quality detection system of green coffee beans, which combined depthwise separable convolution (DSC), squeeze-and-excite block (SE block), skip block, and other frameworks. To avoid the influence of low parameters of the lightweight model caused by the model training process, rectified Adam (RA), lookahead (LA), and gradient centralization (GC) were included to improve efficiency; the model was also put into the embedded system. Finally, the local interpretable model-agnostic explanations (LIME) model was employed to explain the predictions of the model. The experimental results indicated that the accuracy rate of the model could reach up to 98.38% and the F1 score could be as high as 98.24% when detecting the quality of green coffee beans. Hence, it can obtain higher accuracy, lower computing time, and lower parameters. Moreover, the interpretable model verified that the lightweight model in this work is reliable, providing the basis for screening personnel to understand the judgment through its interpretability, thereby improving the classification and prediction of the model.

Functional connectivity (FC) is a potential candidate that can increase the performance of brain-computer interfaces (BCIs) in the elderly because of its compensatory role in neural circuits. However, it is difficult to decode FC by current machine learning techniques because of a lack of its physiological understanding. To investigate the suitability of FC in BCI for the elderly, we propose the decoding of lower- and higher-order FCs using a convolutional neural network (CNN) in six cognitive-motor tasks. The layer-wise relevance propagation (LRP) method describes how age-related changes in FCs impact BCI applications for the elderly compared to younger adults. Seventeen younger (24.5±2.7 years) and twelve older (72.5±3.2 years) adults were recruited to perform tasks related to hand-force control with or without mental calculation. CNN yielded a six-class classification accuracy of 75.3% in the elderly, exceeding the 70.7% accuracy for the younger adults. In the elderly, the proposed method increases the classification accuracy by 88.3% compared to the filter-bank common spatial pattern (FBCSP). LRP results revealed that both lower- and higher-order FCs were dominantly overactivated in the prefrontal lobe depending on task type. These findings suggest a promising application of multi-order FC with deep learning on BCI systems for the elderly.

As recent history has shown, changing climate not only threatens to increase the spread of known disease, but also the emergence of new and dangerous phenotypes. This occurred most recently with West Nile virus: a virus previously known for mild febrile illness rapidly emerged to become a major cause of mortality and long-term disability throughout the world. As we move forward, into increasingly uncertain times, public health research must begin to incorporate a broader understanding of the determinants of disease emergence – what, how, why, and when. The increasing mainstream availability of high-quality open data and high-powered analytical methods presents promising new opportunities. Up to now, quantitative models of disease outbreak risk have been largely based on just a few key drivers, namely climate and large-scale climatic effects. Such limited assessments, however, often overlook key interacting processes and downstream determinants more likely to drive local manifestation of disease. Such pivotal determinants may include local host abundance, human behavioral variability, and population susceptibility dynamics. The results of such analyses can therefore be misleading in cases where necessary downstream requirements are not fulfilled. It is therefore important to develop models that include climate and higher-level climatic effects alongside the downstream non-climatic factors that ultimately determine individual disease manifestation. Today, few models attempt to comprehensively address such dynamics: up until very recently, the technology simply hasn’t been available. Herein, we present an updated overview of current perspectives on the varying drivers and levels of interactions that drive disease spread. We review the predominant analytical paradigms, discuss their strengths and weaknesses, and highlight promising new analytical solutions. Our focus is on the prediction of arboviruses, particularly West Nile virus, as these diseases represent the pinnacle of epidemiological complexity – solution to which would serve as an effective “gatekeeper”. We present the current state-of-the-art with respect to known drivers of arbovirus outbreak risk and severity, differentially highlighting the impact of climate and non-climatic drivers. The reality of multiple classes of drivers interacting at different geospatial and temporal scales requires advanced new methodologies. We therefore close out by presenting and discussing some promising new applications of AI. Given the reality of accelerating disease risks due to climate change, public health and other related fields must begin the process of updating their research programs to incorporate these much needed, new capabilities.

This paper first explains the theory of the origin of force from a new perspective, explaining that the origin of all forces is caused by the "missing of energy in the time dimension" (non-conservation in a certain period of time), and constructs a unified theory of force on this basis. Then, through the unified theory of force, the following phenomena are reinterpreted: (1) The common origin of the inverse square law of gravitation and electromagnetic force; (2) The origin of the repulsive force of electrons and protons at small distances; (3) The mystery of the rotation curve of galaxies and the new explanation of "dark matter"; (4) explain the origin of the magnetic field; (5) Predict that moving magnets have the same radiation effect as charged particles (electron magnetic moments also have radiation effects); (6) Reinterpret Maxwell's displacement current; (7) Reinterpret synchrotron radiation and bremsstrahlung; (8) Explain that the strong and weak forces are short-range forces; (9) Predict the true structure of black holes and the origin of gravitational waves;(10) Possible explanation for the origin of the speed of light.

Deep learning architectures like ResNet and Inception have produced accurate predictions for classifying benign and malignant tumors in the healthcare domain. This enables healthcare institutions to make data-driven decisions and potentially enable early detection of malignancy by employing computer-vision-based deep learning algorithms. These Convolutional Neural Network algorithms, in addition to requiring huge amounts of data, can identify higher and lower-level features that are significant while classifying tumors into benign or malignant. However, these algorithms have limitations concerning explainability and identifying the exact features that are of importance and contributing to the final classification of tumors as benign or malignant. In this paper, we implement several explainable AI techniques, namely, LIME, Saliency Map, Occlusion Analysis, Grad-CAM, SHAP, and Smooth Grad to interpret the results of a custom ResNet60 classifier in the classification of ovarian tumors as benign or malignant. The ResNet60 model attained an accuracy of 97.50% for the test dataset.

The use of artificial intelligence in natural language processing (NLP) has significantly contributed to the advancement of natural language applications such as sentimental analysis, topic modeling, text classification, chatbots, and spam filtering. With a large amount of text generated each day from different sources such as webpages, blogs, emails, social media, and articles, one of the most common tasks in natural language processing is the classification of a text corpus. This is important in many institutions for planning, decision-making, and archives of their projects. Many algorithms exist to automate text classification operations but the most intriguing of them is that which also learns these operations automatically. In this study, we present a new model to infer and learn from data using probabilistic logic and apply it to text classification. This model, called GenCo, is a multi-input single-output (MISO) learning model that uses a collaboration of partial classifications to generate the desired output. It provides a heterogeneity measure to explain its classification results and enables the reduction of the curse of dimensionality in text classification. The classification results are compared with those of conventional text classification models, and it shows that our proposed model has a higher classification performance than conventional models.

The work is devoted to the search for effective solutions to the applied problem of early diagnostics of plant stress in the conditions of smart farming and based on modern explicable artificial intelligence (XAI). The study mostly oriented on the theory and practice of XAI, focused on the use of hyperspectral imagery (HSI) and Thermal Infra-Red (TIR) sensor data at the input of a neural network. The first our goal is to build an XAI neural network, explainable due to its structure, the input of which is a datascientist oriented HSI 'explanator', and the output is a biologist oriented TIR 'explanator'. In the middle is SLP-regressor which solves the universal problem of training HSI pixels to temperatures of plants, needed for early plant stress diagnostic. The result can be considered as prototype of a special XAI explanator which is assigned to transform explanator specialized on area 1 onto explanator specialized on area 2. Using this HSI-TIR explanator we ensured the follows: extend HSI data by TIR attribute; providing TIR data for early diagnostic of plant stress; reducing dimensionality HSI needed for TIR training 25 times (from 204 to 8) preserving the same accuracy of temperature prediction (RMSE=0.2-0.3C). This reducing was achieved without using PCA methods. The constructed model is computationally efficient in training: the average training time is significantly less then 1 min (Intel Core i3-8130U, 2.2 GHz, 4 cores, 4 GB). One of the 8 channels, 820 nm, is the leader in correlation with TIR, what allows building local linear temperature prediction functions.

Artificial Intelligence models are increasingly used in manufacturing to inform decision-making. Responsible decision-making requires accurate forecasts and an understanding of the models’ behavior. Furthermore, the insights into models’ rationale can be enriched with domain knowledge. This research builds explanations considering feature rankings for a particular forecast, enriching them with media news entries, datasets’ metadata, and entries from the Google Knowledge Graph. We compare two approaches (embeddings-based and semantic-based) on a real-world use case regarding demand forecasting.

While increasing empirical evidence suggests that global time series forecasting models can achieve better forecasting performance than local ones, there is a research void regarding when and why the global models fail to provide a good forecast. This paper uses anomaly detection algorithms and Explainable Artificial Intelligence (XAI) to answer when and why a forecast should not be trusted. To address this issue, a dashboard was built to inform the user regarding (i) the relevance of the features for that particular forecast, (ii) which training samples most likely influenced the forecast outcome, (iii) why the forecast is considered an outlier, and (iv) provide a range of counterfactual examples to understand value changes, in the feature vector or the predicted value, can lead to a different outcome. Moreover, a modular architecture and a methodology were developed to iteratively remove noisy data instances from the train set, to enhance the overall global time series forecasting model performance. Finally, to test the effectiveness of the proposed approach, it was validated on two publicly available real-world datasets.

Hopfield Neural Networks (HNNs) are recurrent neural networks used to implement associative memory. Their main feature is their ability to pattern recognition, optimization, or image segmentation. However, sometimes it is not easy to provide the users with good explanations about the results obtained with them due to mainly the large number of changes in the state of neurons (and their weights) produced during a problem of machine learning. There are currently limited techniques to visualize, verbalize, or abstract HNNs. This paper outlines how we can construct automatic video generation systems to explain their execution. This work constitutes a novel approach to get explainable artificial intelligence systems in general and HNNs in particular building on the theory of data-to-text systems and software visualization approaches. We present a complete methodology to build these kinds of systems. Software architecture is also designed, implemented, and tested. Technical details about the implementation are also detailed and explained. Finally, we apply our approach for creating a complete explainer video about the execution of HNNs on a small recognition problem.

The understanding of water quality and its underlying processes is important for the protection of aquatic environments enabling the rare opportunity of access to a domain expert. Hence, an explainable AI (XAI) framework is proposed that is applicable to multivariate time series resulting in explanations that are interpretable by a domain expert. The XAI combines in three steps a data-driven choice of a distance measure with explainable cluster analysis through supervised decision trees. The multivariate time series consists of water quality measurements, including nitrate, electrical conductivity, and twelve other environmental parameters. The relationships between water quality and the environmental parameters are investigated by identifying similar days within a cluster and dissimilar days between clusters. The XAI does not depend on prior knowledge about data structure, and its explanations are tendentially contrastive. The relationships in the data can be visualized by a topographic map representing high-dimensional structures. Two comparable decision-based XAIs were unable to provide meaningful and relevant explanations from the multivariate time series data. Open-source code in R for the three steps of the XAI framework is provided.

In our recent publications pertaining to 4G model of final unification and based on strong and electroweak interactions, we have developed a completely new formula for estimating nuclear binding energy. With reference to currently believed Semi Empirical Mass Formula (SEMF), we call our formula as ‘Strong and Electroweak Mass Formula’ (SEWMF). Our formula constitutes 4 simple terms and only one energy coefficient of magnitude 10.1 MeV. First term is a volume term, second term seems to be a representation of free nucleons associated with electroweak interaction, third term is a radial term and fourth one is an asymmetry term about the mean stable mass number. Considering this kind of approach, nuclear structure can be understood in terms of strong and weak interactions and cold nuclear fusion like complicated concepts can be understood in a theoretical approach positively. In this paper, by considering the accountability of we are making an attempt to improve the applicability and effectiveness of SEWMF. Number 0.00125 being a workable electroweak coefficient for Z=6 to 132 and A=2Z to 3.5Z, number of free nucleons assumed to be associated with electroweak interaction can be expressed as Improved asymmetry term can be expressed as, where represents the light house like stable mass number. With reference to old version, our improved binding energy formula can be expressed as, We are working on its possible modification for mass numbers less than the stable mass numbers. Following this approach, it is possible to show that nuclear binding energy scheme is associated with strong and weak interactions and is practically independent of Coulombic repulsions. Proceeding further, currently believed cold nuclear fusion assumed be associated with hydrated metals can be understood and can be confirmed with strong and weak interactions independent of coulombic repulsions. We are very confident to say that our approach will certainly motivate modern science community in this new direction.

The Surgical Complexity Score (SCS) has been widely used to describe the surgical effort during advanced stage epithelial ovarian cancer (EOC) cytoreduction. Referring to a variety of multi-visceral resections, it best combines the numbers with the complexity of the sub-procedures. Nevertheless, not all potential surgical procedures are described by this score. Lately, the European Society for Gynaecological Oncology (ESGO) has established standard outcome quality indicators pertinent to achieving complete cytoreduction (CC0). There is a need to define what weight all these surgical sub-procedures comprising CC0 would be given. Explainable Artificial Intelligence (XAI) could explain the impact of real-time features on the CC0 prediction. We analyzed prospectively collected data from 560 consecutive patients with FIGO-stage III-IV who underwent cytoreductive surgery between Jan 2014 and Dec 2019 at a UK tertiary referral centre. Following adaptation of the structured ESGO ovarian cancer report template, we employed the eXtreme Gradient Boosting (XGBoost) algorithm to model an exhaustive list of surgical sub-procedures. We applied the Shapley Additive explanations (SHAP) framework to provide global (cohort) explainability. We used Cox regression for survival analysis and constructed Kaplan-Meier curves. The XGBoost model predicted CC0 with an acceptable accuracy (area under curve [AUC] = 0.70; 95% confidence interval [CI] = 0.63–0.76). Visual quantification of the feature importance for the prediction of CC0 identified upper abdominal peritonectomy (UAP) as the most important feature, followed by regional lymphadenectomies. The UAP best correlated with bladder peritonectomy and diaphragmatic stripping (Pearson’s correlations > 0.5). Clear inflection points were shown by pelvic and para-aortic lymph node dissection and ileocecal resection/right hemicolectomy, which increased the probability for CC0. When UAP was solely added to a composite model comprising of engineered features, it substantially enhanced its predictive value (AUC = 0.80, CI = 0.75-0.84). The UAP was predictive of poorer progression-free survival (HR=1.76, CI 1.14- 2.70, P:0.01) but not overall survival (HR=1.06, CI 0.56-1.99, P:0.86). The SCS did not have significant survival impact. Machine Learning allows for operational feature selection by weighting the relative importance of those surgical sub-procedures that appear to be more predictive of CC0. Our study identifies UAP as the most important procedural predictor of CC0 in surgically cytoreduced advanced-stage EOC women. The classification model presented here can potentially be trained with a larger number of samples to generate a robust digital surgical reference in high output tertiary centres. The upper abdominal quadrants should be thoroughly inspected to ensure that CC0 is achievable.

Artificial Intelligence (AI) describes computer systems able to perform tasks that normally require human intelligence, such as visual perception, speech recognition, decision-making, and language translation. Examples of AI techniques are machine learning, neural networks and deep learning. AI can be applied in many different areas, such as econometrics, biometry, e-commerce and the automotive industry. In recent years, AI has found its way into healthcare as well, helping doctors to make better decisions (‘clinical decision support’), localizing tumors in magnetic resonance images, reading and analyzing reports written by radiologists and pathologists, and much more. However, AI has one big risk: it can be perceived as a ‘black box’, limiting trust in its reliability, which is a very big issue in an area in which a decision can mean life or death. As a result, the term Explainable Artificial Intelligence (XAI) has been gaining momentum. XAI tries to ensure that AI algorithms (and the resulting decisions) can be understood by humans. In this narrative review, we will have a look at the current status of XAI in healthcare, describe several issues around XAI, and discuss whether it can really help healthcare to advance, for example by increasing understanding and trust. Finally, alternatives to increase trust in AI are discussed, as well as future research possibilities in the area of XAI.

Deep neural networks (DNN) have successfully delivered a cutting-edge performance in several fields. With the broader deployment of DNN models on critical applications, the security of DNNs becomes an active and yet nascent area. Attacks against DNNs can have catastrophic results, according to recent studies. Poisoning attacks, including backdoor and Trojan attacks, are one of the growing threats against DNNs. Having a wide-angle view of these evolving threats is essential to better understand the security issues. In this regard, creating a semantic model and a knowledge graph for poisoning attacks can reveal the relationships between attacks across intricate data to enhance the security knowledge landscape. In this paper, we propose a DNN Poisoning Attacks Ontology (DNNPAO) that would enhance knowledge sharing and enable further advancements in the field. To do so, we have performed a systematic review of the relevant literature to identify the current state. We collected 28,469 papers from IEEE, ScienceDirect, Web of Science, and Scopus databases, and from these papers, 712 research papers were screened in a rigorous process, and 55 poisoning attacks in DNNs were identified and classified. We extracted a taxonomy of the poisoning attacks as a scheme to develop DNNPAO. Subsequently, we used DNNPAO as a framework to create a knowledge base. Our findings open new lines of research within the field of AI security.

This research work describes an architecture for building a system that guide a user from a forecast generated by a machine learning model through a sequence of decision-making steps. The system is demonstrated in manufacturing demand forecasting use case and can be extended to other domains. In addition, the system provides means for knowledge acquisition by gathering data from users. Finally, it implements an active learning component and compares multiple strategies to recommend media news to the user. Such media news aims to provide additional context to demand forecasts and enhance judgment on decision-making.

The Eurasian grapevine (\textit{Vitis vinifera L.}) is the most widely grown horticultural crop in the world and is important for the economy of many countries. In the wine production chain, grape varieties play an important role, as they directly influence the authenticity and classification of the product. Identifying the different grape varieties is therefore fundamental for quality control and control activities, as well as for regulating production. Currently, ampelography and molecular analysis are the main approaches to identifying grape varieties. However, both methods have limitations. Ampelography is subjective and prone to errors and is experiencing enormous difficulties as ampelographers are increasingly scarce. On the other hand, molecular analyses are very demanding in terms of cost and time. In this scenario, Deep Learning (DL) methods have emerged as a classification alternative to deal with the scarcity of ampelographers and avoid molecular analyses. In this study, the most recent and current methods for identifying grapevine varieties using DL classification-based approaches are presented through a systematic literature review. The steps of the standard DL-based classification pipeline were described for the 18 most relevant studies found in the literature, highlighting their pros and cons. Potential directions for improving this field of research were also presented.

We delve into the axion-dilaton model within the supergravity framework, with a specific focus on the intricacies of domain wall construction and stability. Employing holographic vitrification, we unravel the dynamics of domain wall formation in gauge theories featuring periodic vacuum structures. Our model, incorporating a QCD-like axion term and a stabilizing dilaton, undergoes scrutiny for conductivity variations under weak disorder. The investigation reveals the model's resilience, manifesting near-perfect conductivity under mild disorder conditions. However, the rigorous mathematical motivation for the holographic setup demands further elucidation. The scattered nature of our results prompts the necessity for a more systematic interpretation of QCD phenomena and conductivity transitions. This study contributes to the mathematical understanding of the axion-dilaton model's behavior, highlighting the imperative for a refined holographic framework and a more coherent interpretation of observed phenomena.

Stress has various impacts on the health of human beings. Recent success in wearable sensor development, combined with advancements in deep learning to automatically detect features from raw data, opens several interesting applications related to detecting emotional states. Being able to accurately detect stress-related emotional arousal in an acute setting can positively impact the imminent health status of humans, i.e., through avoiding dangerous locations in an urban traffic setting. This work proposes an explainable deep learning methodology for the automatic detection of stress in physiological sensor data, recorded through a non-invasive wearable sensor device, the Empatica E4 wristband. We propose an Long-Short Term-Memory (LSTM) network, extended through a Deep Generative Ensemble of conditional GANs (LSTM DGE) , to deal with the low data regime of sparsely labeled sensor measurements. As explainability is often a main concern of deep learning models, we leverage Integrated Gradients (IG) to highlight the most essential features used by the model for prediction and to compare the results to state-of-the-art expert-based stress detection methodologies in terms of precision, recall and interpretability. Results show that our LSTM DGE outperforms the state-of-the-art algorithm by 3 percentage points in terms of recall, and 7.18 percentage points in terms of precision. More importantly, through the use of Integrated Gradients as a layer of explainability, we show that there is a strong overlap between model-derived stress features for electrodermal activity, and existing literature, which current state-of-the-art stress detection systems in medical research and psychology are based on.

Machine learning models are increasingly being used in critical domains, but their complexity, lack of transparency, and poor interpretability remain problematic. Decision trees (DTs) and rule-based approaches are well-known examples of interpretable models, and numerous studies have investigated techniques for approximating tree ensembles using DTs or rule sets; however, tree ensemble approximators do not consider interpretability. These methods are known to generate three main types of rule sets: DT-based, unordered-based, and decision list-based. However, no known metric has been devised to distinguish and compare these rule sets. Therefore, the present study proposes an interpretability metric to allow comparisons of interpretability between different rule sets, such as decision list- and DT-based rule sets, and investigates the interpretability of the rules generated by the tree ensemble approximators. To provide new insights into the reasons why decision list-based and inspired classifiers do not work well for categorical datasets consisting of mainly nominal attributes, we compare objective metrics and rule sets generated by the tree ensemble approximators and the \textit{Recursive-Rule eXtraction algorithm (Re-RX) with J48graft}. The results indicated that \textit{Re-RX with J48graft} can handle categorical and numerical attributes separately, has simple rules, and achieves high interpretability, even when the number of rules is large.

This study investigates the interpretability of machine learning (ML) models applied to cumulative damage prediction during a sequence of earthquakes, emphasizing the use of techniques such as SHapley Additive exPlanations (SHAP), Partial Dependence Plots (PDPs), Local Interpretable Model-agnostic Explanations (LIME), Accumulated Local Effects (ALE), Permutation and Impurity-based technique. The research explores the cumulative damage during seismic sequences, aiming to identify critical predictors and assess their influence on the cumulative damage. Moreover, the predictors contribution in respect with the range of final damage is evaluated. Nonlinear time history analyses are applied to extract the seismic response of an eight-story Reinforced Concrete (RC) frame. The regression problem’s input variables are divided into two distinct physical classes: pre-existing damage from the initial seismic event and seismic parameters representing the intensity of the subsequent earthquake, expressed by Park and Ang damage index (DIPA) and Intensity Measures (IMs), respectively. The study offers a comprehensive review of cutting-edge ML methods, hyperparameter tuning, and ML method comparisons. A LightGBM model emerges as the most efficient, among 15 different ML methods examined, with critical predictors for final damage being the initial damage caused by the first shock and the IMs of the subsequent shock: IFVF and SIH. The importance of these predictors is supported by feature importance analysis and local/global explanation methods, enhancing the interpretability and practical utility of the developed model.

Postural deficits such as hyperlordosis (hollow back) or hyperkyphosis (hunchback) are relevant health issues. Diagnoses depend on the experience of the examiner and are therefore often subjective and prone to errors. Machine learning (ML) methods in combination with explainable ar-tificial intelligence (XAI) tools have proven useful for providing an objective, data-based orien-tation. However, only a few works have considered posture parameters, leaving the potential of more human-friendly XAI interpretations still untouched. Therefore, the present work proposes an objective, data-driven ML system for medical decision support that enables especially human-friendly interpretations using counterfactual explanations (CFs). Posture data for 1151 subjects were recorded by means of stereophotogrammetry. An expert-based classification of the subjects regarding the presence of hyperlordosis or hyperkyphosis was initially performed. Using a Gaussian progress classifier, the models were trained and interpreted using CFs. Label errors were flagged and re-evaluated using confident learning. Very good classification performances for both hyperlordosis and hyperkyphosis were found, whereby the re-evaluation and correction of the test labels led to a significant improvement (MPRAUC = 0.97). A statistical evaluation showed that the CFs seemed to be plausible in general. In the context of personalized medicine, the present study’s approach could be of importance for reducing diagnostic errors and thereby improving the individual adaptation of therapeutic measures. Likewise, it could be a basis for the development of apps for preventive posture assessment.

Distributed tracing is a cutting-edge technology for monitoring, managing, and troubleshooting native cloud applications. It offers a more comprehensive and continuous observability, surpassing traditional logging methods, and is indispensable for navigating modern complex software architectures. However, the sheer volume of generated traces is staggering in distributed applications, and direct storage and utilization of every trace are impractical due to associated operational costs. This entails a sampling strategy to select which traces warrant storage and analysis. Historically, sampling methods have included a rate-based approach, often relying heavily on a manual configuration. There is a need for a more intelligent approach, and we propose a hierarchical sampling methodology to address multiple requirements concurrently. Initial rate-based sampling mitigates the overwhelming volume of traces, as no further analysis can be performed on this level. In the next stage, more nuanced analysis is facilitated based on the previous foundation, incorporating information regarding trace properties and ensuring the preservation of vital process details even under extreme conditions. This comprehensive approach not only aids in the visualization and conceptualization of applications but also enables more targeted analysis in later stages. As we delve deeper into the sampling hierarchy, the technique becomes tailored to specific purposes, such as simplifying application troubleshooting. In this context, the sampling strategy prioritizes the retention of erroneous traces from dominant processes, thus facilitating the identification and resolution of underlying issues. The focus of this paper is to reveal the impact of the sampling on troubleshooting efficiency. Leveraging intelligent and explainable artificial intelligence solutions enables the detection of malfunctioning microservices and provides transparent insights into root causes. We advocate for using rule-induction systems, which offer explainability and efficacy in decision-making processes. By integrating advanced sampling techniques with machine learning-driven intelligence, we empower organizations to navigate the complexities of large-scale distributed cloud environments effectively.

Remediation of IT issues encoded into domain-specific or user-defined alerts occurring in cloud environments and customer ecosystems in a vast majority of cases suffers from accurate recommendations which could be timely supplied for recovery of performance degradations. That, of course, is hard to realize through furnishing those abnormality definitions with an appropriate expert knowledge which varies from one environment to another. At the same time, in a large proportion of support cases, the reported problems under Global Support Services (GSS) or Site Reliability Engineering (SRE) treatment ultimately go down to the product teams making them waste costly development hours on investigating self-monitoring metrics of our solutions. Therefore, the mean-time-to-resolution (MTTR) rates of problems/alerts are significantly impacted from lack of a systematic approach towards adopting AI Ops. That would imply building, maintaining, and continuously improving/annotating a data store of insights that ML models are trained and generalized across the whole customer base and corporate cloud services. Our ongoing study is in line with such a vision and validates an approach that learns the alert resolution patterns in such a global setting and explains them using interpretable AI methodologies. The knowledge store of causative rules is then applied in predicting potential sources of the application degradation reflected in an active alert instance. In this communication, we share our experiences with a prototype solution and up to date analysis demonstrating how root conditions are discovered with a high accuracy for a specific type of problem. It is validated against the historical data of resolutions performed by heavy manual development efforts. We also offer a Dempster-Shafer theory-based rule verification framework for experts as a what-if analysis tool to test their hypotheses about underlying environment.

There is no well-defined threshold for intra-operative blood transfusion (BT) in advanced epithelial ovarian cancer (EOC) surgery. We developed a Machine Learning (ML)-driven prediction algorithm to trigger and explain a communication alert for BT based on anticipated peri-operative events irrespective of BT policies. We analysed prospectively collected data from 403 EOC patients who underwent cytoreductive surgery between 2014 and 2019. We calculated the estimated blood volume (EBV) using the formula EBV = weight x 80 and set off 10%EBV as threshold for individual intervention. Based on the known estimated blood loss (EBL) we identified two groups. We employed Receiver operating characteristic (ROC) curves for performance metrics. The model performance for the above threshold prediction was satisfactory (AUC 0.823, 95% CI 0.76-0.88). The top feature commonly shared between interrogators was operative time (OT). Intra-operative blood loss of at least 10%EBV was associated with OT>250 minutes, primary surgery, serous histology, performance status 0, R2 resection and surgical complexity score >4. Large bowel resection, stoma formation, ileocecal resection/right hemicolectomy, mesenteric resection, bladder and upper abdominal peritonectomy were amongst sub-procedures clearly associated with increased intervention risk. Precise prediction of blood requirements is not possible unless a rough estimate of OT is known in advance.

Abstract: The future of transportation is being reshaped by autonomous vehicles (AVs), which promise to revolutionize road safety, accessibility, and environmental sustainability. Central to their evolution are advancements in artificial intelligence (AI), which enable real-time perception, decision-making, and control. This paper explores the future trajectory of AI in AVs, highlighting innovative AI paradigms such as explainable AI, federated learning, and adaptive regulatory frameworks. It delves into the development of sophisticated perception algorithms for environmental understanding, advanced decision-making systems employing reinforcement learning and deep neural networks, and precise control mechanisms through predictive modeling and optimization. By addressing current challenges, including regulatory hurdles and the complexity of AI algorithms, this paper provides a comprehensive outlook on the potential and implications of AV technology. It envisions a future where AI-driven AVs are seamlessly integrated into society, offering profound insights into their impact on transportation and societal dynamics.

Refineries execute a series of interlinked processes, where the product of one unit serves as the input to another process. Potential failures within these processes affect the quality of the end products, operational efficiency, and revenue of the entire refinery. In this context, implementation of a real-time cognitive module, referring to predictive machine learning models, enables to provide equipment state monitoring services and to generate decision-making for equipment operations. In this paper, we propose two machine learning models: 1) to forecast the amount of pentane (C5) content in the final product mixture; 2) to identify if C5 content exceeds the specification thresholds for the final product quality. We validate our approach by using a use case from a real-world refinery. In addition, we develop a visualization to assess which features are considered most important during feature selection, and later by the machine learning models. Finally, we provide insights on the sensor values in the dataset, which help to identify the operational conditions for using such machine learning models.

Artificial Intelligence (AI) is revolutionizing head and neck cancer (HNC) care by providing innovative tools that enhance diagnostic accuracy and personalize treatment strategies. This review highlights the advancements in AI technologies, including deep learning and natural language processing, and their applications in HNC. The integration of AI with imaging techniques, genomics, and electronic health records is explored, emphasizing its role in early detection, biomarker discovery, and treatment planning. Despite noticeable progress, challenges such as data quality, algorithmic bias, and the need for interdisciplinary collaboration remain. Emerging innovations like explainable AI, AI-powered robotics, and real-time monitoring systems are poised to further advance the field. Addressing these challenges and fostering collaboration among AI experts, clinicians, and researchers is crucial for developing equitable and effective AI applications. The future of AI in HNC holds significant promise, offering potential breakthroughs in diagnostics, personalized therapies, and improved patient outcomes.

The exploring comprehensive review of cutting-edge techniques for securing cloud-stored data and managing sensitive information in the context of smart cities through the application of Ciphertext-Policy Attribute-Based Encryption (CP-ABE). It highlights the innovative integration of blockchain technology with CP-ABE, which introduces a decentralized and tamper-resistant key management system, thereby enhancing the overall security framework in cloud environments where data sharing is prevalent. Introducing an online/offline multi-authority CP-ABE scheme, characterized by hidden policies, offers significant advancements in protecting user attributes and access structures, ensuring that sensitive information remains confidential even during encryption and decryption processes. This dual approach not only fortifies security but also optimizes the efficiency of data-sharing mechanisms. Furthermore, the paper delves into implementing hidden sensitive policies and keyword search techniques within smart city infrastructures, which are designed to facilitate secure and efficient data retrieval. These techniques ensure that while data remains accessible to authorized users, privacy is rigorously maintained. Collectively, these approaches represent significant strides in bolstering the security and confidentiality of data in both cloud-based and smart city applications, addressing the growing demand for robust and efficient data management solutions in increasingly interconnected environments.

Interdisciplinary conferences play a vital role in advancing explainable Artificial Intelligence (AI) within increasingly intersecting healthcare and computational biology arenas. Challenges result-ing from algorithmic bias and the necessity for domain-specific Explainable AI (XAI) techniques underscore the increasing significance of transparent and interpretable AI systems used in patient care. Collaborative efforts between clinicians, data scientists, and various stakeholders are nec-essary to innovate solutions tailored to healthcare needs. Specialized conferences may foster these interdisciplinary interactions, providing platforms for knowledge exchange, networking, and collaborative partnerships. The legal, ethical, and societal dimensions of medical AI advocate for an integrative approach that aligns technological advancements with patient-centered care val-ues. The role of specialized conferences is therefore essential for shaping future directions in ex-plainable AI and computational biology that contribute to improved patient outcomes and healthcare innovations.