The pervasiveness of cardiovascular disease and physician misdiagnosis creates the urgent need for artificial intelligence models to improve diagnosis accuracy. The first objective of this study was to train machine learning models on publicly available data sets containing simple medical information of patients to diagnose cardiovascular disease. The Multilayer Perceptron (MLP) assembled for this task performed optimally with an F1 score of 0.8968. This prompted the creation of an open-source, automated cardiovascular disease diagnosis tool, powered by the MLP. The second objective of this study was to employ a meta-learning methodology called Local Interpretable Model-Agnostic Explanations (LIME) to understand the impact of different features on the model's diagnosis in the form of marginal probabilities. K-Means Clustering was employed to segment the data into ten clusters, after which each data example was passed through LIME. The resulting histograms depict the complex relationship between feature, cluster, and impact on diagnosis. A series of P-values with contrasting orders of magnitude shows the nuances in the MLP's understanding of patients from different clusters. The results of meta-learning analysis reveal that the most important features for cardiovascular disease diagnosis are fasting blood sugar, type of chest pain, and slope of the ST segment on an electrocardiogram. Future experiments should replicate the novel methodology introduced in this study on data sets containing more specialized medical features in order to gain practical medical insights about different types of cardiovascular disease represented by each cluster. Finally, feature engineering pathways should be explored with consideration of these results to create versatile diagnosis models not only for cardiovascular disease, but adaptable to other diseases as well.