(1) Background: The goal of our study was to identify SNPs, metabolic pathways (KEGG), and gene ontology (GO) terms significantly associated with calving and workability; (2) Methods: Based on the EuroGenomics reference data set, we analyzed direct (DCE) and maternal (MCE) calving ease, direct (DSB), and maternal (MSB) stillbirth, milking speed (MSP), and temperament (TEM). We estimated SNP effects using a multi-SNP mixed-model. Further, SNP positions were mapped to genes, and GO terms/KEGG pathways of the corresponding genes were assigned. The estimation of GO term/KEGG pathway effects was based on a mixed-model using SNP effects as dependent variables; (3) Results: The number of significant SNPs comprised 59 for DCE, 25 for DSB and MSP, 17 for MCE and MSB, and 7 for TEM. Significant KEGG pathways were found for MSB (2), TEM (2), and MSP (1), while 11 GO terms were significant for MSP, 10 for DCE, 8 for DSB and TEM, 5 for MCE, and 3 for MSB.; (4) Conclusions: From the perspective of a better understanding of the genomic background of the phenotypes, traits with low heritabilities suggest that the focus should be moved from single genes to metabolic pathways or gene ontologies significant for the phenotype.