The fetal heart rate (FHR) is a screening signal for preventing fetal hypoxia during labor. When experts analyze this signal, they have to position a baseline and identify decelerations and accelerations. These steps can potentially be automated and made more objective by data processing analysis, but training and evaluation datasets are required. Here, we describe a dataset of 155 FHR recordings in which a reference baseline, accelerations and decelerations have been annotated by expert consensus. 66 FHR recordings with a shared expert analysis have been included in a training dataset, and 90 other FHR recordings with a non-shared expert analysis have been included in an evaluation dataset. Researchers wishing to evaluate their automatic analysis method should submit their results for comparison with the expert consensus. The dataset also contains the results produced by 11 re-coded automatic analysis methods from the literature. All the data are available at http://utsb.univ-catholille.fr/fhr-review.