Many pilot-based initiatives have been developed to promote awareness and use of climate information services among vulnerable smallholder farmers in Africa through million-dollar investments. However, despite their experimental nature, these pilot projects have been successful in raising participating farmers’ awareness and use of climate information services and they can inform transferrable good practices. Through a systematic literature review approach, this review sought to understand ways in which these past pilot projects have contributed to climate risk management in the context of smallholder farming and the factors that led to their success. Results showed that climate information services main contribution to climate risk management has been through facilitating farm level decision making. Factors that led to success of the pilots include: use of downscaled information; building institutional partnerships to add value to climate information; involving farmers through the co-designing and co-developing process; face-to-face way of communication; embedding pre-seasonal workshops in the activities of local institutions for sustainability; using diversity of communication channels to enhance reach among others. These factors can be borrowed as good practices to inform future efforts focused on increasing adoption of climate information services among a wider population beyond pilot project reach.