The intricate nature of congenital heart disease requires understanding of complex, patient-specific three-dimensional dynamic anatomy of the heart, from imaging data such as three-dimensional echocardiography for successful outcomes from surgical and interventional procedures. Conventional clinical systems use flat screens and therefore display remains two-dimensional, which undermines the full understanding of the three-dimensional dynamic data. Additionally, control of three-dimensional visualisation with two-dimensional tools is often difficult, so used only by imaging specialists. In this paper we describe a virtual reality system for immersive surgery planning using dynamic three-dimensional echocardiography, which enables fast prototyping for visualisation such as volume rendering, multi-planar reformatting, flow visualisation, and advanced interaction such as three-dimensional cropping, windowing, measurement, haptic feedback, automatic image orientation, and multi-user interactions. The available features were evaluated by imaging and non-imaging clinicians, showing that the virtual reality system can help improve understanding and communication of the three-dimensional echocardiography imaging and potentially benefit congenital heart disease treatment.