Hydraulic fracturing for oil-gas and geothermal reservoir stimulation is closely related to the generation and propagation of Mode I crack. Nonlinear deformation due to rock heterogeneity occurs at such crack tip, which causes the fracture process zone (FPZ) to form before the crack propagates unsteadily. However, the relationship between the FPZ characteristics and rock heterogeneity still remain elusive. We used three rock types common in reservoir for experimental investigation, and each of them includes two subtypes with different heterogeneity due to grain size or microstructural characteristics. Drawing on the experiment results, we calculated the FPZ size in each cracked chevron notched Brazilian disk, and we reproduced the formation process of the FPZ in marble by discrete element method. We showed that strong heterogeneity is favorable to large FPZ size, can enhance the ability of crack generation and complicate crack morphology. Coupling the Weibull distribution with fracture mechanics, the dependence of the FPZ size on heterogeneity degree can be theoretically explained, which suggests that inherent heterogeneity of rocks set physical foundation for formation of FPZ. These findings can improve our recognition to formation mechanism of the Mode I crack and provide useful guidelines for evaluating reservoir fracability.