Excessive vibration of temporary grandstand owing to crowd has lateral rhythmic motions can cause human in panic, which attracted increasing attention in recent years. This paper focuses on experiments that a temporary grandstand occupied 20 participants is oscillated by a shaking table with a series of random waves and induced by crowd with rhythmic swaying motions at lateral direction, respectively. And then a series of vibration perception questionnaires about crowd reaction are obtained. Evaluation of annoying level derives in concept of degree of membership and annoying rate method is proposed, then the human health risk of vibration serviceability of temporary grandstand is assessed with acceleration vibration dose value(VDV). From these results it is clear that standing crowd is more tolerant to vibration than seated crowd. The measured vibrations generated by crowd activities on temporary grandstand can cause panic in crowd. New relationship between the annoyance rate and structural acceleration VDV at logarithmic coordinate is proposed. The findings of this study can be utilized to manage the vibration of temporary grandstand and assess the human health risk.