The devastating COVID-19 pandemic forced academia to go virtual. Educational institutions around the world have stressed online learning programs in the aftermath of the pandemic. However, because of insufficient access to ICT, a substantial number of students failed to harness the opportunity of online learning. This study explores the latent digital divide exhibited during the COVID-19 pandemic while online learning activities are emphasized among Bangladeshi students. It also explores the digital divide exposure and the significant underlying drivers of the divide. A cross-sectional survey was employed to collect quantitative data mixed with open-ended questions to collect qualitative information from the student community. The findings revealed that despite the majority of students have physical access to ICT but only 32.5% of students could attend online classes seamlessly, 34.1% of the students reported the data prices as the critical barrier, and 39.8% of students identified the poor network infrastructure is the significant barrier for them to participate in online learning activities. This paper aimed to explore the underlying issues of the digital divide among Bangladeshi students to assist relevant stakeholders (e.g., the Bangladesh government, Educational Institutions, Researchers) in providing the necessary insights to arrange for students to undertake online learning activities successfully.