Inactivated SARS-CoV-2 vaccine (CoronaVac) is commonly used in national immunization programs. However, the immune response significantly declined within a few months. Our study assessed the immune response against SARS-CoV-2 after receiving booster shots of BNT162b2 or ChAdOx1 among health care workers who previously received CoronaVac as their primary immunization. Fifty-six participants received ChAdOx1 and forty-two participants received BNT162b2 were enrolled into this study which evaluated the immune responses including anti-SARS-CoV-2 spike total antibodies (Elecsys®), surrogated viral neutralization test (sVNT) to ancestral strain (cPass™; GenScript) and five variants of concern (Alpha, Beta, Gamma, Delta, and Omicron) (Luminex; multiplex sVNT) and the ELISpot with spike (S1 and S2) peptide pool against the ancestral SARS-CoV-2 strain. The samples were analyzed at baseline, 4, and 12 weeks after primary immunization as well as 4 and 12 weeks after receiving the booster. This study showed a significantly higher B-cell response among the BNT162b2 than the ChAdOx1 booster group, particularly against the Omicron variant, as well as a trend of good T-cell immune response in the BNT162b2 group. Moreover, the immune response rapidly declined at 12 weeks after the booster. A fourth dose or a second booster should be recommended, especially for reducing Omicron severity.