The integration of Augmented Reality (AR) into Human-Robot Interaction (HRI) represents a significant advancement in collaborative technologies. This paper provides a comprehensive review of AR applications within HRI, emphasizing their role in enhancing collaboration, trust, and safety. By aggregating findings from numerous studies, this research highlights key challenges, including the need for improved situational awareness, enhanced safety, and more effective communication between humans and robots. A framework developed from the literature is presented, detailing the critical elements of AR necessary for advancing HRI. The framework outlines effective methods for continuously evaluating AR systems for HRI. This structured approach focuses on enhancing collaboration and safety, with a strong emphasis on integrating best practices from Human-Computer Interaction (HCI) centered around user experience and design.