Agent-based models (ABMs) are computational models for simulating the actions and interactions of autonomous agents in time and space. These models allow users to simulate the complex interactions between individual agents and the landscapes they inhabit and are increasingly used in epidemiology to understand complex phenomena and make predictions. However, as the complexity of the simulated systems increases, notably when disease control interventions are considered, model flexibility and processing speed can become limiting. Here we introduce SamPy, an open-source Python library for stochastic agent-based modeling of epidemics. SamPy is a modular toolkit for model development, providing adaptable modules that capture host movement, disease dynamics, and disease control interventions. Memory optimization and design provide high computational efficiency allowing modelling of large, spatially-explicit populations of agents over extensive geographical areas. In this article, we demonstrate the high flexibility and processing speed of this new library. The version of SamPy considered in this paper is available at https://github.com/sampy-project/sampy-paper .