The purpose of this paper is to build a new bridge between category theory and a generalized probability theory known as noncommutative probability or quantum probability, which was originated as a mathematical framework for quantum theory, in terms of states as linear functional defined on category algebras. We clarify that category algebras can be considered as generalized matrix algebras and that the notions of state on category as linear functional defined on category algebra turns out to be a conceptual generalization of probability measures on sets as discrete categories. Moreover, by establishing a generalization of famous GNS (Gelfand-Naimark-Segal) construction, we obtain a representation of category algebras of †-categories on certain generalized Hilbert spaces which we call semi-Hilbert modules over rigs.