In the paper, by convolution theorem for the Laplace transforms and analytic techniques, the author finds necessary and sufficient conditions for complete monotonicity, monotonicity, and inequalities of several functions involving polygamma functions. By these results, the author derives a lower bound of a function related to the sectional curvature of the manifold of the beta distributions. Finally, the author poses several guesses and open problems related to monotonicity, complete monotonicity, and inequalities of several functions involving polygamma functions.