A probabilistic description is essential for understanding the dynamics of stochastic systems far from equilibrium. To compare different Probability Density Functions (PDFs), it is extremely useful to quantify the difference among different PDFs by assigning an appropriate metric to probability such that the distance increases with the difference between the two PDFs. This metric structure then provides a key link between stochastic processes and geometry. For a non-equilibrium process, we define an infinitesimal distance at any time by comparing two PDFs at times infinitesimally apart and sum these distances in time. The total distance along the trajectory of the system quantifies the total number of different states that the system undergoes in time and is called the information length. By using this concept, we investigate classical and quantum systems and demonstrate the utility of the information length as a unique Lagrangian diagnostic to quantify the information change as a system continuously evolves in time and to map out attractor structure. We further elucidate quantum effects (uncertainty relation) and the dual role of the width of PDF in quantum systems.