1. Introduction
The postulates of Quantum Mechanics (QM) were established in terms of Hilbert Spaces and linear Hermitian operators. Values of physical observables such as energy and momentum were considered as eigenvalues, more precisely as spectral values of linear operators in a Hilbert space. Dirac’s vector bracket notation (VBN) is a very powerful tool to manipulate vectors in Hilbert spaces. It has been widely used in QM and quantum field theories. The main beauty of the VBN is that many formulas can be presented in an abstract symbolic fashion, independent of state expansions or basis selections, which, when needed, can be easily done by inserting an appropriate v-identity operator [
1]
where † denotes the Hermitian adjoint and * is the complex conjugate. However, when applying operators, the more mathematically minded worried if the transformation yielded a result contained within a Hilbert Space or subspace. They had to consider if the operator was bounded or unbounded, etc…One had to develop an entire spectral theory for Hermitian operators in a Hilbert space[
2].
Inspired by the great success of the VBN in QM, we now propose the
Probability Bracket Notation (PBN). The latter relies on a
sample space which is less constrained than a Hilbert space. Assuming
X is a random variable
,
is the set of all its outcomes and
is the probability of
. Then we can make an expression like Equation (4):
Here we have used the definition of conditional probability for
[
3].
Therefore, we seem to have discovered a probability “identity operator”:
Then, following Dirac’s notation, we define the probability bra (
P-bra),
P-ket,
P-bracket (as conditional probabilities by nature),
P-basis, the system
P-ket,
P-identity, normalization, expectation and more, similar but not identical to their counterparts in Equations (
1) - (5). In
Section 2, for systems of one
, we show that the PBN has an advantage similar to that of the VBN: miscellaneous probability expressions [
3,
4,
5] now can be presented in an abstract way, independent of
P-basis and can expanded by inserting a suitable
P-identity.
Next, in
Section 3, we investigate the time evolution of homogeneous Markov chains (HMC) [
3,
4,
5]. We realize that the time evolution of a continuous-time HMC can be written in a symbolic abstract expression (in
Section 3.2), just like the stationary Schrödinger equation in the VBN:
We also find that our time-dependent system
P-kets can be identified with
probability vectors ([
3]). Our system
P-bra is closely related to the
state function or
standard bra introduced in
Doi-Peliti Techniques [
6,
7,
8]. We show that by transforming from the Schrödinger picture to the
Heisenberg picture in the PBN, the time-dependence of a system
P-ket relocates to the
, which becomes a stochastic process; the
Chapman-Kolmogorov Theorem [
4,
5,
9] for transition probabilities can be derived by just inserting a time-dependent
P-identity.
Section 5 shows that a Schrödinger equation transforms to a master equation by making a special Wick rotation.
Section 6 showcases the potential applications of the PBN, such as handling non-Hermitian operators and clustering text datasets. Discussion and concluding remarks are made at the end.
2. Probability Bracket Notation and Random Variable ()
2.1. Discrete random variable
We define a probability space
of a discrete random variable (
, or observable)
X as follows: the set of all elementary events
, associated with a discrete random variable
X, is the sample space
, and
Definition 1. (Probability event-bra and evidence-ket) :Let and, ,
-
1
The symbol represents a probability event bra, or P-bra;
-
2
The symbol represents a probability evidence ket, or P-ket.
Definition 2.(Probability Event-Evidence Bracket
): Theconditional probability
(CP) of event A given evidence B in the sample space Ω can be treated as aP-bracket
, and it can be split into a P-bra and a P-ket, similar to a Dirac bracket. For , we define:
As a CP, the
P-bracket has the following properties for
:
Definition 3.
System P-ket:For any subset, the probability can be written as a conditional probability, or a P-bracket:
Hereis called thesystem P-ket. The P-bracket defined in Equations (9) now becomes:
We have the following important property expressed in
PBN:
The
Bayes formula (see [3, Sec.(2.1)])) now can be expressed as:
The set of all elementary events in
forms a complete mutually disjoint set:
Definition 4.(Discrete
P-Basis and
P-Identity): Using Equations (8-), we have the following properties for basis elements in :
In view of the one-to-one correlation between
and
, from now on, we will use
to label basis elements, just like labeling eigenstates in Equation (3) in the VBN for QM:
Here
X behaves like a right-acting operator. The complete mutually-disjoint events in (
16-
18) form a
probability basis (or
P-basis) and a
P-
identity, similar to Equation (3) in QM:
The system
P-ket,
, now can be expanded from left as:
While the
system P-bra, has its expansion from right as:
The two expansions are quite different, and
. But their
P-bracket is consistent with the requirement of normalization, similar to Equation (4) in the VBN:
Definition 5.(Expectation Value
): Analogous to Equation (5) in QM, the expected value of the or observable X in now can be expressed as:
If
is a continuous function of observable
X, then it is easy to show that:
2.2. Independent random variables
Let
be a vector of
independent random variables and the sample space (i.e., the set of possible outcomes) of
is the set
. Then the
joint probability distribution can be denoted as:
The joint probability of
independent are factorable, e.g.:
The factorable system have the following factorable expectation, for example:
As an example, in
Fock space, we have the following basis from the
occupation numbers
The expectation value of an occupation number now is given by:
Moreover, if sets
A and
B are mutually independent in
, we have following equivalence:
2.3. Continuous P-basis and P-Identity
Equations (
17-
19) can be extended to the probability space
of a
continuous random variable
X,
We see that it is consistent with the normalization requirement:
The expected value
can be easily extended from (
23):
The
basis-independent expressions in the PBN are similar to those in Dirac VBN, among them are the expectation and normalization formulas in the two notations:
Of course, there exist differences between the PBN and Dirac VBN. For example, the expansions of bra, ket and normalization have their own expressions:
2.4. Conditional probability and expectation
The conditional expectation of
X given
in the continuous basis (
31) can be expressed as ([5, p.61]):
To get familiar with the PBN, let us see two simple examples.
2.4.1. Example: Rolling a Die,
(Ref. [3, Example 2.6-2.8])
A die is rolled once. We let
X denote the outcome of this experiment. Then the sample space for this experiment is the 6-element set
. We assumed that the die was fair, and we chose the distribution function defined by
, for
. Using the PBN, we have the P-identity for this sample space:
and because the six outcomes have the same probability
p, we can calculate the probability for each outcome:
Hence, the probability for each outcome has the same value:
Its expectation value can be readily calculated:
And the variance can be calculated as:
2.4.2. Example: Rolling a Die
(Examples 2.1 continued,[3, 2.8 continued])
If
E is the event that the result of the roll is an even number, then
and
. Using the PBN, the probability of event
E can be easily calculated as:
Applying Equation (
40), we can calculate the conditional probabilities
as follows:
Our discussions above can be easily extended to systems of multiple
For example, we can introduce the following system of three independent discrete
:
3. Probability Vectors and Homogeneous Markov Chains (HMCs)
For simplicity, from now on, we will only discuss time evolution for one
. We assume our probability space
has the following stationary discrete
P-basis from a random variable (possible for state-labeling or occupation-number counting):
3.1. Discrete-time HMC
The transition
matrix element is defined as ([3, p.407]]:
In matrix form, if we define a
probability row vector (PRV) at
as
, then matrix
P acting on it from right for
k times gives the PRV at
([
3]):
Definition 6. Time-dependent System P-ket
: we use the following system P-ket, to represent aprobability column vector
in probability space :
The time evolution equation (53) now can be written in a basis-independent way:
Definition 7.(Time-dependent Expectation
): The expectation value of a continuous function f of occupation number in can be expressed as:
We can map the
P-bra and
P-ket into the Hilbert space by using Dirac’s notation:
Then the expectation Equation (
56) can be rewritten in Dirac’s notation as:
3.2. Continuous-time HMC
The time-evolution equation of a continuous-time HMC with a discrete basis (see Equation
or Ref. [5, p.221]) can be written as:
Equations (
60-61) lead to a basis-independent
master equation (see Equation [8, Eq.(2.12)]):
It looks just like Schrödinger’s equation (
7) of a conserved quantum system in Dirac’ notation. With the discrete
P-basis of Fock space in Equation (
28), Equations (
56-59) now can be written as:
Doi’s definition of the state function and state vector ([
8,
9]) correspond to our system
P-bra and
P-ket respectively:
Note that the vector-basis here corresponds to the
P-basis in Equation (
28):
In Peliti’s formalism ([8, p.1472]), the vector-basis (from population operator
n) is normalized in a special way, so the expansion of the system P-bra is also changed:
Equation (
67) can be identified with the
standard bra, introduced in [
8, Eq.(2.27-28)]:
3.3. The Heisenberg Picture
We call Equation (
55) and (
62) the evolution equations in the
Schrödinger picture. Now we introduce the
Heisenberg picture of a
(or observable), similar to what is used in QM [
1]:
Based on
, we can introduce following time-dependent P-basis:
The probability density now can be interpreted in the two pictures:
In the last step, we have used the fact that in the Heisenberg picture, .
Definition 8. Time-dependent P
-Identity
: Equation (69-) also provides us with a time-dependent P-identity in the Heisenberg Picture:
Now the expectation value of the stochastic process can be expressed as:
This suggests that a Markov
stochastic process can be thought as an
operator in the Heisenberg picture, and its expectation value can be found from its Schrödinger picture. Additionally, if a Markov process
is homogeneous, with independent and stationary increments ([
4, p.15]), we can always set
, and obtain the following useful property:
Moreover, there is a relation between their transition probability and probability density:
3.4. Chapman-Kolmogorov Equations of transition probability [5,9]
These can now be easily obtained by inserting our time-dependent
P-identity in Equations (
73). For the HMC of
discrete ([
5]):
For a Markov process of both
continuous and time [
9, Eq.(3.9),p.31]):
3.4.1. Absolute probability distribution (APD)
Likewise, we can find the time evolution of APD for a HMC simply by inserting P-identity
. For the HMC with discrete states ([
5, p.174,214]):
Note that Equations (
80) are identical to Equation (
52):
For a Markov process of both
continuous and time ([
9, p.26]]):
3.5. Kolmogorov Forward and Backward Equations
If the Markov chains are
stochastically continuous, then for infinitesimal
h, the transition probability has the Taylor expansions ([4, Sec.(6.8)];[5, p.217]):
Then, using the Chapman-Kolmogorov Equation (
78), we have:
Therefore, we get following Kolmogorov
Forward equations:
Similarly, we can derive the Kolmogorov
Backward equations:
Using Equations (
81) and (
83) one can extend Equation (
62) to a continuous-time HMC.
3.6. Transition Probability and Path Integrals
From Equation (
62) and (
70) the transition probability of a Markov process can be expressed as follows (assuming
):
We can divide time interval into small pieces and insert the
P-identity
N times:
It perfectly matches the starting equation of Feynman’s path integral for the transition amplitude in QM ([
10]):
For a
free particle,
, the Schrödinger equation and resulted transition amplitude from Feynman’s path integral are (see [
10, Eq.(2.125)]):
4. Examples of Homogeneous Markov Processes
Now let us observe some important examples of the HMC using the PBN.
4.1. PoissonProcess([4, p.250],[5, p.161])
It is a counting process, , having following properties:
- 1
is non-negative process with independent increments and ;
- 2
It is homogeneous and its probability distribution is given by:
It can be shown [
5, p.161] that:
It can be shown (see [
5, p.215]; [
11, Theorem 1.5,p.6]) that Poisson Process has Markov property, and its transition probability is:
4.2. Wiener-LevyProcess(see[5, p.159];[9, sec.(3.6),p.32])
It is a homogeneous process with
independent and stationary increments and
. Its probability density is a normal (Gaussian) distribution
:
Its stationary increment is defined as:
We see that the Wiener-Levy process satisfies Equation (
76).
It can be verified ([
5, p.161]) that it is an
:
4.3. Brownianmotion([4, Sec.(10.1),p.524];[9, p.6,42])
The stochastic process
has
, has
stationary and independent increments for
and its density function for
is a normal distribution
, or:
Brownian motions have
stationary and independent increments ([
4, Sec.(10),p.524,529]), so they are a HMC and satisfy Equation (
76). They are the solution of the following master equation (Einstein’s diffusion equation, see [
9, p.6]) with a drift speed
:
Here the constant
D is called the diffusion coefficient. Equation (
101) can be interpreted as a special HMC case of Equation (
62), given in the
x-basis:
Equation (
102) closely resembling Schrödinger’s Equation (
7) for a free particle in the
x-basis:
5. Special Wick Rotation, Time Evolution and Induced Diffusions
The
induced microscopic diffusion is defined by the following equation:
The
Special Wick Rotation (SWR), caused by the imaginary time rotation
Wick rotation [
12], is defined by:
Under a SWR, Schrödinger Equation (
7) is shifted to the induced micro diffusion (
104):
The simplest example is the
Induced Micro Einstein-Brown motion when
in Equation (
104). Applying (
105) to the transition amplitude in Equation (
92), we get the transition probability:
Here we have introduced the
induced micro diffusion coefficient,
Similarly, applying (
105) to the Schrödinger for free particle, Equation (
103), we get the Einstein’s diffusion equation (
102), with
.
5.0.1. A Special non-Hermitian Case
We can apply Dirac notation and the PBN together to solve the following special quantum system with a non-Hermitian Hamiltonian:
Then the time-evolution equation can be written as:
It leads to two equations:
The first is an ordinary Schrodinger equation while the second is a master equation for an induced micro diffusion. The product of their solutions is the solution of Equation (
111). Suppose we have
and
, then the product of Equation (89) and Equation (
90) gives the path-integral expression of the system:
6. Potential Applications
Hermitian operators are sufficient for “pure” eigenvalue states for closed systems where the energies are conserved and real valued. However, for mixed states and in a number of physical circumstances, non-Hermitian operators have had to be considered. It is well known that any non-Hermitian linear operator
can be expressed in the form:
where
and
are Hermitian and commute with each other, by letting
and
. Note that
can be treated as a wick rotation in the path-integral application of the PBN.
Section 5.0.1 dovetails into the matter of general linear operators where there have been a number of applications. We mention:
The method of “complex scaling” applied to quantum mechanical Hamiltonians was a “hot” area in the area of atomic and molecular Physics during the 1970s and early 1980s and involved non-Hermitian linear operators. We cite an application by the Mathematician Barry Simon of complex scaling to non-relativistic Hamiltonians for molecules [
13].
Another application requiring such an operator was made by Botten
et al. [
14]. They show how to solve a practical problem involving wave scattering using a bi-orthogonal basis, where there is a VPN bra basis and a ket basis consisting of different functions. In a unitary problem, these VPN bra and ket basis functions would be the same. Here, the Helmholtz equation Laplacian
has a wave number
k which is complex. The imaginary part of
k indicates loss or gain depending on its sign.
Konstantin G. Zloshchastiev has made many applications on the general density operator approach with non-Hermitian Hamiltonians of the form Equation (
114) applied to e.g. open dissipative systems, which automatically deals with mixed states (see [
15,
16,
17]).
-
Consider a rectangular real data matrix
. Its similarity matrix (or adjacency matrix)
and corresponding row stochastic (Markov) matrix
defined by:
The symmetric matrix
has real eigenvalues as does
even though the latter is non-symmetric.
is a
transition matrix in the language of QM but also the key operator in the Meila-Shi algorithm of spectral clustering, and
quantum clustering with IT applications in science, engineering, (unstructured) text using a “bag-of-words” model [
18,
19,
20,
21] and even medicine [
22]. Probably, the PBN may provide us with some new approaches to quantum clustering.
If the real data matrix
in Equation (
115) is huge but very sparse (as is often the case in a “bag-of-words” model[
20]), we may use the PBN to find other alternative algorithms for text document clustering. Suppose that the dataset has a vocabulary of
N labeled keywords, which serve as the P-basis in Equation (
28), and
represents the frequency of
keyword in document
. Since
can be greater than 1, they behave like the occupation numbers of a Boson system in Quantum Field Theory. The conditional probability of finding doc
given doc
is:
Now, for example, we can define the relevance of two docs and get its expression as:
This algorithm may be very effective for huge data sets with a lot of abstracts of articles published in many journals with different subjects.
7. Summary and Discussion
Inspired by Dirac’s notation used in quantum mechanics (QM), we proposed the Probability Bracket Notation (PBN). We demonstrated that the PBN could be a very useful tool for symbolic representation and manipulation in probability modeling, like the various normalization and expectation formulas for systems of single or multiple random variables, as well as the master equations of homogeneous Markov processes. We also show that a stationary Schrödinger Equation (
103) naturally becomes a master equation under the special Wick rotation (see Equations
106-).
We have shown the similarities between many QM expressions in VBN and related probabilistic expressions in PBN, which might provide us with a beneficial bridge connecting the quantum world with the classical one. We also showed how the PBN could be applied to problems which require non-Hermitian operators. We make no pretense that the PBN creates new Physics. Rather it provides a notational interdisciplinary “umbrella” to various statistical and physical processes and thereby opens up the possibility of their synthesis and integration.
8. Conclusions
Of course, more investigations need to be done to verify the consistency (or correctness), usefulness and limitations of our proposal of the PBN but it is is intriguing in its possibility of expressing formulations from classical statistics and QM and handling non-Hermitian operators.
Funding
This research received no external funding.
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability Statement
Not applicable.
Acknowledgments
We are indebted to Konstantin G. Zloshchastiev of the Institute of Systems Science, Durban University of Technology, South Africa, for helpful materials concerning non-Hermitian operators. Special thanks to Prof. Sujin Suwanna of Mahidol University, Thailand for insightful comments.
Conflicts of Interest
The authors declare no conflict of interest.
Abbreviations
The following abbreviations are used in this manuscript:
APD |
Absolute Probability Distribution |
CP |
Conditional Probability |
HMC |
Homogeneous Markov Chains |
IT |
Information Technology |
PBN |
Probability Bracket Notation |
P-basis |
Probability basis |
P-bra |
Probability (event) bra |
P-identity |
Probability identity |
P-ket |
Probability (event) ket |
PRV |
Probability Row Vector |
QM |
Quantum Mechanics |
R.V |
Random Variable |
SWR |
Special Wick Rotation |
VBN |
(Dirac) Vector Bracket Notation |
References
- Kroemer, H. Quantum mechanics for engineering: materials science and applied physics; Pearson: Upper Saddle River, NJ, 1994. [Google Scholar]
- Rudin, W. Functional Analysis; McGraw-Hill series in higher mathematics; McGraw-Hill: New York, NY, 1973. [Google Scholar]
- Grinstead, C.M.; Snell, J.L. (Eds.) Introduction to Probability; American Mathematical Society: Providence, RI, 1997. [Google Scholar]
- Ross, S.M. Introduction to probability models, ISE, 9 ed.; Introduction to Probability Models, Academic Press: San Diego, CA, 2006. [Google Scholar]
- Ye, E.; Zhang, D. Probability Theory and Stochastic Processes; Science Publications: Beijing, China, 2005. [Google Scholar]
- Doi, M. Second quantization representation for classical many-particle system. J. Phys. A: Math. Gen. 1976, 9, 1465. [Google Scholar] [CrossRef]
- Trimper, S. Master equation and two heat reservoirs. Phys. Rev. E 2006, 74. [Google Scholar] [CrossRef]
- Peliti, L. . Path integral approach to birth-death processes on a lattice. J. Phys. France 1985, 46, 1469–1483. [Google Scholar] [CrossRef]
- Garcia-Palacios, J.L. 2007; arXiv:cond-mat.stat-mech/cond-mat/0701242].
- Kleinert, H. Path Integrals in Quantum Mechanics, Statistics, Polymer Physics, and Financial Markets, 5th ed.; WORLD SCIENTIFIC, 2009; [https://www.worldscientific.com/doi/pdf/10.1142/7305].
- Berestycki, N.; Sousi, P. Applied Probability - Online Lecture Notes, 2007. http://www.statslab.cam.ac.uk/ ps422/notes-new.pdf.
- Kosztin, I.; Faber, B.; Schulten, K. Introduction to the diffusion Monte Carlo method. Am. J. Phys. 1996, 64, 633–644. [Google Scholar] [CrossRef]
- Morgan, J.D.; Simon, B. The calculation of molecular resonances by complex scaling. J. Phys. B At. Mol. Opt. Phys. 1981, 14, L167. [Google Scholar] [CrossRef]
- Botten, L.C.; Craig, M.S.; McPhedran, R.C.; Adams, J.L.; Andrewartha, J.R. The Finitely Conducting Lamellar Diffraction Grating. Optica Acta: International Journal of Optics 1981, 28, 1087–1102. [Google Scholar] [CrossRef]
- Zloshchastiev, K.G. Quantum-statistical approach to electromagnetic wave propagation and dissipation inside dielectric media and nanophotonic and plasmonic waveguides. Phys. Rev. B 2016, 94. [Google Scholar] [CrossRef]
- Zloshchastiev, K.G. Generalization of the Schrödinger Equation for Open Systems Based on the Quantum-Statistical Approach. Universe 2024, 10. [Google Scholar] [CrossRef]
- Zloshchastiev, K. PROJECT Density Operator Approach for non-Hermitian Hamiltonians.
- Fertik, M.B.; Scott, T.; Dignan, T. Identifying Information related to a Particular Entity from Electronic Sources, using Dimensional Reduction and Quantum Clustering, 2014. US Patent No. 8,744, 197.
- Wang, S.; Dignan, T.G. Thematic Clustering, 2014. US Patent No. 888,665, 1 B.
- Scott, T.C.; Therani, M.; Wang, X.M. Data Clustering with Quantum Mechanics. Mathematics 2017, 5. [Google Scholar] [CrossRef]
- Maignan, A.; Scott, T.C. A Comprehensive Analysis of Quantum Clustering : Finding All the Potential Minima. International Journal of Data Mining & Knowledge Management Process 2021, 11, 33–54. [Google Scholar]
- Kumar, D.; Scott, T.C.; Quraishy, A.; Kashif, S.M.; Qadeer, R.; Anum, G. The Gender-Oriented Perspective in the Development of Type 2 Diabetes Mellitus Complications; SGOP Study. JPTCP 2023, 30, 2308–2318. [Google Scholar]
|
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).