One of the main qualitative properties of the solutions of differential equations is stability. There are various types of stability defined, studied and applied to different types of differential equation, esspecially to fractional differential equation. The stability of Hadamard fractional differential equations is studied in [
1]. The stability of Caputo type fractional derivatives are studied by many authors and many sufficient conditions are obtained (for example, see Mittag-Leffler stability in [
2], the application of Lyapunov functions in [
3]). Concerning fractional differential equations with Riemann-Liouville fractional derivatives the stability of linear systems is studied in [
4], nonlinear systems in [
5,
6], Lyapunov functions are applied and comparison results are established in [14], practical stability is studied in [
8], existence and Ulam stability in [
9]. Note the initial condition for fractional differential equations with the Riemann-Liouville type fractional derivative is totally different than the initial condition to ordinary differential equations or to fractional differential equations with Caputo type derivatives. Some of the authors did not take this into account and consequently the study of stability has a gap. Concerning the basic concepts of the stability for Riemann-Liouville fractional differential equations we note [
10] where several up-to-date types of fractional derivatives are defined, studied and applied to differential equations. Recently, the so called generalized proportional fractional integrals and derivatives were defined (see, [
11,
12]). Similar to classical fractional derivatives there are two main types of generalized proportional fractional derivatives: Caputo type and Riemann-Liouville type. Several results concerning existence (see, for example,[
13,
14]), integral presentation of the solutions (see, for example, [
15]), stability properties (see, for example, [
16,7]) and applications to some models (see, for example,[7]) are considered with the Caputo type of generalized proportional fractional derivatives. Also there are some results concerning Riemann-Liouville type. Some existence results are obtained in [
18]. In [
19,
20] the oscillation properties of the fractional differential equations with a generalized proportional Riemann-Liouville fractional derivative is studied. The existence and uniqueness of a coupled system is studied in [
21] in the case of three-point generalized fractional integral boundary conditions. In this paper initially we prove some comparison results for generalized proportional Riemann-Liouville fractional derivatives. Also, we discuss the behavior of the solutions on small enough intervals about the initial time. Some examples are given illustrating the necessity of excluding the initial time when the stability is studied. The obtained results are a basis for studying a stability property of the equilibrium of a model of neural networks. The models of neural networks are important issues due to their successive application in pattern recognition, artificial intelligence, automatic control, signal processing, optimization and etc. In the past decades, several types of fractional derivatives are applied to the models of neural networks to describe more adequately the dynamics of the neurons. Many qualitative properties of their equilibriums are studied. In this paper we apply the generalized proportional Riemann-Liouville fractional derivative to the BAM model of neutral networks. One of the main properties of the applied fractional derivative is its singularity at the initial time. In connection with this we define in an appropriate way an exponential Mittag-Leffler stability in time excluding the initial time. Also, two types of equilibrium deeply connected with the applied fractional derivative are defined. Sufficient conditions based on the new comparison results are obtained and illustrated with examples. The rest of this paper is organized as follows. In Section 2, some notes on fractional calculus are provided, the basic definitions of the generalized proportional fractional integrals and derivatives are given in the case when the order of fractional derivative is in the interval
and the parameter is in
. The connection with the tempered fractional integrals and the derivatives is discussed. In Section 3, we prove some comparison results for generalized Riemann-Liouville fractional derivatives. In Section 4, the model of BAM neural networks with GPRLFD is set up and studied. Two types of equilibriums are defined. These definitions are deeply connected with the applied GPRLFD and its properties which are totally different than the ones of ordinary derivative and the Caputo type fractional derivatives. Mittag-Lefller exponential stability in time of both types of equilibriums is defined and studied. Finally, an example is given to illustrate the theoretical results and statements.