Preprint Article Version 1 This version is not peer-reviewed

Neural Fractional Differential Equations: Optimising the Order of the Fractional Derivative

Version 1 : Received: 30 July 2024 / Approved: 31 July 2024 / Online: 31 July 2024 (15:17:27 CEST)

How to cite: Coelho, C.; Costa, M. F. P.; Ferrás, L. L. Neural Fractional Differential Equations: Optimising the Order of the Fractional Derivative. Preprints 2024, 2024072572. https://doi.org/10.20944/preprints202407.2572.v1 Coelho, C.; Costa, M. F. P.; Ferrás, L. L. Neural Fractional Differential Equations: Optimising the Order of the Fractional Derivative. Preprints 2024, 2024072572. https://doi.org/10.20944/preprints202407.2572.v1

Abstract

Neural Fractional Differential Equations (Neural FDE) represent a neural network architecture specifically designed to fit the solution of a fractional differential equation to given data. This architecture combines an analytical component, represented by a fractional derivative, with a neural network component, forming an initial value problem. During the learning process, both the order of the derivative and the parameters of the neural network must be optimised. In this work, we investigate the non-uniqueness of the optimal order of the derivative and its interaction with the neural network component. Based on our findings, we perform a numerical analysis to examine how different initialisations and values of the order of the derivative (in the optimisation process) impact its final optimal value. Results show that the neural network on the right-hand side of the Neural FDE struggles to adjust its parameters to fit the FDE to the data dynamics for any given order of the fractional derivative. Consequently, Neural FDEs do not require a unique α value, instead, they can use a wide range of α values to fit data. This flexibility is beneficial when fitting to given data is required, and the underlying physics is not known.

Keywords

Fractional Differential Equations; Neural Networks; Optimisation

Subject

Computer Science and Mathematics, Artificial Intelligence and Machine Learning

Comments (0)

We encourage comments and feedback from a broad range of readers. See criteria for comments and our Diversity statement.

Leave a public comment
Send a private comment to the author(s)
* All users must log in before leaving a comment
Views 0
Downloads 0
Comments 0
Metrics 0


×
Alerts
Notify me about updates to this article or when a peer-reviewed version is published.
We use cookies on our website to ensure you get the best experience.
Read more about our cookies here.