We investigate the influence of a self-propelling, out-of-equilibrium active particle on generalized elastic systems, including flexible and semiflexible polymers, fluid membranes, and fluctuating interfaces, while accounting for long-ranged hydrodynamic effects. We derive the fractional Langevin equation governing the dynamics of the active particle, as well as that of any other passive particle (or probe) bound to the elastic system. Our study explores the diffusional behavior emerging for both the active particle and a distant probe.