Preprint
Article

A Cost-Effective Integrated Methodology for Electromagnetic Actuation via Visual Feedback

Altmetrics

Downloads

116

Views

57

Comments

0

A peer-reviewed article of this preprint also exists.

Submitted:

21 February 2024

Posted:

22 February 2024

You are already at the latest version

Alerts
Abstract
Electromagnetic actuation can support many fields of technology, such as robotics or biomedical applications. In this context, fully understanding the system behavior and proposing a low-cost package for feedback control is challenging. Modeling the electromagnetic force is particularly tricky because it is a nonlinear function of the actuated object’s position and coil’s current. Measuring in real time the position of the actuated object with the precision required for accurate motion control is also nontrivial. In this study, we propose a novel, cost-effective electromagnetic set-up to achieve position control via visual feedback. We actuate vertically and under different experimental conditions a 10 mm diameter steel ball hanging on a low-stiffness spring, demonstrating good tracking performance (the position error remains within ±0.5 mm with a negligible phase delay in the best scenarios). The experimental results confirm the feasibility of the proposed set-up, which is characterized by minimum complexity and realized with off-the-shelf and cost-effective components. For these reasons, such a contribution helps to understand and apply electromagnetic actuation even further.
Keywords: 
Subject: Engineering  -   Mechanical Engineering

1. Introduction

Electromagnetic actuation finds application in many engineering sectors since its driving magnetic field can easily and safely propagate through many materials and reach confined spaces. These unique features make this actuation form well-suited for multiple applications broadly related to robotics, such as electromagnetic actuation for image stabilization [1], minimally invasive microrobots for microsurgery [2,3,4,5,6,7,8], targeted drug delivery inside the human body [9,10] or early screening and cancer treatment [11], magnetic levitation (e.g., vertical motion of a ball [12]) and general motion control of ferromagnetic elements (e.g., planar steering of a ferrofluid drop [13]).
It is well-known that electromagnets can only pull ferromagnetic objects without the ability to push them away. Then, precisely manipulating a ferromagnetic object at a distance from the electromagnet(s) is challenging for multiple reasons. Modeling the electromagnetic force is quite uncertain because it is a nonlinear function of the actuated object position and electromagnet coil current (the magnetic flux and the resulting electromagnet’s pulling force drop quickly with the distance from its surface). Analytical expressions available to predict the electromagnetic force have limited accuracy and are not readily usable for control design due to their complexity, even when referencing idealized scenarios [14,15,16,17]. Moreover, the presence of a ferromagnetic element in the close vicinity of an electromagnet can significantly distort the magnetic flux’s distribution, an effect not normally incorporated in analytical prediction methods (refer to Section 2.3 for more details). Fully understanding the system behavior is, therefore, hard in this context.
An additional difficulty takes over when the goal becomes achieving closed-loop position control of the actuated element. The object position must be sensed without interfering with its motion. Thus, feasible alternatives for industrial settings use laser sensors [18] or optical tracking [13]. Other expensive techniques exist (e.g., magnetic resonance imaging, computed tomography, ultrasound, or infrared radiation [2]). Still, they are more suitable for biomedical applications, such as the magnetic particle imaging used for electromagnetically navigating drug delivery [19]. Laser sensing is costly and has some challenges, such as safety-related issues because lasers can harm the human eye. Optical tracking can be cost-effective, or at least affordable, depending on the selected camera used for visual feedback (the required frame rate, which is application-driven, plays a significant role). In any case, the latter technique is promising when cost-effectiveness is sought.
Concerning motion control in industrial applications, the steering of ferromagnetic particles (ferrofluid) was studied in 2D. The proposed form of planar manipulation relied on an array of four electromagnets actuated by feedback control based on visual feedback [20]. The ferrofluid could follow arbitrary trajectories with reasonable accuracy, which was improved using optimal control techniques [13,21]. Despite the remarkable tracking abilities, this approach needs complex control design and is limited to systems with slow dynamics (the feedback loop runs at 15 Hz). Then, an approach with 3D motion capabilities in high-viscosity fluids drove a 1.46 mg magnetic cylinder via eight electromagnets [22]. The magnetic force distribution in the workspace was not precisely known, so the controller involved a PID design whose tuning was not model-based. A physical-based control design is, in fact, very computationally demanding. A black-box approximation based on neural networks was proposed, but the system's active control was not further investigated [23]. Moreover, the literature on the control of levitating (solid) objects is extensive. Typical techniques are complex due to the strong nonlinearities of magnetic levitating systems. They involve neural networks [18], feedback linearization [12,24], model predictive control [25], or adaptive sliding mode control [26]. These controllers require the measurement of the actuated object’s position with a fast enough sampling time. Precise knowledge of the electromagnetic force is also crucial for control design, a rarely well-defined scenario.
Referring to motion control in the medical field, tiny dimensions are commonplace. The first example concerns a microrobot with a predefined magnetization profile [27]. The time-varying magnetic field imposed with open-loop control around the robot generates different locomotion modes (e.g., walking, crawling, or jumping). Then, a cylindrical magnetic millirobot can navigate in soft tissues because it is attracted to the center of a permanent magnet array [28]; position control is achieved by x-ray imaging and a motion stage that slides and rotates the soft tissues. Three permanent magnets (only one of them is displaced by a stepper motor) enable precise control of another microrobot to perform complex trajectories and deploy cargo [29]. This method leverages open-loop control, unlike the closed-loop technique developed for a pivot walking robot [30]. The latter device employs visual feedback but needs a complex magnetic actuator with three nested electromagnetic Helmholtz coils.
In summary, closed-loop position control with electromagnetic actuation requires the accurate and contactless measurement of the object position, the accurate prediction of the electromagnetic force, and the implementation of a suitable control strategy to close the loop. Despite the extensive investigations carried out to date, one aspect that has not been adequately addressed is the characterization of the electromagnetic force, which most of the time has been predicted analytically or numerically with limited accuracy, restricting the actuation to small objects whose presence does not excessively distort the magnetic field. In this paper, we propose a novel and cost-effective electromagnetic set-up to perform position control via visual feedback and a model-based control law. Specifically, the set-up comprises one webcam for position tracking and one electromagnet actuating a 10 mm diameter steel ball hanging on a low-stiffness spring. Notably, the electromagnetic force has been directly measured, thereby eliminating the uncertainties associated with analytical and numerical prediction methods. The present set-up demonstrates good tracking performance with an actuated object big enough to significantly distort the electromagnetic field, even though all the components used to assemble the set-up are off-the-shelf and cost-effective.
The rest of this paper is organized as follows. After introducing our novel set-up (Section 2.1), we validate the proposed package for optical tracking of the moving object (Section 2.2). Then, we experimentally identify the field distribution produced by the electromagnet used in our study and the electromagnetic force it generates on the actuated object (Section 2.3). We also characterize the friction force of the moving object in different scenarios (Section 2.4) and propose a feedback control law to perform closed-loop position control (Section 2.5). Finally, we report our experimental results collected under different operating conditions (Section 3) and conclude our discussion with critical remarks and suggestions for future developments (Section 4).

2. Experimental Set-Up

This section elucidates the novel set-up developed in this study. After providing a general introduction, we will focus on the different subsystems that we have integrated.

2.1. Overall System

We present our experimental set-up in two steps. First, we give a general description of its operation and then detail the selected components.

2.1.1. System Description

Figure 1 shows a simplified representation of the system that we have developed. We aim to control the vertical position of a 10 mm diameter steel ball hanging to a low-stiffness spring connected to a fixed frame. An electromagnet is located below the ball, whose vertical projection intercepting its center ends up on the external radius of the electromagnet core (i.e., the location where the magnetic flux is maximum). We use the axial flux of the electromagnet to lower the ball from its equilibrium position that lies a few millimeters above the electromagnet surface in unactuated conditions; the elastic force of the spring recalls the ball up to the equilibrium position because the electromagnet does not have the capability of lifting the ball. The ball is enclosed inside a 13 mm diameter vertical transparent tube filled with fluids characterized by very different viscosity (air, water, or glycol, as explained later), giving opportunities for conducting tests in diverse friction conditions. A camera located laterally and pointing out on one side of the frame measures the vertical ball position. This information is used to track the commanded ball’s position with feedback control acting on the voltage applied to the electromagnet. An LED light is placed on the opposite side of the frame, which is covered with a white paper sheet (not shown in Figure 1) to obtain homogeneous lighting conditions on the background.
The physical governing equations of this set-up are described as follows. The 1D motion of the moving object is captured by the 2nd-Newton law (this assumption of 1D motion holds as confirmed by the experimental evidence available in the attached videos since the ball always moves vertically without touching the tube):
z ¨   M b = F E M + M b g F B F S F F ,
where z is the distance between the electromagnet surface and the ball’s center-of-mass, M b the ball mass, F E M the electromagnetic force, g the acceleration of gravity, F B the buoyant force, F S the elastic force of the spring, and F F the viscous friction force. The buoyant force in Equation (2) recalls the fluid density ρ and fluid volume V = π   D b 3 / 6 displaced by the ball with diameter D b . The spring force in Equation (3) involves the stiffness constant k , while we model the friction in Equation (4) as a viscous term with corresponding coefficient b :
F B = ρ   g   V ,
F S = k   z + M b g ,
F F = b   z ˙ .
Modeling the electromagnetic force is challenging because it is a highly nonlinear function of the ball position and the electromagnet’s coil current. This current I is driven by the applied voltage V and depends on the coil resistance R and inductance L , considering that an equivalent R-L circuit can represent the electromagnet:
I ˙ = R L I + 1 L V .
Since the coil resistance remains essentially constant if the temperature does not change significantly, we can express the electromagnetic force as a function of the commanded voltage and ball position (i.e., F E M = f 1 z ,   V ) by leveraging the Ohm's Law ( V = R   i ). We have, therefore, chosen to fit experimental data as described in Section 2.3 to come up with such an equation of the electromagnetic force.

2.1.2. System Implementation

We implemented our complete set-up according to the schematic presented in Figure 2. The electromagnetic actuation of the ball is effectuated with a DC-powered lifting solenoid electromagnet KK-P80/38 commercialized by KAKACOM (Yueqing, China). It has a lifting capacity of 120 kg, a maximum operating DC voltage of 24 V, and a maximum current of 0.47 A, corresponding to a maximum power consumption of 11 W. We have experimentally characterized the resistance and inductance of the electromagnet using an LCR meter, RS PRO LCR-1701 (Shanghai, China); they result as R = 60.0 Ω and L = 0.6985 H. A 3D-printed frame houses the electromagnet, provides a fixed anchoring point for the spring (its stiffness is k = 0.008 N/mm), and supports the camera used for visual feedback. The latter function is realized with an off-the-shelf Brio C1000e webcam commercialized by Logitech (Lausanne, Switzerland) [31]. Control of the ball motion is achieved by adjusting the voltage applied across the electromagnet. An Arduino 1 board runs the control law that is compiled in Simulink. Then, the control signal leaving the board is directed to a digital potentiometer Mosfet LR7843 (Shenzhen, China) supplied by a 24 V DC electric power supply.

2.2. Motion Tracking Methodology

As detailed in the technical specifications [31], the Brio C1000e webcam can be operated with an image resolution of 1920 x 1080 pixels and a recording frequency of 30 fps or 60 fps or with an image resolution of 1280 x 720 pixels and a recording frequency of 30 fps, 60 fps, or 90 fps; this latter corresponding to the maximum recording frequency that this webcam can support. Since a high recording frequency is clearly desirable in motion tracking, the webcam was set to operate at 90 fps with a resolution of 1280 x 720 pixels for the tests documented herein.
Preliminary motion tracking tests indicated that the webcam frame rate did not peak at 90 fps, as expected based on the settings, but instead varied in the range of 85 ± 2 fps. Since modifications to the lighting conditions during the tests had no apparent effect on the webcam frame rate, the minor reduction in the recording frequency from 90 fps to 85 fps was ascribed to the peculiarities of the present set-up, which comprises a close-up view of a relatively small object illuminated with backlighting, and hence does not conform to the typical application of a webcam. Note that increasing the distance between the webcam and the ball to raise the webcam frame rate was not feasible because this would have reduced the spatial resolution, thereby degrading the accuracy of the ball centroid position determination. As shown later, the recording frequency of 85 fps was adequate to track the motion of the ball successfully, and the fluctuation in the frame rate during operation (within ± 2 fps) was small enough to be inconsequential on the accuracy of the ball position tracking and subsequent electromagnetic actuation. Therefore, no further action was taken at this stage to raise the frame rate of the webcam, and all motion-tracking videos documented herein were captured at 85 fps. It is worth remembering that the objective of the present study was to develop an integrated methodology for electromagnetic actuation with visual feedback by relying exclusively on cost-effective, off-the-shelf components. Hence, a certain degree of compromise on the performance was inevitable.
The video stream from the webcam was imported in Simulink (version R2021a) using the built-in block ‘From Video Device.’ Simulink ran on a PC DELL Precision 3660 with processor 12th Gen Intel(R) Core(TM) i7-12700K and 32 GB RAM. The Simulink simulation time step was set at 1/85 s to match the webcam frame rate, namely 85 fps (note that hardware triggering is not supported for the type of webcam employed here). Following standard practice in image analysis, the imported gray-scale frames were binarized and then complemented to isolate one single feature corresponding to the moving ball, whose centroid position was then computed and used to inform the electromagnetic actuation, as explained later in Section 2.3. The images were scaled using the ball diameter as reference length, and the spatial resolution was 3.5 pixels/mm. Even though a sub-pixel accuracy on the order of ± 0.1 pixels is rather common for centroid location [32], it seems prudent to assume here a more conservative accuracy estimate of ± 1 pixel for the ball centroid location, corresponding to about ± 300 microns, because the present position tracking methodology was conceived to be cost-effective and hence was not optimized.
The present motion-tracking methodology was validated with preliminary experiments carried out with an oscillating pendulum. Specifically, the pendulum was realized by suspending the ball from a fixed pivot using a cotton thread of 10 ± 0.1 mm in length. The pendulum was manually displaced from equilibrium, and the subsequent oscillation of the ball was tracked. A representative example is provided in Figure 3, where the ball displacement time-series and its histogram and power spectrum are presented. As can be noted, the displacement time-series is decaying-periodic. The histogram is bridge-shaped, as expected for the pendulum oscillation, which is a damped periodic motion. The power spectrum presents one dominant peak that closely matches the pendulum oscillation frequency f predicted according to the well-known relation:
f = 1 2   π g l
where g is the acceleration of gravity and l is the pendulum length (in the present case, l is 10 mm and hence f is 1.58 Hz). These preliminary pendulum oscillation results validate the present motion tracking set-up and methodology.

2.3. Magnetic Flux and Force

The electromagnet KK-P80/38 selected for use here was introduced above. The attractive force that the electromagnet generates can be varied by adjusting the supply power, which in the present case was produced by modulating the supply voltage from 0 to 24 V. The present electromagnet can generate a maximum attractive force on the ball, which is on the order of ten times the ball weight, hence large enough for the present application.
The electromagnet was preliminarily characterized by measuring the magnetic field produced at different supply voltages (the magnetic flux meter employed was the Gaussmeter model GM07 commercialized by Hirst Magnetic Instruments Ltd, www.hirst-magnetics.com, accessed 21 January 2024). Representative results are provided in Figure 4a,b, where the axial and radial components of the magnetic flux measured at a supply voltage of 24 V are presented as contour plots. Specifically, the radial coordinate is measured along a diameter on the electromagnet surface starting from the geometrical center. In contrast, the axial coordinate is measured perpendicularly to the electromagnet surface, starting from the surface itself. As can be noted in Figure 4a,b, there is a reasonable degree of symmetry in the magnetic field with respect to the axis of the electromagnet (corresponding to the vertical line passing through the origin of the horizontal axis in Figure 4a,b), so that the present electromagnet generates a nearly symmetric magnetic field despite being a cost-effective off-the-shelf component not explicitly designed for sophisticated electromagnetic actuation.
As is well known, the magnetic field generated by an electromagnet is perturbed when magnetizable bodies are present, particularly so when the variation of the magnetic field is significant over a distance comparable to the body dimension. This is clearly the case in the present set-up, where the ball has a diameter of 10 mm and, thus, is large compared to the distance over which the magnetic field varies. As a representative example, the magnetic flux measured in the presence of the ball is provided in Figure 4c,d, where the location of the ball corresponds to the black circle. The perturbation of the magnetic field is evident when comparing the magnetic field measured without the ball (Figure 4a,b) with the corresponding measurements taken when the ball is present (Figure 4c,d). This dramatic modification precludes the possibility of deducing the magnetic force acting on the ball from the magnetic field measurements, such as those documented in Figure 4a,b, which nonetheless retain their value in characterizing the electromagnet performance, notably the degree of symmetry of the magnetic field.
The magnetic force acting on the ball was measured directly with a force sensor (model ZNLBM-IIX commercialized by BENGBU CHINO SENSOR CO., LTD.). To this extent, a custom-made plastic support was 3D printed to connect the ball to the force sensor. Then, the ball was located at several distances from the electromagnet, and the magnetic force was measured at each distance for different electromagnet supply voltages (4, 8, 12, 16, 20, and 24 V). The results are provided in Figure 5a, where the magnetic force measurements at each electromagnet supply voltage are displayed as functions of the distance between the electromagnet surface and the center of the ball (note that, since the ball diameter is 10 mm, a distance of 5 mm would correspond to the ball sitting on the electromagnet surface). As can be noted, the magnetic force decreases rapidly with increasing distance, and the trends observed at different supply voltages appear qualitatively similar. For use here, the magnetic force measurements in Figure 5a have been fitted with the following empirical relation:
F E M = M b g 2.182 V V m a x 2 + 0.2095 V V m a x z D b 2.364
where M b is the mass of the ball (4.068 g), D b is the diameter of the ball (10.00 mm), g is the acceleration of gravity, V is the electromagnet supply voltage ( V m a x is the maximum supply voltage, equal to 24 V), and z is the distance between the electromagnet surface and the ball center in mm. The functional form of Equation (7), a power law modulated by the supply voltage, is motivated by the trend observed in the data in Figure 5a, and the numerical parameters have been computed with standard least squares regression.
The predictions of the empirical fitting relation in Equation (7) are included in Figure 5a as continuous lines superimposed onto the discrete measurements, while a parity plot with a direct comparison between predictions and measurements is provided in Figure 5b. The empirical relation in Equation (7) fits the present magnetic force measurements quite well, with an accuracy of 2.7% and a bias of 0.6%, which are deemed adequate for the present application. In particular, the accuracy and bias metrics used here are the mean symmetric accuracy and the symmetric signed percentage error [33]. The fitting relation in Equation (7) is also analytically invertible, which simplifies its incorporation into the control methodology, as discussed in Section 2.5.

2.4. Viscous Friction Force

As anticipated in Section 2.1.1, the viscous friction force acting on the ball is assumed to be simply proportional to the ball velocity, as set out in Equation (4). Despite its simplicity, this viscous friction model is widely used in engineering to model viscous damping in single-degree-of-freedom systems, and usually is adequate to describe the damping force acting on a body that is moving at a moderate velocity in a fluid. The critical aspect of the friction model in Equation (4) is choosing a value of the viscous damping coefficient b representative of the system being considered. This step was accomplished with a set of dedicated preliminary experiments. Starting with the ball in equilibrium under its own weight, the electromagnet was powered to pull the ball down into contact with the electromagnet surface. Then, the electromagnet was unpowered with a step command to release the ball, which would then return to its original equilibrium position through a damped free oscillation. These preliminary experiments were carried out with the ball moving in air, water, and glycol. In each case, the value of the viscous damping coefficient b was empirically deduced from the observed motion, leading to a difference of an order of magnitude for the viscous damping coefficients in the different fluids ( b a i r = 0.0045 kg/s, b w a t e r = 0.02 kg/s, and b g l y c o l = 0.095 kg/s). The measured damped free oscillations of the ball in air, water, and glycol are provided in Figure 6, together with the corresponding free oscillations predicted from integrating the equation of motion, Equation (1), where the viscous friction force was modeled as explained above. As noted, the agreement between measurements and predictions is good, indicating that the simple viscous friction model in Equation (4) adequately describes the present system.

2.5. Closed-Loop Position Control

Rather than optimizing position tracking, the paper’s target is proving that our electromagnetic set-up behaves as desired even without using advanced control algorithms such as those for levitation recalled in the introduction [12,18,24,26]. Thus, we have deliberately kept the control design simple. Our controller generates a reference voltage signal for the electromagnet to track the commanded position of the ball z S e t . The control logic emerges from the block diagram shown in Figure 7.
A feedforward term estimates the required electromagnet’s voltage V F F by leveraging the force equilibrium of the ball depicted in Equation (1). We do not consider the dynamics of the electromagnetic subsystem given in Equation (5) because we have experimentally verified that they are negligible (the electromagnet time scale is on the order of 10-3 s). The commanded acceleration z ¨ S e t is used to calculate the desired electromagnetic force F E M , S e t . This force and the commanded ball’s position enter the force-fitting of the electromagnet to calculate the voltage command; this fitting has been rewritten accordingly in the form V = f 2 z ,   F E M since Equation (7) is invertible:
V = 0.2095 2 + 8.728   F E M z D b 2.364 ( M b   g ) 1 0.2095 V m a x 4.364
The dimensionless tuning term k F F compensates for the uncertainties of this prediction (e.g., the small error introduced in the measuring/mapping process of the electromagnetic force). For tests addressing very different operating conditions (e.g., a sinusoidal input command with variable frequency), instead of keeping k F F   constant, we adjust it over time t according to the following linear trend to improve position tracking:
k F F = k F F , 0 k F F *   t ,
where k F F , 0   is the initial value and k F F * is the rate of change. The resulting open-loop command V F F is then corrected by summing up the feedback term V F B to obtain the final voltage command V E M to be applied to the electromagnet. The proportional-integrative controller with gains k P and k I , respectively, manipulates the filtered position error e z = z S e t z F i l t resulting from the difference between the commanded and measured position and generates a corresponding voltage command V F B . We use the filtered signal of the measured position (i.e., we apply a low-pass filter with unitary gain and cut-off frequency ω x to the measured signal). This approach removes undesired fluctuations of the measured signal from the feedback loop, especially when driving the ball inside low-viscosity fluids (air). It is, in fact, crucial to supply a smooth voltage command V E M ; otherwise, the ball's motion might become unstable. Alternative set-ups where the ball is immersed in high-viscosity liquids allow for a more aggressive setting of the control parameters (i.e., higher values of k P , k I , and ω x ) that benefit the ball’s position tracking. The exact values of these parameters will be specified later depending on the experiment being performed.

3. Experiments

We performed three experiments by immersing the actuated steel ball in fluids kept at room temperature but with very different viscosity μ , namely air ( μ a i r = 0.00001813 kg/ms), water ( μ w a t e r = 0.001002 kg/ms), and glycol ( μ g l y c o l = 0.018376 kg/ms). For each scenario, we conducted an initial test commanding a sinusoidal motion profile with constant frequency; this test explores the maximum tracking performance of the current set-up. Additionally, we performed a second test to characterize the system robustness, where we imposed a sinusoidal motion profile with variable frequency.

3.1. Case 1: Motion in Air

As mentioned, we start by exploring the maximum tracking potential of the proposed set-up. We applied a sinusoidal position command with a constant frequency of 0.16 Hz to move the ball 4 mm in the z direction below its equilibrium point. The position tracking in Figure 8a has a minimum overshoot (no more than 0.25 mm) and negligible phase delay. Figure 8b shows the actual tracking error e z * = z S e t z M e a s , calculated with the measured position, stays within ±0.5 mm. Some fluctuations characterize the trend of such a position error; for this reason, we introduced in the feedback loop the filtered error e z obtained with the filtered position signal. It is also worth noticing that the electromagnetic force is permanently active (Figure 8c depicts that there is always a nonzero voltage command); this is the driving force when lowering the ball from its equilibrium point. Conversely, the electromagnetic force switches its role during the lifting stage since it controls the ball position by counteracting the driving force of the elastic spring. This dual behavior explains the different tracking performance between the lowering and lifting stages. Anyway, the ball motion is always very smooth, which is a remarkable outcome due to the almost negligible drag friction of this configuration. It is worth noticing that the ball motion is 1D since it moves vertically inside the tube without touching it (the videos in the attached material support this statement). This behavior is the case because we have correctly selected the control gains. An improper gain selection (i.e., too aggressive settings) causes loss of control with an unacceptable swinging oscillation of the ball (such a scenario was confirmed by experiments not reported herein).
Considering a more challenging scenario, we performed a second test where the frequency of the sinusoidal position command varies linearly up to 2 Hz. Figure 9 depicts the results confirming that the system can keep up while providing a smooth response characterized by a voltage command that does not saturate. The risk is again losing the ball control because there is almost no damping in this scenario; this unfortunate event is not the case even if the actual position error e z * deteriorates progressively even if it stays within ±1 mm. The phase delay is generally negligible while undershooting characterizes the position error. Again, there is a slightly asymmetric system response between the lowering and lifting stages, where the latter scenario results more accurate.

3.2. Case 2: Motion in Water

When repeating the same constant-frequency test described in the previous section while submerging the ball in water, the tracking performance is aligned to the scenario in air with a position error that stays within ±0.5 mm (Figure 10). We used a low-pass filter with a much higher cut-off frequency, 25 Hz, compared to 7 Hz for the case in air. In practical terms, we can apply a feedback command containing some fluctuations since water's larger viscosity introduces a friction term that damps out undesired oscillations. The voltage command is again varying smoothly.
Moving to the scenario with a variable-frequency (up to 2 Hz) sinusoidal command reported in Figure 11, the results show that the position tracking has an actual error e z * well within ±1 mm with a minimum phase delay. The system response is smooth enough even if the low-pass filter’s cut-off frequency was doubled concerning the case in the air (30 Hz compared to 15 Hz).

3.3. Case 3: Motion in Glycol

The results of the tests with the ball immersed in glycol (Figure 12 and Figure 13) resemble the ones in water. The actual position error stays within ±0.5 mm, the phase delay is always negligible, and the commanded voltage exhibits a smooth trend despite the higher cut-off frequency used to filter the measured position. It becomes apparent that increasing the system’s viscous friction above a certain level (see the case in the water) brings marginal improvement to the overall system response.

3.4. System Comparison

After discussing the experimental results individually, we compare them herein. We start by providing an overview of the control parameters selected for our experiments (Table 1). It is apparent that low-viscosity fluids, such as air, require very smooth input commands to avoid unwanted oscillations; filtering the measured position with a low cut-off frequency is the most effective way to enforce this situation. Once a relatively smooth signal is fed back, the settings of the proportional and integrative gains play a minor role in the system response.
In this regard, Figure 14a refers to the experiments with a constant-frequency position command. It shows that the proposed set-up can maintain a consistent performance when proper control settings are chosen even if the environmental conditions change drastically; we are comparing cases with almost no friction (motion in the air), moderate friction (motion in water), and significant friction (motion in glycol). The tracking error calculated with the measured position is almost indistinguishable in terms of both accuracy (it remains well within ±0.5 mm with negligible phase delay) and fluctuations (the input command is always very smooth). Moreover, Figure 14b recalls the experiments with a variable-frequency position command (i.e., the selection of the control settings must be a compromise to deal with very different dynamic scenarios sufficiently well). Again, the system performance is consistent among the three cases. The actual position error remains approximately within ±1 mm for the instances in air and water. It is, however, apparent that the high viscosity of glycol helps improve the position tracking at higher frequencies.
Finally, Table 2 lists the root mean square (RMS) values of the same errors plotted in Figure 14. The RMS value indicates, on average, how far the error is from zero. Thus, an increased viscous friction benefits the average system behavior. When considering constant-frequency commands, the RMS values of the position error in water and glycol become 85.6% and 79.1%, respectively, with respect to the case in the air. Moving to the tests with variable-frequency commands, the RMS values of the position error in water and glycol become 90% and 75.1% concerning the case in the air.

4. Conclusions

In this research paper, we have developed a novel and integrated methodology for applying electromagnetic actuation for closed-loop position control using visual feedback. The main contributions of our study are summarized as follows:
  • We have proposed a user-friendly set-up that relies on cost-effective, off-the-shelf components. This set-up combines three main subsystems: actuation, motion tracking, and feedback control. Our approach has minimum complexity since we have chosen a plug-and-play webcam for optical tracking and developed an intuitive, model-based control law.
  • We have gained significant insight into the distribution of the magnetic flux / magnetic force of electromagnets. We have shown that the magnetic flux is highly nonlinear and severely changes when a ferromagnetic object is nearby. We have also done an accurate and experimentally validated fitting of the electromagnetic force by creating an invertible function to be used for the control design.
  • We have used an off-the-shelf webcam to implement motion tracking via visual feedback. The camera samples images in the range of 85 ± 2 fps. Our conservative estimate for the sensing accuracy of the ball centroid’s location is about ± 300 microns. We have validated this approach with an oscillating pendulum whose power spectrum presents one dominant peak that closely matches its theoretical oscillation frequency.
  • We have deliberately designed a control algorithm for closed-loop, position control of the actuated object with minimum complexity. This law combines a model-based feedforward term (it predicts the electromagnet’s voltage command based on the desired motion) and a feedback term (it corrects the voltage command by applying proportional-integrative control on the position error).
  • We have performed closed-loop position tracking (1D vertical motion) with a 10 mm steel ball hanging to a low-stiffness spring and surrounded by diverse fluids (air, water, and glycol). Despite the different conditions, our set-up can consistently perform well when proper control settings are chosen. When commanded by a sinusoidal position with constant frequency, the tracking error stays within ±0.5 mm with a negligible phase delay.
In summary, the low-cost characteristics and straightforward structure make this integrated methodology an excellent candidate for future research. There are, in fact, some areas that deserve further investigation, such as designing electromagnets with more suitable trends of the force characteristics. Then, the proposed approach is of interest for industry-relevant applications. While maintaining a single-electromagnet set-up, the natural extension addresses levitation since it gives room for developing advanced control algorithms. Additionally, a system with two or more electromagnets has already been envisioned to control the 2D planar motion of objects, including ferrofluids.

Supplementary Materials

The following supporting information can be downloaded at the website of this paper posted on Preprints.org. The following videos are displayed in real-time (1x): Video S1: Closed-loop motion control of the ball surrounded by air with a constant-frequency position command. Video S2: Closed-loop motion control of the ball surrounded by air with a variable-frequency position command. Video S3: Closed-loop motion control of the ball surrounded by water with a constant-frequency position command. Video S4: Closed-loop motion control of the ball surrounded by water with a variable-frequency position command. Video S5: Closed-loop motion control of the ball surrounded by glycol with a constant-frequency position command. Video S6: Closed-loop motion control of the ball surrounded by glycol with a variable-frequency position command.

Author Contributions

Conceptualization, D.P., A.C., and A.A.; methodology, S.C., D.P., A.C., and A.A.; validation, S.C.; formal analysis, D.P. and A.C.; investigation, S.C.; data curation, S.C., D.P. and A.C.; writing—original draft preparation, D.P. and A.C.; writing—review and editing, S.C., D.P., A.C., and A.A.; visualization, S.C., D.P., and A.C.; supervision, D.P., A.C., and A.A.; funding acquisition, D.P. All authors have read and agreed to the published version of the manuscript.

Funding

“This research received no external funding.”

Data Availability Statement

The data presented in this study are available upon request from the corresponding authors.

Conflicts of Interest

“The authors declare no conflict of interest.”

References

  1. Heya, A.; Hirata, K. Experimental Verification of Three-Degree-of-Freedom Electromagnetic Actuator for Image Stabilization. Sensors (Switzerland) 2020, 20. [Google Scholar] [CrossRef]
  2. Nelson, B.J.; Kaliakatsos, I.K.; Abbott, J.J. Microrobots for Minimally Invasive Medicine. Annu Rev Biomed Eng 2010, 12, 55–85. [Google Scholar] [CrossRef]
  3. Zhou, J.; Li, M.; Li, N.; Zhou, Y.; Wang, J.; Jiao, N. System Integration of Magnetic Medical Microrobots: From Design to Control. Front Robot AI 2023, 10. [Google Scholar] [CrossRef]
  4. Xu, T.; Yu, J.; Yan, X.; Choi, H.; Zhang, L. Magnetic Actuation Based Motion Control for Microrobots: An Overview. Micromachines (Basel) 2015, 6, 1346–1364. [Google Scholar] [CrossRef]
  5. Ebrahimi, N.; Bi, C.; Cappelleri, D.J.; Ciuti, G.; Conn, A.T.; Faivre, D.; Habibi, N.; Hošovský, A.; Iacovacci, V.; Khalil, I.S.M.; et al. Magnetic Actuation Methods in Bio/Soft Robotics. Adv Funct Mater 2021, 31. [Google Scholar] [CrossRef]
  6. Yang, Z.; Yang, H.; Cao, Y.; Cui, Y.; Zhang, L. Magnetically Actuated Continuum Medical Robots: A Review. Advanced Intelligent Systems 2023, 5, 2200416. [Google Scholar] [CrossRef]
  7. Yuan, S.; Wan, Y.; Song, S. RectMag3D: A Magnetic Actuation System for Steering Milli/Microrobots Based on Rectangular Electromagnetic Coils. Applied Sciences (Switzerland) 2020, 10. [Google Scholar] [CrossRef]
  8. Erin, O.; Raval, S.; Schwehr, T.J.; Pryor, W.; Barnoy, Y.; Bell, A.; Liu, X.; Mair, L.O.; Weinberg, I.N.; Krieger, A.; et al. Enhanced Accuracy in Magnetic Actuation: Closed-Loop Control of a Magnetic Agent With Low-Error Numerical Magnetic Model Estimation. IEEE Robot Autom Lett 2022, 7, 9429–9436. [Google Scholar] [CrossRef] [PubMed]
  9. Zarrouk, A.; Belharet, K.; Tahri, O. Vision-Based Magnetic Actuator Positioning for Wireless Control of Microrobots. Rob Auton Syst 2020, 124, 103366. [Google Scholar] [CrossRef]
  10. Nadour, H.; Bozorg Grayeli, A.; Poisson, G.; Belharet, K. CochleRob: Parallel-Serial Robot to Position a Magnetic Actuator around a Patient’s Head for Intracochlear Microrobot Navigation. Sensors 2023, 23. [Google Scholar] [CrossRef] [PubMed]
  11. Sun, H.; Liu, J.; Wang, Q. Magnetic Actuation Systems and Magnetic Robots for Gastrointestinal Examination and Treatment. Chinese Journal of Electrical Engineering 2023, 9, 3–28. [Google Scholar] [CrossRef]
  12. Hajjaji, A. El; Ouladsine, M. Modeling and Nonlinear Control of Magnetic Levitation Systems. IEEE Transactions on Industrial Electronics 2001, 48, 831–838. [Google Scholar] [CrossRef]
  13. Probst, R.; Lin, J.; Komaee, A.; Nacev, A.; Cummins, Z.; Shapiro, B. Planar Steering of a Single Ferrofluid Drop by Optimal Minimum Power Dynamic Feedback Control of Four Electromagnets at a Distance. J Magn Magn Mater 2011, 323, 885–896. [Google Scholar] [CrossRef]
  14. Callaghan, E.E.; Maslen, S.H.; L. R. Center The Magnetic Field of a Finite Solenoid; NASA, Washington, DC, USA, Tech. Note D-465, 1960.
  15. Engel-Herbert, R.; Hesjedal, T. Calculation of the Magnetic Stray Field of a Uniaxial Magnetic Domain. J Appl Phys 2005, 97. [Google Scholar] [CrossRef]
  16. Waindok, A.; Tomczuk, B.; Koteras, D. Modeling of Magnetic Field and Transients in a Novel Permanent Magnet Valve Actuator. Sensors (Switzerland) 2020, 20. [Google Scholar] [CrossRef]
  17. Waindok, A.; Tomczuk, B.; Koteras, D. Modeling of Magnetic Field and Transients in a Novel Permanent Magnet Valve Actuator. Sensors (Switzerland) 2020, 20. [Google Scholar] [CrossRef] [PubMed]
  18. Yang, Z.-J.; Tateishi, M. Adaptive Robust Nonlinear Control of a Magnetic Levitation System. Automatica 2001, 37, 1125–1131. [Google Scholar] [CrossRef]
  19. Le, T.-A.; Zhang, X.; Hoshiar, A.K.; Yoon, J. Real-Time Two-Dimensional Magnetic Particle Imaging for Electromagnetic Navigation in Targeted Drug Delivery. Sensors 2017, 17, 2050. [Google Scholar] [CrossRef] [PubMed]
  20. Komaee, A.; Shapiro, B. Steering a Ferromagnetic Particle by Magnetic Feedback Control: Algorithm Design and Validation. In Proceedings of the American Control Conference Marriott Waterfront, Baltimore, MD, USA, 2010. [Google Scholar]
  21. Komaee, A.; Shapiro, B. Steering a Ferromagnetic Particle by Optimal Magnetic Feedback Control. IEEE Transactions on Control Systems Technology 2012, 20, 1011–1024. [Google Scholar] [CrossRef]
  22. Ghanbari, A.; Chang, P.H.; Nelson, B.J.; Choi, H. Electromagnetic Steering of a Magnetic Cylindrical Microrobot Using Optical Feedback Closed-Loop Control. Int J Optomechatronics 2014, 8, 129–145. [Google Scholar] [CrossRef]
  23. Alessandri, A.; Bagnerini, P.; Gaggero, M.; Mantelli, L.; Santamaria, V.; Traverso, A. Black-Box Modeling and Optimal Control of a Two-Phase Flow Using Level Set Methods. IEEE Transactions on Control Systems Technology 2022, 30, 520–534. [Google Scholar] [CrossRef]
  24. Padovani, D.; Cioncolini, A.; Alessandri, A. State Observers for Output Feedback Control of an Electromagnetic Levitation System. In Proceedings of the IEEE 18th International Conference on Advanced Motion Control, Kyoto, Japan, 2024. (in press). [Google Scholar]
  25. Bächle, T.; Hentzelt, S.; Graichen, K. Nonlinear Model Predictive Control of a Magnetic Levitation System. Control Eng Pract 2013, 21, 1250–1258. [Google Scholar] [CrossRef]
  26. Wang, J.; Rong, J.; Yang, J. Adaptive Fixed-Time Position Precision Control for Magnetic Levitation Systems. IEEE Transactions on Automation Science and Engineering 2023, 20, 458–469. [Google Scholar] [CrossRef]
  27. Hu, W.; Lum, G.Z.; Mastrangeli, M.; Sitti, M. Small-Scale Soft-Bodied Robot with Multimodal Locomotion. Nature 2018, 554, 81–85. [Google Scholar] [CrossRef] [PubMed]
  28. Son, D.; Cagri Ugurlu, M.; Sitti, M. Permanent Magnet Array-Driven Navigation of Wireless Millirobots inside Soft Tissues. Sci. Adv 2021, 7. [Google Scholar] [CrossRef] [PubMed]
  29. Jeong, M.; Tan, X.; Fischer, F.; Qiu, T. A Magnetic Millirobot Walks on Slippery Biological Surfaces for Targeted Cargo Delivery. Micromachines (Basel) 2023, 14. [Google Scholar] [CrossRef]
  30. Al Khatib, E.; Razzaghi, P.; Hurmuzlu, Y. Feedback Control of Millimeter Scale Pivot Walkers Using Magnetic Actuation. Rob Auton Syst 2023, 168. [Google Scholar] [CrossRef]
  31. Logitech C1000e Webcam with 4K Ultra HD Video & HDR. Available online: https://www.logitech.com/zh-cn/products/webcams/brio-4k-hdr-webcam.960-001107.html (accessed on 31 January 2024).
  32. Fisher, R.B. Subpixel Estimation. In Computer Vision: A Reference Guide; Ikeuchi, K., Ed.; Springer International Publishing: Cham, 2021; pp. 1217–1220 ISBN 978-3-030-63416-2. [Google Scholar]
  33. Morley, S.K.; Brito, T. V.; Welling, D.T. Measures of Model Performance Based On the Log Accuracy Ratio. Space Weather 2018, 16, 69–88. [Google Scholar] [CrossRef]
Figure 1. The novel set-up for electromagnetic actuation proposed in this paper: (a) system overview, (b) zoomed-in view of the actuator and moving object, and (c) simplified view of the moving object with its free-body diagram. .
Figure 1. The novel set-up for electromagnetic actuation proposed in this paper: (a) system overview, (b) zoomed-in view of the actuator and moving object, and (c) simplified view of the moving object with its free-body diagram. .
Preprints 99549 g001
Figure 2. Block diagram showing the structure of the experimental set-up.
Figure 2. Block diagram showing the structure of the experimental set-up.
Preprints 99549 g002
Figure 3. Representative results for motion tracking of the oscillating pendulum: (a) displacement time-series, (b) detailed view of displacement time-series, (c) displacement normalized histogram, (d) displacement power spectrum (PSD).
Figure 3. Representative results for motion tracking of the oscillating pendulum: (a) displacement time-series, (b) detailed view of displacement time-series, (c) displacement normalized histogram, (d) displacement power spectrum (PSD).
Preprints 99549 g003aPreprints 99549 g003b
Figure 4. Electromagnet experimental characterization at 24 V supply voltage: (a) axial magnetic flux, (b) radial magnetic flux, (c) axial magnetic flux measured in the presence of the ball, (d) radial magnetic flux measured in the presence of the ball. The black circle in panels (c) and (d) represents the ball, while the coordinate system is placed on the electromagnet surface with its origin on the geometrical center of the core.
Figure 4. Electromagnet experimental characterization at 24 V supply voltage: (a) axial magnetic flux, (b) radial magnetic flux, (c) axial magnetic flux measured in the presence of the ball, (d) radial magnetic flux measured in the presence of the ball. The black circle in panels (c) and (d) represents the ball, while the coordinate system is placed on the electromagnet surface with its origin on the geometrical center of the core.
Preprints 99549 g004
Figure 5. (a) Magnetic force measurements at various distances between the electromagnet surface and the ball center for different electromagnet supply voltages (4, 8, 12, 16, 20, and 24 V): the discrete data points are the measured values, while the continuous lines are the predictions of the fitting relation in Equation (7); (b) parity plot with comparison between magnetic force predictions from Equation (7) and measurements (the dashed lines are ±20% error bounds).
Figure 5. (a) Magnetic force measurements at various distances between the electromagnet surface and the ball center for different electromagnet supply voltages (4, 8, 12, 16, 20, and 24 V): the discrete data points are the measured values, while the continuous lines are the predictions of the fitting relation in Equation (7); (b) parity plot with comparison between magnetic force predictions from Equation (7) and measurements (the dashed lines are ±20% error bounds).
Preprints 99549 g005
Figure 6. Measured and simulated trends of the damped free oscillations in (a) air, (b) water, and (c) glycol. The ball is in contact with the electromagnet surface at the beginning of the tests and is released with a step command that removes the applied voltage at t = 0 s. The plots use a different time scale for better visualization.
Figure 6. Measured and simulated trends of the damped free oscillations in (a) air, (b) water, and (c) glycol. The ball is in contact with the electromagnet surface at the beginning of the tests and is released with a step command that removes the applied voltage at t = 0 s. The plots use a different time scale for better visualization.
Preprints 99549 g006
Figure 7. Block diagram of the proposed closed-loop position control algorithm used to generate the voltage applied to the electromagnet.
Figure 7. Block diagram of the proposed closed-loop position control algorithm used to generate the voltage applied to the electromagnet.
Preprints 99549 g007
Figure 8. Closed-loop motion control of the ball surrounded by air with a constant-frequency position command (Video S1 and control parameters k F F = 1, k P = 2.2 V/mm, k I = 1.8 V/mm/s, and ω x = 7 Hz): (a) ball position, (b) position error, and (c) voltage command.
Figure 8. Closed-loop motion control of the ball surrounded by air with a constant-frequency position command (Video S1 and control parameters k F F = 1, k P = 2.2 V/mm, k I = 1.8 V/mm/s, and ω x = 7 Hz): (a) ball position, (b) position error, and (c) voltage command.
Preprints 99549 g008
Figure 9. Closed-loop control of the ball in the air with a variable-frequency command (Video S2 and control parameters k F F , 0 = 1, k F F * = 0.05/30 1/s, k P = 1.5 V/mm, k I = 1.05 V/mm/s, and ω x = 15 Hz): (a) ball position, (b) position error, (c) voltage command, and (d) input frequency.
Figure 9. Closed-loop control of the ball in the air with a variable-frequency command (Video S2 and control parameters k F F , 0 = 1, k F F * = 0.05/30 1/s, k P = 1.5 V/mm, k I = 1.05 V/mm/s, and ω x = 15 Hz): (a) ball position, (b) position error, (c) voltage command, and (d) input frequency.
Preprints 99549 g009
Figure 10. Closed-loop motion control of the ball surrounded by water with a constant-frequency command (Video S3 and control parameters k F F = 1, k P = 1.8 V/mm, k I = 1.2 V/mm/s, and ω x = 25 Hz): (a) ball position, (b) position error, and (c) voltage command.
Figure 10. Closed-loop motion control of the ball surrounded by water with a constant-frequency command (Video S3 and control parameters k F F = 1, k P = 1.8 V/mm, k I = 1.2 V/mm/s, and ω x = 25 Hz): (a) ball position, (b) position error, and (c) voltage command.
Preprints 99549 g010
Figure 11. Closed-loop control of the ball in the water with a variable-frequency position command (Video S4 and control parameters k F F , 0 = 1, k F F * = 0.005 1/s, k P = 1.05 V/mm, k I = 0.7 V/mm/s, and ω x = 30 Hz): (a) ball position, (b) position error, (c) and voltage command.
Figure 11. Closed-loop control of the ball in the water with a variable-frequency position command (Video S4 and control parameters k F F , 0 = 1, k F F * = 0.005 1/s, k P = 1.05 V/mm, k I = 0.7 V/mm/s, and ω x = 30 Hz): (a) ball position, (b) position error, (c) and voltage command.
Preprints 99549 g011
Figure 12. Closed-loop control of the ball in the glycol with a constant-frequency position command (Video S5 and control parameters k F F = 1, k P = 3 V/mm, k I = 2.5 V/mm/s, and ω x = 25 Hz): (a) ball position, (b) position error, and (c) voltage command.
Figure 12. Closed-loop control of the ball in the glycol with a constant-frequency position command (Video S5 and control parameters k F F = 1, k P = 3 V/mm, k I = 2.5 V/mm/s, and ω x = 25 Hz): (a) ball position, (b) position error, and (c) voltage command.
Preprints 99549 g012
Figure 13. Closed-loop motion control of the ball in the glycol with a variable-frequency position command (Video S6 and control parameters k F F , 0 = 1, k F F * = 0.1/30 1/s, k P = 0.8 V/mm, k I = 0.7 V/mm/s, and ω x = 30 Hz): (a) ball position, (b) position error, (c) voltage command.
Figure 13. Closed-loop motion control of the ball in the glycol with a variable-frequency position command (Video S6 and control parameters k F F , 0 = 1, k F F * = 0.1/30 1/s, k P = 0.8 V/mm, k I = 0.7 V/mm/s, and ω x = 30 Hz): (a) ball position, (b) position error, (c) voltage command.
Preprints 99549 g013
Figure 14. Comparison of the actual position error e z * = z S e t z M e a s   resulting from the tests reported above and performed in different conditions (air, water, and glycol): (a) constant-frequency position command, and (b) variable-frequency position command.
Figure 14. Comparison of the actual position error e z * = z S e t z M e a s   resulting from the tests reported above and performed in different conditions (air, water, and glycol): (a) constant-frequency position command, and (b) variable-frequency position command.
Preprints 99549 g014
Table 1. Synthesis of the control settings used to perform our experimental validations.
Table 1. Synthesis of the control settings used to perform our experimental validations.
Test k F F , 0 (-) k F F * (-) k P (V/mm) k I (V/mm/s) ω x (Hz)
Air (constant-frequency) 1 0 2.2 1.8 7
Air (variable-frequency) 1 0.05/30 1.5 1.05 15
Water (constant-frequency) 1 0 1.8 1.2 25
Water (variable-frequency) 1 0.005 1.05 0.7 30
Glycol (constant-frequency) 1 0 3 2.5 25
Glycol (variable-frequency) 1 0.1/30 0.8 0.7 30
Table 2. RMS values in mm of the actual position error e z * = z S e t z M e a s   resulting from the tests reported above and performed in different conditions (air, water, and glycol).
Table 2. RMS values in mm of the actual position error e z * = z S e t z M e a s   resulting from the tests reported above and performed in different conditions (air, water, and glycol).
Test RMS value Test RMS value
Air (constant-frequency) 0.1884 Air (variable-frequency) 0.3857
Water (constant-frequency) 0.1612 Water (variable-frequency) 0.3471
Glycol (constant-frequency) 0.1491 Glycol (variable-frequency) 0.2896
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
Copyright: This open access article is published under a Creative Commons CC BY 4.0 license, which permit the free download, distribution, and reuse, provided that the author and preprint are cited in any reuse.
Prerpints.org logo

Preprints.org is a free preprint server supported by MDPI in Basel, Switzerland.

Subscribe

© 2024 MDPI (Basel, Switzerland) unless otherwise stated