A 79.7g Manipulator Prototype for E-Flap Robot: A Plucking-Leaf Application

Received May 10, 2022, accepted June 14, 2022, date of publication June 17, 2022, date of current version June 23, 2022. Digital Object Identifier 10.1109/ACCESS.2022.3184110 A 79.7g Manipulator Prototype for E-Flap Robot: A Plucking-Leaf Application SAEED RAFEE NEKOO , DANIEL FELIU-TALEGON , JOSE ANGEL ACOSTA , AND ANIBAL OLLERO , (Fellow, IEEE) GRVC Robotics Laboratory, Departamento de Ingeniería de Sistemas y Automática, Escuela Técnica Superior de Ingeniería, Universidad de Sevilla, 41092 Seville, Spain Corresponding author: Saeed Rafee Nekoo ([email protected]) This work was supported in part by the European Project GRIFFIN European Research Council (ERC) Advanced Grant 2017 (Action 788247); and in part by the Plan Andaluz de Investigación, Desarrollo e Innovación (PAIDI) 2020 through the Project HOMing Pigeon bOT (HOMPOT) under Grant PY20_00597. ABSTRACT The manipulation capabilities of flapping-wing flying robots (FWFRs) is a problem barely studied. This is a direct consequence of the load-carrying capacity limitation of the flapping-wing robots. Ornithopters will improve the existent multirotor unmanned aerial vehicles (UAVs) since they could perform longer missions and offer a safe interaction in proximity to humans. This technology also opens the possibility to perch in some trees and perform tasks such as obtaining samples from nature, enabling biologists to collect samples in remote places, or assisting people in rescue missions by carrying medicines or first-aid kits. This paper presents a very lightweight manipulator (79.7g) prototype to be mounted on an ornithopter. The distribution of the mass on the flapping-wing robot is sensitive and an extra lumped mass far from the center-of-mass (CoM) of the robot deteriorates the flight stability. A configuration was proposed to avoid changing the CoM. Flight experiments show that adding the arm to the robot only moved the CoM 6mm and the performance of the flight with the manipulator has been satisfactory. Plucking leaf is chosen as an application to the designed system and several experimental tests confirmed successful sampling of leaves by the prototype. INDEX TERMS Flapping-wing robot, lightweight manipulator, aerial manipulation, aerial robot, leaf plucking. I. INTRODUCTION In the last decade, the physical interaction between aerial robots and their environment, particularly for manipulation, has attracted great interest in academia [1]. Recent aerial platforms [1]–[4], have demonstrated to be very efficient solutions for remote sensing for mapping, inspection in industrial environments, detecting natural disasters, and cooperative free-flying for assembly and structure constructions. There are several devices for manipulation, ranging from one-degree-of-freedom (DoF) grippers [5]–[7], vacuum-cups to grab an object [8], to multi-DoF manipulators [9]–[12]. The reported aerial manipulation tasks have been successfully performed [1]. Nowadays by multirotor unmanned autonomous vehicles (UAVs), users could carry lightweight manipulators; however, this technology still suffers from The associate editor coordinating the review of this manuscript and approving it for publication was Tao Liu . some limitations such as autonomy or safety to collaborate with humans. In the last years, a new generation of aerial robots with flapping wings has aroused interest because of their prominent advantages. Flapping wing robots are bio-inspired solutions to produce lift and thrust in aerial robots, leading to a quieter, safer, and more efficient alternative [13]. Adding manipulation capability to ornithopters is the next step after fly and perch to justify the usage of the robot in different applications. However, the ‘‘lightweight’’ manipulators for multirotor UAVs are still ‘‘heavy’’ for ornithopters. As a result, the scale of weight must be reduced more than the conventional one for aerial manipulators [4]. There are some limitations in aerial manipulation with ornithopters such as a reduction in the accuracy since it is difficult that the system holds a position long enough for the manipulator to converge. That limit is due to the incapability of stationary flight of the FWFR in contrast with multirotor systems. Then the 65300 This work is licensed under a Creative Commons Attribution 4.0 License. For more information, see https://creativecommons.org/licenses/by/4.0/ VOLUME 10, 2022 S. R. Nekoo et al.: 79.7g Manipulator Prototype for E-Flap Robot: A Plucking-Leaf Application manipulation in this work is done after perching on a branch and after that, the manipulation starts. The leg must hold the bird in a proper position. The animal flapping flight has attracted enormous interest in the last few years [14], [15]. Many flapping-wing aerial platforms have been developed that motivate the use of this generation of aerial robots. The current effort is concentrated on increasing the load capacity [16], improving flight performance, and adding manipulation capabilities. The hard challenge of adding manipulation capabilities to aerial robots such as flapping-wing birds has been barely explored [17], [18]; the control problem of manipulation was addressed while the system was perched maintaining the equilibrium. Small manipulators for surgeries [19], micromanipulation [20], etc. have been proposed in the literature. A small robotic manipulator was built for intrauterine fetal surgery in an open magnetic resonance imaging; the robot possessed 5 DoFs and the weight was 500g (a major part was dedicated to electronics) [19]. A 535g two-DoF manipulator was designed for carrying a load up to 200g [21]. The design and development of new prototypes of very lightweight manipulators is currently a research topic of interest since there is not a standard or commercial solution suitable for their integration into aerial platforms. The hard requirements of aerial robots and in particular flapping-wing robots make us investigate new designs to perform some manipulation tasks in high-altitude or dangerous places that cannot be easily accessed from the ground. We propose an ultra-lightweight two DoF robot manipulator with a gripper at the end-effector to carry out tasks like sample collection. Moreover, this work is analyzed in-depth in terms of the integration of the manipulator in a way not to influence the flight of the system and perform some manipulation tasks. An interactive application with plants has been aimed, specifically, to pluck a leaf from a branch or a tree for post-analytical laboratory work. The analysis of plant diseases and pests is important for determining the yield and quality of plants. Plant diseases are responsible for major economic losses in the agricultural industry worldwide, in particular in dangerous places that humans cannot access easily. Sampling leaves is an application of robotics using visual servoing and computer vision technique [22]–[25]. The platforms for moving the sampling device and the vision system are usually mobile robots or industrial manipulators. The monitoring systems for leaves and also agricultural applications using aerial systems were mostly vision-based monitoring systems without interaction with the plant [26]–[28]. The problem associated with automatic plant disease identification using visible range images has received considerable attention in the last two decades [29]. Monitoring plant health and detecting pathogen, at early stages, are essential to reduce disease spread and facilitate effective management practices [30]. However, the detection of diseases using vision is challenging because of the complex lighting conditions and multiple morphologies. The ultimate long-term vision is to substitute the traditional manual plucking methods of leaves which not only are inefficient, but also require a great deal of labor, leading to a high-cost problem. For example, the research and development of automated tea harvesting robots have attracted great interest in the last years [24]. Perching and manipulation could be viewed as the same ability for flapping-wing robots since both have actuators and add additional degrees of freedom to the system. Considering two legs, one could balance the bird on a branch or the ground and the other could help to manipulate an object. However, here in this work, manipulators are considered as an additional mechanism possibly on top of the robotic birds for sampling, carrying small objects, etc.; and the legs installed below the robot. In the literature, the legs served for takeoff [31], [32], bipedal locomotion [33], or perching [34], [35]. The preliminary works for leg design [34], [35] focused on bio-inspiration and soft robotics, and for the safety of the bird, a supporting-safety rope was used. They used two legs for adding manipulation capability as well, Bellow the robot or for moving the bird on the branch. Here the motivation is to increase the workspace and have the manipulator for sampling or manipulation on top at the tip of the bird. The scale is ultra-lightweight to show the flight demonstration without a safety rope, presented in the video file as supplementary material. The main contribution of this work is to design a 79.7g manipulator (including the driver, micro-controller, and electronics), mounted at the tip of a flapping wing robot to sample leaves from trees, as a post-perching study. The results have been validated and tested experimentally: flight capability with the manipulator on top in indoor tests, and leaf-plucking tests in outdoor experimentation. Also, it is important to highlight that to the best of the authors’ knowledge, it is the first time that a flapping-wing robot with a manipulator on top, automatically flies without a radio control transmitter. The flight control repeatedly regulates the FWFR to the desired set-point. The prototype has autonomous capabilities onboard and the validation has been done by closing the loop with the motion capture system. This article is organized as follows. Section II presents the description of the flapping bird robot. Section III describes the mechanical design of the arm. Section IV describes the actual prototype and hardware characteristics of the manipulator, and experimental results are reported in Section V. Finally, concluding remarks and proposals for future studies are given in Section VI. II. E-FLAP ORNITHOPTER: FEATURES AND BACKGROUND This section presents the most important features of the flapping-wing robot, E-Flap [16], on which the manipulator design is integrated. A photograph of the E-Flap (flying outdoor) is shown in Fig. 1. The E-Flap has been developed within the GRIFFIN1Advanced Grant of the European Research Council, and the features considered in the design 1General compliant aerial Robotic manipulation system Integrating Fixed and Flapping wings to INcrease range and safety (https://griffin-erc- advancedgrant.eu). VOLUME 10, 2022 65301 S. R. Nekoo et al.: 79.7g Manipulator Prototype for E-Flap Robot: A Plucking-Leaf Application have been: 1) Flapping wing robots with autonomous capabilities, which includes onboard electronics for perception and control activities, 2) Manipulation capabilities, which include devices to be able to interact with the environment. The perception part including the hardware and computational power needed to perform onboard reliable perception, including an event camera has been addressed by [36]. E-Flap prototype has a NanoPi companion computer directly plugged into the PCB (Printed Circuit Board) with the micro-controller and a WiFi module, used to receive flight instruction from an external PC when flying. The NanoPi is connected to the VectorNAV VN-200 board which is a highperformance GNSS-Aided Inertial Navigation System. This allows autonomous navigation with the E-Flap ornithopter. More information about the hardware architecture of the E-Flap can be found in [16]. FIGURE 1. E-Flap outdoor flight. Some control techniques have been proposed for improving the autonomous flight of the system [37]. E-Flap prototype weighs 510g and it has been demonstrated that it can carry a payload up to 520g [16]. However, a payload bigger than 300g degrades the performance in flight enormously reducing the maneuverability and the climb rate of the system (flight angle). This forces us to design a manipulator with the hard requirement of 100g, that is the 30% of the payload capability leaving the rest of the payload for the perception and other devices that are required. Another requirement is to establish an adequate position for the installation of the manipulator. The E-Flap’s body consisted of two carbon fiber plates of 1.5mm thickness which create a protected space to add the transmission, the motors, and so on. III. DESCRIPTION OF TWO-DoF ROBOT MANIPULATOR A. DYNAMIC MODEL OF THE MANIPULATOR The robotic manipulator in this work is a two-DoF planar arm, set up in the YZ plane and the gravity affects the system in the Yaxis direction. It should be noted that once the robot landed on a branch, the manipulator starts working, then the dynamic equation of the robotic arm is in the form of fixed base robots. The dynamics of the manipulator possess the common form of [38]: M(q)¨ q+c(q,˙ q)+g(q)=u,(1) where q(t)∈R2includes a generalized coordinate vector, M(q):R2→R2×2is an inertia matrix, c(q,˙ q):R2× R2→R2includes the Coriolis and centrifugal terms, and g(q):R2→R2is a gravity vector. The inertia matrix, gravity, and Coriolis and centrifugal vectors are presented as: M(q)=m11(q)m12(q) m12(q)m22(q), g(q)=g1(q) g2(q), c(q,˙ q)=c1(q,˙ q) c2(q,˙ q),(2) where the details are presented in [39]: m11(q)=m2a2 c,2+mpa2 2+2mpa2a1cos(q2) +Izz,2+Izz,1+m1a2 c,1+m2a2 1+mpa2 1 +2m2ac,2a1cos(q2), m12(q)=m2a2 c,2+m2ac,2a1cos(q2) +Izz,2+mpa2 2+mpa2a1cos(q2), m22(q)=m2a2 c,2+Izz,2+mpa2 2, g1(q)=g(m1ac,1cos(q1)+m2ac,2cos(q1+q2) +m2a1cos(q1)+mpa2cos(q1+q2) +mpa1cos(q1)), g2(q)=gcos(q1+q2)(ac,2m2+mpa2), c1(q,˙ q)= −sin(q2)˙q2a1(2˙q1+ ˙q2)(ac,2m2+a2mp), c2(q,˙ q)=a1sin(q2)(ac,2m2+a2mp)˙q2 1, in which ai(m),mi(kg),Izz,i(kgm2) are the length, mass, and moment of inertia of the i-th link, mpis mass of the load, and g=9.81(m/s2) is gravity constant. Considering the state vector of the system as x= [qT,˙ qT]T, the state-space representation of the system (1) is found: ˙ x=˙ q −M−1(q)(c(q,˙ q)+g(q))+0 M−1(q)u.(3) B. DESIGN DECISION MAKING The load-carrying capacity of the flapping-wing robot is limited, hence, reducing the weight in any possible aspect has been always demanded. To reduce the weight, the use of a carbon-fiber plate was preferred rather than 3D printed polylactide (PLA) material in joints and holders. On the one hand, the flapping wing bird is stable in flight, and adding any mass to the system changes the center-of-mass (CoM) of the whole body and deviates the bird from stability conditions in flight. On the other hand, the proper position for the arm is at the tip of the bird for manipulation purposes. Mounting the 65302 VOLUME 10, 2022 S. R. Nekoo et al.: 79.7g Manipulator Prototype for E-Flap Robot: A Plucking-Leaf Application FIGURE 2. The bird, holding the arm on the wings. manipulator at the tip of the bird has several advantages: it can be placed on the wings during the flight, see Fig. 2. It should be noted that on top of the wing is the safest place in case of a possible landing. It also has access to the workspace in front of the bird after perching on a branch. The leg of the bird could move the arm for extending the workspace (the leg adds another DoF to the bird and it can move the whole body while it is on the branch). An added lumped mass at the tip of the bird changes significantly the distribution of the mass on the whole body. To compensate for the imbalanced mass, the leg could be moved back from the CoM. An end-effector gripper is required for holding/moving a lightweight object during the manipulation and a lightweight mini servomotor is chosen for this task. To reduce the weight of the gripper, the side surface of the servo holder was chosen as the fixed jaw of the gripper. The design of the manipulator is presented in Fig. 3. The total weight of the arm with electronics weighs 79.7g, see Fig. 4. The center of gravity of the E-Flap before adding the leg and manipulator was reported 218.215mm from the tip of the bird (alongside the longitudinal axis) [16]. Adding the leg moved it back to 221mm, measured experimentally by finding a point that puts the bird in a horizontal and balanced state in the OptiTrack testbed, see Fig. 5, the top picture. Finally, adding the manipulator at the tip of the bird and spreading it on the wings, will change the CoM to the final value of 215mm. The change in the CoM is not significant so the flight parameters have remained the same for the experimentation. The CoM measurement method is as follows. Searching a position alongside the body axis and placing a pin under the main rod of the body. When the bird is stable and the rod is horizontal, that point is the CoM which was found experimentally. The obtained data before adding the manipulator was also close to the data received from the CAD model [16]. The same approach defined the CoM position after the installation of the manipulator and the electronics. FIGURE 3. The CAD design of the manipulator. FIGURE 4. The weight of the manipulator and the electronics, 79.7g. C. HARDWARE ARCHITECTURE The two-DoF robot manipulator consists of two-carbon fiber links actuated with two Pololu brushed direct-current (DC) micro metal reduction gear-motors (1:200). The motors are controlled using pulse-width modulation signals through an L293D quadruple half-H driver. Angular positions of the motors are measured using magnetic encoders, which provide the rotatory position of the motors. The gripper of the manipulator is actuated by a servomotor BlueBird BMS-115HV, which weighs 11.3g, with 4.3kgcm torque at 6.0V. Processing is performed on a Arduino Micro single-board computer, responsible for data acquisition, control implementation, and communications. Also, it has been designed a PCB to mount all the electronic components on a board and connect the different sensors and actuators in a working circuit. The hardware/software architecture of the system and the different components are represented in Fig. 6. The figure shows the weight of all the electronic components around 52g in total which means that the weight of the structure of the manipulator and the wiring is only 28g. IV. NONLINEAR CONTROL DESIGN To control the system (1), a feedback linearization term combined with a PID controller is used. This control technique cancels out all the nonlinearities so that the output dynamics become linear. In essence, it transforms the original system into an equivalent linear form by change of coordinates and feedback. Thus, since the whole state x=[qT,˙ qT]Tis measurable, the system can be linearized utilizing the following fictitious control input v, a PID input: ¨ q=v,(4) VOLUME 10, 2022 65303 S. R. Nekoo et al.: 79.7g Manipulator Prototype for E-Flap Robot: A Plucking-Leaf Application FIGURE 5. The CoM measurement of the E-Flap before and after installation of the manipulator and electronics. FIGURE 6. Components of the system. where vis supplied into: u=M(q)v+c(q,˙ q)+g(q),(5) where M(q),c(q,˙ q),g(q) are reported in Eq. (2). By taking Laplace transform of (4), the transfer function of the system is G(s)=diag(1/s2,1/s2), that relates the angular position of each joint with the fictitious input, v. Then, by using a PID controller for each angular position in the form of: R(s)=diag(kp+ki s+kds,kp+ki s+kds) (6) each link is controlled successfully, provided that the PID gains are well-tuned. The controller (6) with the linearization (5) cancels out all the nonlinearities of the system ensuring good trajectory tracking and eliminating the error due to friction of the motors and unmodeled disturbances. V. EXPERIMENTAL RESULTS In this section, we perform two kinds of experiments: a) experiments of the ornithopter flying with the manipulator and b) experiments performing a plucking-leaf application when the ornithopter is perched on a branch. For the flight experiments, we use a motorized launcher to start the flight of the ornithopter with a preset speed, of 4m/s. The flight experiments are performed indoors because at this stage the controlled flights are only possible in the indoor test-bed equipped with an OptiTrack system for providing position feedback of the ornithopter. Outdoor flights and perching maneuvers are not possible, then it is supposed that the ornithopter has perched on a branch and it is in a stable position. On the other hand, the plucking leaf experimentation has been done outdoors on a real tree. We highlight that the topics to perform the complete process with flapping-wing robots have been addressed in previous literature such as flying [16], and stabilization after perching [18]. The other necessary step is perching on a branch, which is not considered in this work. Then, the focus of this paper is to address the post-perching application of the ornithopter and its manipulator in outdoor scenarios. The robot manipulator must be capable of plucking leaves from the branches of a tree. The ornithopter is placed in an appropriate position with accessibility to a leaf. The manipulator is programmed to go towards the leaf’s position and pluck it from a tree, then put it back in a box on top of the wings. Then, the process is not fully autonomous at this stage since there is no camera to report the relative position between the leaf and the manipulator. A. FLIGHT EXPERIMENTS WITH MANIPULATOR We test the flight performance of the ornithopter including the manipulator. This is important to verify: a) the manipulator is lightweight enough to be transported by the flappingwing robot, b) the decision of mounting the manipulator at the tip and spread it above the wings is a good choice and c) the increase in weight with a slight modification of the center of gravity (6mm) does not influence the performance in flight. The ornithopter was launched from its initial point using a motorized launcher which sets the initial speed of the ornithopter. The ornithopter was commanded to a target point with a height of 2m and followed a straight line in the plane XY using the PID controller based on the previous work [37]. The snapshots of the flying bird carrying the manipulator are shown in Fig. 7. The manipulator was spread on top of the wings to distribute the mass alongside the main axis of the bird, the longitudinal one. Figure 8shows the robot’s trajectory in the XZ plane. 65304 VOLUME 10, 2022 S. R. Nekoo et al.: 79.7g Manipulator Prototype for E-Flap Robot: A Plucking-Leaf Application FIGURE 7. The snapshots of the flight experiment, carrying the manipulator. The manipulator was spread on top of the wings to distribute the mass. FIGURE 8. Robot’s trajectory in the XZ plane with and without the manipulator. The trajectories are obtained via a visual infrared tracking system with very high precision. The figures report the data of four experiments. The first experiment was performed without the manipulator using it as a flight performance reference because the controllers were adjusted for this case. The other three experiments were performed with the manipulator. It can be seen that the performances of the four experiments are similar and the influence of the manipulator in the flight is almost negligible. The figure also shows that the controller performs correctly, with a maximum error of 10cm on the Zaxis. B. PLUCKING-LEAF APPLICATION RESULTS Experiments have been carried out with the prototype described in Section II to demonstrate the possibility to perform manipulation tasks. We validate the proposed design and demonstrate that the hardware architecture allows us to control the manipulator. The tests verify the reliability of the designed gripper and the control position of the DC micro motors using the control strategy described in Section IV. Also, it is demonstrated that the micromotors are powerful enough to perform the desired tasks. The PID gains of the controller are well-tuned experimentally to achieve almost perfect trajectory tracking. The gains are set to the values kp=500, kd=25 and ki=5 for each link. Figure 9shows the results of the experiment. Figure 9-(a) shows the references of the DC motors (dashed line), their angular positions measured by the encoders of the motors (solid lines), and the commanded servomotor position. FIGURE 9. Experimental results. We can see that the position of the servomotor varies between the opened claw position (58◦) and the closed claw position (98◦) to keep the gripper opened and closed, respectively. Moreover, it shows that the DC motors perform good trajectory tracking using the proposed nonlinear controller of Section IV. The reference trajectories are second-order polynomial curves to avoid moving the motors abruptly or reaching the motor saturation bounds. These soft references are important in the DC micromotors to avoid any possible damage to the gears. Figure 9-(b) shows the PWM duty cycle of the control signal that is injected into the motors provided by the nonlinear controller. The input PWM duty cycle signals are in the range of [−100,100]. A signed PWM duty cycle is used for clearer comprehension. It can be noticed that the signals are smooth and they are not reaching the values of the motor VOLUME 10, 2022 65305 S. R. Nekoo et al.: 79.7g Manipulator Prototype for E-Flap Robot: A Plucking-Leaf Application FIGURE 10. The time-lapse of the experiment in sampling a leaf from a tree. The yellow circle in (1) indicates the target leaf to be plucked. (4) shows that the gripper is open and the leaf is in the right position, see the red arrow, and in (5), the gripper is closed and takes the leaf. saturation. Also, it can be seen that in the stage of plucking the leaf, the control signal is twice bigger than in the stage of moving towards the commanded point because the trajectory is faster and the system is moving against gravity. Even so, the motors do not produce saturation which means that they are powerful enough for this task despite their ultralightweight characteristics. Finally, Fig. 10 shows the experiment time lapse. The manipulator was set on the initial position, shown in Fig. 10-(1), successfully moved towards the commanded point, Fig. 10-(2) to Fig. 10-(3), gripper open in Fig. 10-(4), grasped the leaf, Fig. 10-(5), and plucked the leaf in subplot (7), and finally placed the leaf in the box, presented in subplot (8). VI. CONCLUDING REMARKS A. CONCLUSION This work presented the design of a very lightweight manipulator for flapping-wing flying robots to sample/pluck leaves from a branch or tree after perching. The arm consists of a two-DoF planar robot and a servo gripper for taking the sample. The load capacity of the ornithopter is quite limited, defined as 100g for the manipulation device, which forces us to reduce any extra part from the manipulator. The system designed considering the reduction of plastic/aluminum parts and adding carbon-fiber components, resulted in a 79.7g robot including electronics, drivers, and processor board. The experiment, plucking a leaf from a tree was shown the success of the design and the prototype is still 20g below the load carrying limitation. Moreover, this approach could also be used to carry some medicine to humans in rescue missions perching next to the injured person. Other applications can be addressed easily with this approach by changing only the end-effector of the system. The FWFR flew with the arm freely spread on top of the bird, and the motors were turned off to avoid damaging the gears caused by the oscillation of the flapping. We believe if we lock the arms in a specific position, the motors will be damaged. B. FUTURE STUDY Tacking a sample and restoring it with only one arm is a challenging task. It is suggested to increase the number of arms to two to perform dual-arm manipulation, which will allow more sophisticated sampling and delivery applications. 65306 VOLUME 10, 2022 S. R. Nekoo et al.: 79.7g Manipulator Prototype for E-Flap Robot: A Plucking-Leaf Application The other topic for studying is visual servoing and adding a camera to the robot for online monitoring and providing the position of the leaf for plucking to the arm. This approach will present an autonomous platform for the task. Moreover, the application of the aerial flapping-wing robot could be extended to the delivery of the medicine for people in an emergency in out-of-reach places, sensing and measurement from nature, and monitoring. REFERENCES [1] A. Ollero, M. Tognon, A. Suarez, D. Lee, and A. Franchi, ‘‘Past, present, and future of aerial robotic manipulators,’’ IEEE Trans. Robot., vol. 38, no. 1, pp. 626–645, Feb. 2022. [2] A. Ollero, G. Heredia, A. Franchi, G. Antonelli, K. Kondak, A. Sanfeliu, A. Viguria, J. R. M.-D. Dios, F. Pierri, J. Cortes, A. Santamaria-Navarro, M. A. T. Soto, R. Balachandran, J. Andrade-Cetto, and A. Rodriguez, ‘‘The AEROARMS project: Aerial robots with advanced manipulation capabilities for inspection and maintenance,’’ IEEE Robot. Autom. Mag., vol. 25, no. 4, pp. 12–23, Dec. 2018. [3] A. Ollero and B. Siciliano, Aerial Robotic Manipulation. Cham, Switzerland: Springer, 2019. [4] A. Suarez, M. Perez, G. Heredia, and A. Ollero, ‘‘Small-scale compliant dual arm with tail for winged aerial robots,’’ in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS), Nov. 2019, pp. 208–214. [5] P. E. I. Pounds, D. R. Bersak, and A. M. Dollar, ‘‘Stability of small-scale UAV helicopters and quadrotors with added payload mass under PID control,’’ Auton. Robots, vol. 33, nos. 1–2, pp. 129–142, 2012. [6] S. Shimahara, S. Leewiwatwong, R. Ladig, and K. Shimonomura, ‘‘Aerial torsional manipulation employing multi-rotor flying robot,’’ in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS), Oct. 2016, pp. 1595–1600. [7] A. Rodriguez-Castaño, S. R. Nekoo, H. Romero, R. Salmoral, J. Á. Acosta, and A. Ollero, ‘‘Installation of clip-type bird flight diverters on highvoltage power lines with aerial manipulation robot: Prototype and testbed experimentation,’’ Appl. Sci., vol. 11, no. 16, p. 7427, Aug. 2021. [8] C. C. Kessens, J. Thomas, J. P. Desai, and V. Kumar, ‘‘Versatile aerial grasping using self-sealing suction,’’ in Proc. IEEE Int. Conf. Robot. Autom. (ICRA), May 2016, pp. 3249–3254. [9] H. Lee, H. Kim, and H. J. Kim, ‘‘Path planning and control of multiple aerial manipulators for a cooperative transportation,’’ in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS), Sep. 2015, pp. 2386–2391. [10] N. Lai, Y. Chen, J. Liang, B. He, H. Zhong, and Y. Wang, ‘‘An onboardeye-to-hand visual servo and task coordination control for aerial manipulator based on a spherical model,’’ Mechatronics, vol. 82, Apr. 2022, Art. no. 102724. [11] N. Imanberdiyev, S. Sood, D. Kircali, and E. Kayacan, ‘‘Design, development and experimental validation of a lightweight dual-arm aerial manipulator with a COG balancing mechanism,’’ Mechatronics, vol. 82, Apr. 2022, Art. no. 102719. [12] M. Zhao, K. Nagato, K. Okada, M. Inaba, and M. Nakao, ‘‘Forceful valve manipulation with arbitrary direction by articulated aerial robot equipped with thrust vectoring apparatus,’’ IEEE Robot. Autom. Lett., vol. 7, no. 2, pp. 4893–4900, Apr. 2022. [13] M. I. Woods, J. F. Henderson, and G. D. Lock, ‘‘Energy requirements for the flight of micro air vehicles,’’ Aeronaut. J., vol. 105, no. 1045, pp. 135–149, Mar. 2001. [14] C. P. Ellington, ‘‘The novel aerodynamics of insect flight: Applications to micro-air vehicles,’’ J. Experim. Biol., vol. 202, no. 23, pp. 3439–3448, Dec. 1999. [15] M. F. Platzer, K. D. Jones, J. Young, and J. C. S. Lai, ‘‘Flapping wing aerodynamics: Progress and challenges,’’ AIAA J., vol. 46, no. 9, pp. 2136–2149, 2008. [16] R. Zufferey, J. Tormo-Barbero, M. M. Guzman, F. J. Maldonado, E. Sanchez-Laulhe, P. Grau, M. Perez, J. A. Acosta, and A. Ollero, ‘‘Design of the high-payload flapping wing robot E-Flap,’’ IEEE Robot. Autom. Lett., vol. 6, no. 2, pp. 3097–3104, Apr. 2021. [17] D. Feliu-Talegon, J. Á. Acosta, A. Suarez, and A. Ollero, ‘‘A bio-inspired manipulator with claw prototype for winged aerial robots: Benchmark for design and control,’’ Appl. Sci., vol. 10, no. 18, p. 6516, Sep. 2020. [18] D. Feliu-Talegon, J. A. Acosta, and A. Ollero, ‘‘Control aware of limitations of manipulators with claw for aerial robots imitating Bird’s skeleton,’’ IEEE Robot. Autom. Lett., vol. 6, no. 4, pp. 6426–6433, Oct. 2021. [19] K. Harada, K. Tsubouchi, M. G. Fujie, and T. Chiba, ‘‘Micro manipulators for intrauterine fetal surgery in an open MRI,’’ in Proc. IEEE Int. Conf. Robot. Autom., Apr. 2005, pp. 502–507. [20] A. Menciassi, A. Eisinberg, I. Izzo, and P. Dario, ‘‘From ‘macro’ to ‘micro’ manipulation: Models and experiments,’’ IEEE/ASME Trans. Mechatronics, vol. 9, no. 2, pp. 311–320, Jun. 2004. [21] B. H. Do, O. G. Osele, and A. M. Okamura, ‘‘A lightweight, highextension, planar 3-degree-of-freedom manipulator using pinched bistable tapes,’’ 2021, arXiv:2110.09751. [22] Y. Li, L. He, J. Jia, J. Lv, J. Chen, X. Qiao, and C. Wu, ‘‘In-field tea shoot detection and 3D localization using an RGB-D camera,’’ Comput. Electron. Agricult., vol. 185, Jun. 2021, Art. no. 106149. [23] G. Sethia, H. K. S. Guragol, S. Sandhya, J. Shruthi, and N. Rashmi, ‘‘Automated computer vision based weed removal bot,’’ in Proc. IEEE Int. Conf. Electron., Comput. Commun. Technol. (CONECCT), Jul. 2020, pp. 1–6. [24] Y.-L. Lai, P.-L. Chen, and P.-L. Yen, ‘‘A human-robot cooperative vehicle for tea plucking,’’ in Proc. 7th Int. Conf. Control, Decis. Inf. Technol. (CoDIT), Jun. 2020, pp. 217–222. [25] S. K. Thangavel and M. Murthi, ‘‘A semi automated system for smart harvesting of tea leaves,’’ in Proc. 4th Int. Conf. Adv. Comput. Commun. Syst. (ICACCS), Jan. 2017, pp. 1–10. [26] Y. Song, J. Wang, and B. Shan, ‘‘An effective leaf area index estimation method for wheat from UAV-based point cloud data,’’ in Proc. IEEE Int. Geosci. Remote Sens. Symp., Jul. 2019, pp. 1801–1804. [27] L. Du, Y. Sun, S. Chen, J. Feng, Y. Zhao, Z. Yan, X. Zhang, and Y. Bian, ‘‘A novel object detection model based on faster R-CNN for spodoptera frugiperda according to feeding trace of corn leaves,’’ Agriculture, vol. 12, no. 2, p. 248, Feb. 2022. [28] Q. Sun, X. Gu, L. Chen, X. Xu, Z. Wei, Y. Pan, and Y. Gao, ‘‘Monitoring maize canopy chlorophyll density under lodging stress based on UAV hyperspectral imagery,’’ Comput. Electron. Agricult., vol. 193, Feb. 2022, Art. no. 106671. [29] J. G. A. Barbedo, ‘‘A review on the main challenges in automatic plant disease identification based on visible range images,’’ Biosyst. Eng., vol. 144, pp. 52–60, Apr. 2016. [30] F. Martinelli, R. Scalenghe, S. Davino, S. Panno, G. Scuderi, P. Ruisi, P. Villa, D. Stroppiana, M. Boschetti, L. R. Goulart, C. E. Davis, and A. M. Dandekar, ‘‘Advanced methods of plant disease detection. A review,’’ Agronomy Sustain. Develop., vol. 35, no. 1, pp. 1–25, Jan. 2015. [31] O. A. Hudson, M. Fanni, S. M. Ahmed, and A. Sameh, ‘‘Autonomous flight take-off in flapping wing aerial vehicles,’’ J. Intell. Robotic Syst., vol. 98, no. 1, pp. 135–152, Apr. 2020. [32] N. T. Truong, H. V. Phan, and H. C. Park, ‘‘Design and demonstration of a bio-inspired flapping-wing-assisted jumping robot,’’ Bioinspiration Biomimetics, vol. 14, no. 3, Mar. 2019, Art. no. 036010. [33] K. Peterson and R. S. Fearing, ‘‘Experimental dynamics of wing assisted running for a bipedal ornithopter,’’ in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., Sep. 2011, pp. 5080–5086. [34] A. E. Gomez-Tamm, V. Perez-Sanchez, B. C. Arrue, and A. Ollero, ‘‘SMA actuated low-weight bio-inspired claws for grasping and perching using flapping wing aerial systems,’’ in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS), Oct. 2020, pp. 8807–8814. [35] V. Perez-Sanchez, A. E. Gomez-Tamm, F. J. Garcia-Rubiales, B. Arrue, and A. Ollero, ‘‘Analysis of forces involved in the perching maneuver of flapping-wing aerial systems and development of an ultra-lightweight perching system,’’ in Proc. Int. Conf. Unmanned Aircr. Syst. (ICUAS), Jun. 2021, pp. 1284–1290. [36] A. G. Eguiluz, J. P. Rodriguez-Gomez, R. Tapia, F. J. Maldonado, J. A. Acosta, J. R. Martinez-de Dios, and A. Ollero, ‘‘Why fly blind? Event-based visual guidance for ornithopter robot flight,’’ in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS), Sep. 2021, pp. 1958–1965. [37] F. J. Maldonado, J. A. Acosta, J. Tormo-Barbero, P. Grau, M. M. Guzman, and A. Ollero, ‘‘Adaptive nonlinear control for perching of a bioinspired ornithopter,’’ in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS), Oct. 2020, pp. 1385–1390. [38] R. J. Schilling, Fundamentals of Robotics: Analysis and Control. Englewood Cliffs, NJ, USA: Prentice-Hall, 1990. [39] S. Rafee Nekoo, ‘‘Nonlinear closed loop optimal control: A modified state-dependent Riccati equation,’’ ISA Trans., vol. 52, no. 2, pp. 285–290, Mar. 2013. VOLUME 10, 2022 65307 S. R. Nekoo et al.: 79.7g Manipulator Prototype for E-Flap Robot: A Plucking-Leaf Application SAEED RAFEE NEKOO is currently a Senior Postdoctoral Research Fellow with the Robotics, Vision, and Control Research Group (GRVC) Robotics Laboratory, University of Seville, in association with AICIA. He is currently involved in the AERIAL-CORE H2020 project in the control of inspection robots for high-voltage power lines; Advanced Grant GRIFFIN ERC in the design and prototyping of bird-shaped legs for perching; and lightweight cooperative manipulator design, prototyping, and control for a flapping bird bio-inspired robot. His research interests include robotics, nonlinear and optimal control, control engineering, manufacturing, cooperative robotics, flexible joint manipulators, observer, and estimator design, path planning, wheeled mobile robots, control of autonomous underwater vehicles, free-floating space manipulator design, and control, digital implementation of continuous-time nonlinear controllers, and design, manufacturing, and control of mechatronic systems, aerial robotics, multirotor UAV, variable-pitch-rotor quadcopter control, motion control of aerobatic maneuver, sliding mode control, the soft landing of drones, lightweight cooperative manipulators, and gravity compensation. DANIEL FELIU-TALEGON received the M.Sc. and Ph.D. degrees in industrial engineering from the University of Castilla—La Mancha, Ciudad Real, Spain, in 2014 and 2019, respectively. He is currently a Postdoctoral Research Fellow with the Robotics, Vision, and Control Research Group (GRVC) Robotics Laboratory, University of Seville, where he has been engaged in the GRIFFIN ERC Advanced Grant project in the development of manipulation capabilities for flapping-wing robots. His research interests include the active damping of vibrations in flexible structures, the fractional dynamics and control systems, the dynamic control of flexible robots, and the control of lightweight manipulators in aerial robotics. He was awarded the National Prize for the Best Ph.D. Thesis in Robotics, in 2019 by the Comité Español de Automática (CEA). JOSE ANGEL ACOSTA was born in Huelva, Spain. He received the Servo-Electrical and Mechanical Engineering degree from the University of Huelva, Spain, the Electrical Engineering degree from the University of Seville, Spain, and the Ph.D. degree from the Department of Automatic Control and Systems Engineering, University of Seville. He was a Marie Curie Control Training Site Fellow as a Member of the Centre National de la Recherche Scientifique (CNRS), France, Laboratoire des Signaux et Systèmes, Supélec, France, in 2003 and 2005. In 1999, he joined that Department as a Research Assistant, where he is currently a Professor and a Research Member with the Automatic Control and Robotics Institute. He has also been a Visitor at the Laboratoire des Signaux & Systèmes, CNRS, repeatedly, since 2005, and an Academic Visitor researching with the Department of Electrical and Electronic Engineering, as a Member of the Control and Power Group, Imperial College London, U.K., from 2008 to 2011. His research interests include nonlinear control of dynamical systems with an emphasis on electromechanical and robotic systems. He received a Ph.D. European Award, in 2005, for his Ph.D. degree. He was nominated for the George S. Axelby Outstanding Paper Award from the IEEE Transactions on Automatic Control journal, in 2006. ANIBAL OLLERO (Fellow, IEEE) is currently a Full Professor and the Head of the GRVC Robotics Laboratory, University of Seville, and the Scientific Advisor of the Center for Aerospace Technologies (CATEC), Seville. He has been a Full Professor at the Universities of Santiago and Malaga, Spain, and a Researcher at the Robotics Institute, Carnegie Mellon University, Pittsburgh, USA, and LAAS-CNRS, Toulouse, France. He has authored more than 750 publications, including nine books and 200 articles in journals and has been the editor of 15 books. He has delivered plenaries and keynotes in more than 100 events including IEEE ICRA 2016 and IEEE IROS 2018. He has been supervisor or co-supervisor of 45 Ph.D. theses that have received many awards. He led more than 160 research projects, participating in more than 25 projects of the European Research Programmes being a Coordinator of seven and associated or the Deputy Coordinator of three, all of them dealing with unmanned aerial systems and aerial robots. Since November 2018, he has been running the GRIFFIN ERC-Advanced Grant with the objective of developing a new generation of aerial robots that will be able to glide, flap the wings, perch, and manipulate by maintaining the equilibrium, and since December 2019, he is also the Coordinator of the H2020-AERiAL-CORE project with the participation of 15 universities, research centers, and companies dealing with aerial robotic manipulators and applications to inspection and maintenance. He has transferred technologies to more than 20 companies and has been awarded with 25 international research and innovation awards, including the recent Rei Jaume I in New Technologies, Spain, the Challenge 3 of the MBZIRC 2020 International Robotics Competition, the Overall Information and Communication Technologies Innovation Radar Prize 2017 of the European Commission, and has been also elected between the three European innovators of the year being a Candidate to the European personalities of the year 2017. 65308 VOLUME 10, 2022