Full text
sensors Article Assessment of the Accuracy of a Multi-Beam LED Scanner Sensor for Measuring Olive Canopies Rafael R. Sola-Guirado 1, Sergio Bayano-Tejero 1, Antonio Rodríguez-Lizana 2, Jesús A. Gil-Ribes 1and Antonio Miranda-Fuentes 1,* 1Rural Engineering Department, University of Cordoba. Ed. Leonardo da Vinci, Campus Rabanales, Ctra. Nacional IV, km 396, 14014 Córdoba, Spain; [email protected] (R.R.S.-G.); [email protected] (S.B.-T.); [email protected] (J.A.G.-R.) 2Aerospace Engineering and Fluid Mechanics Department, University of Seville, Ctra. de Utrera km 1, 41013 Sevilla, Spain; [email protected] *Correspondence: [email protected]; Tel.: +34-957-212-689 Received: 31 October 2018; Accepted: 10 December 2018; Published: 13 December 2018 Abstract: Canopy characterization has become important when trying to optimize any kind of agricultural operation in high-growing crops, such as olive. Many sensors and techniques have reported satisfactory results in these approaches and in this work a 2D laser scanner was explored for measuring canopy trees in real-time conditions. The sensor was tested in both laboratory and field conditions to check its accuracy, its cone width, and its ability to characterize olive canopies in situ. The sensor was mounted on a mast and tested in laboratory conditions to check: (i) its accuracy at different measurement distances; (ii) its measurement cone width with different reflectivity targets; and (iii) the influence of the target’s density on its accuracy. The field tests involved both isolated and hedgerow orchards, in which the measurements were taken manually and with the sensor. The canopy volume was estimated with a methodology consisting of revolving or extruding the canopy contour. The sensor showed high accuracy in the laboratory test, except for the measurements performed at 1.0 m distance, with 60 mm error (6%). Otherwise, error remained below 20 mm (1% relative error). The cone width depended on the target reflectivity. The accuracy decreased with the target density. Keywords: laser scanner; accuracy test; high-growing crops; canopy characterization; olive orchards; agricultural work 1. Introduction Tree crops are attracting the attention of many researchers because of the difficulty of their management [ 1 – 8 ]. In contrast to the arable crops, whose mechanization and management is very controlled, tree crops present the difficulty of being tridimensional, which crucially conditions the way many operations are performed. This circumstance differs according to tree morphology, from existing hedgerow orchards that behave geometrically similar to regular leaf walls, such as the case of apple trees and vineyards of central Europe [ 9 , 10 ], to traditional orchards with big-sized irregular isolated trees, such as the citrus and olive plantations of Southern Europe [ 11 , 12 ]. Therefore, knowing canopy characteristics is very important from a management point of view and, thus, canopy characterization is of remarkable importance in most operations performed in these crops, such as harvesting, pruning, spraying, and every related operation performed on the tree crown. Canopy characterization is attracting increasing attention because of the need to obtain specific knowledge about specific parameters related to tree size and geometry, so as to adapt machines to operate automatically [ 13 – 20 ]. Each particular case requires different information, involving a diverse Sensors 2018,18, 4406; doi:10.3390/s18124406 www.mdpi.com/journal/sensors
Sensors 2018,18, 4406 2 of 18 degree of resolution and measurement range, so there is no unique characterization methodology that matches every single situation [ 21 ]. These methodologies significantly differ depending on the tree plantation pattern. Thus, in hedgerow/trellis orchards, the basic measurements taken are oriented towards the quantification of the total tree volume per hectare or the tree height. In the case of isolated trees, on the other hand, efforts are conducted to obtain the individual tree crown volume. The different methodologies in use for canopy characterization can be classified as manual and electronic [ 12 , 22 ]. The manual methodologies are diverse, but in every case, they involve operators taking measurements with different kinds of equipment, such as topographic milestones and measuring tapes. The base of these methods relies on an operator standing next to the tree with the measurement instrument and another one standing beside the first operator and noting down the measurements they take. In other occasions, destructive operations are required, for example for taking leaf samples to characterize the leaf density [ 7 , 9 , 23 ]. These methodologies present the advantage of being easy to use, allowing farmers and technicians to implement them in commercial plantations without an important degree of training but, on the other hand, they are not extremely precise and, in addition, they sometimes require a lot of work, especially if many trees require characterization. Among the different manual methods used by authors with scientific purposes, the ellipsoid method is the most frequent [ 12 , 24 , 25 ]. Other important methods are the manual measurement of hedgerow trees, usually involving the measurement of the wall height and width, [ 26 ] the crown vertical projection method, [ 27 ] consisting of determining the ground projection of the tree crown in isolated trees, subsequently estimating the crown volume through previously developed correlations, the tree silhouette method [ 12 ], based on manually defining the tree crown contour on different pictures taken from the tree, determining its area and determining the tree volume by revolutionizing this area around the central symmetry axle, and the mean vector method, recently proposed for manual olive crown characterization by Miranda-Fuentes et al. [12]. On the other hand, electronic methods involve the use of different sensors to obtain, depending on the case, several parameters of the canopy geometry. The information that the sensors provide may be from drones [ 28 ], from satellite imagery [ 29 ], or from the ground [ 30 ]. The main advantages of these systems are their precision and their automatic work but, on the other hand, they usually need specific training in onboard electronics, image analysis or programming to access all their potential). They are also expensive in general, so their use is limited to research and big farms for the moment, though their price is continuously decreasing, making them more affordable every day. Generally, most of the methods included in this group involve distance measurement, though some are based on photography and image analysis for direct volume calculation, such as the case of stereo vision methods [ 31 , 32 ]. These distances allow for the establishment of point sets in three-dimensional environments, which enable the determination of canopy profiles, [ 33 ], height, [ 9 ] volume [ 25 , 34 , 35 ], or even density [ 36 – 38 ]. The most frequent electronic methodologies involve the use of ultrasonic sensors, [ 39 – 41 ] light sensors, [ 42 ] radar systems [ 43 ] and LiDAR (Light Detection and Ranging) sensors [ 44 , 45 ]. Among all of the aforementioned methods, the LiDAR scanners have been proved to have the best accuracy [ 8 ]. The advantage of these systems is that they sweep a nearly continuous angular range (angular resolution usually lower than 1 ◦ ), emitting lasers in a range of directions (usually 360 ◦ ) in their working plane, so they can scan any surface, obtaining its contour. For the volume determination, a third dimension is needed (an additional movement perpendicular to the mentioned working plane). Here we have two additional options or categories to classify LiDAR systems: 3D and 2D LiDAR. In the case of the 3D LiDAR, this movement is achieved with an additional rotation of the whole scanner instrument around its vertical axle, not only sweeping a vertical plane but a horizontal one as well [ 46 ]. The 2D LiDAR, on the other hand, lacks this second horizontal rotation, so if left static, it only characterizes a 2D point set. In this case, the movement needs to be added, and in agricultural applications the sensor is attached to a vehicle that moves alongside the tree row, scanning it from its both sides [47].
Sensors 2018,18, 4406 3 of 18 In this way, different authors have successfully characterized very different crops, such as apple [ 39 ], peach [ 16 ], citrus [ 36 ], olive [ 12 , 46 ] or vineyard [ 48 ]. The main problems regarding LiDAR use in field conditions is the need for advanced training in data management and electronics. Maybe in the future these sensors can be prepared to operate automatically but, for the moment, they are limited to research and very specific applications. Similar problems apply to short-distance photogrammetry techniques, that, although they would be another interesting method for measuring distances based on · 3D models, would require a post-analysis phase, and so they are not feasible for real-time application. In the particular field of the pesticide application, where the canopy characterization presents a particular interest to adapting pesticide doses to requirements in terms of leaf surface to be covered [ 49 ] and accomplishing, in this way, the sustainable use of agrochemicals demanded by Directive 2009/128/CE [ 50 ], the only sensors commercially implemented are ultrasonic sensors. Considering olive, the most important tree crop in the European Union with a total harvested area of around 5 Mha and an annual production of nearly 12 Mt, the use of these sensors is only limited to an ON/OFF function, i.e., they are intended to be used as a switch for the electrovalves controlling the spray section of the airblast sprayer [ 16 , 51 ]. This function has been shown to provide great savings when operating in other crops [52,53] and even in this one [54]. The aim of the presented research is to explore a multi-beam LED (Light-Emitting Diode) scanner with a real-time approach, but without compared to other types of sensors of techniques. The main objectives were to determine the accuracy of the sensor according to different parameters, i.e., the reflectivity of the material and the gaps percentage, to measure the width of each sensor’s measuring cone at different distances and to test the sensor’s accuracy under real field conditions in isolated and hedgerow olive orchards. 2. Materials and Methods 2.1. Measuring System The sensor used to characterize the canopy was the 2D laser scanner OMD8000-R2100-B16-2V15 (Pepperl + Fuchs, Mannheim, Germany; Figure 1a). This device counted using a CAN open Interface and measuring method PRT (Pulse Ranging Technology). The sensor consists of a transmitter and a receiver placed in the same housing. The transmitter emits pulses of infrared light that are reflected on the target and captured back by the receiver. The distance is calculated through the time takes the pulse emitted to return to the receiver and the speed of light (c). Sensors 2018, 18, x FOR PEER REVIEW 3 of 18 in the future these sensors can be prepared to operate automatically but, for the moment, they are limited to research and very specific applications. Similar problems apply to short-distance photogrammetry techniques, that, although they would be another interesting method for measuring distances based on·3D models, would require a post-analysis phase, and so they are not feasible for real-time application. In the particular field of the pesticide application, where the canopy characterization presents a particular interest to adapting pesticide doses to requirements in terms of leaf surface to be covered [49] and accomplishing, in this way, the sustainable use of agrochemicals demanded by Directive 2009/128/CE [50], the only sensors commercially implemented are ultrasonic sensors. Considering olive, the most important tree crop in the European Union with a total harvested area of around 5 Mha and an annual production of nearly 12 Mt, the use of these sensors is only limited to an ON/OFF function, i.e., they are intended to be used as a switch for the electrovalves controlling the spray section of the airblast sprayer [16,51]. This function has been shown to provide great savings when operating in other crops [52,53] and even in this one [54]. The aim of the presented research is to explore a multi-beam LED (Light-Emitting Diode) scanner with a real-time approach, but without compared to other types of sensors of techniques. The main objectives were to determine the accuracy of the sensor according to different parameters, i.e., the reflectivity of the material and the gaps percentage, to measure the width of each sensor’s measuring cone at different distances and to test the sensor’s accuracy under real field conditions in isolated and hedgerow olive orchards. 2. Materials and Methods 2.1. Measuring System The sensor used to characterize the canopy was the 2D laser scanner OMD8000-R2100-B16-2V15 (Pepperl + Fuchs, Mannheim, Germany; Figure 1a). This device counted using a CAN open Interface and measuring method PRT (Pulse Ranging Technology). The sensor consists of a transmitter and a receiver placed in the same housing. The transmitter emits pulses of infrared light that are reflected on the target and captured back by the receiver. The distance is calculated through the time takes the pulse emitted to return to the receiver and the speed of light (c). The sensor counted using 11 emitter elements arranged side by side, which can span a scanning range of 88 degrees. The main difference to a conventional laser scanner is the capability to take the measurement of a spot rather than a single point, in a similar way to the ultrasonic sensor, commonly used for canopy characterization. According to the manufacturer, the diameter of the light spot is 550 mm at 4 m distance (Figure 1b). The measuring range of the sensor was 0.2 to 8.0 m (relative humidity supported up to 90%) with IR (Infrared Radiation) light source in modulated infrared of 850 nm. Figure 1. (a) Laser scanner OMD8000-R2100-B16-2V15. (b) Arrangement of the measurement spots. For the laboratory and field measurements, the sensor was mounted on a vertical tripod that enabled the regulation of the horizontal and vertical angles (though two bubble levels) and the sensor height. It also incorporated different angle indicators to make possible the perfect alignment of the Figure 1. (a) Laser scanner OMD8000-R2100-B16-2V15. (b) Arrangement of the measurement spots. The sensor counted using 11 emitter elements arranged side by side, which can span a scanning range of 88 degrees. The main difference to a conventional laser scanner is the capability to take the measurement of a spot rather than a single point, in a similar way to the ultrasonic sensor, commonly used for canopy characterization. According to the manufacturer, the diameter of the light spot is 550 mm at 4 m distance (Figure 1b). The measuring range of the sensor was 0.2 to 8.0 m (relative
Sensors 2018,18, 4406 4 of 18 humidity supported up to 90%) with IR (Infrared Radiation) light source in modulated infrared of 850 nm. For the laboratory and field measurements, the sensor was mounted on a vertical tripod that enabled the regulation of the horizontal and vertical angles (though two bubble levels) and the sensor height. It also incorporated different angle indicators to make possible the perfect alignment of the sensor with respect to the horizontal plane. Visual references were also included to make it possible to predict, according to the sensor orientation, every emitter’s direction. The full electronic arrangement is shown in Figure 2. Sensors 2018, 18, x FOR PEER REVIEW 4 of 18 sensor with respect to the horizontal plane. Visual references were also included to make it possible to predict, according to the sensor orientation, every emitter’s direction. The full electronic arrangement is shown in Figure 2. Figure 2. Electronic arrangement of the 2D LiDAR scanner. The sensor was connected to a display (CR1082, IFM Electronic, Essen, Germany) for real-time monitoring of the data from the 11 emitters to detect possible errors or problems. There was a datalogger (CR3101, IFM Electronic, Essen, Germany) that stored the data acquired by the sensors in a “.csv” format file. The scan frequency was 50 Hz, while the acquisition and registry were made at 2 Hz since it was the maximum allowed by the datalogger. The measured value noise was 20 mm (1 sigma, 4 m on white, orthogonal) with an angle resolution of 8° and absolute accuracy of ±50 mm (orthogonal). The data acquisition was pre-programmed in CoDeSys (Controller Development System) language and controlled through the display. After the tests, the data was exported to a laptop computer (Thinkpad Z510, Lenovo, Pekin, China), where it was imported in Microsoft Excel ® (Microsoft, Redmond, WA, USA) for preliminary analysis and data visualization. The CoDeSys library was employed to register the data by creating a “.csv” file composed by 8 columns in byte format. Thus, each LED measurement was separated into 2 bytes by programming datalogger and, consequently, each “.csv” file could contain four LED measurements over time. Thus, 3 files were necessary to register 11 LED measurements. Once the data was stored in the computer, the “.csv” files were linked, and all the measurements were converted to original format for analysis using Microsoft Excel ®. Every single file was created for a given test, an R-software script developed with GPL License RStudio version r243 was used to compile every single one into a general table, containing the different variables organized in different columns, ready to their exportation to the statistical software. There was a code to properly identify data coming from the different trials previously described. Data was also pre-visualized and collected through the acquisition program developed in CoDeSys language. The data acquisition frequency of 50 Hz allowed for a near real-time monitoring of the 11 measurements. 2.2. Laboratory Arrangement The laboratory tests were carried out using a large white wall. These tests were aimed at studying the sensor’s accuracy under certain circumstance which could affect its performance in field operations, such as the varying target density. In every test, the measurement distance was a variable. Its maximum value was set at 5 m in every case, as this is the maximum distance usually found in canopy characterization operations in olive orchards when placing the sensor in the center of the space between tree rows. The laboratory arrangement for every test is described in this section. Figure 2. Electronic arrangement of the 2D LiDAR scanner. The sensor was connected to a display (CR1082, IFM Electronic, Essen, Germany) for real-time monitoring of the data from the 11 emitters to detect possible errors or problems. There was a datalogger (CR3101, IFM Electronic, Essen, Germany) that stored the data acquired by the sensors in a “.csv” format file. The scan frequency was 50 Hz, while the acquisition and registry were made at 2 Hz since it was the maximum allowed by the datalogger. The measured value noise was 20 mm (1 sigma, 4 m on white, orthogonal) with an angle resolution of 8◦and absolute accuracy of ±50 mm (orthogonal). The data acquisition was pre-programmed in CoDeSys (Controller Development System) language and controlled through the display. After the tests, the data was exported to a laptop computer (Thinkpad Z510, Lenovo, Pekin, China), where it was imported in Microsoft Excel ® (Microsoft, Redmond, WA, USA) for preliminary analysis and data visualization. The CoDeSys library was employed to register the data by creating a “.csv” file composed by 8 columns in byte format. Thus, each LED measurement was separated into 2 bytes by programming datalogger and, consequently, each “.csv” file could contain four LED measurements over time. Thus, 3 files were necessary to register 11 LED measurements. Once the data was stored in the computer, the “.csv” files were linked, and all the measurements were converted to original format for analysis using Microsoft Excel ® . Every single file was created for a given test, an R-software script developed with GPL License RStudio version r243 was used to compile every single one into a general table, containing the different variables organized in different columns, ready to their exportation to the statistical software. There was a code to properly identify data coming from the different trials previously described. Data was also pre-visualized and collected through the acquisition program developed in CoDeSys language. The data acquisition frequency of 50 Hz allowed for a near real-time monitoring of the 11 measurements. 2.2. Laboratory Arrangement The laboratory tests were carried out using a large white wall. These tests were aimed at studying the sensor’s accuracy under certain circumstance which could affect its performance in field operations,
Sensors 2018,18, 4406 5 of 18 such as the varying target density. In every test, the measurement distance was a variable. Its maximum value was set at 5 m in every case, as this is the maximum distance usually found in canopy characterization operations in olive orchards when placing the sensor in the center of the space between tree rows. The laboratory arrangement for every test is described in this section. 2.2.1. Absolute and Relative Accuracy of the Sensor The absolute and relative accuracy of the sensor was checked by setting the sensor (on the tripod) horizontal at 1.40 m height, perpendicularly aiming at a horizontal matte white flat wall (Figure 3a). The sensor was placed at a varying distance from the wall, ranging from 0.5 to 5.0 m, in intervals of 0.5 m. To keep the same measurement position in the target, a laser indicator from the laser telemeter (GLM 50 Professional, BOSCH, Chicago, IL, USA) was used. This telemeter, with measurement range from 50 to 50,000 mm and precision of ± 1.5 mm, was also used to measure the real distance to the wall, to make the comparison with the measurements taken by the sensor. This sensor has been successfully used in previous studies with similar purposes [22]. Sensors 2018, 18, x FOR PEER REVIEW 5 of 18 2.2.1. Absolute and Relative Accuracy of the Sensor The absolute and relative accuracy of the sensor was checked by setting the sensor (on the tripod) horizontal at 1.40 m height, perpendicularly aiming at a horizontal matte white flat wall (Figure 3a). The sensor was placed at a varying distance from the wall, ranging from 0.5 to 5.0 m, in intervals of 0.5 m. To keep the same measurement position in the target, a laser indicator from the laser telemeter (GLM 50 Professional, BOSCH, Chicago, IL, USA) was used. This telemeter, with measurement range from 50 to 50,000 mm and precision of ± 1.5 mm, was also used to measure the real distance to the wall, to make the comparison with the measurements taken by the sensor. This sensor has been successfully used in previous studies with similar purposes [22]. To have a reference for the tripod position, marks were set on the ground to follow a straight line when approaching the sensor to the wall. These marks included the sensor’s position in every studied distance, and a weight mass under the tripod allowed for the accurate placement of the tripod to match the sensor’s position. In laboratory test, and in the field test, acquisition of 11 emitters was taken over 500 ms intervals during a 10 s period. However, by comparison, the laboratory test was carried out by using only the central emitter (emitter 6, Figure 3b) because of spacing restriction. Figure 3. (a) Sensor arrangement for accuracy laboratory test, (b) tested LED emitters. 2.2.2. Cone Width Measurement Each emitter does not behave like a laser beam in the sense of measuring a punctual distance, but makes a sort of “mean distance measurement” of an area supposed to be circular or ellipsoidal, which is called a “spot”. As can be observed in Figure 1b, this spot increases in diameter when increasing the distance from the sensor, so the LED produces a conical measurement shape that is known as a “measurement cone”. A similar phenomenon can be found in the aforementioned ultrasonic sensors, [22,39] producing significant interference between measurements of sensors placed very close. Nevertheless, the cone width has a major influence in this interference, as the wider the cone, the higher the area detected in the measurement. It also has major influence on the sensor’s accuracy when measuring the distance to a target point, as the bigger the spot, the lower the certainty of measuring any particular distance. For these reasons, the cone width of one LED emitter was measured. It was also necessary to check if the cone width was symmetric in its two axis or, on the contrary, there was any asymmetry. To measure the cone width in both axes (x and y in Figure 4), two 500 × 500 mm targets were used. They differed in the material, with the main difference of being reflective or not. This proved to have a significant effect on the cone shape in ultrasonic sensors in previous studies [22]. As with the aforementioned case, only the central emitter was tested, (number “6” in Figure 3b), as every sensor was supposed to behave in the same way. The cone shape was measured in different distances to the sensor. Thus, measurements were taken at 0.5, 1.0, 1.5, 2.0, 2.5, 3.0, 3.5, 4.0, 4.5 and 5.0 m distances. The cone width in each axis was measured as explained in Figure 4. The target was inserted in the emitter’s field of view from the four outermost positions defining the spot size: both sides and the upper and lower part. Figure 3. (a) Sensor arrangement for accuracy laboratory test, (b) tested LED emitters. To have a reference for the tripod position, marks were set on the ground to follow a straight line when approaching the sensor to the wall. These marks included the sensor’s position in every studied distance, and a weight mass under the tripod allowed for the accurate placement of the tripod to match the sensor’s position. In laboratory test, and in the field test, acquisition of 11 emitters was taken over 500 ms intervals during a 10 s period. However, by comparison, the laboratory test was carried out by using only the central emitter (emitter 6, Figure 3b) because of spacing restriction. 2.2.2. Cone Width Measurement Each emitter does not behave like a laser beam in the sense of measuring a punctual distance, but makes a sort of “mean distance measurement” of an area supposed to be circular or ellipsoidal, which is called a “spot”. As can be observed in Figure 1b, this spot increases in diameter when increasing the distance from the sensor, so the LED produces a conical measurement shape that is known as a “measurement cone”. A similar phenomenon can be found in the aforementioned ultrasonic sensors, Ref. [ 22 , 39 ] producing significant interference between measurements of sensors placed very close. Nevertheless, the cone width has a major influence in this interference, as the wider the cone, the higher the area detected in the measurement. It also has major influence on the sensor’s accuracy when measuring the distance to a target point, as the bigger the spot, the lower the certainty of measuring any particular distance. For these reasons, the cone width of one LED emitter was measured. It was also necessary to check if the cone width was symmetric in its two axis or, on the contrary, there was any asymmetry. To measure the cone width in both axes (xand yin Figure 4), two 500 × 500 mm targets were used. They differed in the material, with the main difference of being reflective or not. This proved to have a significant effect on the cone shape in ultrasonic sensors in previous studies [ 22 ]. As with the
Sensors 2018,18, 4406 6 of 18 aforementioned case, only the central emitter was tested, (number “6” in Figure 3b), as every sensor was supposed to behave in the same way. The cone shape was measured in different distances to the sensor. Thus, measurements were taken at 0.5, 1.0, 1.5, 2.0, 2.5, 3.0, 3.5, 4.0, 4.5 and 5.0 m distances. The cone width in each axis was measured as explained in Figure 4. The target was inserted in the emitter’s field of view from the four outermost positions defining the spot size: both sides and the upper and lower part. Sensors 2018, 18, x FOR PEER REVIEW 6 of 18 Figure 4. Scheme of the characterization of the cone width. With the purpose of ensuring the accuracy of the measurements, the target was mounted on a fixed platform that moved along a straight trajectory in a continuous way. The cone width was determined by stopping the target’s advance in that moment in which the measurement collected by the sensor for the selected emitter changed from the one corresponding to the wall to that to the target, with a difference in between them of 23 cm (Figure 4). This change in the measurement was quickly detected on the computer, by using the data acquisition program, which enabled real-time data visualization, and was noted. Repeating the process 3 times yielded, consequently, 12 points per sampling distance. 2.2.3. Density Influence on Sensor’s Accuracy One of the most important requirements for a sensor working on detecting a real canopy is its capability to detect the outermost part of the tree crown without suffering excessive accuracy loss because of the low leaf density (i.e., the laser bean penetrating inside the canopy and producing mistakes in the measurement of the canopy contour). In the particular case of the evaluated sensor, it has the capability to measure spots with every one of its emitters. Nevertheless, and as happens in the case of the ultrasonic sensors, [22] it is necessary for the sensor to achieve a minimum target area to have reflected enough energy to detect the object, passing through it in the opposite case. Therefore, it was necessary to know the minimum surface density to reflect the sensor’s signal to predict its possibility to work in different olive plantation systems, with varying leaf density. Thus, the measurement accuracy of the sensor to a density-variable target was evaluated. The target was made of 8 1000 × 150 mm pieces of plastic material (polyethylene) that were combined to achieve high or low density when using more or fewer pieces and fixed to a vertical mast (Figure 5b). Therefore, as it can be seen in Figure 5a, the target ranged from 1 (lowest density) to 8 (highest density) plastic pieces, and the studied distances from the sensor to the target ranged from 0.5 to 5.0 m, with a 0.5 m increment between two consecutive distances. The target was perfectly aligned with sensor number “6” (Figure 3b), by using a laser indicator that helped to correct any possible misalignment in the studied LED (Figure 5b). Figure 4. Scheme of the characterization of the cone width. With the purpose of ensuring the accuracy of the measurements, the target was mounted on a fixed platform that moved along a straight trajectory in a continuous way. The cone width was determined by stopping the target’s advance in that moment in which the measurement collected by the sensor for the selected emitter changed from the one corresponding to the wall to that to the target, with a difference in between them of 23 cm (Figure 4). This change in the measurement was quickly detected on the computer, by using the data acquisition program, which enabled real-time data visualization, and was noted. Repeating the process 3 times yielded, consequently, 12 points per sampling distance. 2.2.3. Density Influence on Sensor’s Accuracy One of the most important requirements for a sensor working on detecting a real canopy is its capability to detect the outermost part of the tree crown without suffering excessive accuracy loss because of the low leaf density (i.e., the laser bean penetrating inside the canopy and producing mistakes in the measurement of the canopy contour). In the particular case of the evaluated sensor, it has the capability to measure spots with every one of its emitters. Nevertheless, and as happens in the case of the ultrasonic sensors, [ 22 ] it is necessary for the sensor to achieve a minimum target area to have reflected enough energy to detect the object, passing through it in the opposite case. Therefore, it was necessary to know the minimum surface density to reflect the sensor’s signal to predict its possibility to work in different olive plantation systems, with varying leaf density. Thus, the measurement accuracy of the sensor to a density-variable target was evaluated. The target was made of 8 1000 × 150 mm pieces of plastic material (polyethylene) that were combined to achieve high or low density when using more or fewer pieces and fixed to a vertical mast (Figure 5b). Therefore, as it can be seen in Figure 5a, the target ranged from 1 (lowest density) to 8 (highest density) plastic pieces, and the studied distances from the sensor to the target ranged from 0.5 to 5.0 m, with a 0.5 m increment between two consecutive distances. The target was perfectly
Sensors 2018,18, 4406 7 of 18 aligned with sensor number “6” (Figure 3b), by using a laser indicator that helped to correct any possible misalignment in the studied LED (Figure 5b). Sensors 2018, 18, x FOR PEER REVIEW 7 of 18 Figure 5. (a) Variable-density target for density’s influence on accuracy laboratory test, with the theoretical cone proposed by the manufacturer. (b) Laboratory layout. To properly correlate the sensor’s accuracy to the target density, the area covered by the target was compared to the total target area with the eight plastic pieces, calculating the independent variable “Target Density” (TD), whose maximum value was 100% (8 pieces) and its minimum was 16.8% (1 piece). The sensor’s absolute and relative error was correlated with this TD to determine the influence of this parameter on the measurement accuracy. For every configuration, a total of 20 distance measurements were taken, and when every combination was completed, the process began consecutively, so that 3 replications of the trial were done in total, which made 60 measurements per single configuration. 2.3. Field Arrangement The field trial was carried out in the experimental olive farm of the University of Cordoba (37°56′00″ N; 4°43′09″ W), which contains two different cultivation patterns, both used in this trial. On the one hand, there was an intensive cultivation pattern, characterized by isolated small-sized trees with row spacing of 7 m and tree spacing 6 m and different olive varieties. On the other hand, there is a super-intensive pattern, with a hedgerow-type orchard, with row spacing of 5 m and tree spacing of 2 m and composed of different varieties. Trees were measured for isolated trees (Figure 6) and for hedgerow trees (Figure 7) by using the sensor along with its tripod set at 2.5 m distance from the target tree crown. This distance was selected to match the geometry of the sensor working on an intensive cultivation system, in which the row spacing usually ranges from 6 to 8 m, and the total tree height nearly reaches 4 m, simulating the placement of the sensor in a tractor-driven machine, for example an airblast sprayer. The sensor’s height was fixed at 150 cm to coincide with the medium height of the tree crown (manually measured), and properly stabilized. The sensor’s aforementioned height, therefore, was set in relation to the base height of the tree’s trunk in every case to avoid the influence of the tree ridge, which varied in size from one tree to another. For isolated trees, a total of 6 trees were completely characterized, with 4 sampling positions (profiles) each. For hedgerow trees, 20 trees belonging to two different rows were characterized with 2 sampling positions from each tree side. The measurement point in every tree was that coincident with the medium plane, for generally being the maximum-width profile. 30 measurements were taken for every sampling position and with every single emitter. To compare each sensor’s measurement with the real distance, an implement was developed to support a rigid stick that enabled the real distance measurement on each emitter (Figure 6). This implement consisted of a fixed metallic platform that contained one support called direction sticker, which held the stick in a second point, being the first point the sensor placement in every case. The two mentioned points defined a line, coincident with the orientation of the longitudinal axle of the measurement cone for the studied emitter. Thus, the rigid stick could have as many orientations as Figure 5. ( a ) Variable-density target for density’s influence on accuracy laboratory test, with the theoretical cone proposed by the manufacturer. (b) Laboratory layout. To properly correlate the sensor’s accuracy to the target density, the area covered by the target was compared to the total target area with the eight plastic pieces, calculating the independent variable “Target Density” (TD), whose maximum value was 100% (8 pieces) and its minimum was 16.8% (1 piece). The sensor’s absolute and relative error was correlated with this TD to determine the influence of this parameter on the measurement accuracy. For every configuration, a total of 20 distance measurements were taken, and when every combination was completed, the process began consecutively, so that 3 replications of the trial were done in total, which made 60 measurements per single configuration. 2.3. Field Arrangement The field trial was carried out in the experimental olive farm of the University of Cordoba (37 ◦ 56 0 00 00 N; 4 ◦ 43 0 09 00 W), which contains two different cultivation patterns, both used in this trial. On the one hand, there was an intensive cultivation pattern, characterized by isolated small-sized trees with row spacing of 7 m and tree spacing 6 m and different olive varieties. On the other hand, there is a super-intensive pattern, with a hedgerow-type orchard, with row spacing of 5 m and tree spacing of 2 m and composed of different varieties. Trees were measured for isolated trees (Figure 6) and for hedgerow trees (Figure 7) by using the sensor along with its tripod set at 2.5 m distance from the target tree crown. This distance was selected to match the geometry of the sensor working on an intensive cultivation system, in which the row spacing usually ranges from 6 to 8 m, and the total tree height nearly reaches 4 m, simulating the placement of the sensor in a tractor-driven machine, for example an airblast sprayer. The sensor’s height was fixed at 150 cm to coincide with the medium height of the tree crown (manually measured), and properly stabilized. The sensor’s aforementioned height, therefore, was set in relation to the base height of the tree’s trunk in every case to avoid the influence of the tree ridge, which varied in size from one tree to another. For isolated trees, a total of 6 trees were completely characterized, with 4 sampling positions (profiles) each. For hedgerow trees, 20 trees belonging to two different rows were characterized with 2 sampling positions from each tree side. The measurement point in every tree was that coincident with the medium plane, for generally being the maximum-width profile. 30 measurements were taken for every sampling position and with every single emitter.
Sensors 2018,18, 4406 8 of 18 Sensors 2018, 18, x FOR PEER REVIEW 8 of 18 the directions defined by the sensors contained in the scanner (11 in total). The separation between consecutive directions was, therefore, 8°, the angular separation between consecutive emitters (Figure 1b). At the same time, measurements were manually taken with a rule to determine the width of the tree and its canopy height. Figure 6. (a) Measurement location in the isolated tree test. (b) Use of the implement for measuring the contact point in tree at the emitter direction. Figure 7. (a) Measurement location in the hedgerow trees. (b) Sensor measurements. The first purpose was to determine the accuracy of the sensor when aiming at real olive trees in field conditions. Therefore, the same electronic layout used in the laboratory was kept (Figure 2). The accuracy of the sensor was checked as the absolute error, calculated as the difference between the real and the sensor’s measurements, expressed in cm. The relative error was also checked, as expressed in Equation (1). 𝑅𝐸 = | 𝑑 − 𝑑 | 𝑑 − 𝑖 × 100 × 1 𝑛 (1) where n is the number of emitters, 11 in this case, dreal−i is the real distance measured with the rigid stick for the position corresponding to the emitter “i“ (cm) and dsensor−i the distance measured by this emitter “i” (cm). The individual error of an individual emitter “i” was calculated, therefore, as explained in Equation (2). Figure 6. ( a ) Measurement location in the isolated tree test. ( b ) Use of the implement for measuring the contact point in tree at the emitter direction. Sensors 2018, 18, x FOR PEER REVIEW 8 of 18 the directions defined by the sensors contained in the scanner (11 in total). The separation between consecutive directions was, therefore, 8°, the angular separation between consecutive emitters (Figure 1b). At the same time, measurements were manually taken with a rule to determine the width of the tree and its canopy height. Figure 6. (a) Measurement location in the isolated tree test. (b) Use of the implement for measuring the contact point in tree at the emitter direction. Figure 7. (a) Measurement location in the hedgerow trees. (b) Sensor measurements. The first purpose was to determine the accuracy of the sensor when aiming at real olive trees in field conditions. Therefore, the same electronic layout used in the laboratory was kept (Figure 2). The accuracy of the sensor was checked as the absolute error, calculated as the difference between the real and the sensor’s measurements, expressed in cm. The relative error was also checked, as expressed in Equation (1). 𝑅𝐸 = | 𝑑 − 𝑑 | 𝑑 − 𝑖 × 100 × 1 𝑛 (1) where n is the number of emitters, 11 in this case, dreal−i is the real distance measured with the rigid stick for the position corresponding to the emitter “i“ (cm) and dsensor−i the distance measured by this emitter “i” (cm). The individual error of an individual emitter “i” was calculated, therefore, as explained in Equation (2). Figure 7. (a) Measurement location in the hedgerow trees. (b) Sensor measurements. To compare each sensor’s measurement with the real distance, an implement was developed to support a rigid stick that enabled the real distance measurement on each emitter (Figure 6). This implement consisted of a fixed metallic platform that contained one support called direction sticker, which held the stick in a second point, being the first point the sensor placement in every case. The two mentioned points defined a line, coincident with the orientation of the longitudinal axle of the measurement cone for the studied emitter. Thus, the rigid stick could have as many orientations as the directions defined by the sensors contained in the scanner (11 in total). The separation between consecutive directions was, therefore, 8 ◦ , the angular separation between consecutive emitters (Figure 1b). At the same time, measurements were manually taken with a rule to determine the width of the tree and its canopy height. The first purpose was to determine the accuracy of the sensor when aiming at real olive trees in field conditions. Therefore, the same electronic layout used in the laboratory was kept (Figure 2). The accuracy of the sensor was checked as the absolute error, calculated as the difference between the real and the sensor’s measurements, expressed in cm. The relative error was also checked, as expressed in Equation (1). RE = n ∑ i=1|dreal−i−dsensor−i| dsensor −i×100×1 n(1)
Sensors 2018,18, 4406 9 of 18 where nis the number of emitters, 11 in this case, d real−i is the real distance measured with the rigid stick for the position corresponding to the emitter “i“ (cm) and d sensor−i the distance measured by this emitter “i” (cm). The individual error of an individual emitter “i” was calculated, therefore, as explained in Equation (2). REi= |dreal−i−dsensor−i| dsensor −i×100 (2) The measurements with values of 65,535 denoted that pulses of infrared light were not received back to the sensor. Numbers of data value 65,535 were analyzed versus the number of different data value for 20 measurements taken for each LED. If number of 65,535 data value was higher, the LED was directed at a gap or sky. If the number of data values different to 65,535 is higher, the data in the minority were erased from the dataset and not analyzed. Wrong data were identified through filters using Microsoft Excel®. 3. Results 3.1. Laboratory Results 3.1.1. Sensor’s Accuracy Assessment The sensor’s absolute and relative error for different sampling distances and for emitter 6 is represented in Figure 8a,b. The sensor was very accurate for its purpose, with low absolute error rates, which were below 60 mm in every case (Figure 8a). This error showed a peak at 1.0 m distance ( ± 58 mm) and then got reduced to a nearly constant value below 15 mm from 2.5 m distance. The minimum absolute error was found at 2.5 m distance, with a mean value of ± 5 mm. The irregular pattern described by the results is noticeable: a rising error rate which increases to its maximum value, then decreases, and finally turns stable. This scenario is, of course, well represented in the relative error behavior (Figure 8b). The low relative error rate generated by the sensor, which stayed below 6% for every sampling distance, was expected from the low absolute error values previously mentioned. This performance can be explained by the fact that the target was completely homogeneous and plane, with controlled conditions of light and without environmental dust, which can significantly improve the accuracy of measurements in comparison with a real field environment. When looking at the graph, there is a critical point in which the sensor showed the poorest relative performance: 1 m distance. This was expected from the absolute error chart and the fact that the maximum absolute error was found at a short distance. In this case, the mean relative error (5.7%) was much higher than the rest of the collected values. In fact, the next distance tested (1.5 m) gave as a result a much more reduced error rate (2.4%), and from 2.5 m to 5 m, a distance interval in which the sensor showed the minimum absolute errors (Figure 9a), the relative results kept below 0.5% in every case (Figure 8b). Taking this result into account, this sensor would need at least 2.5 m to be precise, which could potentially limit its use in canopy characterization operations with narrow space in between the crop lines and wide trees, as the case of citrus, in which row spacing is typically set to 5 m [ 55 ]. Nevertheless, considering the absolute error found in the 2.5 m distance (<60 mm), there is no important effect in any operation carried out with agricultural machinery, such as pruning or pesticide application. In this last case, for example, the sensor measurements are used to define any canopy parameter that allows for the optimal spray dose calculation, which is generally known as “crop-adapted spraying” or “crop-adapted spray application” [ 56 , 57 ], based on the leaf amount and, therefore, adjusted to real requirements. For this purpose, potential mistakes at 60 mm for a tree crown volume calculation are significantly less important than the lack of vertical resolution caused by the sensor’s discrete measuring points, which divide the whole canopy into horizontal slices whose height corresponds to the spacing between sensors or measuring points [ 22 ]. In this sense, it could be better
Sensors 2018,18, 4406 16 of 18 8. Rosell, J.R.; Sanz, R. A review of methods and applications of the geometric characterization of tree crops in agricultural activities. Comput. Electron. Agric. 2012,81, 124–141. [CrossRef] 9. Llop, J.; Gil, E.; Llorens, J.; Miranda-Fuentes, A.; Gallart, M. Testing the suitability of a terrestrial 2D LiDAR scanner for canopy characterization of greenhouse tomato crops. Sensors 2016,16, 1435. [CrossRef] 10. Walklate, P.J.; Weiner, K.-L.; Parkin, C.S. Analysis of and Experimental Measurements made on a Moving Air-Assisted Sprayer with Two-Dimensional Air-Jets Penetrating a Uniform Crop Canopy. J. Agric. Eng. Res. 1996,63, 365–377. [CrossRef] 11. Sola-Guirado, R.R.; Castro-García, S.; Blanco-Roldán, G.L.; Jiménez-Jiménez, F.; Castillo-Ruiz, F.J.; Gil-Ribes, J.A. Traditional olive tree response to oil olive harvesting technologies. Biosyst. Eng. 2014 , 118, 186–193. [CrossRef] 12. Miranda-Fuentes, A.; Llorens, J.; Gamarra-Diezma, J.L.; Gil-Ribes, J.A.; Gil, E. Towards an optimized method of olive tree crown volume measurement. Sensors 2015,15, 3671–3687. [CrossRef] 13. Landers, A.J. Developments towards an automatic precision sprayer for fruit crop canopies. In 2010 Pittsburgh, Pennsylvania, June 20–June 23, 2010; American Society of Agricultural and Biological Engineers: St. Joseph, MI, USA, 2010. 14. Jeon, H.Y.; Zhu, H. Development of a Variable-Rate Sprayer for Nursery Liner Applications. Trans. ASABE 2012,55, 303–312. [CrossRef] 15. Rosell-Polo, J.R.; Sanz, R.; Llorens, J.; Arnó, J.; Escolà, A.; Ribes-Dasi, M.; Masip, J.; Camp, F.; Gràcia, F.; Solanelles, F.; et al. A tractor-mounted scanning LIDAR for the non-destructive measurement of vegetative volume and surface area of tree-row plantations: A comparison with conventional destructive measurements. Biosyst. Eng. 2009,102, 128–134. [CrossRef] 16. Giles, D.K.; Delwiche, M.J.; Dodd, R.B. Sprayer control by sensing orchard crop characteristics: Orchard architecture and spray liquid savings. J. Agric. Eng. Res. 1989,43, 271–289. [CrossRef] 17. Pérez-Ruiz, M.; Agüera, J.; Gil, J.A.; Slaughter, D.C. Optimization of agrochemical application in olive groves based on positioning sensor. Precis. Agric. 2010,12, 564–575. [CrossRef] 18. Chen, Y.; Ozkan, H.E.; Zhu, H.; Derksen, R.C.; Krause, C.R. Spray Deposition inside Tree Canopies from a Newly Developed Variable-Rate Air-Assisted Sprayer. Trans. ASABE 2013,56, 1263–1272. [CrossRef] 19. Escolà, A.; Rosell-Polo, J.R.; Planas, S.; Gil, E.; Pomar, J.; Camp, F.; Llorens, J.; Solanelles, F. Variable rate sprayer. Part 1—Orchard prototype: Design, implementation and validation. Comput. Electron. Agric. 2013 , 95, 122–135. [CrossRef] 20. Gil, E.; Llorens, J.; Llop, J.; Fàbregas, X.; Escolà, A.; Rosell-Polo, J.R. Variable rate sprayer. Part 2—Vineyard prototype: Design, implementation, and validation. Comput. Electron. Agric. 2013,95, 136–150. [CrossRef] 21. Sola-Guirado, R.R.; Ceular-Ortiz, D.; Gil-Ribes, J.A. Automated system for real time tree canopy contact with canopy shakers. Comput. Electron. Agric. 2017,143, 139–148. [CrossRef] 22. Gamarra-Diezma, J.L.; Miranda-Fuentes, A.; Llorens, J.; Cuenca, A.; Blanco-Roldán, G.L.; Rodríguez-Lizana, A. Testing Accuracy of Long-Range Ultrasonic Sensors for Olive Tree Canopy Measurements. Sensors 2015 ,15, 2902–2919. [CrossRef] 23. Méndez, V.; Catalán, H.; Rosell-Polo, J.R.; Arnó, J.; Sanz, R. LiDAR simulation in modelled orchards to optimise the use of terrestrial laser scanners and derived vegetative measures. Biosyst. Eng. 2013 ,115, 7–19. [CrossRef] 24. Villalobos, F.J.; Orgaz, F.; Mateos, L. Non-destructive measurement of leaf area in olive (Olea europaea L.) trees using a gap inversion method. Agric. For. Meteorol. 1995,73, 29–42. [CrossRef] 25. Zaman, Q.; Schumann, A.W. Performance of an ultrasonic tree volume measurement system in commercial citrus groves. Precis. Agric. 2005,6, 467–480. [CrossRef] 26. Cross, J.V.; Murray, R.A. Relationship between orchard tree crop structure and performance characteristics of an axial fan sprayer. Asp. Appl. Biol. 2000,57, 285–292. 27. Iniesta, F.; Testi, L.; Orgaz, F.; Villalobos, F.J. The effects of regulated and continuous deficit irrigation on the water use, growth and yield of olive trees. Eur. J. Agron. 2009,30, 258–265. [CrossRef] 28. Sola-Guirado, R.R.; Castillo-Ruiz, F.J.; Jiménez-Jiménez, F.; Blanco-Roldan, G.L.; Castro-Garcia, S.; Gil-Ribes, J.A. Olive actual “on year” yield forecast tool based on the tree canopy geometry using UAS imagery. Sensors 2017 , 17, 1743. [CrossRef]
Sensors 2018,18, 4406 17 of 18 29. Yadav, S.; Rizvi, I.; Kadam, S. Urban tree canopy detection using object-based image analysis for very high resolution satellite images: A literature review. In Proceedings of the 2015 International Conference on Technologies for Sustainable Development (ICTSD), Mumbai, India, 4–6 February 2015; pp. 4–9. [CrossRef] 30. Underwood, J.P.; Hung, C.; Whelan, B.; Sukkarieh, S. Mapping almond orchard canopy volume, flowers, fruit and yield using lidar and vision sensors. Comput. Electron. Agric. 2016,130, 83–96. [CrossRef] 31. Kise, M.; Zhang, Q.; Rovira-Más, F. A Stereovision-based crop row detection method for tractor-automated guidance. Biosyst. Eng. 2005,90, 357–367. [CrossRef] 32. Rovira-Más, F.; Zhang, Q.; Reid, J.F. Creation of Three-dimensional Crop Maps based on Aerial Stereoimages. Biosyst. Eng. 2005,90, 251–259. [CrossRef] 33. Llorens, J.; Gil, E.; Llop, J.; Queraltó, M. Georeferenced LiDAR 3D Vine Plantation Map Generation. Sensors 2011,11, 6237–6256. [CrossRef] 34. Tumbo, S.D.; Salyani, M.; Whitney, J.D.; Wheaton, T.A.; Miller, W.M. Investigation of laser and ultrasonic ranging sensors for measurements of citrus canopy volume. Appl. Eng. Agric. 2002 ,18, 367–372. [CrossRef] 35. Gil, E.; Escolà, A.; Rosell, J.R.; Planas, S.; Val, L. Variable rate application of plant protection products in vineyard using ultrasonic sensors. Crop Prot. 2007,26, 1287–1297. [CrossRef] 36. Wei, J.; Salyani, M. Development of a laser scanner for measuring tree canopy characteristics: Phase 2. Foliage density measurement. Trans. ASABE 2005,48, 1595–1602. [CrossRef] 37. Pai, N.; Salyani, M.; Sweeb, R.D. Regulating airflow of orchard airblast sprayer based on tree foliage density. Trans. ASABE 2009,52, 1423–1428. [CrossRef] 38. Palleja, T.; Landers, A.J. Real time canopy density estimation using ultrasonic envelope signals in the orchard and vineyard. Comput. Electron. Agric. 2015,115, 108–117. [CrossRef] 39. Escolà, A.; Planas, S.; Rosell, J.; Pomar, J.; Camp, F.; Solanelles, F.; Gracia, F.; Llorens, J.; Gil, E. Performance of an Ultrasonic Ranging Sensor in Apple Tree Canopies. Sensors 2011,11, 2459–2477. [CrossRef] 40. Zaman, Q.U.; Schumann, A.W.; Hostler, H.K. Estimation of citrus fruit yield using ultrasonically-sensed tree size. Appl. Eng. Agric. 2006,22, 39–44. [CrossRef] 41. Stajnko, D.; Berk, P.; Lešnik, M.; Jejˇciˇc, V.; Lakota, M.; Strancar, A.; Hoˇcevar, M.; Rakun, J. Programmable ultrasonic sensing system for targeted spraying in orchards. Sensors 2012,12, 15500–15519. [CrossRef] 42. Giuliani, R.; Magnanini, E.; Fragassa, C.; Nerozzi, F. Ground monitoring the light-shadow windows of a tree canopy to yield canopy light interception and morphological traits. Plant Cell Environ. 2000 ,23, 783–796. [CrossRef] 43. Bietresato, M.; Carabin, G.; Vidoni, R.; Gasparetto, A.; Mazzetto, F. Evaluation of a LiDAR-based 3D-stereoscopic vision system for crop-monitoring applications. Comput. Electron. Agric. 2016 ,124, 1–13. [CrossRef] 44. Sanz, R.; Rosell, J.R.; Llorens, J.; Gil, E.; Planas, S. Relationship between tree row LIDAR-volume and leaf area density for fruit orchards and vineyards obtained with a LIDAR 3D Dynamic Measurement System. Agric. For. Meteorol. 2013,171, 153–162. [CrossRef] 45. Sanz-Cortiella, R.; Llorens-Calveras, J.; Escolà, A.; Arno-Satorra, J.; Ribes-Dasi, M.; Masip-Vilalta, J.; Camp, F.; Gracia-Aguila, F.; Solanelles-Batlle, F.; Planas-DeMarti, S.; et al. Innovative LIDAR 3D Dynamic Measurement System to Estimate Fruit-Tree Leaf Area. Sensors 2011,11, 5769–5791. [CrossRef] [PubMed] 46. Moorthy, I.; Miller, J.R.; Berni, J.A.J.; Zarco-Tejada, P.; Hu, B.; Chen, J. Field characterization of olive (Olea europaea L.) tree crown architecture using terrestrial laser scanning data. Agric. For. Meteorol. 2011 ,151, 204–214. [CrossRef] 47. Rosell, J.R.; Llorens, J.; Sanz, R.; Arnó, J.; Ribes-Dasi, M.; Masip, J.; Escolà, A.; Camp, F.; Solanelles, F.; Gràcia, F. Obtaining the three-dimensional structure of tree orchards from remote 2D terrestrial LIDAR scanning. Agric. For. Meteorol. 2009,149, 1505–1515. [CrossRef] 48. Llorens, J.; Gil, E.; Llop, J.; Escolà, A. Ultrasonic and LIDAR Sensors for Electronic Canopy Characterization in Vineyards: Advances to Improve Pesticide Application Methods. Sensors 2011 ,11, 2177–2194. [CrossRef] [PubMed] 49. Campillo, R. Los productos químicos en la olivicultura actual. Phytoma España 1998,102, 159–167. 50. Parliament, E. European Directive 2009/128/EC for the Sustainable Use of Pesticides; European Parliamentary Research Service: Brussels, Belgium, 2009; pp. 71–86. 51. Giles, D.K.; Delwiche, M.J.; Dodd, R.B. Control of orchard spraying based on electronic sensing of target characteristics. Trans. ASAE 1987,30, 1624–1636. [CrossRef]
Sensors 2018,18, 4406 18 of 18 52. Ganzelmeier, H.; Rautmann, D. Drift, drift reducing sprayers and sprayer testing. Asp. Appl. Biol. 2000 ,57, 1–10. 53. Brown, D.L.; Giles, D.K.; Oliver, M.N.; Klassen, P. Targeted spray technology to reduce pesticide in runoff from dormant orchards. Crop Prot. 2008,27, 545–552. [CrossRef] 54. Miranda-Fuentes, A.; Cuenca, A.; Godoy-Nieto, A.; González-Sánchez, E.J.; de Fuentes, P.M.; Blanco-Roldán, G.L.; Gil-Ribes, J.A. Field testing and monitoring of newly designed airblast sprayers in traditional olive orchards. In Proceedings of the 14th Workshop on Spray Application Techniques in Fruit Growing, Hasselt, Belgium, 10–12 May 2017. 55. Torrent, X.; Garcerá, C.; Moltó, E.; Chueca, P.; Abad, R.; Grafulla, C.; Román, C.; Planas, S. Comparison between standard and drift reducing nozzles for pesticide application in citrus: Part II. Effects on canopy spray distribution, control efficacy of Aonidiella aurantii (Maskell), beneficial parasitoids and pesticide residues on fruit. Crop Prot. 2017,94, 83–96. [CrossRef] 56. Doruchowski, G.; Balsari, P.; Van De Zande, J. Development of a crop adapted spray application system for sustainable plant protection in fruit growing. In Proceedings of the International Symposium on Application of Precision Agriculture for Fruits and Vegetables, Orlando, FL, USA, 6 January 2008; Volume 824, pp. 251–260. 57. Llorens, J.; Gil, E.; Llop, J.; Escolà, A. Variable rate dosing in precision viticulture: Use of electronic devices to improve application efficiency. Crop Prot. 2010,29, 239–248. [CrossRef] 58. Miranda-Fuentes, A.; Rodríguez-Lizana, A.; Cuenca, A.; González-Sánchez, E.J.; Blanco-Roldán, G.L.; Gil-Ribes, J.A. Improving plant protection product applications in traditional and intensive olive orchards through the development of new prototype air-assisted sprayers. Crop Prot. 2017,94, 44–58. [CrossRef] © 2018 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).