Review
Technology progress in mechanical harvest of fresh market apples

https://doi.org/10.1016/j.compag.2020.105606Get rights and content

Highlights

  • Reviewed fresh market apple harvest technologies of shake-and-catch, robotics, and platforms.

  • High-throughput and bruising-free catching mechanism needed for shake-and-catch commercialization.

  • Progress of sensing and automation technologies will help develop harvest robotics.

  • Harvest platform, only technology adopted by growers, replaces ladder-and-bucket method.

  • More functions incorporated and improved economics enhance harvest platform adoption.

Abstract

This article reviews the research and development progress of mechanical harvest technologies for fresh market apples over the past decades with a focus on the predominant technologies of shake-and-catch, robots, and harvest-assist platform methods. In addition, based on the review it points out the bottlenecks and future trends of these three technology categories. Major progress in the shake-and-catch method is related to theoretical studies on the effective removal of apples and catching mechanisms to minimize bruising. The unacceptable bruising conditions hinder the shake-and-catch method from commercial application. Two startups of apple harvesting robots are in the stage of commercializing their products based on vacuum and three-finger end-effectors, respectively. Economic benefits, as well as technology reliability and robustness of both robots, are pending for validation before they are on the market. In addition, a key obstacle faced by both robots before commercial use is to find a solution to pick apples grown in clusters. Harvest-assist platforms are gradually adopted by apple growers, but at a very low rate due to their doubts on economic benefits. Validation of harvest-assist platforms’ economic benefits and incorporation with more functions (e.g., sorting) would enhance their adoption. With the rapid development of sensing and automation technologies, such as novel sensors, embedded systems, and machine learning algorithms, and the progress in new tree canopy structures that are friendlier for fruit visibility and accessibility, it is believed the robots for fresh market apple harvest would be realized and commercialized in the near future. Currently, more efforts should be invested in analyzing and validating the economic benefits of harvest-assist platforms, as well as adding more functions to the harvest-assist platforms, to increase their application rate for the benefit of the apple industry.

Introduction

Apple is one of the most consumed fruit in both fresh eating and other forms (e.g., juice and sauce), and it provides a number of health benefits, such as reducing the incidence rates of cancers and cardiovascular diseases (Boyer and Liu, 2004, STATISTA, 2016, PBH., 2015). Fresh market apples are still manually harvested using the conventional ladder-and-bucket approach (Zhang, 2015, Freivalds et al., 2006). In manual harvesting of apples, seasonal workers stand on the ground for picking the low-level fruits and need to climb a ladder to get access to high-level fruits. During the whole harvest process, workers need to wear a bucket to temporarily hold apples, and after the bucket is full, they walk to a bin to unload the fruits. This harvest method is low in efficiency, since a lot of activities performed manually by workers (e.g., moving ladders, climbing up and down, and unloading apples from buckets to bins) are not directly related to apple picking. This conventional harvest approach demands high physical strength for the carrying out of the bucket (≈19 kg when full) continuously, not to mention workers have to climb/descend ladders with a heavy bucket (Freivalds et al., 2006). In addition, the conventional harvest approach is prone to causing occupational injuries, such as ladder falls, back strains, and musculoskeletal disorders (Zhang et al., 2019a, Zhang et al., 2019b, Fathallah, 2010). Mechanical apple harvest is an approach to alleviate the disadvantages of the conventional ladder-and-bucket apple harvest method.

Researchers during the past decades worked towards the realization of mechanical apple harvest using different methods that can be categorized into shake-and-catch method, robots, and harvest-assist platform (Zhang et al., 2016a). The shake-and-catch approach is to hold the trunk or limbs and then shake to detach apples (Allshouse and Morrow, 1972). Several harvest machines based on this concept have been developed, but they are not adopted commercially for fresh market apple harvest due to extensive impacts related to bruising damages on fruit (Berlage and Langmo, 1974, Tennes et al., 1976). Harvesting robots mainly include two components – a machine vision system and an end-effector. The machine vision system detects and localizes apples, and the end-effector detaches fruit from the tree. Though researchers have developed a variety of apple harvesting robot prototypes, none of them is commercialized, due to low throughput and efficiency, unreliable performance, and high cost (Slaughter and Harrell, 1987, Slaughter and Harrell, 1989, Zhao et al., 2016). Harvesting robots, however, can have the potential to entirely replace the laborers. To immediately benefit the apple industry, researchers shifted to the development of harvest-assist platforms to replace the use of ladders (Zhang et al., 2016a, 2017a). Instead of picking by standing on a ladder, picking fruit by standing on the harvest-assist platform would increase harvest efficiency, reduce physical strength requirements, improve overall safety, and alleviate occupational injuries (Schupp et al., 2011).

Numerous research projects have been conducted with results published in the past decades on the progress of mechanical fresh market apple harvest aforementioned concepts (Zhang and Karkee, 2016, He et al., 2017, Wheat, 2019, Zhang et al., 2019d). There were some reviews published in this domain, but they only focused on specific topics: Gongal et al. (2015) reviewed the progress on the machine vision for fruit detection; Bac et al., 2014, Zhao et al., 2016 summarized the progress in robots harvest and vision-based control for robots; and Zhang et al. (2016a) focused on the shake-and-catch method. However, no reviews were published about the mechanical harvest of fresh market apples in a holistic manner in the past decade. Thus, a proper synchronization of the literature in the mechanical fresh market apple harvest has been lacking, and this article aims to fill this need of reviewing the technology progress on the methods of shake-and-catch, robots, and harvest-assist platform.

Section snippets

Shake-and-catch method

Shake-and-catch serves as a promising fresh market apple harvest technology (Markwardt et al., 1968, Fu et al., 2016). A major advantage of shake-and-catch method is its high harvest efficiency, and it was reported that the developed machines were capable of harvesting 20 to 60 trees/h (Allshouse and Morrow, 1972, Chen et al., 1982). However, the low apple detachment rates and unacceptable bruising of harvested apples hindered the machines’ commercial application (LaBelle et al., 1965, Peterson

Apple harvesting robots

Starting from the 1970s, researchers started to develop robots for fresh market fruit harvest (Sarig, 1993, Ceccarelli et al., 2000, Gongal et al., 2015, 2016). Robots for apple harvest progressed slowly, unlike their counterparts in industrial application, due to uncontrolled field environment (e.g., lighting) and complex field working conditions (e.g., water, dust, and vibration) (Sivaraman and Burks, 2006). Robots harvesting is a systematic design, with a lot of technologies involved, such

Apple harvest-assist platform progress

Since both the shake-and-catch method and robots are not ready for commercial use of fresh market apple harvest, and the pressure increases from labor cost increase and labor shortage on apple industry, agricultural engineers and industrial startups invest efforts on developing harvest-assist platforms to assist pickers for fresh market apple harvest since the 1990s (Torregrosa et al., 2009, Schupp et al., 2011). The shortcomings of conventional apple harvest method are mainly due to the use of

Progress summary of fresh market apple mechanical harvest

Table 1 provides a snapshot of the various developments and progresses made in the field of mechanical harvesting of fresh market apples using shake-and-catch, robots, and harvest-assist platforms methods, the overall merits and limitations of these methods, along with identified technology sub-categories and relevant references. This information can be used to compare the methods as well as a roadmap to comprehend the developments so far at a glance and gain detailed information through the

Conclusion and future trends

In this article, the progress in the mechanical harvest of fresh market apples has been summarized focusing on the three predominant technologies, such as shake-and-catch, robots, and harvest-assist platform methods. For the shake-and-catch technology, the recently obtained theoretical knowledge in apple detachment (location index, limb load, and hooker position) is desirable to be applied to design proper tree canopies for easy detachment of apples. Though the tree canopy structure has evolved

Disclaimer

Mention of commercial products or orchards in this paper is only for providing factual information and does not imply endorsement of them by authors over those not mentioned.

Declaration of Competing Interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

References (135)

  • L. He et al.

    Effect of fruit location on apple detachment with mechanical shaking

    Biosyst. Eng.

    (2017)
  • A. Koirala et al.

    Deep learning–Method overview and review of use for fruit detection and yield estimation

    Comput. Electron. Agric.

    (2019)
  • F. Kurtulmus et al.

    Green citrus detection using ‘eigenfruit’, color and circular Gabor texture features under natural outdoor conditions

    Comput. Electron. Agric.

    (2011)
  • M.J. Le Flufy

    The design of a prototype apple harvester

    J. Agric. Eng. Res.

    (1982)
  • J. Li et al.

    Characterizing apple picking patterns for robotic harvesting

    Comput. Electron. Agric.

    (2016)
  • G. Lin et al.

    In-field citrus detection and localisation based on RGB-D image analysis

    Biosyst. Eng.

    (2019)
  • R. Linker et al.

    Determination of the number of green apples in RGB images recorded in orchards

    Comput. Electron. Agric.

    (2012)
  • S. Ma et al.

    Air suspension-based catching mechanism for mechanical harvesting of apples

    IFAC-PapersOnLine

    (2016)
  • A. Mizushima et al.

    An image segmentation method for apple sorting and grading using support vector machine and Otsu’s method

    Comput. Electron. Agric.

    (2013)
  • P. Moallem et al.

    Computer vision-based apple grading for golden delicious apples based on surface features

    Inf. Process. Agric.

    (2017)
  • C. Ortiz et al.

    Shock absorbing surfaces for collecting fruit during the mechanical harvesting of citrus

    Biosyst. Eng.

    (2011)
  • D.L. Peterson et al.

    Advances in mechanical harvesting of fresh market quality apples

    J. Agric. Eng. Res.

    (1989)
  • J. Rakun et al.

    Detecting fruits in natural scenes by using spatial-frequency based texture analysis and multiview geometry

    Comput. Electron. Agric.

    (2011)
  • Y. Sarig

    Robotics of fruit harvesting: A state-of-the-art review

    J. Agric. Eng. Res.

    (1993)
  • Y. Si et al.

    Location of apples in trees using stereoscopic vision

    Comput. Electron. Agric.

    (2015)
  • M.M. Sofu et al.

    Design of an automatic apple sorting system using machine vision

    Comput. Electron. Agric.

    (2016)
  • D. Stajnko et al.

    Estimation of number and diameter of apple fruits in an orchard during the growing season by thermal imaging

    Comput. Electron. Agric.

    (2004)
  • G.W. Allshouse et al.

    Over-the-row harvester for dwarf fruit trees

    Trans. ASAE

    (1972)
  • C.W. Bac et al.

    Harvesting robots for high-value crops: State-of-the-art review and challenges ahead

    J. Field Rob.

    (2014)
  • Baeten, J., Donne, K., Boedrij, S., Beckers, W., & Claesen, E. (2008). Autonomous fruit picking machine: A robotic...
  • A.G. Berlage et al.

    Harvesting apples with straddle-frame trunk shaker

    Trans. ASAE

    (1974)
  • J. Boyer et al.

    Apple phytochemicals and their health benefits

    Nutr. J.

    (2004)
  • D.M. Bulanon et al.

    A multispectral imaging analysis for enhancing citrus fruit detection

    Environ. Control. in Biol.

    (2010)
  • Bulanon, D. M., Kataoka, T., Okamoto, H., & Hata, S. (2004). Determining the 3-D location of the apple fruit during...
  • Bulanon, D. M., Kataoka, T., Ota, Y., & Hiroma, T. (2001). A machine vision system for the apple harvesting robot....
  • Bulanon, D. M., Okamoto, H., & Hata, S. I. (2005). Feedback control of manipulator using machine vision for robotic...
  • Burwood-Taylor, L. (2017). Abundant Robotics raises $10m series A for apple picking robot led by GV. Retrieved from...
  • M. Ceccarelli et al.

    Designing a robotic gripper for harvesting horticulture products

    Robotica

    (2000)
  • P. Chen et al.

    Harvesting Valencia oranges with flexible curved fingers

    Trans. ASAE

    (1982)
  • Chilianu, M and Vlasov, O. (2017). Meet Pluk-O-Trak — the new innovative friend of Moldovan apple pickers. Retrieved...
  • Courtney, R. (2018). Picking a harvest platform: Roundup of manufacturers’ top picks. Retrieved from...
  • Courtney, R., and Mullinax, T.J. (2019). Washington orchards host robotic arms race — Video. Retrieved from...
  • S. Cubero et al.

    Advances in machine vision applications for automatic inspection and quality evaluation of fruits and vegetables

    Food Bioprocess Technol.

    (2011)
  • Davidson, J. R., & Mo, C. (2015). Mechanical design and initial performance testing of an apple-picking end-effector....
  • Davidson, J. R., Silwal, A., Hohimer, C. J., Karkee, M., Mo, C., & Zhang, Q. (2016a). Proof-of-concept of a robotic...
  • J. Davidson et al.

    Hand-picking dynamic analysis for undersensed robotic apple harvesting

    Trans. ASABE

    (2016)
  • M.E. De Kleine et al.

    A semi-automated harvesting prototype for shaking fruit tree limbs

    Trans. ASABE

    (2015)
  • R.G. Diener et al.

    Vibration characteristics of trellis-trained apple trees with reference to fruit detachment

    Trans. ASAE

    (1965)
  • A.M. Dollar et al.

    The highly adaptive SDM hand: Design and performance evaluation

    Int. J. Robotics Res.

    (2010)
  • W. Dong et al.

    Semantic mapping for orchard environments by merging two-sides reconstructions of tree rows

    J. Field Rob.

    (2020)
  • Cited by (75)

    View all citing articles on Scopus
    View full text