Non-Invasive Sensor Technology
Transcript
Well as you know as a consumer yourself, you go into a retail store and you purchase fruit on the basis of what it looks like, take it home and you have an eating experience that’s bad and the research says that you won't go back to buy that fruit for four to six weeks, so it's not an instant decision but it’s certainly important to repeat purchase.
You know the big problem has been that to test mangoes in the past for maturity, they had to cut them. So the only tests we really had were the external visual cues, you know so whether it’s full, good shoulders, shape, bit of blush colour. But the reality is there's a big variation between varieties in that area and some varieties are really hard to tell by external cues, so the only sure method we had before was to actually take a mango and cut it in half and have a look at the flesh colour. So with one of the NIR guns we are now able to walk through the orchard testing fruit, seeing if there’s enough to go through a spot pick or whether they’re all ready and train up our workers as to the visual cues as to what a mature mango looks like. It just means we can get our start date correct so that we're picking fully mature fruit that the customer is going to be happy with.
Initially, we were prompted by growers to look at estimating the quality of fruit non-invasively, its internal quality being sugar content or dry matter content and that took us down the path of measuring in-line. So you’re on a pack line, you’re sorting on colour and weight. Now we were adding in another facility, that is estimating that the sugar content or dry matter content of that fruit. We were in the fields doing the dry matter measurements and we could see the grower practice of trying to estimate fruit yields, that is how much crop was on the tree, so that they could be organised in terms of labour requirements, packhouse requirements and that was all being done manually with a hand counter, so that lead us into a new line of work looking at machine vision in the field, so rather than just machine vision in the pack house, taking it into the field to estimate crop load across the field. The next step on from that of course, having seen the fruit, is to try and reach out to pick the fruit to automate the harvest.
It’s actually getting more advanced and so now the machinery is able to identify and count fruit in the orchard and last year it turned out to be with only a few percents wrong from the actual count of numbers of mangoes are in that entire block. Now that technology is also able to give us the size range of that fruit and so knowing how much fruit is in the block, knowing when it’s going to be mature, knowing the size of the fruit means we can schedule our workforce, we can order the right number of cartons, we can order the right numbers of inserts to go in those cartons. This is going, this could be a real game-changer for not only our farm but for the industry.
The IFFS Non-Invasive Sensor Technologies group is focused on the development of new sensor hardware and applications of existing sensors to assess agricultural commodities and advance productivity without damaging the product. Their work has focussed to tree-fruit crops, and mango in particular, and has been recognised by several awards including the Australian Mangoes 2024 Industry Innovation Award.
The team is known for pioneering work on the use of near-infrared spectroscopy for assessing horticultural produce, and on the implementation of machine-vision for in-orchard fruit load estimation. A current direction involves use of both technologies within a selective fruit harvesting solution to address labour shortages and occupational risks to workers.
A hallmark of the group has been partnership with international technology companies and the Australian horticultural supply chain, delivering research into practical outcomes.
The work of the group is multi-disciplinary in nature, and has involved work in:
- Spectroscopy
- Chemometrics
- Instrumentation – electronics
- Machine vision
- Mechatronics
- Geospatial analysis
- Agronomy
- Business (technology adoption)
The group has delivered outcomes in:
- A handheld near-infrared spectroscopy (NIRS) measurement system to assess harvest maturity and future eating quality of mango (and other) fruit
- An on-packline NIRS measurement system to screen fruits for certain internal defects
- Algorithm and temperature sensor hardware for forecast of the time fruit will be harvest mature
- A web-application for display of data, enabling decisions on the order of harvest of orchard blocks
- Automated technologies for fruit and flower counting automated technologies for fruit picking. Read about the world-first mango auto-harvester
Our main adoption partners in this journey have been MAF Oceania, Felix Instruments, SensorHost, Agricultural Robotics and Australian Mango Industry Association.
Robotic Auto-Harvester for Mangos
Our researchers developed the world’s first mango auto-harvester, with its latest prototype displaying improved fruit handling in trials at Central Queensland orchards.
The auto-harvester has turned heads within the mango industry for some time, but recently underwent substantial refinement and is becoming a more viable for commercialisation.
Read about the world-first mango auto-harvester
NIRS for Fruit Quality
Our non-invasives sensors team has led the world in adapting and implementing near-infrared spectroscopy (NIRS) measurement systems to assess the eating quality of mangos and predict the ideal harvest time.
NIRS sensors and the Fruitmaps app have been widely adopted within the mango industry, laying the foundation for CQU to research in-field machine vision systems to count fruit and estimate fruit size, for fruit load estimates before harvest, allowing farmers to better plan their harvest (e.g. employing the right number of pickers at the right time).
Kerry Walsh, Professor - Sensor Systems
The theme of Kerry Walsh’s career has been the application of non-invasive instrumentation to issues related to plant performance, and in particular, in photosynthate transport - assimilate partitioning. He has led multidisciplinary work resulting in the association of a phytoplasma with the papaya dieback disorder, and the use of near infra-spectroscopy (NIRS) for fruit quality assessment. Kerry has a practical, hands-on, capability, yet an academic perspective on life. He strongly believes that his R&D effort should result in a gain to society and that he should provide practically relevant training to undergraduates and postgraduates.
Dr Zhenglin Wang
Dr Zhenglin Wang is an active researcher in computer vision, machine learning, and precision agriculture, with over 10 years of industry experience as a software engineer. He has played a key role in multiple agricultural innovation projects, including the development of the world’s first automated mango harvesters—a milestone in agri-tech. Driven by a strong passion for applied research, Dr Wang focuses on delivering practical automation solutions that address real-world challenges in agriculture.
Past students
Nicholas Anderson
Nicholas began working on mango orchards while on a working holiday visa and was soon hooked on the fruit and lured into postgraduate work on crop forecasting at CQUniversity. His experience includes near-infrared spectroscopy in assessment of mango fruit maturity led him into a position using the technology in assessment of soil carbon. He is now a NIR spectroscopist (Measurement analysis group lead) with CarbonLink P/L.
Dr Anand Koirala
Anand delivered a PhD thesis through CQUniversity on the use of machine vision technologies for fruit quality and yield estimation. His activity included work on a pipeline for processing imagery collected for from cameras mounted to mobile platforms driven through mango orchards for count and map display of flowers and fruit. He has continued in a senior role at RetinaVisions P/L involving processing of images from cameras mounted to garbage trucks, mapping road defects.
Dr Hari Dhonju
Hari produced a thesis at CQUniversity on the design and development of an orchard harvest management information system, incorporating the outputs of the various sensors that the group has developed. Hari has continued into a position as Geospatial Automation Lead at Agronomeye P/L.
