Flutter-Based Real-Time Mobile App for Fruit Shelf-Life Prediction (FSP) Using Multi-Modality Imaging

Flutter-Based Real-Time Mobile App for Fruit Shelf-Life Prediction (FSP) Using Multi-Modality Imaging

Varsha Yogesh Bhole, Arun Kumar
Copyright: © 2022 |Pages: 20
DOI: 10.4018/IJIRR.298023
Article PDF Download
Open access articles are freely available for download

Abstract

The present work uses flutter and transfer learning-based techniques for predicting the shelf-life of fruits in real-time by reducing the demand for huge number of samples and longer training durations. The work uses mango fruit as a case study, by capturing two types of images axiomatically through smartphone rear camera and a Seek thermal camera. A set of models based on transfer learning were created, then trained, and applied post-training quantization for optimizing the model size and low latency. The models were subsequently converted into TFLite format with TF-Select Ops and deployed in the Flutter app code, and thereby generating the APK files for real-time execution on mobile devices. The performance metrics of the models were evaluated on accuracy, model size, and latency. With a minor level of degradation in accuracy, the model with quantization outperforms and achieves better latency and 12x times reduction in size. The overall accuracy achieved for both the cameras (normal and Thermal) on mobile device was 90% and 93.33% respectively, for predicting the fruit shelf life.
Article Preview
Top

1. Introduction

Deep learning (DL) and flutter are the high-tech solutions in computer science. Deep learning methods have significant strides in visual identification applications. Detecting and categorizing image datasets with deep learning is progressive research (Abdel-Hamid et al., 2014; Alzu’bi et al., 2020; Zhang et al., 2019). DL offers a solution to accomplish artificial intelligence enabling machines to solve problems in such a way as the human brain does. It has been implemented in several areas of people’s day-to-day lives. For example, Siri and Alexa, the voice-based apps are utilized to recognize the speech to help and enable people to communicate with devices by speaking instead of keyboard based inputs.

An ordinary work in image processing is recognizing the same kinds of items using machine learning techniques for classifying and clustering the fruits (Bhole et al, 2020b). Previously, a thermal imaging idea in Naik and Patel (2017), machine learning with a color feature extraction model (Bhole et al, 2020a) and deep neural network (Bhole et al, 2020c) have been suggested and manifested for evaluation of quality and categorizing maturity of the mango (Behera et al., 2020; Sahu and Potdar, 2017; Sultana et al., 2017; Bhole and Kumar, 2020d). Numerous techniques have been employed for identifying the quality of fruits with maturity levels through RGB imaging, either under-controlled or real situations (Behera et al., 2020; Sahu and Potdar, 2017; Sultana et al., 2017; Intaravanne et al, 2012). Particularly, these non-destructive methods have been dependent on the examination of visible and spectral imaging using pattern analysis. Moreover, very little work has been performed based on thermal imaging for fruit quality evaluation. The benefit of the thermal imaging approach is that it is contactless, non-destructive, faster, and also works well in dark environs to lighting environments as well as helpful in addressing the social problems and creating the applications seamlessly. It offers an opportunity for creating new ways to inspect processes that have not been even possible previously.

Furthermore, the number of published works, particularly on the evaluation of shelf-life of fruits, is yet restricted to particular cases. Fan and Zhou (2011) utilized Near-Infrared Spectroscopy to inspect the trait of apple at different periods of shelf life and obtained the accuracy up till 100%. But, the use of Near Infrared Spectroscopy is expensive and not handy technique. However, this is a destructive approach which was used at the laboratory level and can’t be useful for real-time evaluation. Zhang et al. (2013) employed VIS/NIR spectrometer to assess the different stages of Malus Asiatica Nakai fruit by observing the variation in pectin of the fruit. However, this is a destructive approach which was used at the laboratory level and can’t be useful for real-time evaluation. Nandan Thor (2017) predicted the shell life of banana by extracting color features along with 7 machine learning methods and claimed the maximum accuracy as 52%. This approach is non-destructive but the features are extracted manually through image processing techniques by using external surface parameters with very little accuracy.

The automatic shelf-life prediction system has become essential, mainly in the agriculture and food business to reduce the human-intensive work processes and this can be done on mobile devices (Karar et al., 2021) to enhance efficiency. But, this would need sophisticated feature identification process to evaluate fruit shelf-life using similar features that have a high color resemblance. Therefore, customized machine learning models are required to evaluate fruit’s shelf-life and address the intricate features (Bhole et al., 2021) of images for particular applications.

Complete Article List

Search this Journal:
Reset
Volume 14: 1 Issue (2024)
Volume 13: 1 Issue (2023)
Volume 12: 4 Issues (2022): 3 Released, 1 Forthcoming
Volume 11: 4 Issues (2021)
Volume 10: 4 Issues (2020)
Volume 9: 4 Issues (2019)
Volume 8: 4 Issues (2018)
Volume 7: 4 Issues (2017)
Volume 6: 4 Issues (2016)
Volume 5: 4 Issues (2015)
Volume 4: 4 Issues (2014)
Volume 3: 4 Issues (2013)
Volume 2: 4 Issues (2012)
Volume 1: 4 Issues (2011)
View Complete Journal Contents Listing