A multimodal deep learning approach for non-desctructive quality assessment of ficus carica L. / Iylia Adhwa Mazni

The rapid progress in agriculture continually increases the demand for high-quality fruits. Ficus Carica L. (figs) is considered as one of the high-value fruits that required quality assessment due to its prevalence benefits was highly demanding. However, the quality was usually assessed by a destru...

Full description

Saved in:
Bibliographic Details
Main Author: Mazni, Iylia Adhwa
Format: Thesis
Language:English
Published: 2023
Online Access:https://ir.uitm.edu.my/id/eprint/88802/1/88802.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
id my-uitm-ir.88802
record_format uketd_dc
spelling my-uitm-ir.888022023-12-26T07:25:59Z A multimodal deep learning approach for non-desctructive quality assessment of ficus carica L. / Iylia Adhwa Mazni 2023 Mazni, Iylia Adhwa The rapid progress in agriculture continually increases the demand for high-quality fruits. Ficus Carica L. (figs) is considered as one of the high-value fruits that required quality assessment due to its prevalence benefits was highly demanding. However, the quality was usually assessed by a destructive method that normally led to a concern which is the loss of destructed fruits. In addition to that, this traditional approach by employing human labour is time-consuming and prone to human mistakes. In order to address these problems, an automatic non-destructive quality assessment of fig fruits using a deep learning regression model based on RGB and Laser-light Back scattering images (LLBI) is developed in this research work. To achieve this, the image of 33 matured Super Red Hybrid (SRH) fig fruits and the chemical properties (i.e., Brix value) dataset was collected for training and testing the model. The image of fig fruits was captured based on RGB and back scattering images that involve three different wavelengths of laser (650nm, 532nm, and 405nm) which represent Red, Green, and Blue, respectively. To determine the best two image modalities for this regression task, the performance of single modality deep learning models on RGB and Laser-light Backscattering images for figs fruits quality assessment is investigated before the optimization of the model takes place. The investigation is done by comparing the performance of the proposed CNN regression model with the state-of-the-art architecture which is VGG-16 and ResNet-50 for each single image modality. Then, the optimized proposed CNN regression model is extended to a novel multimodal deep learning regression model for the non-destructive quality assessment. In this model, an additional fusion layer is added before the input layer in which the two best single image modalities (RGB and red LLBI) were fused using an average fusion technique. Based on the experimental result, the proposed model shows the best prediction result and capable to assess the quality of fig fruit non-destructively where the value of RMSE and R2 achieve 0.6039, and 0.8084, respectively. Therefore, the development of a multimodal deep learning approach for non-destructive quality assessment of fig fruit was successfully achieved throughout this study. 2023 Thesis https://ir.uitm.edu.my/id/eprint/88802/ https://ir.uitm.edu.my/id/eprint/88802/1/88802.pdf text en public masters Universiti Teknologi MARA (UiTM) Faculty of Electrical Engineering Setumin, Samsul
institution Universiti Teknologi MARA
collection UiTM Institutional Repository
language English
advisor Setumin, Samsul
description The rapid progress in agriculture continually increases the demand for high-quality fruits. Ficus Carica L. (figs) is considered as one of the high-value fruits that required quality assessment due to its prevalence benefits was highly demanding. However, the quality was usually assessed by a destructive method that normally led to a concern which is the loss of destructed fruits. In addition to that, this traditional approach by employing human labour is time-consuming and prone to human mistakes. In order to address these problems, an automatic non-destructive quality assessment of fig fruits using a deep learning regression model based on RGB and Laser-light Back scattering images (LLBI) is developed in this research work. To achieve this, the image of 33 matured Super Red Hybrid (SRH) fig fruits and the chemical properties (i.e., Brix value) dataset was collected for training and testing the model. The image of fig fruits was captured based on RGB and back scattering images that involve three different wavelengths of laser (650nm, 532nm, and 405nm) which represent Red, Green, and Blue, respectively. To determine the best two image modalities for this regression task, the performance of single modality deep learning models on RGB and Laser-light Backscattering images for figs fruits quality assessment is investigated before the optimization of the model takes place. The investigation is done by comparing the performance of the proposed CNN regression model with the state-of-the-art architecture which is VGG-16 and ResNet-50 for each single image modality. Then, the optimized proposed CNN regression model is extended to a novel multimodal deep learning regression model for the non-destructive quality assessment. In this model, an additional fusion layer is added before the input layer in which the two best single image modalities (RGB and red LLBI) were fused using an average fusion technique. Based on the experimental result, the proposed model shows the best prediction result and capable to assess the quality of fig fruit non-destructively where the value of RMSE and R2 achieve 0.6039, and 0.8084, respectively. Therefore, the development of a multimodal deep learning approach for non-destructive quality assessment of fig fruit was successfully achieved throughout this study.
format Thesis
qualification_level Master's degree
author Mazni, Iylia Adhwa
spellingShingle Mazni, Iylia Adhwa
A multimodal deep learning approach for non-desctructive quality assessment of ficus carica L. / Iylia Adhwa Mazni
author_facet Mazni, Iylia Adhwa
author_sort Mazni, Iylia Adhwa
title A multimodal deep learning approach for non-desctructive quality assessment of ficus carica L. / Iylia Adhwa Mazni
title_short A multimodal deep learning approach for non-desctructive quality assessment of ficus carica L. / Iylia Adhwa Mazni
title_full A multimodal deep learning approach for non-desctructive quality assessment of ficus carica L. / Iylia Adhwa Mazni
title_fullStr A multimodal deep learning approach for non-desctructive quality assessment of ficus carica L. / Iylia Adhwa Mazni
title_full_unstemmed A multimodal deep learning approach for non-desctructive quality assessment of ficus carica L. / Iylia Adhwa Mazni
title_sort multimodal deep learning approach for non-desctructive quality assessment of ficus carica l. / iylia adhwa mazni
granting_institution Universiti Teknologi MARA (UiTM)
granting_department Faculty of Electrical Engineering
publishDate 2023
url https://ir.uitm.edu.my/id/eprint/88802/1/88802.pdf
_version_ 1794192164768448512