Catering robots have shown great potential in assisting the elderly and people with upper limb disabilities. Food assistance robots are usually small in size and require good convenience and mobility, so they must adopt lightweight design to operate efficiently and save energy in limited space. Therefore, a lightweight visual model of MEAL-YOLOv8 is proposed to achieve more efficient food classification function, combining BRA and MSDA attention mechanisms, and integrating the advantages of YOLOv8 and MobileNetV3. After deployment on the JETSON NANO B01 platform, the MEAL-YOLOv8 model has a size of only 2.37 MB, a memory usage of 158 MB, and a classification accuracy of 91.4%. It has high-precision and low latency visual recognition capabilities, allowing the food aid robot to operate efficiently in resource limited environments and recognize food in real-time and accurately.
关键词
Keywords
references
United Nations . World population prospects 2022: summary of results [EB/OL]. https://www.un.org/development/desa/pd/sites/www.un.org.development.desa.pd/files/wpp2022_summary_of_results.pdf https://www.un.org/development/desa/pd/sites/www.un.org.development.desa.pd/files/wpp2022_summary_of_results.pdf . doi: 10.18356/9789210014380 http://dx.doi.org/10.18356/9789210014380
RUDNICKA E , NAPIERAŁA P , PODFIGURNA A , et al . The world health organization (WHO) approach to healthy ageing [J]. Maturitas , 2020 , 139 : 6 - 11 . doi: 10.1016/j.maturitas.2020.05.018 http://dx.doi.org/10.1016/j.maturitas.2020.05.018
GERLACH H K , JANSEN T A , LEONHARDT S . A survey on robotic devices for upper limb rehabilitation [J]. Journal of Neuroengineering and Rehabilitation , 2014 , 11 : 1 - 29 . doi: 10.1186/1743-0003-11-3 http://dx.doi.org/10.1186/1743-0003-11-3
TOPPING M . The development of Handy 1, a robotic aid to independence for the severely disabled [C]// IEEE Colloquium Mechatronic Aids for the Disabled , 1995 : 1 - 2 . doi: 10.1049/ic:19950683 http://dx.doi.org/10.1049/ic:19950683
SOYAMA R , ISHII S , FUKASE A . 8 selectable operating interfaces of the meal-assistance device “my spoon” [C]// Advances in Rehabilitation Robotics , Lecture Notes in Control and Information Science , 2006 : 155 - 163 .
HERMANN R P , PHALANGAS A C , MAHONEY R M , et al . Powered feeding devices: an evaluation of three models [J]. Archives of Physical Medicine and Rehabilitation , 1999 , 80 : 1237 - 1242 . doi: 10.1016/s0003-9993(99)90022-9 http://dx.doi.org/10.1016/s0003-9993(99)90022-9
CHOI I , KO K , SONG H , et al . A meal-assistance robot system for Asian food and its food acquisition point estimation and user interface based on face recognition [J]. Applied Science , 2023 , 13 ( 5 ): 3216 .
KAWAMOTO H , SHIRAKI T , OTSUKA T , et al . Meal-assistance by robot suit HAL using detection of food position with camera [C]// IEEE International Conference on Robotics and Biomimetics , 2011 : 889 - 894 . doi: 10.1109/robio.2011.6181400 http://dx.doi.org/10.1109/robio.2011.6181400
FAN Y , ZHANG L , ZHENG C , et al . Real-time and accurate meal detection for meal-assisting robots [J]. Journal of Food Engineering , 2024 , 371 : 111996 . doi: 10.1016/j.jfoodeng.2024.111996 http://dx.doi.org/10.1016/j.jfoodeng.2024.111996
ZHAO X , CHEN D , XIANG G , et al . A vision-based target localization system for the meal assistance robot [C]// International Conference on CYBER Technology in Automation, Control, and Intelligent Systems , 2022 : 769 - 774 . doi: 10.1109/cyber55403.2022.9907689 http://dx.doi.org/10.1109/cyber55403.2022.9907689
PERERA C J , LALITHARATNE T D , KIGUCHI K . EEG-controlled meal assistance robot with camera-based automatic mouth position tracking and mouth open detection [C]// IEEE International Conference on Robotics and Automation , 2017 : 1760 - 1765 . doi: 10.1109/ICRA.2017.7989208 http://dx.doi.org/10.1109/ICRA.2017.7989208
SIMONYAN K , ZISSERMAN A . Very deep convolutional networks for large-scale image recognition [DB/OL] . https://arxiv.org/abs/1409.1556 https://arxiv.org/abs/1409.1556 .
HE K , ZHANG X , REN S , et al . Deep residual learning for image recognition [C]// IEEE Conference on Computer Vision and Pattern Recognition , 2016 : 770 - 778 . doi: 10.1109/cvpr.2016.90 http://dx.doi.org/10.1109/cvpr.2016.90
GIRSHICK R . Fast R-CNN [C]// IEEE International Conference on Computer Vision , 2015 : 1440 - 1448 . doi: 10.1109/iccv.2015.169 http://dx.doi.org/10.1109/iccv.2015.169
REDMON J , DIVVALA S , GIRSHICK R , et al . You only look once: unified, real-time object detection [C]// Las Vegas: IEEE Conference on Computer Vision and Pattern Recognition , 2016 . doi: 10.1109/cvpr.2016.91 http://dx.doi.org/10.1109/cvpr.2016.91
REDMON J , FARHADI A . YOLO9000: better, faster, stronger [C]// Honolulu: IEEE Conference on Computer Vision and Pattern Recognition , 2017 . doi: 10.1109/cvpr.2017.690 http://dx.doi.org/10.1109/cvpr.2017.690
REDMON J , FARHADI A . Yolov3: an incremental improvement[DB/OL] . https://arxiv.org/abs/1804.02767 https://arxiv.org/abs/1804.02767 . doi: 10.1109/cvpr.2017.690 http://dx.doi.org/10.1109/cvpr.2017.690
BOCHKOVSKIY A , WANG C Y , LIAO H Y M . Yolov4: optimal speed and accuracy of object detection[DB/OL] . https://arxiv.org/abs/2004.10934 https://arxiv.org/abs/2004.10934 .
GE Z , LIU S , WANG F , et al . Yolox: exceeding YOLO series in 2021[DB/OL] . https://arxiv.org/abs/2107.08430 https://arxiv.org/abs/2107.08430 .
JIAO J , TANG Y M , LIN K Y , et al . DilateFormer: multi-scale dilated transformer for visual recognition [J]. IEEE Transactions on Multimedia , 2023 , 25 : 8906 - 8919 . doi: 10.1109/tmm.2023.3243616 http://dx.doi.org/10.1109/tmm.2023.3243616
ZHU L , WANG X , KE Z , et al . Biformer: vision transformer with bi-level routing attention [C]// Vancouver: IEEE Conference on Computer Vision and Pattern Recognition , 2023 . doi: 10.1109/cvpr52729.2023.00995 http://dx.doi.org/10.1109/cvpr52729.2023.00995