際際滷

際際滷Share a Scribd company logo
Multimedia Application Lab
NCUT Department of Computer Science and Information Engineering
Development of a Home Surveillance Vehicle Using
Arduino
Reporter 鐚 Siao-Dawn Tsai
Date : 112.06.02
Author: Chuin-Mu Wang, Shao-Wei Chu , Jiaren Lim,Siao-Dawn Tsai
NCUT Department of Computer Science and Information Engineering
Outline
Introduction
1
Method
2
- Model Training
- Dataset Preparation and Explaination
- Arduino Car
- Function List
- Vehicle Operation
- OpenPoses Technique
Model
3
Experiment and Result
4
- Background
- Questions
- Purposed
Conclusions
5
2
Multimedia Application Lab
NCUT Department of Computer Science and Information Engineering
3
Introduction
Multimedia Application Lab
NCUT Department of Computer Science and Information Engineering
Background
4
 In recent years, Taiwan has made significant advancements in
healthcare, resulting in longer life expectancy. The population is living
longer and a decline in birth rates, leading to a higher proportion of
elderly individuals.
 Advancements in technology have introduced various new
applications, such as microprocessors in embedded systems and the
utilization of deep learning in image recognition. These technologies
not only enhance convenience but also improve quality of life and
safety.
NCUT Department of Computer Science and Information Engineering
 With the aging population, home care has become increasingly significant,
yet the existing healthcare and long-term care services cannot meet the
growing demand.
 Elderly individuals who live alone or lack caregiver support may face the
following crises : Accidental falls, Sudden medical emergencies, Home
safety issues, etc.
Questions
5
Multimedia Application Lab
NCUT Department of Computer Science and Information Engineering
Propose
6
 Arduino serves as the control center for monitoring vehicles, processing and
transmitting diverse data and image information.
 Develop a system that utilizes deep learning and image recognition to
identify accidents and achieve comprehensive monitoring.
 Leverage the low power consumption, small size, and ease of programming
of Arduino to enhance the efficiency and safety of home care.
Multimedia Application Lab
NCUT Department of Computer Science and Information Engineering
NCUT Department of Computer Science and Information Engineering
Method
7
Multimedia Application Lab
NCUT Department of Computer Science and Information Engineering
8
Arduino Car
Arduino MEGA for vehicle control and transmission.
3D print the vehicle body using PLA material.
Utilize GA12-N20 gear motor for vehicle movement.
OV7670 camera module for image acquisition.
Integrate ESP Arduino Wi-Fi module.
Multimedia Application Lab
NCUT Department of Computer Science and Information Engineering
9
Function List
Remote control: Enable remote control of the vehicle's movement to
reach the person in need through a mobile phone or computer.
Environmental monitoring: Monitor the environmental conditions, such
as temperature, humidity, and smoke, to detect abnormalities promptly.
Multimedia Application Lab
NCUT Department of Computer Science and Information Engineering
Vehicle Operation
10
Multimedia Application Lab
NCUT Department of Computer Science and Information Engineering
OpenPoses Techniques
OpenPose comprises a feature extraction network and a keypoint detection
network.
The feature extraction network utilizes convolutional layers, pooling layers, and
batch normalization layers to capture spatial and semantic information from the
image.
The keypoint detection network consists of keypoint position detection and
keypoint correlation detection branches, employing convolutional neural
networks to detect keypoints' positions and relationships.
11
Multimedia Application Lab
NCUT Department of Computer Science and Information Engineering
NCUT Department of Computer Science and Information Engineering
Model
12
Multimedia Application Lab
NCUT Department of Computer Science and Information Engineering
13
Model Training
End
Start OpenPose
Train Model
Model
Picture
Label
File
Dataset
Pretraining
Weight
Multimedia Application Lab
NCUT Department of Computer Science and Information Engineering
14
Dataset Preparation and Explanation
 The source pictures are taken manually and dataset from online and the amount of pictures is
shown in Table.
Class 3
Images 5200
Split Ratio鐚Train, Test鐚 7 : 3
Quantity of Images and Classes
Multimedia Application Lab
NCUT Department of Computer Science and Information Engineering
NCUT Department of Computer Science and Information Engineering
Experiment and Result
15
Multimedia Application Lab
NCUT Department of Computer Science and Information Engineering
NCUT Department of Computer Science and Information Engineering
Motion Recognition Steps
16
Multimedia Application Lab
NCUT Department of Computer Science and Information Engineering
17
Fall Detection
Multimedia Application Lab
NCUT Department of Computer Science and Information Engineering
NCUT Department of Computer Science and Information Engineering
Conclusions
18
Multimedia Application Lab
NCUT Department of Computer Science and Information Engineering
19
Conclusions
 This paper proposes to use image recognition to assist the long-term care. Compared with
the current mainstream safety devices, it can not only prevent the elders from accidents, but
also assist in checking the status of surrounding house area.
 The model trained in this experiment initially used 5,200 images, which were split into a
training set of approximately 3,640 images and a testing set of approximately 1,560 images.
The fall, walking, and sitting positions each accounted for one-third of the dataset, and the
overall accuracy was 0.96.
Thanks For Listening
Ad

Recommended

ROAD POTHOLE DETECTION USING YOLOV4 DARKNET
ROAD POTHOLE DETECTION USING YOLOV4 DARKNET
IRJET Journal
Advance Intelligent Video Surveillance System Using OpenCV
Advance Intelligent Video Surveillance System Using OpenCV
IRJET Journal
Intelligent System For Face Mask Detection
Intelligent System For Face Mask Detection
IRJET Journal
fdfdsfs sfsfsfsffdfdsfdfsfsfsfsfsdfdsfsdfdsfsdfdsf
fdfdsfs sfsfsfsffdfdsfdfsfsfsfsfsdfdsfsdfdsfsdfdsf
krisnasingh0322
POTHOLE DETECTION SYSTEM USING YOLO v4 ALGORITHM
POTHOLE DETECTION SYSTEM USING YOLO v4 ALGORITHM
IRJET Journal
ML for blind people.pptx
ML for blind people.pptx
JAYKUMARKABRA
Object Detection and Localization for Visually Impaired People using CNN
Object Detection and Localization for Visually Impaired People using CNN
IRJET Journal
STRATAGIES FOR DETECTING DATA POISONING IN DISTRIBUTED ML.docx
STRATAGIES FOR DETECTING DATA POISONING IN DISTRIBUTED ML.docx
spub1985
STRATAGIES FOR DETECTING DATA POISONING IN DISTRIBUTED ML (1).docx
STRATAGIES FOR DETECTING DATA POISONING IN DISTRIBUTED ML (1).docx
spub1985
PROJECT LIGTAS PRESENTATION.pptx
PROJECT LIGTAS PRESENTATION.pptx
JessaSiares
IRJET- Object Detection and Recognition for Blind Assistance
IRJET- Object Detection and Recognition for Blind Assistance
IRJET Journal
IRJET - Autonomous Navigation System using Deep Learning
IRJET - Autonomous Navigation System using Deep Learning
IRJET Journal
IMPLEMENTATION OF IDS (INTRUDER DETECTION SYSTEM)
IMPLEMENTATION OF IDS (INTRUDER DETECTION SYSTEM)
IRJET Journal
AUTOMATIC ATTENDANCE SYSTEM MANAGEMENT USING RASPBERRY PI WITH ULTRASONIC SENSOR
AUTOMATIC ATTENDANCE SYSTEM MANAGEMENT USING RASPBERRY PI WITH ULTRASONIC SENSOR
IRJET Journal
A SURVEY ON KIDNEY STONE DETECTION USING IMAGE PROCESSING AND DEEP LEARNING
A SURVEY ON KIDNEY STONE DETECTION USING IMAGE PROCESSING AND DEEP LEARNING
IRJET Journal
Final yr proj ppt
Final yr proj ppt
Dikshya Rath
Artificial Intelligence based CCTV accident detection and nearby patrol alert...
Artificial Intelligence based CCTV accident detection and nearby patrol alert...
IRJET Journal
Project Purposel for reference to do project
Project Purposel for reference to do project
DIVYADHARSHINISDIVYA
SATURDAY PRESENTATION.pptx
SATURDAY PRESENTATION.pptx
JessaSiares
X-Ray Based Quick Covid-19 Detection Using Raspberry-pi
X-Ray Based Quick Covid-19 Detection Using Raspberry-pi
IRJET Journal
Accident detection system project report.pdf
Accident detection system project report.pdf
Kamal Acharya
Toddler monitoring system in vehicle using single shot detector-mobilenet and...
Toddler monitoring system in vehicle using single shot detector-mobilenet and...
IAESIJAI
Smart Home for Senior Citizens
Smart Home for Senior Citizens
IRJET Journal
seminar report kshitij on PBL presentation.pdf
seminar report kshitij on PBL presentation.pdf
sayalishivarkar1
INDOOR AND OUTDOOR NAVIGATION ASSISTANCE SYSTEM FOR VISUALLY IMPAIRED PEOPLE ...
INDOOR AND OUTDOOR NAVIGATION ASSISTANCE SYSTEM FOR VISUALLY IMPAIRED PEOPLE ...
IRJET Journal
AN ANDROID APPLICATION FOR CAMPUS INFORMATION SYSTEM
AN ANDROID APPLICATION FOR CAMPUS INFORMATION SYSTEM
IRJET Journal
MINOR PROJECT-1[1].pptxb jwjeye6swhqhwhwe
MINOR PROJECT-1[1].pptxb jwjeye6swhqhwhwe
sunnyphotography601
Smart Traffic System using Machine Learning
Smart Traffic System using Machine Learning
IRJET Journal
Energy Balances Of Oecd Countries 2011 Iea Statistics 1st Edition Oecd
Energy Balances Of Oecd Countries 2011 Iea Statistics 1st Edition Oecd
razelitouali
Nice Dream.pdf /
Nice Dream.pdf /
ErinUsher3

More Related Content

Similar to ILT202411111111111111111111111111111.pdf (20)

STRATAGIES FOR DETECTING DATA POISONING IN DISTRIBUTED ML (1).docx
STRATAGIES FOR DETECTING DATA POISONING IN DISTRIBUTED ML (1).docx
spub1985
PROJECT LIGTAS PRESENTATION.pptx
PROJECT LIGTAS PRESENTATION.pptx
JessaSiares
IRJET- Object Detection and Recognition for Blind Assistance
IRJET- Object Detection and Recognition for Blind Assistance
IRJET Journal
IRJET - Autonomous Navigation System using Deep Learning
IRJET - Autonomous Navigation System using Deep Learning
IRJET Journal
IMPLEMENTATION OF IDS (INTRUDER DETECTION SYSTEM)
IMPLEMENTATION OF IDS (INTRUDER DETECTION SYSTEM)
IRJET Journal
AUTOMATIC ATTENDANCE SYSTEM MANAGEMENT USING RASPBERRY PI WITH ULTRASONIC SENSOR
AUTOMATIC ATTENDANCE SYSTEM MANAGEMENT USING RASPBERRY PI WITH ULTRASONIC SENSOR
IRJET Journal
A SURVEY ON KIDNEY STONE DETECTION USING IMAGE PROCESSING AND DEEP LEARNING
A SURVEY ON KIDNEY STONE DETECTION USING IMAGE PROCESSING AND DEEP LEARNING
IRJET Journal
Final yr proj ppt
Final yr proj ppt
Dikshya Rath
Artificial Intelligence based CCTV accident detection and nearby patrol alert...
Artificial Intelligence based CCTV accident detection and nearby patrol alert...
IRJET Journal
Project Purposel for reference to do project
Project Purposel for reference to do project
DIVYADHARSHINISDIVYA
SATURDAY PRESENTATION.pptx
SATURDAY PRESENTATION.pptx
JessaSiares
X-Ray Based Quick Covid-19 Detection Using Raspberry-pi
X-Ray Based Quick Covid-19 Detection Using Raspberry-pi
IRJET Journal
Accident detection system project report.pdf
Accident detection system project report.pdf
Kamal Acharya
Toddler monitoring system in vehicle using single shot detector-mobilenet and...
Toddler monitoring system in vehicle using single shot detector-mobilenet and...
IAESIJAI
Smart Home for Senior Citizens
Smart Home for Senior Citizens
IRJET Journal
seminar report kshitij on PBL presentation.pdf
seminar report kshitij on PBL presentation.pdf
sayalishivarkar1
INDOOR AND OUTDOOR NAVIGATION ASSISTANCE SYSTEM FOR VISUALLY IMPAIRED PEOPLE ...
INDOOR AND OUTDOOR NAVIGATION ASSISTANCE SYSTEM FOR VISUALLY IMPAIRED PEOPLE ...
IRJET Journal
AN ANDROID APPLICATION FOR CAMPUS INFORMATION SYSTEM
AN ANDROID APPLICATION FOR CAMPUS INFORMATION SYSTEM
IRJET Journal
MINOR PROJECT-1[1].pptxb jwjeye6swhqhwhwe
MINOR PROJECT-1[1].pptxb jwjeye6swhqhwhwe
sunnyphotography601
Smart Traffic System using Machine Learning
Smart Traffic System using Machine Learning
IRJET Journal
STRATAGIES FOR DETECTING DATA POISONING IN DISTRIBUTED ML (1).docx
STRATAGIES FOR DETECTING DATA POISONING IN DISTRIBUTED ML (1).docx
spub1985
PROJECT LIGTAS PRESENTATION.pptx
PROJECT LIGTAS PRESENTATION.pptx
JessaSiares
IRJET- Object Detection and Recognition for Blind Assistance
IRJET- Object Detection and Recognition for Blind Assistance
IRJET Journal
IRJET - Autonomous Navigation System using Deep Learning
IRJET - Autonomous Navigation System using Deep Learning
IRJET Journal
IMPLEMENTATION OF IDS (INTRUDER DETECTION SYSTEM)
IMPLEMENTATION OF IDS (INTRUDER DETECTION SYSTEM)
IRJET Journal
AUTOMATIC ATTENDANCE SYSTEM MANAGEMENT USING RASPBERRY PI WITH ULTRASONIC SENSOR
AUTOMATIC ATTENDANCE SYSTEM MANAGEMENT USING RASPBERRY PI WITH ULTRASONIC SENSOR
IRJET Journal
A SURVEY ON KIDNEY STONE DETECTION USING IMAGE PROCESSING AND DEEP LEARNING
A SURVEY ON KIDNEY STONE DETECTION USING IMAGE PROCESSING AND DEEP LEARNING
IRJET Journal
Final yr proj ppt
Final yr proj ppt
Dikshya Rath
Artificial Intelligence based CCTV accident detection and nearby patrol alert...
Artificial Intelligence based CCTV accident detection and nearby patrol alert...
IRJET Journal
Project Purposel for reference to do project
Project Purposel for reference to do project
DIVYADHARSHINISDIVYA
SATURDAY PRESENTATION.pptx
SATURDAY PRESENTATION.pptx
JessaSiares
X-Ray Based Quick Covid-19 Detection Using Raspberry-pi
X-Ray Based Quick Covid-19 Detection Using Raspberry-pi
IRJET Journal
Accident detection system project report.pdf
Accident detection system project report.pdf
Kamal Acharya
Toddler monitoring system in vehicle using single shot detector-mobilenet and...
Toddler monitoring system in vehicle using single shot detector-mobilenet and...
IAESIJAI
Smart Home for Senior Citizens
Smart Home for Senior Citizens
IRJET Journal
seminar report kshitij on PBL presentation.pdf
seminar report kshitij on PBL presentation.pdf
sayalishivarkar1
INDOOR AND OUTDOOR NAVIGATION ASSISTANCE SYSTEM FOR VISUALLY IMPAIRED PEOPLE ...
INDOOR AND OUTDOOR NAVIGATION ASSISTANCE SYSTEM FOR VISUALLY IMPAIRED PEOPLE ...
IRJET Journal
AN ANDROID APPLICATION FOR CAMPUS INFORMATION SYSTEM
AN ANDROID APPLICATION FOR CAMPUS INFORMATION SYSTEM
IRJET Journal
MINOR PROJECT-1[1].pptxb jwjeye6swhqhwhwe
MINOR PROJECT-1[1].pptxb jwjeye6swhqhwhwe
sunnyphotography601
Smart Traffic System using Machine Learning
Smart Traffic System using Machine Learning
IRJET Journal

Recently uploaded (20)

Energy Balances Of Oecd Countries 2011 Iea Statistics 1st Edition Oecd
Energy Balances Of Oecd Countries 2011 Iea Statistics 1st Edition Oecd
razelitouali
Nice Dream.pdf /
Nice Dream.pdf /
ErinUsher3
What are the benefits that dance brings?
What are the benefits that dance brings?
memi27
GEOGRAPHY-Study Material [ Class 10th] .pdf
GEOGRAPHY-Study Material [ Class 10th] .pdf
SHERAZ AHMAD LONE
ROLE PLAY: FIRST AID -CPR & RECOVERY POSITION.pptx
ROLE PLAY: FIRST AID -CPR & RECOVERY POSITION.pptx
Belicia R.S
Assisting Individuals and Families to Promote and Maintain Health Unit 7 | ...
Assisting Individuals and Families to Promote and Maintain Health Unit 7 | ...
RAKESH SAJJAN
Unit- 4 Biostatistics & Research Methodology.pdf
Unit- 4 Biostatistics & Research Methodology.pdf
KRUTIKA CHANNE
The Man In The Back Exceptional Delaware.pdf
The Man In The Back Exceptional Delaware.pdf
dennisongomezk
Sustainable Innovation with Immersive Learning
Sustainable Innovation with Immersive Learning
Leonel Morgado
Paper 108 | Thoreaus Influence on Gandhi: The Evolution of Civil Disobedience
Paper 108 | Thoreaus Influence on Gandhi: The Evolution of Civil Disobedience
Rajdeep Bavaliya
Paper 109 | Archetypal Journeys in Interstellar: Exploring Universal Themes...
Paper 109 | Archetypal Journeys in Interstellar: Exploring Universal Themes...
Rajdeep Bavaliya
How to Create an Event in Odoo 18 - Odoo 18 際際滷s
How to Create an Event in Odoo 18 - Odoo 18 際際滷s
Celine George
THERAPEUTIC COMMUNICATION included definition, characteristics, nurse patient...
THERAPEUTIC COMMUNICATION included definition, characteristics, nurse patient...
parmarjuli1412
Chalukyas of Gujrat, Solanki Dynasty NEP.pptx
Chalukyas of Gujrat, Solanki Dynasty NEP.pptx
Dr. Ravi Shankar Arya Mahila P. G. College, Banaras Hindu University, Varanasi, India.
FEBA Sofia Univercity final diplian v3 GSDG 5.2025.pdf
FEBA Sofia Univercity final diplian v3 GSDG 5.2025.pdf
ChristinaFortunova
Basic English for Communication - Dr Hj Euis Eti Rohaeti Mpd
Basic English for Communication - Dr Hj Euis Eti Rohaeti Mpd
Restu Bias Primandhika
How to Manage Inventory Movement in Odoo 18 POS
How to Manage Inventory Movement in Odoo 18 POS
Celine George
SPENT QUIZ NQL JR FEST 5.0 BY SOURAV.pptx
SPENT QUIZ NQL JR FEST 5.0 BY SOURAV.pptx
Sourav Kr Podder
Capitol Doctoral Presentation -June 2025.pptx
Capitol Doctoral Presentation -June 2025.pptx
CapitolTechU
Energy Balances Of Oecd Countries 2011 Iea Statistics 1st Edition Oecd
Energy Balances Of Oecd Countries 2011 Iea Statistics 1st Edition Oecd
razelitouali
Nice Dream.pdf /
Nice Dream.pdf /
ErinUsher3
What are the benefits that dance brings?
What are the benefits that dance brings?
memi27
GEOGRAPHY-Study Material [ Class 10th] .pdf
GEOGRAPHY-Study Material [ Class 10th] .pdf
SHERAZ AHMAD LONE
ROLE PLAY: FIRST AID -CPR & RECOVERY POSITION.pptx
ROLE PLAY: FIRST AID -CPR & RECOVERY POSITION.pptx
Belicia R.S
Assisting Individuals and Families to Promote and Maintain Health Unit 7 | ...
Assisting Individuals and Families to Promote and Maintain Health Unit 7 | ...
RAKESH SAJJAN
Unit- 4 Biostatistics & Research Methodology.pdf
Unit- 4 Biostatistics & Research Methodology.pdf
KRUTIKA CHANNE
The Man In The Back Exceptional Delaware.pdf
The Man In The Back Exceptional Delaware.pdf
dennisongomezk
Sustainable Innovation with Immersive Learning
Sustainable Innovation with Immersive Learning
Leonel Morgado
Paper 108 | Thoreaus Influence on Gandhi: The Evolution of Civil Disobedience
Paper 108 | Thoreaus Influence on Gandhi: The Evolution of Civil Disobedience
Rajdeep Bavaliya
Paper 109 | Archetypal Journeys in Interstellar: Exploring Universal Themes...
Paper 109 | Archetypal Journeys in Interstellar: Exploring Universal Themes...
Rajdeep Bavaliya
How to Create an Event in Odoo 18 - Odoo 18 際際滷s
How to Create an Event in Odoo 18 - Odoo 18 際際滷s
Celine George
THERAPEUTIC COMMUNICATION included definition, characteristics, nurse patient...
THERAPEUTIC COMMUNICATION included definition, characteristics, nurse patient...
parmarjuli1412
FEBA Sofia Univercity final diplian v3 GSDG 5.2025.pdf
FEBA Sofia Univercity final diplian v3 GSDG 5.2025.pdf
ChristinaFortunova
Basic English for Communication - Dr Hj Euis Eti Rohaeti Mpd
Basic English for Communication - Dr Hj Euis Eti Rohaeti Mpd
Restu Bias Primandhika
How to Manage Inventory Movement in Odoo 18 POS
How to Manage Inventory Movement in Odoo 18 POS
Celine George
SPENT QUIZ NQL JR FEST 5.0 BY SOURAV.pptx
SPENT QUIZ NQL JR FEST 5.0 BY SOURAV.pptx
Sourav Kr Podder
Capitol Doctoral Presentation -June 2025.pptx
Capitol Doctoral Presentation -June 2025.pptx
CapitolTechU
Ad

ILT202411111111111111111111111111111.pdf

  • 1. Multimedia Application Lab NCUT Department of Computer Science and Information Engineering Development of a Home Surveillance Vehicle Using Arduino Reporter 鐚 Siao-Dawn Tsai Date : 112.06.02 Author: Chuin-Mu Wang, Shao-Wei Chu , Jiaren Lim,Siao-Dawn Tsai
  • 2. NCUT Department of Computer Science and Information Engineering Outline Introduction 1 Method 2 - Model Training - Dataset Preparation and Explaination - Arduino Car - Function List - Vehicle Operation - OpenPoses Technique Model 3 Experiment and Result 4 - Background - Questions - Purposed Conclusions 5 2
  • 3. Multimedia Application Lab NCUT Department of Computer Science and Information Engineering 3 Introduction
  • 4. Multimedia Application Lab NCUT Department of Computer Science and Information Engineering Background 4 In recent years, Taiwan has made significant advancements in healthcare, resulting in longer life expectancy. The population is living longer and a decline in birth rates, leading to a higher proportion of elderly individuals. Advancements in technology have introduced various new applications, such as microprocessors in embedded systems and the utilization of deep learning in image recognition. These technologies not only enhance convenience but also improve quality of life and safety.
  • 5. NCUT Department of Computer Science and Information Engineering With the aging population, home care has become increasingly significant, yet the existing healthcare and long-term care services cannot meet the growing demand. Elderly individuals who live alone or lack caregiver support may face the following crises : Accidental falls, Sudden medical emergencies, Home safety issues, etc. Questions 5
  • 6. Multimedia Application Lab NCUT Department of Computer Science and Information Engineering Propose 6 Arduino serves as the control center for monitoring vehicles, processing and transmitting diverse data and image information. Develop a system that utilizes deep learning and image recognition to identify accidents and achieve comprehensive monitoring. Leverage the low power consumption, small size, and ease of programming of Arduino to enhance the efficiency and safety of home care.
  • 7. Multimedia Application Lab NCUT Department of Computer Science and Information Engineering NCUT Department of Computer Science and Information Engineering Method 7
  • 8. Multimedia Application Lab NCUT Department of Computer Science and Information Engineering 8 Arduino Car Arduino MEGA for vehicle control and transmission. 3D print the vehicle body using PLA material. Utilize GA12-N20 gear motor for vehicle movement. OV7670 camera module for image acquisition. Integrate ESP Arduino Wi-Fi module.
  • 9. Multimedia Application Lab NCUT Department of Computer Science and Information Engineering 9 Function List Remote control: Enable remote control of the vehicle's movement to reach the person in need through a mobile phone or computer. Environmental monitoring: Monitor the environmental conditions, such as temperature, humidity, and smoke, to detect abnormalities promptly.
  • 10. Multimedia Application Lab NCUT Department of Computer Science and Information Engineering Vehicle Operation 10
  • 11. Multimedia Application Lab NCUT Department of Computer Science and Information Engineering OpenPoses Techniques OpenPose comprises a feature extraction network and a keypoint detection network. The feature extraction network utilizes convolutional layers, pooling layers, and batch normalization layers to capture spatial and semantic information from the image. The keypoint detection network consists of keypoint position detection and keypoint correlation detection branches, employing convolutional neural networks to detect keypoints' positions and relationships. 11
  • 12. Multimedia Application Lab NCUT Department of Computer Science and Information Engineering NCUT Department of Computer Science and Information Engineering Model 12
  • 13. Multimedia Application Lab NCUT Department of Computer Science and Information Engineering 13 Model Training End Start OpenPose Train Model Model Picture Label File Dataset Pretraining Weight
  • 14. Multimedia Application Lab NCUT Department of Computer Science and Information Engineering 14 Dataset Preparation and Explanation The source pictures are taken manually and dataset from online and the amount of pictures is shown in Table. Class 3 Images 5200 Split Ratio鐚Train, Test鐚 7 : 3 Quantity of Images and Classes
  • 15. Multimedia Application Lab NCUT Department of Computer Science and Information Engineering NCUT Department of Computer Science and Information Engineering Experiment and Result 15
  • 16. Multimedia Application Lab NCUT Department of Computer Science and Information Engineering NCUT Department of Computer Science and Information Engineering Motion Recognition Steps 16
  • 17. Multimedia Application Lab NCUT Department of Computer Science and Information Engineering 17 Fall Detection
  • 18. Multimedia Application Lab NCUT Department of Computer Science and Information Engineering NCUT Department of Computer Science and Information Engineering Conclusions 18
  • 19. Multimedia Application Lab NCUT Department of Computer Science and Information Engineering 19 Conclusions This paper proposes to use image recognition to assist the long-term care. Compared with the current mainstream safety devices, it can not only prevent the elders from accidents, but also assist in checking the status of surrounding house area. The model trained in this experiment initially used 5,200 images, which were split into a training set of approximately 3,640 images and a testing set of approximately 1,560 images. The fall, walking, and sitting positions each accounted for one-third of the dataset, and the overall accuracy was 0.96.