際際滷

際際滷Share a Scribd company logo
C-Lab
Cognitive Vision, Robotics and Autonomy
Monday, 20 January 2020 1
Prof R Bowden
Centre for Vision Speech and Signal Processing
CVSSP Centre for Vision, Speech and Signal Processing
Creating machines that can see, hear and
understand the world around them
Surrey Autonomous Testbed
DAVe:
Deep
Autonomous
Vehcile
Surrey Autonomous Testbed
 The testbed is very similar to the street drone, using the same Twizy vehicle,
sensors and processing platform
 Twizy Cargo
 Nvidia PX2 Drive
 6 Sekonix cameras (street drone as 8 but same coverage, less overlap)
 Ouster 64 beam lidar
 Wheel odometry, not available on street drone
 Supports wider research and collaborative
projects with Parkopedia, JLR, McLarren,
FLIR amongst others
 Provides Surrey with a data
capture and demonstration platform
Surrey Autonomous Testbed
 Two phase build:
 Phase 1  sensor recording and onboard processing
 Phase 2  actuators to provide full control
 Entire build opensource:
http://autonomous.home.blog
How to build an autonomous vehicle for
< 贈15K
SAE
International
Society of
Automotive
Engineers
Classification
System
Demonstration scenario
1. Parking process is
started via
smartphone
2. Vehicle enters a car
park, localises itself
using indoor maps
and navigates to a
space
3. Driver summons
parked vehicle back
via smartphone
4. Vehicle exits a car
park and is picked by
a driver in a pick up
zone
Work related to Autonomous Driving
 Automatic extrinsic calibration of car
mounted sensors
 Reinforcement Learning for vehicle
control and safety verification
 Feature Learning
across lighting and
weather
 Vehicle state estimation,
sensor fusion and side slip
estimation
 Semantic Segmentation
 Monoscopic depth estimation and
scene estimation
DARPA 3 Waves of AI
 Wave 1  Handcrafted Knowledge
 e.g. classical AI, chess computers
 Engineers create sets of rules to represent knowledge in welldefined domains
 The structure of the knowledge is defined by humans
 The specifics are explored by the machine
 Enables reasoning over narrowly defined problems
 No learning capability and poor handling of uncertainty
 Wave 2  Statistical Learning
 e.g. machine and deep learning, alpha go
 Engineers create statistical models for specific
problem domains and train them on big data
 Nuanced classification and prediction capabilities
 No contextual capability and minimal reasoning ability
 Statistically impressive, but individually unreliable
 Wave 3 - Contextual adaptation
 Systems construct contextual explanatory models for classes of real world phenomena

More Related Content

Similar to Panel 4-Cognitive vision, robotics and autonomy (20)

Validation Framework for Autonomous Aerial Vehicles
Validation Framework for Autonomous Aerial VehiclesValidation Framework for Autonomous Aerial Vehicles
Validation Framework for Autonomous Aerial Vehicles
M. Ilhan Akbas
Self Driving Car Using Raspberry Pi and OpenCV.pptx
Self Driving Car Using Raspberry Pi and OpenCV.pptxSelf Driving Car Using Raspberry Pi and OpenCV.pptx
Self Driving Car Using Raspberry Pi and OpenCV.pptx
Devashish Negi
Presentation object detection (1)
Presentation object detection (1)Presentation object detection (1)
Presentation object detection (1)
AkezhanZholdybaev
Automated vehicle
Automated vehicleAutomated vehicle
Automated vehicle
University of Gujrat
Artificial intelligence (AI) + Sensors + Aeronautics
Artificial intelligence (AI) + Sensors + AeronauticsArtificial intelligence (AI) + Sensors + Aeronautics
Artificial intelligence (AI) + Sensors + Aeronautics
waleed zahid kayani
Intelligente visie maakt drones autonoom
Intelligente visie maakt drones autonoomIntelligente visie maakt drones autonoom
Intelligente visie maakt drones autonoom
EUKA
automation.pptx
automation.pptxautomation.pptx
automation.pptx
SabarDasal
Autonomous Driving- TU Chemnitz
Autonomous Driving- TU ChemnitzAutonomous Driving- TU Chemnitz
Autonomous Driving- TU Chemnitz
Vivek Bakul Maru
Self driving car
Self driving carSelf driving car
Self driving car
VipinYadav257
Autonomous Driving AI Workloads: Technology Trends and Optimization Strategi...
Autonomous Driving AI Workloads: Technology Trends and Optimization Strategi...Autonomous Driving AI Workloads: Technology Trends and Optimization Strategi...
Autonomous Driving AI Workloads: Technology Trends and Optimization Strategi...
Edge AI and Vision Alliance
The Importance of Timing to Autonomous Vehicle Navigation
The Importance of Timing to Autonomous Vehicle NavigationThe Importance of Timing to Autonomous Vehicle Navigation
The Importance of Timing to Autonomous Vehicle Navigation
Tim Klimasewski
B.Tech 5th Semester Industrial Robotics Notes Module- VI
B.Tech 5th Semester Industrial Robotics Notes Module- VIB.Tech 5th Semester Industrial Robotics Notes Module- VI
B.Tech 5th Semester Industrial Robotics Notes Module- VI
KameshMechrocks3
About RumiCar project
About RumiCar projectAbout RumiCar project
About RumiCar project
Rumika Chiba
AV Latency Measurement
AV Latency MeasurementAV Latency Measurement
AV Latency Measurement
RekaNext Capital
pick and place robotic arm
pick and place robotic armpick and place robotic arm
pick and place robotic arm
ANJANA ANILKUMAR
Mainprojpresentation 150617092611-lva1-app6892
Mainprojpresentation 150617092611-lva1-app6892Mainprojpresentation 150617092611-lva1-app6892
Mainprojpresentation 150617092611-lva1-app6892
ANJANA ANILKUMAR
autonomous vehicles org ppt.pptx
autonomous vehicles org ppt.pptxautonomous vehicles org ppt.pptx
autonomous vehicles org ppt.pptx
ADISHPRAMOD
Machine learning and Autonomous System
Machine learning and Autonomous SystemMachine learning and Autonomous System
Machine learning and Autonomous System
Anshul Saxena
GANS Artifical Intelligence Assigmentt 7.pptx
GANS Artifical Intelligence Assigmentt 7.pptxGANS Artifical Intelligence Assigmentt 7.pptx
GANS Artifical Intelligence Assigmentt 7.pptx
amazingsun810
slide-171212080528.pptx
slide-171212080528.pptxslide-171212080528.pptx
slide-171212080528.pptx
SharanrajK22MMT1003
Validation Framework for Autonomous Aerial Vehicles
Validation Framework for Autonomous Aerial VehiclesValidation Framework for Autonomous Aerial Vehicles
Validation Framework for Autonomous Aerial Vehicles
M. Ilhan Akbas
Self Driving Car Using Raspberry Pi and OpenCV.pptx
Self Driving Car Using Raspberry Pi and OpenCV.pptxSelf Driving Car Using Raspberry Pi and OpenCV.pptx
Self Driving Car Using Raspberry Pi and OpenCV.pptx
Devashish Negi
Presentation object detection (1)
Presentation object detection (1)Presentation object detection (1)
Presentation object detection (1)
AkezhanZholdybaev
Artificial intelligence (AI) + Sensors + Aeronautics
Artificial intelligence (AI) + Sensors + AeronauticsArtificial intelligence (AI) + Sensors + Aeronautics
Artificial intelligence (AI) + Sensors + Aeronautics
waleed zahid kayani
Intelligente visie maakt drones autonoom
Intelligente visie maakt drones autonoomIntelligente visie maakt drones autonoom
Intelligente visie maakt drones autonoom
EUKA
automation.pptx
automation.pptxautomation.pptx
automation.pptx
SabarDasal
Autonomous Driving- TU Chemnitz
Autonomous Driving- TU ChemnitzAutonomous Driving- TU Chemnitz
Autonomous Driving- TU Chemnitz
Vivek Bakul Maru
Autonomous Driving AI Workloads: Technology Trends and Optimization Strategi...
Autonomous Driving AI Workloads: Technology Trends and Optimization Strategi...Autonomous Driving AI Workloads: Technology Trends and Optimization Strategi...
Autonomous Driving AI Workloads: Technology Trends and Optimization Strategi...
Edge AI and Vision Alliance
The Importance of Timing to Autonomous Vehicle Navigation
The Importance of Timing to Autonomous Vehicle NavigationThe Importance of Timing to Autonomous Vehicle Navigation
The Importance of Timing to Autonomous Vehicle Navigation
Tim Klimasewski
B.Tech 5th Semester Industrial Robotics Notes Module- VI
B.Tech 5th Semester Industrial Robotics Notes Module- VIB.Tech 5th Semester Industrial Robotics Notes Module- VI
B.Tech 5th Semester Industrial Robotics Notes Module- VI
KameshMechrocks3
About RumiCar project
About RumiCar projectAbout RumiCar project
About RumiCar project
Rumika Chiba
pick and place robotic arm
pick and place robotic armpick and place robotic arm
pick and place robotic arm
ANJANA ANILKUMAR
Mainprojpresentation 150617092611-lva1-app6892
Mainprojpresentation 150617092611-lva1-app6892Mainprojpresentation 150617092611-lva1-app6892
Mainprojpresentation 150617092611-lva1-app6892
ANJANA ANILKUMAR
autonomous vehicles org ppt.pptx
autonomous vehicles org ppt.pptxautonomous vehicles org ppt.pptx
autonomous vehicles org ppt.pptx
ADISHPRAMOD
Machine learning and Autonomous System
Machine learning and Autonomous SystemMachine learning and Autonomous System
Machine learning and Autonomous System
Anshul Saxena
GANS Artifical Intelligence Assigmentt 7.pptx
GANS Artifical Intelligence Assigmentt 7.pptxGANS Artifical Intelligence Assigmentt 7.pptx
GANS Artifical Intelligence Assigmentt 7.pptx
amazingsun810

Recently uploaded (20)

Replacing RocksDB with ScyllaDB in Kafka Streams by Almog Gavra
Replacing RocksDB with ScyllaDB in Kafka Streams by Almog GavraReplacing RocksDB with ScyllaDB in Kafka Streams by Almog Gavra
Replacing RocksDB with ScyllaDB in Kafka Streams by Almog Gavra
ScyllaDB
L01 Introduction to Nanoindentation - What is hardness
L01 Introduction to Nanoindentation - What is hardnessL01 Introduction to Nanoindentation - What is hardness
L01 Introduction to Nanoindentation - What is hardness
RostislavDaniel
MIND Revenue Release Quarter 4 2024 - Finacial Presentation
MIND Revenue Release Quarter 4 2024 - Finacial PresentationMIND Revenue Release Quarter 4 2024 - Finacial Presentation
MIND Revenue Release Quarter 4 2024 - Finacial Presentation
MIND CTI
UiPath Automation Developer Associate Training Series 2025 - Session 1
UiPath Automation Developer Associate Training Series 2025 - Session 1UiPath Automation Developer Associate Training Series 2025 - Session 1
UiPath Automation Developer Associate Training Series 2025 - Session 1
DianaGray10
UiPath Automation Developer Associate Training Series 2025 - Session 2
UiPath Automation Developer Associate Training Series 2025 - Session 2UiPath Automation Developer Associate Training Series 2025 - Session 2
UiPath Automation Developer Associate Training Series 2025 - Session 2
DianaGray10
Technology use over time and its impact on consumers and businesses.pptx
Technology use over time and its impact on consumers and businesses.pptxTechnology use over time and its impact on consumers and businesses.pptx
Technology use over time and its impact on consumers and businesses.pptx
kaylagaze
AIXMOOC 2.3 - Modelli di reti neurali con esperimenti di addestramento
AIXMOOC 2.3 - Modelli di reti neurali con esperimenti di addestramentoAIXMOOC 2.3 - Modelli di reti neurali con esperimenti di addestramento
AIXMOOC 2.3 - Modelli di reti neurali con esperimenti di addestramento
Alessandro Bogliolo
Q4_TLE-7-Lesson-6-Week-6.pptx 4th quarter
Q4_TLE-7-Lesson-6-Week-6.pptx 4th quarterQ4_TLE-7-Lesson-6-Week-6.pptx 4th quarter
Q4_TLE-7-Lesson-6-Week-6.pptx 4th quarter
MariaBarbaraPaglinaw
The Future of Repair: Transparent and Incremental by Botond Denes
The Future of Repair: Transparent and Incremental by Botond DenesThe Future of Repair: Transparent and Incremental by Botond Denes
The Future of Repair: Transparent and Incremental by Botond Denes
ScyllaDB
How Discord Indexes Trillions of Messages: Scaling Search Infrastructure by V...
How Discord Indexes Trillions of Messages: Scaling Search Infrastructure by V...How Discord Indexes Trillions of Messages: Scaling Search Infrastructure by V...
How Discord Indexes Trillions of Messages: Scaling Search Infrastructure by V...
ScyllaDB
Stronger Together: Combining Data Quality and Governance for Confident AI & A...
Stronger Together: Combining Data Quality and Governance for Confident AI & A...Stronger Together: Combining Data Quality and Governance for Confident AI & A...
Stronger Together: Combining Data Quality and Governance for Confident AI & A...
Precisely
Inside Freshworks' Migration from Cassandra to ScyllaDB by Premkumar Patturaj
Inside Freshworks' Migration from Cassandra to ScyllaDB by Premkumar PatturajInside Freshworks' Migration from Cassandra to ScyllaDB by Premkumar Patturaj
Inside Freshworks' Migration from Cassandra to ScyllaDB by Premkumar Patturaj
ScyllaDB
Integrated Operating Window - A Gateway to PM
Integrated Operating Window - A Gateway to PMIntegrated Operating Window - A Gateway to PM
Integrated Operating Window - A Gateway to PM
Farhan Tariq
Both Feet on the Ground - Generative Artificial Intelligence
Both Feet on the Ground - Generative Artificial IntelligenceBoth Feet on the Ground - Generative Artificial Intelligence
Both Feet on the Ground - Generative Artificial Intelligence
Pete Nieminen
A Framework for Model-Driven Digital Twin Engineering
A Framework for Model-Driven Digital Twin EngineeringA Framework for Model-Driven Digital Twin Engineering
A Framework for Model-Driven Digital Twin Engineering
Daniel Lehner
Gojek Clone Multi-Service Super App.pptx
Gojek Clone Multi-Service Super App.pptxGojek Clone Multi-Service Super App.pptx
Gojek Clone Multi-Service Super App.pptx
V3cube
Transform Your Future with Front-End Development Training
Transform Your Future with Front-End Development TrainingTransform Your Future with Front-End Development Training
Transform Your Future with Front-End Development Training
Vtechlabs
Endpoint Backup: 3 Reasons MSPs Ignore It
Endpoint Backup: 3 Reasons MSPs Ignore ItEndpoint Backup: 3 Reasons MSPs Ignore It
Endpoint Backup: 3 Reasons MSPs Ignore It
MSP360
Unlock AI Creativity: Image Generation with DALL揃E
Unlock AI Creativity: Image Generation with DALL揃EUnlock AI Creativity: Image Generation with DALL揃E
Unlock AI Creativity: Image Generation with DALL揃E
Expeed Software
Formal Methods: Whence and Whither? [Martin Fr辰nzle Festkolloquium, 2025]
Formal Methods: Whence and Whither? [Martin Fr辰nzle Festkolloquium, 2025]Formal Methods: Whence and Whither? [Martin Fr辰nzle Festkolloquium, 2025]
Formal Methods: Whence and Whither? [Martin Fr辰nzle Festkolloquium, 2025]
Jonathan Bowen
Replacing RocksDB with ScyllaDB in Kafka Streams by Almog Gavra
Replacing RocksDB with ScyllaDB in Kafka Streams by Almog GavraReplacing RocksDB with ScyllaDB in Kafka Streams by Almog Gavra
Replacing RocksDB with ScyllaDB in Kafka Streams by Almog Gavra
ScyllaDB
L01 Introduction to Nanoindentation - What is hardness
L01 Introduction to Nanoindentation - What is hardnessL01 Introduction to Nanoindentation - What is hardness
L01 Introduction to Nanoindentation - What is hardness
RostislavDaniel
MIND Revenue Release Quarter 4 2024 - Finacial Presentation
MIND Revenue Release Quarter 4 2024 - Finacial PresentationMIND Revenue Release Quarter 4 2024 - Finacial Presentation
MIND Revenue Release Quarter 4 2024 - Finacial Presentation
MIND CTI
UiPath Automation Developer Associate Training Series 2025 - Session 1
UiPath Automation Developer Associate Training Series 2025 - Session 1UiPath Automation Developer Associate Training Series 2025 - Session 1
UiPath Automation Developer Associate Training Series 2025 - Session 1
DianaGray10
UiPath Automation Developer Associate Training Series 2025 - Session 2
UiPath Automation Developer Associate Training Series 2025 - Session 2UiPath Automation Developer Associate Training Series 2025 - Session 2
UiPath Automation Developer Associate Training Series 2025 - Session 2
DianaGray10
Technology use over time and its impact on consumers and businesses.pptx
Technology use over time and its impact on consumers and businesses.pptxTechnology use over time and its impact on consumers and businesses.pptx
Technology use over time and its impact on consumers and businesses.pptx
kaylagaze
AIXMOOC 2.3 - Modelli di reti neurali con esperimenti di addestramento
AIXMOOC 2.3 - Modelli di reti neurali con esperimenti di addestramentoAIXMOOC 2.3 - Modelli di reti neurali con esperimenti di addestramento
AIXMOOC 2.3 - Modelli di reti neurali con esperimenti di addestramento
Alessandro Bogliolo
Q4_TLE-7-Lesson-6-Week-6.pptx 4th quarter
Q4_TLE-7-Lesson-6-Week-6.pptx 4th quarterQ4_TLE-7-Lesson-6-Week-6.pptx 4th quarter
Q4_TLE-7-Lesson-6-Week-6.pptx 4th quarter
MariaBarbaraPaglinaw
The Future of Repair: Transparent and Incremental by Botond Denes
The Future of Repair: Transparent and Incremental by Botond DenesThe Future of Repair: Transparent and Incremental by Botond Denes
The Future of Repair: Transparent and Incremental by Botond Denes
ScyllaDB
How Discord Indexes Trillions of Messages: Scaling Search Infrastructure by V...
How Discord Indexes Trillions of Messages: Scaling Search Infrastructure by V...How Discord Indexes Trillions of Messages: Scaling Search Infrastructure by V...
How Discord Indexes Trillions of Messages: Scaling Search Infrastructure by V...
ScyllaDB
Stronger Together: Combining Data Quality and Governance for Confident AI & A...
Stronger Together: Combining Data Quality and Governance for Confident AI & A...Stronger Together: Combining Data Quality and Governance for Confident AI & A...
Stronger Together: Combining Data Quality and Governance for Confident AI & A...
Precisely
Inside Freshworks' Migration from Cassandra to ScyllaDB by Premkumar Patturaj
Inside Freshworks' Migration from Cassandra to ScyllaDB by Premkumar PatturajInside Freshworks' Migration from Cassandra to ScyllaDB by Premkumar Patturaj
Inside Freshworks' Migration from Cassandra to ScyllaDB by Premkumar Patturaj
ScyllaDB
Integrated Operating Window - A Gateway to PM
Integrated Operating Window - A Gateway to PMIntegrated Operating Window - A Gateway to PM
Integrated Operating Window - A Gateway to PM
Farhan Tariq
Both Feet on the Ground - Generative Artificial Intelligence
Both Feet on the Ground - Generative Artificial IntelligenceBoth Feet on the Ground - Generative Artificial Intelligence
Both Feet on the Ground - Generative Artificial Intelligence
Pete Nieminen
A Framework for Model-Driven Digital Twin Engineering
A Framework for Model-Driven Digital Twin EngineeringA Framework for Model-Driven Digital Twin Engineering
A Framework for Model-Driven Digital Twin Engineering
Daniel Lehner
Gojek Clone Multi-Service Super App.pptx
Gojek Clone Multi-Service Super App.pptxGojek Clone Multi-Service Super App.pptx
Gojek Clone Multi-Service Super App.pptx
V3cube
Transform Your Future with Front-End Development Training
Transform Your Future with Front-End Development TrainingTransform Your Future with Front-End Development Training
Transform Your Future with Front-End Development Training
Vtechlabs
Endpoint Backup: 3 Reasons MSPs Ignore It
Endpoint Backup: 3 Reasons MSPs Ignore ItEndpoint Backup: 3 Reasons MSPs Ignore It
Endpoint Backup: 3 Reasons MSPs Ignore It
MSP360
Unlock AI Creativity: Image Generation with DALL揃E
Unlock AI Creativity: Image Generation with DALL揃EUnlock AI Creativity: Image Generation with DALL揃E
Unlock AI Creativity: Image Generation with DALL揃E
Expeed Software
Formal Methods: Whence and Whither? [Martin Fr辰nzle Festkolloquium, 2025]
Formal Methods: Whence and Whither? [Martin Fr辰nzle Festkolloquium, 2025]Formal Methods: Whence and Whither? [Martin Fr辰nzle Festkolloquium, 2025]
Formal Methods: Whence and Whither? [Martin Fr辰nzle Festkolloquium, 2025]
Jonathan Bowen

Panel 4-Cognitive vision, robotics and autonomy

  • 1. C-Lab Cognitive Vision, Robotics and Autonomy Monday, 20 January 2020 1 Prof R Bowden Centre for Vision Speech and Signal Processing
  • 2. CVSSP Centre for Vision, Speech and Signal Processing Creating machines that can see, hear and understand the world around them
  • 4. Surrey Autonomous Testbed The testbed is very similar to the street drone, using the same Twizy vehicle, sensors and processing platform Twizy Cargo Nvidia PX2 Drive 6 Sekonix cameras (street drone as 8 but same coverage, less overlap) Ouster 64 beam lidar Wheel odometry, not available on street drone Supports wider research and collaborative projects with Parkopedia, JLR, McLarren, FLIR amongst others Provides Surrey with a data capture and demonstration platform
  • 5. Surrey Autonomous Testbed Two phase build: Phase 1 sensor recording and onboard processing Phase 2 actuators to provide full control Entire build opensource: http://autonomous.home.blog How to build an autonomous vehicle for < 贈15K
  • 7. Demonstration scenario 1. Parking process is started via smartphone 2. Vehicle enters a car park, localises itself using indoor maps and navigates to a space 3. Driver summons parked vehicle back via smartphone 4. Vehicle exits a car park and is picked by a driver in a pick up zone
  • 8. Work related to Autonomous Driving Automatic extrinsic calibration of car mounted sensors Reinforcement Learning for vehicle control and safety verification Feature Learning across lighting and weather Vehicle state estimation, sensor fusion and side slip estimation Semantic Segmentation Monoscopic depth estimation and scene estimation
  • 9. DARPA 3 Waves of AI Wave 1 Handcrafted Knowledge e.g. classical AI, chess computers Engineers create sets of rules to represent knowledge in welldefined domains The structure of the knowledge is defined by humans The specifics are explored by the machine Enables reasoning over narrowly defined problems No learning capability and poor handling of uncertainty Wave 2 Statistical Learning e.g. machine and deep learning, alpha go Engineers create statistical models for specific problem domains and train them on big data Nuanced classification and prediction capabilities No contextual capability and minimal reasoning ability Statistically impressive, but individually unreliable Wave 3 - Contextual adaptation Systems construct contextual explanatory models for classes of real world phenomena