Robotics: Vision Intelligence and Machine Learning

بواسطة: edX

Overview

How do robots “see”, respond to and learn from their interactions with the world around them? This is the fascinating field of visual intelligence and machine learning. Visual intelligence allows a robot to “sense” and “recognize” the surrounding environment. It also enables a robot to “learn” from the memory of past experiences by extracting patterns in visual signals.

You will understand how Machine Learning extracts statistically meaningful patterns in data that support classification, regression and clustering. Then by studying Computer Vision and Machine Learning together you will be able to build recognition algorithms that can learn from data and adapt to new environments.

By the end of this course, part of the Robotics MicroMasters program, you will be able to program vision capabilities for a robot such as robot localization as well as object recognition using machine learning.

Projects in this course will utilize MATLAB and OpenCV and will include real examples of video stabilization, recognition of 3D objects, coding a classifier for objects, building a perceptron, and designing a convolutional neural network (CNN) using one of the standard CNN frameworks.

Syllabus

Week 1: Camera Geometry and Color Sensing

Week 2: Fourier Transforms, Image Convolution, Edge Detection
Week 3: Image Convolution and Edge Detection Part 2, Image Pyramids
Week 4: Feature Detection: Filters, SIFT, HOG
Week 5: Geometrical Transformation, Affine, Protective and Ransac
Week 6: Optical Flow Estimation
Week 7: Image Morphing
Week 8: Image Blending
Week 9: Image Carving
Week 10: Probability and Statistics, Regression and Classification
Week 11: SVM and Object Recognition
Week 12: Convolutional Neural Network

Taught by

Jianbo Shi, Kostas Daniilidis and Dan Lee

Robotics: Vision Intelligence and Machine Learning
الذهاب الي الدورة

Robotics: Vision Intelligence and Machine Learning

بواسطة: edX

  • edX
  • مجانية
  • الإنجليزية
  • متاح شهادة
  • أيام محددة
  • advanced
  • English
8.1.2PHP Version328msRequest Duration2MBMemory UsageGET ar/الدورات/{slug}Route
    • Booting (209ms)
    • Application (118ms)
    • 1 x Booting (63.66%)
      208.92ms
      1 x Application (36.09%)
      118.45ms
      14 templates were rendered
      • public.courses.show (resources/views/public/courses/show.blade.php)3bladefile
        Params
        0
        course
        1
        links
        2
        config
      • public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        classes
      • public.courses.partials.details (resources/views/public/courses/partials/details.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        classes
      • public.layouts.main (resources/views/public/layouts/main.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.layouts.partials.meta (resources/views/public/layouts/partials/meta.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.layouts.partials.navbar (resources/views/public/layouts/partials/navbar.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.auth.profile.partials.links (resources/views/public/auth/profile/partials/links.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.layouts.partials.flash-session (resources/views/public/layouts/partials/flash-session.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      uri
      GET ar/الدورات/{slug}
      middleware
      web, localize:ar
      controller
      App\Http\Controllers\CourseController@show
      as
      ar.courses.show
      namespace
      prefix
      /ar
      where
      file
      app/Http/Controllers/CourseController.php:17-35
      7 statements were executed5.52ms
      • select * from `courses` where `slug_ar` = 'robotics:-vision-intelligence-and-machine-learning' limit 1
        3.75ms/app/Http/Controllers/CourseController.php:20corspedia
        Metadata
        Bindings
        • 0. robotics:-vision-intelligence-and-machine-learning
        Backtrace
        • 17. /app/Http/Controllers/CourseController.php:20
        • 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • update `courses` set `visitors` = `visitors` + 1, `courses`.`updated_at` = '2025-04-17 05:24:37' where `id` = 571
        730μs/app/Http/Controllers/CourseController.php:21corspedia
        Metadata
        Bindings
        • 0. 2025-04-17 05:24:37
        • 1. 571
        Backtrace
        • 17. /app/Http/Controllers/CourseController.php:21
        • 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select `id`, `name_en`, `name_ar`, `topic_id`, `slug_en`, `slug_ar` from `subjects` where `subjects`.`id` in (16)
        170μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select `id`, `name_en`, `name_ar`, `slug_en`, `slug_ar` from `topics` where `topics`.`id` in (1)
        140μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 25. /app/Http/Controllers/CourseController.php:23
        • 26. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 27. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 28. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 29. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `institutions` where `institutions`.`id` in (23) and `institutions`.`deleted_at` is null
        170μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `providers` where `providers`.`id` in (1) and `providers`.`deleted_at` is null
        160μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `html_files` where `html_files`.`id` = 565 limit 1
        400μs/app/Models/Course.php:84corspedia
        Metadata
        Bindings
        • 0. 565
        Backtrace
        • 21. /app/Models/Course.php:84
        • 28. view::public.courses.show:29
        • 30. /vendor/laravel/framework/src/Illuminate/Filesystem/Filesystem.php:125
        • 31. /vendor/laravel/framework/src/Illuminate/View/Engines/PhpEngine.php:58
        • 32. /vendor/laravel/framework/src/Illuminate/View/Engines/CompilerEngine.php:72
      App\Models\HtmlFile
      1
      App\Models\Provider
      1
      App\Models\Institution
      1
      App\Models\Topic
      1
      App\Models\Subject
      1
      App\Models\Course
      1
        _token
        OXCoTCmt1OmDAy9aDB8TsDSKAm98n5QQB8p8UEii
        locale
        ar
        _previous
        array:1 [ "url" => "https://www.corspedia.com/ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/roboti...
        _flash
        array:2 [ "old" => [] "new" => [] ]
        PHPDEBUGBAR_STACK_DATA
        []
        path_info
        /ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/robotics:-vision-intelligence-and-machine-learning
        status_code
        200
        
        status_text
        OK
        format
        html
        content_type
        text/html; charset=UTF-8
        request_query
        []
        
        request_request
        []
        
        request_headers
        0 of 0
        array:24 [ "cf-ipcountry" => array:1 [ 0 => "US" ] "cf-connecting-ip" => array:1 [ 0 => "18.117.196.141" ] "cdn-loop" => array:1 [ 0 => "cloudflare; loops=1" ] "x-forwarded-proto" => array:1 [ 0 => "https" ] "cf-visitor" => array:1 [ 0 => "{"scheme":"https"}" ] "sec-fetch-site" => array:1 [ 0 => "none" ] "accept" => array:1 [ 0 => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7" ] "user-agent" => array:1 [ 0 => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)" ] "upgrade-insecure-requests" => array:1 [ 0 => "1" ] "sec-ch-ua-platform" => array:1 [ 0 => ""Windows"" ] "sec-ch-ua-mobile" => array:1 [ 0 => "?0" ] "sec-ch-ua" => array:1 [ 0 => ""HeadlessChrome";v="129", "Not=A?Brand";v="8", "Chromium";v="129"" ] "cache-control" => array:1 [ 0 => "no-cache" ] "pragma" => array:1 [ 0 => "no-cache" ] "sec-fetch-dest" => array:1 [ 0 => "document" ] "cf-ray" => array:1 [ 0 => "93197f45c8a48b98-ORD" ] "accept-encoding" => array:1 [ 0 => "gzip, br" ] "priority" => array:1 [ 0 => "u=0, i" ] "sec-fetch-user" => array:1 [ 0 => "?1" ] "sec-fetch-mode" => array:1 [ 0 => "navigate" ] "x-forwarded-for" => array:1 [ 0 => "18.117.196.141" ] "host" => array:1 [ 0 => "www.corspedia.com" ] "content-length" => array:1 [ 0 => "" ] "content-type" => array:1 [ 0 => "" ] ]
        request_server
        0 of 0
        array:50 [ "USER" => "www-data" "HOME" => "/var/www" "HTTP_CF_IPCOUNTRY" => "US" "HTTP_CF_CONNECTING_IP" => "18.117.196.141" "HTTP_CDN_LOOP" => "cloudflare; loops=1" "HTTP_X_FORWARDED_PROTO" => "https" "HTTP_CF_VISITOR" => "{"scheme":"https"}" "HTTP_SEC_FETCH_SITE" => "none" "HTTP_ACCEPT" => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7" "HTTP_USER_AGENT" => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)" "HTTP_UPGRADE_INSECURE_REQUESTS" => "1" "HTTP_SEC_CH_UA_PLATFORM" => ""Windows"" "HTTP_SEC_CH_UA_MOBILE" => "?0" "HTTP_SEC_CH_UA" => ""HeadlessChrome";v="129", "Not=A?Brand";v="8", "Chromium";v="129"" "HTTP_CACHE_CONTROL" => "no-cache" "HTTP_PRAGMA" => "no-cache" "HTTP_SEC_FETCH_DEST" => "document" "HTTP_CF_RAY" => "93197f45c8a48b98-ORD" "HTTP_ACCEPT_ENCODING" => "gzip, br" "HTTP_PRIORITY" => "u=0, i" "HTTP_SEC_FETCH_USER" => "?1" "HTTP_SEC_FETCH_MODE" => "navigate" "HTTP_X_FORWARDED_FOR" => "18.117.196.141" "HTTP_HOST" => "www.corspedia.com" "REDIRECT_STATUS" => "200" "SERVER_NAME" => "corspedia.com" "SERVER_PORT" => "443" "SERVER_ADDR" => "141.95.147.152" "REMOTE_USER" => "" "REMOTE_PORT" => "61302" "REMOTE_ADDR" => "172.69.17.55" "SERVER_SOFTWARE" => "nginx/1.18.0" "GATEWAY_INTERFACE" => "CGI/1.1" "HTTPS" => "on" "REQUEST_SCHEME" => "https" "SERVER_PROTOCOL" => "HTTP/2.0" "DOCUMENT_ROOT" => "/var/www/corspedia/public" "DOCUMENT_URI" => "/index.php" "REQUEST_URI" => "/ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/robotics:-vision-intelligence-and-machine-learning" "SCRIPT_NAME" => "/index.php" "CONTENT_LENGTH" => "" "CONTENT_TYPE" => "" "REQUEST_METHOD" => "GET" "QUERY_STRING" => "" "SCRIPT_FILENAME" => "/var/www/corspedia/public/index.php" "PATH_INFO" => "" "FCGI_ROLE" => "RESPONDER" "PHP_SELF" => "/index.php" "REQUEST_TIME_FLOAT" => 1744867477.67 "REQUEST_TIME" => 1744867477 ]
        request_cookies
        []
        
        response_headers
        0 of 0
        array:5 [ "content-type" => array:1 [ 0 => "text/html; charset=UTF-8" ] "cache-control" => array:1 [ 0 => "no-cache, private" ] "date" => array:1 [ 0 => "Thu, 17 Apr 2025 05:24:37 GMT" ] "set-cookie" => array:2 [ 0 => "XSRF-TOKEN=eyJpdiI6ImJuRlRCN0FOb3hLd3lnS3J5OGxuRmc9PSIsInZhbHVlIjoicnh4bzluQjUzWWRUKzI5RndPYkhZVW5KYURzbmNyZ2plYlRqS3JtdG5iVTZFcHVzeGJlL1N3SUk1SDU2ZEF6ZVpZYlFyeWxnSXpIUVdJZUl5R0hhUXlEd0VzU0I5WW94a21NL09tVXhMbTZ1NklOTEhFMkhKNlJwcmlwZWVPc1kiLCJtYWMiOiIwNzBjMzVlMTBhZGJjNjQyY2M4MjFhMDZmMzBkYjUxYzYyZTVmYjM2NjlkNGE4MjlhMGU2NDc1ODY5MmFiY2MyIiwidGFnIjoiIn0%3D; expires=Thu, 17 Apr 2025 07:24:37 GMT; Max-Age=7200; path=/; samesite=laxXSRF-TOKEN=eyJpdiI6ImJuRlRCN0FOb3hLd3lnS3J5OGxuRmc9PSIsInZhbHVlIjoicnh4bzluQjUzWWRUKzI5RndPYkhZVW5KYURzbmNyZ2plYlRqS3JtdG5iVTZFcHVzeGJlL1N3SUk1SDU2ZEF6ZVpZYlFye" 1 => "laravel_session=eyJpdiI6IjdSaW9PaXF2UkJ6d05IRWlBRHRtSWc9PSIsInZhbHVlIjoiQWJSeGZ1ZGd3RTc4ODZVdVJmWUtPN1ZCS1piZG5KT3ZISW1jYi8rd3lFaDVTVW85Q3VaN1lnUHFrYmpQN1d5MXN5T0hybXpOeWR3RUgrK0RQbVFBZzhKc3NSSHpOVmthVldCdi9xTDU5cDVFaW55b0NNTXRJK3dZd1YxV01MamoiLCJtYWMiOiJlMTZkZGM2ZDI4M2Q0MmFmMzUxNzNiMGUwZjhhM2UzNjk3ZWIwYWY2MjZiYzg1MDExY2NhMTQ0YzRkNWMwNjE5IiwidGFnIjoiIn0%3D; expires=Thu, 17 Apr 2025 07:24:37 GMT; Max-Age=7200; path=/; httponly; samesite=laxlaravel_session=eyJpdiI6IjdSaW9PaXF2UkJ6d05IRWlBRHRtSWc9PSIsInZhbHVlIjoiQWJSeGZ1ZGd3RTc4ODZVdVJmWUtPN1ZCS1piZG5KT3ZISW1jYi8rd3lFaDVTVW85Q3VaN1lnUHFrYmpQN1d5MXN5" ] "Set-Cookie" => array:2 [ 0 => "XSRF-TOKEN=eyJpdiI6ImJuRlRCN0FOb3hLd3lnS3J5OGxuRmc9PSIsInZhbHVlIjoicnh4bzluQjUzWWRUKzI5RndPYkhZVW5KYURzbmNyZ2plYlRqS3JtdG5iVTZFcHVzeGJlL1N3SUk1SDU2ZEF6ZVpZYlFyeWxnSXpIUVdJZUl5R0hhUXlEd0VzU0I5WW94a21NL09tVXhMbTZ1NklOTEhFMkhKNlJwcmlwZWVPc1kiLCJtYWMiOiIwNzBjMzVlMTBhZGJjNjQyY2M4MjFhMDZmMzBkYjUxYzYyZTVmYjM2NjlkNGE4MjlhMGU2NDc1ODY5MmFiY2MyIiwidGFnIjoiIn0%3D; expires=Thu, 17-Apr-2025 07:24:37 GMT; path=/XSRF-TOKEN=eyJpdiI6ImJuRlRCN0FOb3hLd3lnS3J5OGxuRmc9PSIsInZhbHVlIjoicnh4bzluQjUzWWRUKzI5RndPYkhZVW5KYURzbmNyZ2plYlRqS3JtdG5iVTZFcHVzeGJlL1N3SUk1SDU2ZEF6ZVpZYlFye" 1 => "laravel_session=eyJpdiI6IjdSaW9PaXF2UkJ6d05IRWlBRHRtSWc9PSIsInZhbHVlIjoiQWJSeGZ1ZGd3RTc4ODZVdVJmWUtPN1ZCS1piZG5KT3ZISW1jYi8rd3lFaDVTVW85Q3VaN1lnUHFrYmpQN1d5MXN5T0hybXpOeWR3RUgrK0RQbVFBZzhKc3NSSHpOVmthVldCdi9xTDU5cDVFaW55b0NNTXRJK3dZd1YxV01MamoiLCJtYWMiOiJlMTZkZGM2ZDI4M2Q0MmFmMzUxNzNiMGUwZjhhM2UzNjk3ZWIwYWY2MjZiYzg1MDExY2NhMTQ0YzRkNWMwNjE5IiwidGFnIjoiIn0%3D; expires=Thu, 17-Apr-2025 07:24:37 GMT; path=/; httponlylaravel_session=eyJpdiI6IjdSaW9PaXF2UkJ6d05IRWlBRHRtSWc9PSIsInZhbHVlIjoiQWJSeGZ1ZGd3RTc4ODZVdVJmWUtPN1ZCS1piZG5KT3ZISW1jYi8rd3lFaDVTVW85Q3VaN1lnUHFrYmpQN1d5MXN5" ] ]
        session_attributes
        0 of 0
        array:5 [ "_token" => "OXCoTCmt1OmDAy9aDB8TsDSKAm98n5QQB8p8UEii" "locale" => "ar" "_previous" => array:1 [ "url" => "https://www.corspedia.com/ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/robotics:-vision-intelligence-and-machine-learning" ] "_flash" => array:2 [ "old" => [] "new" => [] ] "PHPDEBUGBAR_STACK_DATA" => [] ]