AI skills: Introduction to Unsupervised, Deep and Reinforcement Learning

بواسطة: edX

Overview

In this course you will learn the basics of several machine learning topics to help you solve real life challenges. Unsupervised learning techniques such as clustering and dimensionality reduction are useful to make sense of large and/or high dimensional datasets that are not annotated. Deep learning is a supervised learning technique that is useful to train neural networks to solve more complicated classification and regression tasks. Finally, reinforcement learning techniques can be used to train AI agents that interact with an environment.

Using hands-on and interactive exercises you will get insight into the fundamental algorithms and basic concepts of:

Clustering is used to identify similar data/objects and patterns from your engineering datasets. It is a technique that is especially useful if you don’t have labeled or annotated data. We explain various approaches to clustering and cover how similarity and dissimilarity measures are used.

Dimensionality reduction techniques are used to reduce the number of features representing a given dataset, while retaining the structure of the dataset. We discuss feature selection and feature extraction techniques such as Principal Component Analysis (PCA), and how and when to apply it.

Deep Learning is a family of machine learning methods based on artificial neural networks. You will learn how to build and train deep neural networks consisting of fully connected neural networks of multiple hidden layers.

Reinforcement learning teaches an AI to interact with an environment. We cover basic reinforcement learning concepts and techniques, such as how to model the system using a Markov Decision Process, and how to train an optimal policy using tabular Q-learning using the Bellman equation.

This course is designed by a team of TU Delft machine learning experts from various backgrounds, highlighting the various topics from their individual perspectives.

Syllabus

Topic 1: Introduction

This is an introduction to the course with an overview of the topics.

Topic 2: Clustering

Clustering techniques are used to identify similar data/objects and patterns from your engineering datasets.

You will learn about the problem of clustering, the main classes of clustering techniques and how we can implement k-means and hierarchical clustering.

• Introduction to clustering

• Formalizing the problem of clustering

• Similarity and dissimilarity measures

• k-means clustering

• Hierarchical clustering

Topic 3: Dimensionality Reduction

Dimensionality reduction techniques are used to reduce the number of features representing a given dataset, while retaining the structure of the dataset as much as possible.

You will learn what dimensionality reduction is, why it is needed and how to use it. You will learn about Principal Component Analysis dimensionality reduction technique and how and when to apply it.

• What is dimensionality reduction?

• Why dimensionality reduction techniques are used

• Feature selection vs. feature extraction techniques

• Principal component analysis feature-extraction technique

Topic 4: Introduction to Deep Learning

Deep learning is a broader family of machine learning methods based on artificial neural networks.

You will learn the foundations of Deep Learning, understand how to build neural networks, and learn how to lead successful machine learning projects. You will learn about fully connected neural networks, some theoretical aspects of deep learning, the back-propagation algorithm, Adam, and much more.

• What neural networks are

• Architecture of fully connected neural networks

• Capabilities of neural networks

• The benefits of deep architectures

• Training deep neural networks with stochastic gradient descent and Adam

Topic 5: Introduction to Reinforcement Learning

Reinforcement learning teaches an AI to interact with an environment.

You will be introduced to basic reinforcement learning concepts and techniques, and how they could be applied in real world applications.

• How an AI interacts with the environmen

• The formalization of this as a Markov Decision Process

• An agent’s behavior as a policy

• The optimal policy found using tabular Q-learning

• Why tabular reinforcement learning does not scale well

• Neural networks for deep reinforcement learning to scale up to interesting applications

Taught by

Hongrui Wang, Amira Elnouty, Luca Laurenti, Wendelin Böhmer and Tom Viering

AI skills: Introduction to Unsupervised, Deep and Reinforcement Learning
الذهاب الي الدورة

AI skills: Introduction to Unsupervised, Deep and Reinforcement Learning

بواسطة: edX

  • edX
  • مجانية
  • الإنجليزية
  • متاح شهادة
  • أيام محددة
  • intermediate
  • English
8.1.2PHP Version228msRequest Duration2MBMemory UsageGET ar/الدورات/{slug}Route
    • Booting (156ms)
    • Application (72.1ms)
    • 1 x Booting (68.24%)
      155.86ms
      1 x Application (31.57%)
      72.10ms
      14 templates were rendered
      • public.courses.show (resources/views/public/courses/show.blade.php)3bladefile
        Params
        0
        course
        1
        links
        2
        config
      • public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        classes
      • public.courses.partials.details (resources/views/public/courses/partials/details.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        classes
      • public.layouts.main (resources/views/public/layouts/main.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.layouts.partials.meta (resources/views/public/layouts/partials/meta.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.layouts.partials.navbar (resources/views/public/layouts/partials/navbar.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.auth.profile.partials.links (resources/views/public/auth/profile/partials/links.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.layouts.partials.flash-session (resources/views/public/layouts/partials/flash-session.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      uri
      GET ar/الدورات/{slug}
      middleware
      web, localize:ar
      controller
      App\Http\Controllers\CourseController@show
      as
      ar.courses.show
      namespace
      prefix
      /ar
      where
      file
      app/Http/Controllers/CourseController.php:17-35
      7 statements were executed4.28ms
      • select * from `courses` where `slug_ar` = 'ai-skills:-introduction-to-unsupervised,-deep-and-reinforcement-learning' limit 1
        2.84ms/app/Http/Controllers/CourseController.php:20corspedia
        Metadata
        Bindings
        • 0. ai-skills:-introduction-to-unsupervised,-deep-and-reinforcement-learning
        Backtrace
        • 17. /app/Http/Controllers/CourseController.php:20
        • 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • update `courses` set `visitors` = `visitors` + 1, `courses`.`updated_at` = '2025-04-13 02:21:20' where `id` = 765
        620μs/app/Http/Controllers/CourseController.php:21corspedia
        Metadata
        Bindings
        • 0. 2025-04-13 02:21:20
        • 1. 765
        Backtrace
        • 17. /app/Http/Controllers/CourseController.php:21
        • 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select `id`, `name_en`, `name_ar`, `topic_id`, `slug_en`, `slug_ar` from `subjects` where `subjects`.`id` in (3)
        170μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select `id`, `name_en`, `name_ar`, `slug_en`, `slug_ar` from `topics` where `topics`.`id` in (1)
        140μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 25. /app/Http/Controllers/CourseController.php:23
        • 26. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 27. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 28. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 29. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `institutions` where `institutions`.`id` in (51) and `institutions`.`deleted_at` is null
        170μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `providers` where `providers`.`id` in (1) and `providers`.`deleted_at` is null
        160μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `html_files` where `html_files`.`id` = 759 limit 1
        180μs/app/Models/Course.php:84corspedia
        Metadata
        Bindings
        • 0. 759
        Backtrace
        • 21. /app/Models/Course.php:84
        • 28. view::public.courses.show:29
        • 30. /vendor/laravel/framework/src/Illuminate/Filesystem/Filesystem.php:125
        • 31. /vendor/laravel/framework/src/Illuminate/View/Engines/PhpEngine.php:58
        • 32. /vendor/laravel/framework/src/Illuminate/View/Engines/CompilerEngine.php:72
      App\Models\HtmlFile
      1
      App\Models\Provider
      1
      App\Models\Institution
      1
      App\Models\Topic
      1
      App\Models\Subject
      1
      App\Models\Course
      1
        _token
        C88OpxSMlmgOPErT6vjfgBoGH7zPTgsDy2m8KJZl
        locale
        ar
        _previous
        array:1 [ "url" => "https://www.corspedia.com/ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/ai-ski...
        _flash
        array:2 [ "old" => [] "new" => [] ]
        PHPDEBUGBAR_STACK_DATA
        []
        path_info
        /ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/ai-skills:-introduction-to-unsupervised,-deep-and-reinforcement-learning
        status_code
        200
        
        status_text
        OK
        format
        html
        content_type
        text/html; charset=UTF-8
        request_query
        []
        
        request_request
        []
        
        request_headers
        0 of 0
        array:24 [ "sec-ch-ua-mobile" => array:1 [ 0 => "?0" ] "sec-ch-ua" => array:1 [ 0 => ""HeadlessChrome";v="129", "Not=A?Brand";v="8", "Chromium";v="129"" ] "cache-control" => array:1 [ 0 => "no-cache" ] "pragma" => array:1 [ 0 => "no-cache" ] "upgrade-insecure-requests" => array:1 [ 0 => "1" ] "priority" => array:1 [ 0 => "u=0, i" ] "user-agent" => array:1 [ 0 => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)" ] "cf-ipcountry" => array:1 [ 0 => "US" ] "cf-connecting-ip" => array:1 [ 0 => "18.190.159.202" ] "accept" => array:1 [ 0 => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7" ] "sec-fetch-site" => array:1 [ 0 => "none" ] "cf-visitor" => array:1 [ 0 => "{"scheme":"https"}" ] "sec-fetch-mode" => array:1 [ 0 => "navigate" ] "sec-fetch-user" => array:1 [ 0 => "?1" ] "x-forwarded-proto" => array:1 [ 0 => "https" ] "cdn-loop" => array:1 [ 0 => "cloudflare; loops=1" ] "accept-encoding" => array:1 [ 0 => "gzip, br" ] "sec-fetch-dest" => array:1 [ 0 => "document" ] "sec-ch-ua-platform" => array:1 [ 0 => ""Windows"" ] "x-forwarded-for" => array:1 [ 0 => "18.190.159.202" ] "cf-ray" => array:1 [ 0 => "92f77d461dbb0006-ORD" ] "host" => array:1 [ 0 => "www.corspedia.com" ] "content-length" => array:1 [ 0 => "" ] "content-type" => array:1 [ 0 => "" ] ]
        request_server
        0 of 0
        array:50 [ "USER" => "www-data" "HOME" => "/var/www" "HTTP_SEC_CH_UA_MOBILE" => "?0" "HTTP_SEC_CH_UA" => ""HeadlessChrome";v="129", "Not=A?Brand";v="8", "Chromium";v="129"" "HTTP_CACHE_CONTROL" => "no-cache" "HTTP_PRAGMA" => "no-cache" "HTTP_UPGRADE_INSECURE_REQUESTS" => "1" "HTTP_PRIORITY" => "u=0, i" "HTTP_USER_AGENT" => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)" "HTTP_CF_IPCOUNTRY" => "US" "HTTP_CF_CONNECTING_IP" => "18.190.159.202" "HTTP_ACCEPT" => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7" "HTTP_SEC_FETCH_SITE" => "none" "HTTP_CF_VISITOR" => "{"scheme":"https"}" "HTTP_SEC_FETCH_MODE" => "navigate" "HTTP_SEC_FETCH_USER" => "?1" "HTTP_X_FORWARDED_PROTO" => "https" "HTTP_CDN_LOOP" => "cloudflare; loops=1" "HTTP_ACCEPT_ENCODING" => "gzip, br" "HTTP_SEC_FETCH_DEST" => "document" "HTTP_SEC_CH_UA_PLATFORM" => ""Windows"" "HTTP_X_FORWARDED_FOR" => "18.190.159.202" "HTTP_CF_RAY" => "92f77d461dbb0006-ORD" "HTTP_HOST" => "www.corspedia.com" "REDIRECT_STATUS" => "200" "SERVER_NAME" => "corspedia.com" "SERVER_PORT" => "443" "SERVER_ADDR" => "141.95.147.152" "REMOTE_USER" => "" "REMOTE_PORT" => "13954" "REMOTE_ADDR" => "172.70.126.133" "SERVER_SOFTWARE" => "nginx/1.18.0" "GATEWAY_INTERFACE" => "CGI/1.1" "HTTPS" => "on" "REQUEST_SCHEME" => "https" "SERVER_PROTOCOL" => "HTTP/2.0" "DOCUMENT_ROOT" => "/var/www/corspedia/public" "DOCUMENT_URI" => "/index.php" "REQUEST_URI" => "/ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/ai-skills:-introduction-to-unsupervised,-deep-and-reinforcement-learning" "SCRIPT_NAME" => "/index.php" "CONTENT_LENGTH" => "" "CONTENT_TYPE" => "" "REQUEST_METHOD" => "GET" "QUERY_STRING" => "" "SCRIPT_FILENAME" => "/var/www/corspedia/public/index.php" "PATH_INFO" => "" "FCGI_ROLE" => "RESPONDER" "PHP_SELF" => "/index.php" "REQUEST_TIME_FLOAT" => 1744510879.9575 "REQUEST_TIME" => 1744510879 ]
        request_cookies
        []
        
        response_headers
        0 of 0
        array:5 [ "content-type" => array:1 [ 0 => "text/html; charset=UTF-8" ] "cache-control" => array:1 [ 0 => "no-cache, private" ] "date" => array:1 [ 0 => "Sun, 13 Apr 2025 02:21:20 GMT" ] "set-cookie" => array:2 [ 0 => "XSRF-TOKEN=eyJpdiI6ImJiMUtVVGRVdDRra2VKUU1lM2VNdGc9PSIsInZhbHVlIjoiTjRobkk3WU5VTmNyeUZrNUJNbVp0OHZZVWNBSnhFUDZHUlBmM1loaVlBckdiVFhHWW9rb204aU4zZzV4MlM1clZ0YWdZU3lEU0g2SWdKbkg5SC9UR0ZRODlsdzdwSEV0clBUcGhSMkIzcTRXNkRYVVc2L2tmQ005YnZKd2c3SG8iLCJtYWMiOiI2NjEyMmU2OGIxMzE0OTNjNzM5MzRlNTUwOWU4NWUyMzVlNWFhMTRjMjUxZGIxNmYwOTRmODRlNzY5MDZhMWQ4IiwidGFnIjoiIn0%3D; expires=Sun, 13 Apr 2025 04:21:20 GMT; Max-Age=7200; path=/; samesite=laxXSRF-TOKEN=eyJpdiI6ImJiMUtVVGRVdDRra2VKUU1lM2VNdGc9PSIsInZhbHVlIjoiTjRobkk3WU5VTmNyeUZrNUJNbVp0OHZZVWNBSnhFUDZHUlBmM1loaVlBckdiVFhHWW9rb204aU4zZzV4MlM1clZ0YWdZU" 1 => "laravel_session=eyJpdiI6Ik5CWnBpUmVpZ0hyYVNEK0J0STh2d3c9PSIsInZhbHVlIjoic2FVODlIaWh1OEZkajFid2t3OGJ6ejUreXlUOERqME1xM09oNjBZZ3BmWldweisydXRRSnZIUHZkQVhpdFhuZUJySXlXSncreUNQc2d3c0QzWWdUTnJWOHZZQWRWdkV5Sk1PUGFteCtjdCtLQUdZQVE0NThiUGkwQU5sR3h6TnQiLCJtYWMiOiJlYzc4ZTAyMjE3OTgzZmE0ZDM2ZGM3MzQ2YmIzNzdjZjY4NTc3ZTQ5NWI1NTkyMjViY2ZmODNmYWRkNzViZWM1IiwidGFnIjoiIn0%3D; expires=Sun, 13 Apr 2025 04:21:20 GMT; Max-Age=7200; path=/; httponly; samesite=laxlaravel_session=eyJpdiI6Ik5CWnBpUmVpZ0hyYVNEK0J0STh2d3c9PSIsInZhbHVlIjoic2FVODlIaWh1OEZkajFid2t3OGJ6ejUreXlUOERqME1xM09oNjBZZ3BmWldweisydXRRSnZIUHZkQVhpdFhuZUJy" ] "Set-Cookie" => array:2 [ 0 => "XSRF-TOKEN=eyJpdiI6ImJiMUtVVGRVdDRra2VKUU1lM2VNdGc9PSIsInZhbHVlIjoiTjRobkk3WU5VTmNyeUZrNUJNbVp0OHZZVWNBSnhFUDZHUlBmM1loaVlBckdiVFhHWW9rb204aU4zZzV4MlM1clZ0YWdZU3lEU0g2SWdKbkg5SC9UR0ZRODlsdzdwSEV0clBUcGhSMkIzcTRXNkRYVVc2L2tmQ005YnZKd2c3SG8iLCJtYWMiOiI2NjEyMmU2OGIxMzE0OTNjNzM5MzRlNTUwOWU4NWUyMzVlNWFhMTRjMjUxZGIxNmYwOTRmODRlNzY5MDZhMWQ4IiwidGFnIjoiIn0%3D; expires=Sun, 13-Apr-2025 04:21:20 GMT; path=/XSRF-TOKEN=eyJpdiI6ImJiMUtVVGRVdDRra2VKUU1lM2VNdGc9PSIsInZhbHVlIjoiTjRobkk3WU5VTmNyeUZrNUJNbVp0OHZZVWNBSnhFUDZHUlBmM1loaVlBckdiVFhHWW9rb204aU4zZzV4MlM1clZ0YWdZU" 1 => "laravel_session=eyJpdiI6Ik5CWnBpUmVpZ0hyYVNEK0J0STh2d3c9PSIsInZhbHVlIjoic2FVODlIaWh1OEZkajFid2t3OGJ6ejUreXlUOERqME1xM09oNjBZZ3BmWldweisydXRRSnZIUHZkQVhpdFhuZUJySXlXSncreUNQc2d3c0QzWWdUTnJWOHZZQWRWdkV5Sk1PUGFteCtjdCtLQUdZQVE0NThiUGkwQU5sR3h6TnQiLCJtYWMiOiJlYzc4ZTAyMjE3OTgzZmE0ZDM2ZGM3MzQ2YmIzNzdjZjY4NTc3ZTQ5NWI1NTkyMjViY2ZmODNmYWRkNzViZWM1IiwidGFnIjoiIn0%3D; expires=Sun, 13-Apr-2025 04:21:20 GMT; path=/; httponlylaravel_session=eyJpdiI6Ik5CWnBpUmVpZ0hyYVNEK0J0STh2d3c9PSIsInZhbHVlIjoic2FVODlIaWh1OEZkajFid2t3OGJ6ejUreXlUOERqME1xM09oNjBZZ3BmWldweisydXRRSnZIUHZkQVhpdFhuZUJy" ] ]
        session_attributes
        0 of 0
        array:5 [ "_token" => "C88OpxSMlmgOPErT6vjfgBoGH7zPTgsDy2m8KJZl" "locale" => "ar" "_previous" => array:1 [ "url" => "https://www.corspedia.com/ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/ai-skills:-introduction-to-unsupervised,-deep-and-reinforcement-learning" ] "_flash" => array:2 [ "old" => [] "new" => [] ] "PHPDEBUGBAR_STACK_DATA" => [] ]