Become a Deep Reinforcement Learning Expert

بواسطة: Udacity

Overview

Deep reinforcement learning is one of AI’s hottest fields. Researchers, engineers, and investors are excited by its world-changing potential. In this advanced program, you’ll master techniques like Deep Q-Learning and Actor-Critic Methods, and connect with experts from NVIDIA and Unity as you build a portfolio of your own reinforcement learning projects.
Master the deep reinforcement learning skills that are powering amazing advances in AI. Then start applying these to applications like video games and robotics.

Syllabus

  • Foundations of Reinforcement Learning
    • Master the fundamentals of reinforcement learning by writing your own implementations of many classical solution methods.
  • Value-Based Methods
    • Apply deep learning architectures to reinforcement learning tasks. Train your own agent that navigates a virtual world from sensory data.
  • Policy-Based Methods
    • Learn the theory behind evolutionary algorithms and policy-gradient methods. Design your own algorithm to train a simulated robotic arm to reach target locations.
  • Multi-Agent Reinforcement Learning
    • Learn how to apply reinforcement learning methods to applications that involve multiple, interacting agents. These techniques are used in a variety of applications, such as the coordination of autonomous vehicles.

Taught by

Alexis Cook, Arpan Chakraborty, Mat Leonard, Luis Serrano, Cezanne Camacho, Dana Sheahan, Chhavi Yadav, Juan Delgado, Miguel Morales, Bardia H., Ross A., Camilo G., Fabian V., Ho Chit S. and Robson M.

Become a Deep Reinforcement Learning Expert
الذهاب الي الدورة

Become a Deep Reinforcement Learning Expert

بواسطة: Udacity

  • Udacity
  • مدفوعة
  • الإنجليزية
  • متاح شهادة
  • متاح في أي وقت
  • الجميع
  • N/A
8.1.2PHP Version256msRequest Duration2MBMemory UsageGET ar/الدورات/{slug}Route
    • Booting (161ms)
    • Application (94.81ms)
    • 1 x Booting (62.74%)
      160.68ms
      1 x Application (37.02%)
      94.81ms
      14 templates were rendered
      • public.courses.show (resources/views/public/courses/show.blade.php)3bladefile
        Params
        0
        course
        1
        links
        2
        config
      • public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        classes
      • public.courses.partials.details (resources/views/public/courses/partials/details.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        classes
      • public.layouts.main (resources/views/public/layouts/main.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.layouts.partials.meta (resources/views/public/layouts/partials/meta.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.layouts.partials.navbar (resources/views/public/layouts/partials/navbar.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.auth.profile.partials.links (resources/views/public/auth/profile/partials/links.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.layouts.partials.flash-session (resources/views/public/layouts/partials/flash-session.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      uri
      GET ar/الدورات/{slug}
      middleware
      web, localize:ar
      controller
      App\Http\Controllers\CourseController@show
      as
      ar.courses.show
      namespace
      prefix
      /ar
      where
      file
      app/Http/Controllers/CourseController.php:17-35
      6 statements were executed4.6ms
      • select * from `courses` where `slug_ar` = 'become-a-deep-reinforcement-learning-expert' limit 1
        3.37ms/app/Http/Controllers/CourseController.php:20corspedia
        Metadata
        Bindings
        • 0. become-a-deep-reinforcement-learning-expert
        Backtrace
        • 17. /app/Http/Controllers/CourseController.php:20
        • 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • update `courses` set `visitors` = `visitors` + 1, `courses`.`updated_at` = '2025-01-11 05:53:59' where `id` = 1280
        360μs/app/Http/Controllers/CourseController.php:21corspedia
        Metadata
        Bindings
        • 0. 2025-01-11 05:53:59
        • 1. 1280
        Backtrace
        • 17. /app/Http/Controllers/CourseController.php:21
        • 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select `id`, `name_en`, `name_ar`, `topic_id`, `slug_en`, `slug_ar` from `subjects` where `subjects`.`id` in (27)
        180μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select `id`, `name_en`, `name_ar`, `slug_en`, `slug_ar` from `topics` where `topics`.`id` in (1)
        150μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 25. /app/Http/Controllers/CourseController.php:23
        • 26. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 27. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 28. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 29. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `providers` where `providers`.`id` in (6) and `providers`.`deleted_at` is null
        320μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `html_files` where `html_files`.`id` = 1273 limit 1
        220μs/app/Models/Course.php:84corspedia
        Metadata
        Bindings
        • 0. 1273
        Backtrace
        • 21. /app/Models/Course.php:84
        • 28. view::public.courses.show:29
        • 30. /vendor/laravel/framework/src/Illuminate/Filesystem/Filesystem.php:125
        • 31. /vendor/laravel/framework/src/Illuminate/View/Engines/PhpEngine.php:58
        • 32. /vendor/laravel/framework/src/Illuminate/View/Engines/CompilerEngine.php:72
      App\Models\HtmlFile
      1
      App\Models\Provider
      1
      App\Models\Topic
      1
      App\Models\Subject
      1
      App\Models\Course
      1
        _token
        ZlkND2FjZUhoA0g9MSRW6YVua8fxoBsANfCeT5Am
        locale
        ar
        _previous
        array:1 [ "url" => "https://www.corspedia.com/ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/become...
        _flash
        array:2 [ "old" => [] "new" => [] ]
        PHPDEBUGBAR_STACK_DATA
        []
        path_info
        /ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/become-a-deep-reinforcement-learning-expert
        status_code
        200
        
        status_text
        OK
        format
        html
        content_type
        text/html; charset=UTF-8
        request_query
        []
        
        request_request
        []
        
        request_headers
        0 of 0
        array:24 [ "sec-ch-ua-mobile" => array:1 [ 0 => "?0" ] "sec-ch-ua" => array:1 [ 0 => ""HeadlessChrome";v="129", "Not=A?Brand";v="8", "Chromium";v="129"" ] "cache-control" => array:1 [ 0 => "no-cache" ] "pragma" => array:1 [ 0 => "no-cache" ] "cdn-loop" => array:1 [ 0 => "cloudflare; loops=1" ] "sec-fetch-dest" => array:1 [ 0 => "document" ] "upgrade-insecure-requests" => array:1 [ 0 => "1" ] "priority" => array:1 [ 0 => "u=0, i" ] "cf-connecting-ip" => array:1 [ 0 => "3.148.103.81" ] "user-agent" => array:1 [ 0 => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)" ] "accept" => array:1 [ 0 => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7" ] "cf-visitor" => array:1 [ 0 => "{"scheme":"https"}" ] "sec-fetch-site" => array:1 [ 0 => "none" ] "sec-fetch-mode" => array:1 [ 0 => "navigate" ] "x-forwarded-proto" => array:1 [ 0 => "https" ] "cf-ipcountry" => array:1 [ 0 => "US" ] "accept-encoding" => array:1 [ 0 => "gzip, br" ] "sec-fetch-user" => array:1 [ 0 => "?1" ] "sec-ch-ua-platform" => array:1 [ 0 => ""Windows"" ] "x-forwarded-for" => array:1 [ 0 => "3.148.103.81" ] "cf-ray" => array:1 [ 0 => "9002a648ef28f165-ORD" ] "host" => array:1 [ 0 => "www.corspedia.com" ] "content-length" => array:1 [ 0 => "" ] "content-type" => array:1 [ 0 => "" ] ]
        request_server
        0 of 0
        array:50 [ "USER" => "www-data" "HOME" => "/var/www" "HTTP_SEC_CH_UA_MOBILE" => "?0" "HTTP_SEC_CH_UA" => ""HeadlessChrome";v="129", "Not=A?Brand";v="8", "Chromium";v="129"" "HTTP_CACHE_CONTROL" => "no-cache" "HTTP_PRAGMA" => "no-cache" "HTTP_CDN_LOOP" => "cloudflare; loops=1" "HTTP_SEC_FETCH_DEST" => "document" "HTTP_UPGRADE_INSECURE_REQUESTS" => "1" "HTTP_PRIORITY" => "u=0, i" "HTTP_CF_CONNECTING_IP" => "3.148.103.81" "HTTP_USER_AGENT" => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)" "HTTP_ACCEPT" => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7" "HTTP_CF_VISITOR" => "{"scheme":"https"}" "HTTP_SEC_FETCH_SITE" => "none" "HTTP_SEC_FETCH_MODE" => "navigate" "HTTP_X_FORWARDED_PROTO" => "https" "HTTP_CF_IPCOUNTRY" => "US" "HTTP_ACCEPT_ENCODING" => "gzip, br" "HTTP_SEC_FETCH_USER" => "?1" "HTTP_SEC_CH_UA_PLATFORM" => ""Windows"" "HTTP_X_FORWARDED_FOR" => "3.148.103.81" "HTTP_CF_RAY" => "9002a648ef28f165-ORD" "HTTP_HOST" => "www.corspedia.com" "REDIRECT_STATUS" => "200" "SERVER_NAME" => "corspedia.com" "SERVER_PORT" => "443" "SERVER_ADDR" => "141.95.147.152" "REMOTE_USER" => "" "REMOTE_PORT" => "45876" "REMOTE_ADDR" => "172.70.131.10" "SERVER_SOFTWARE" => "nginx/1.18.0" "GATEWAY_INTERFACE" => "CGI/1.1" "HTTPS" => "on" "REQUEST_SCHEME" => "https" "SERVER_PROTOCOL" => "HTTP/2.0" "DOCUMENT_ROOT" => "/var/www/corspedia/public" "DOCUMENT_URI" => "/index.php" "REQUEST_URI" => "/ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/become-a-deep-reinforcement-learning-expert" "SCRIPT_NAME" => "/index.php" "CONTENT_LENGTH" => "" "CONTENT_TYPE" => "" "REQUEST_METHOD" => "GET" "QUERY_STRING" => "" "SCRIPT_FILENAME" => "/var/www/corspedia/public/index.php" "PATH_INFO" => "" "FCGI_ROLE" => "RESPONDER" "PHP_SELF" => "/index.php" "REQUEST_TIME_FLOAT" => 1736574839.4268 "REQUEST_TIME" => 1736574839 ]
        request_cookies
        []
        
        response_headers
        0 of 0
        array:5 [ "content-type" => array:1 [ 0 => "text/html; charset=UTF-8" ] "cache-control" => array:1 [ 0 => "no-cache, private" ] "date" => array:1 [ 0 => "Sat, 11 Jan 2025 05:53:59 GMT" ] "set-cookie" => array:2 [ 0 => "XSRF-TOKEN=eyJpdiI6IlVoZmtUSTA0YjZqMWhpL2VEUk9SMWc9PSIsInZhbHVlIjoiL1FuZUs1VG9uOGRWTW9wTmJlbFdGallUbHE1VFhXNFFvaHRYcDNaTUVnaVVGeUpMbnJ0V2NpQUhsN29jeFZ4dnJEdFlaUnhhNXZ5ZzFqczE3Z2ozL1NBOFBiUWNId3B1V2o0TWx4di9SQkpjNG90S3ZwVit1S3Q5R3dvYzMwZk0iLCJtYWMiOiI3Y2MzNmUzZDU0OTZlYzRhODJjOWIzY2JmYzg5NTE1ZjAxMDg1YTg4YjY2MzU0M2U4OWZiY2RlY2UxN2UzODZkIiwidGFnIjoiIn0%3D; expires=Sat, 11 Jan 2025 07:53:59 GMT; Max-Age=7200; path=/; samesite=laxXSRF-TOKEN=eyJpdiI6IlVoZmtUSTA0YjZqMWhpL2VEUk9SMWc9PSIsInZhbHVlIjoiL1FuZUs1VG9uOGRWTW9wTmJlbFdGallUbHE1VFhXNFFvaHRYcDNaTUVnaVVGeUpMbnJ0V2NpQUhsN29jeFZ4dnJEdFlaU" 1 => "laravel_session=eyJpdiI6IisycUkxV093eWFKMmpESXY3Z1l6aXc9PSIsInZhbHVlIjoid1pTL3BNUU9aOGVWbURGaDhNMEM0YnEwckdvZnJXN0JXd2RaWG1rQXJBVk9aWTNDSTV5RFJUNEt4T0pJSGR5d3VSNXlNdFg5ZE45ZFlNN1UrUy9ZclEydDdTVHRuNU82V0o1SktBQ3VLUU0vUzc5S3BwbUJMTkpvUTBNYnFna3AiLCJtYWMiOiIyOTgzNGFhY2Q5MDM2OTRhNDcxYTZlMTk3YTlhZGU4ODRkMmI2YzdiN2YyMTg1Y2ZhZmQ0NDkyYjExZjdmNzFmIiwidGFnIjoiIn0%3D; expires=Sat, 11 Jan 2025 07:53:59 GMT; Max-Age=7200; path=/; httponly; samesite=laxlaravel_session=eyJpdiI6IisycUkxV093eWFKMmpESXY3Z1l6aXc9PSIsInZhbHVlIjoid1pTL3BNUU9aOGVWbURGaDhNMEM0YnEwckdvZnJXN0JXd2RaWG1rQXJBVk9aWTNDSTV5RFJUNEt4T0pJSGR5d3VS" ] "Set-Cookie" => array:2 [ 0 => "XSRF-TOKEN=eyJpdiI6IlVoZmtUSTA0YjZqMWhpL2VEUk9SMWc9PSIsInZhbHVlIjoiL1FuZUs1VG9uOGRWTW9wTmJlbFdGallUbHE1VFhXNFFvaHRYcDNaTUVnaVVGeUpMbnJ0V2NpQUhsN29jeFZ4dnJEdFlaUnhhNXZ5ZzFqczE3Z2ozL1NBOFBiUWNId3B1V2o0TWx4di9SQkpjNG90S3ZwVit1S3Q5R3dvYzMwZk0iLCJtYWMiOiI3Y2MzNmUzZDU0OTZlYzRhODJjOWIzY2JmYzg5NTE1ZjAxMDg1YTg4YjY2MzU0M2U4OWZiY2RlY2UxN2UzODZkIiwidGFnIjoiIn0%3D; expires=Sat, 11-Jan-2025 07:53:59 GMT; path=/XSRF-TOKEN=eyJpdiI6IlVoZmtUSTA0YjZqMWhpL2VEUk9SMWc9PSIsInZhbHVlIjoiL1FuZUs1VG9uOGRWTW9wTmJlbFdGallUbHE1VFhXNFFvaHRYcDNaTUVnaVVGeUpMbnJ0V2NpQUhsN29jeFZ4dnJEdFlaU" 1 => "laravel_session=eyJpdiI6IisycUkxV093eWFKMmpESXY3Z1l6aXc9PSIsInZhbHVlIjoid1pTL3BNUU9aOGVWbURGaDhNMEM0YnEwckdvZnJXN0JXd2RaWG1rQXJBVk9aWTNDSTV5RFJUNEt4T0pJSGR5d3VSNXlNdFg5ZE45ZFlNN1UrUy9ZclEydDdTVHRuNU82V0o1SktBQ3VLUU0vUzc5S3BwbUJMTkpvUTBNYnFna3AiLCJtYWMiOiIyOTgzNGFhY2Q5MDM2OTRhNDcxYTZlMTk3YTlhZGU4ODRkMmI2YzdiN2YyMTg1Y2ZhZmQ0NDkyYjExZjdmNzFmIiwidGFnIjoiIn0%3D; expires=Sat, 11-Jan-2025 07:53:59 GMT; path=/; httponlylaravel_session=eyJpdiI6IisycUkxV093eWFKMmpESXY3Z1l6aXc9PSIsInZhbHVlIjoid1pTL3BNUU9aOGVWbURGaDhNMEM0YnEwckdvZnJXN0JXd2RaWG1rQXJBVk9aWTNDSTV5RFJUNEt4T0pJSGR5d3VS" ] ]
        session_attributes
        0 of 0
        array:5 [ "_token" => "ZlkND2FjZUhoA0g9MSRW6YVua8fxoBsANfCeT5Am" "locale" => "ar" "_previous" => array:1 [ "url" => "https://www.corspedia.com/ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/become-a-deep-reinforcement-learning-expert" ] "_flash" => array:2 [ "old" => [] "new" => [] ] "PHPDEBUGBAR_STACK_DATA" => [] ]