Managing Machine Learning Projects

بواسطة: Coursera

Overview

This second course of the AI Product Management Specialization by Duke University's Pratt School of Engineering focuses on the practical aspects of managing machine learning projects. The course walks through the keys steps of a ML project from how to identify good opportunities for ML through data collection, model building, deployment, and monitoring and maintenance of production systems. Participants will learn about the data science process and how to apply the process to organize ML efforts, as well as the key considerations and decisions in designing ML systems.

At the conclusion of this course, you should be able to:
1) Identify opportunities to apply ML to solve problems for users
2) Apply the data science process to organize ML projects
3) Evaluate the key technology decisions to make in ML system design
4) Lead ML projects from ideation through production using best practices

Syllabus

  • Identifying Opportunities for Machine Learning
    • In this module we will discuss how to identify problems worth solving, how to determine whether ML is a good fit as part of the solution, and how to validate solution concepts. We will also learn why heuristics are useful in modeling projects and the advantages and disadvantages of ML relative to heuristics.
  • Organizing ML Projects
    • In this module we will focus on the CRISP-DM data science process and how it can be used to organize ML projects. We will begin by understanding what is unique about ML project relative to normal software projects, and then discuss approaches to manage the inherent risks of ML projects. We will also walk through the key roles on a ML project team and how to organize work.
  • Data Considerations
    • In this module we will explore the key data-related issues that arise in ML projects. Data is the foundation of successful machine learning, and gathering data of sufficient quantity and quality with the right set of attributes is the key to a successful project. We will discuss the key considerations in sourcing data, cleaning data, and developing and selecting a feature set to use in modeling. The module will conclude with a discussion on best practices to ensure reproducibility of your data pipeline.
  • ML System Design & Technology Selection
    • In this module we will discuss the key decisions to make in designing ML systems, such as cloud vs. edge and online vs. batch, and compare the benefits of each type of system. We will then discuss the primary technology decisions to make in a ML project and introduce the common tools and technologies used to build ML models.
  • Model Lifecycle Management
    • The final module in the course focuses on identifying and mitigating the key issues which ML models experience once they are in production. We will discuss how to set up a robust ML system monitoring capability and define a model maintenance plan to maintain high performance of a production model. We will conclude with a discussion on the importance of versioning in ML systems to facilitate continued rapid iteration even after deployment.

Taught by

Jon Reifschneider

Managing Machine Learning Projects
الذهاب الي الدورة

Managing Machine Learning Projects

بواسطة: Coursera

  • Coursera
  • مجانية
  • الإنجليزية
  • متاح شهادة
  • متاح في أي وقت
  • beginner
  • English, Arabic, French, Portuguese, German, Thai, Indonesian, Spanish, Kazakh, Hindi, Russian, Swedish, Korean, Greek, Italian, Chinese, Ukrainian, Japanese, Polish, Dutch, Turkish
8.1.2PHP Version274msRequest Duration2MBMemory UsageGET ar/الدورات/{slug}Route
    • Booting (181ms)
    • Application (93.09ms)
    • 1 x Booting (65.86%)
      180.77ms
      1 x Application (33.91%)
      93.09ms
      14 templates were rendered
      • public.courses.show (resources/views/public/courses/show.blade.php)3bladefile
        Params
        0
        course
        1
        links
        2
        config
      • public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        classes
      • public.courses.partials.details (resources/views/public/courses/partials/details.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        classes
      • public.layouts.main (resources/views/public/layouts/main.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.layouts.partials.meta (resources/views/public/layouts/partials/meta.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.layouts.partials.navbar (resources/views/public/layouts/partials/navbar.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.auth.profile.partials.links (resources/views/public/auth/profile/partials/links.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.layouts.partials.flash-session (resources/views/public/layouts/partials/flash-session.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      uri
      GET ar/الدورات/{slug}
      middleware
      web, localize:ar
      controller
      App\Http\Controllers\CourseController@show
      as
      ar.courses.show
      namespace
      prefix
      /ar
      where
      file
      app/Http/Controllers/CourseController.php:17-35
      7 statements were executed3.62ms
      • select * from `courses` where `slug_ar` = 'managing-machine-learning-projects' limit 1
        2.25ms/app/Http/Controllers/CourseController.php:20corspedia
        Metadata
        Bindings
        • 0. managing-machine-learning-projects
        Backtrace
        • 17. /app/Http/Controllers/CourseController.php:20
        • 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • update `courses` set `visitors` = `visitors` + 1, `courses`.`updated_at` = '2025-04-13 17:18:20' where `id` = 151
        490μs/app/Http/Controllers/CourseController.php:21corspedia
        Metadata
        Bindings
        • 0. 2025-04-13 17:18:20
        • 1. 151
        Backtrace
        • 17. /app/Http/Controllers/CourseController.php:21
        • 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select `id`, `name_en`, `name_ar`, `topic_id`, `slug_en`, `slug_ar` from `subjects` where `subjects`.`id` in (4)
        200μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select `id`, `name_en`, `name_ar`, `slug_en`, `slug_ar` from `topics` where `topics`.`id` in (1)
        150μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 25. /app/Http/Controllers/CourseController.php:23
        • 26. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 27. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 28. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 29. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `institutions` where `institutions`.`id` in (24) and `institutions`.`deleted_at` is null
        180μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `providers` where `providers`.`id` in (2) and `providers`.`deleted_at` is null
        150μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `html_files` where `html_files`.`id` = 151 limit 1
        200μs/app/Models/Course.php:84corspedia
        Metadata
        Bindings
        • 0. 151
        Backtrace
        • 21. /app/Models/Course.php:84
        • 28. view::public.courses.show:29
        • 30. /vendor/laravel/framework/src/Illuminate/Filesystem/Filesystem.php:125
        • 31. /vendor/laravel/framework/src/Illuminate/View/Engines/PhpEngine.php:58
        • 32. /vendor/laravel/framework/src/Illuminate/View/Engines/CompilerEngine.php:72
      App\Models\HtmlFile
      1
      App\Models\Provider
      1
      App\Models\Institution
      1
      App\Models\Topic
      1
      App\Models\Subject
      1
      App\Models\Course
      1
        _token
        kk4vZSu8SR1Dnv5ti65E6A540wizfkJja89Mct0a
        locale
        ar
        _previous
        array:1 [ "url" => "https://www.corspedia.com/ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/managi...
        _flash
        array:2 [ "old" => [] "new" => [] ]
        PHPDEBUGBAR_STACK_DATA
        []
        path_info
        /ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/managing-machine-learning-projects
        status_code
        200
        
        status_text
        OK
        format
        html
        content_type
        text/html; charset=UTF-8
        request_query
        []
        
        request_request
        []
        
        request_headers
        0 of 0
        array:24 [ "sec-ch-ua-mobile" => array:1 [ 0 => "?0" ] "sec-ch-ua" => array:1 [ 0 => ""HeadlessChrome";v="129", "Not=A?Brand";v="8", "Chromium";v="129"" ] "cache-control" => array:1 [ 0 => "no-cache" ] "pragma" => array:1 [ 0 => "no-cache" ] "upgrade-insecure-requests" => array:1 [ 0 => "1" ] "priority" => array:1 [ 0 => "u=0, i" ] "user-agent" => array:1 [ 0 => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)" ] "cf-ipcountry" => array:1 [ 0 => "US" ] "cf-connecting-ip" => array:1 [ 0 => "18.219.145.197" ] "accept" => array:1 [ 0 => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7" ] "sec-fetch-site" => array:1 [ 0 => "none" ] "cf-visitor" => array:1 [ 0 => "{"scheme":"https"}" ] "sec-fetch-mode" => array:1 [ 0 => "navigate" ] "sec-fetch-user" => array:1 [ 0 => "?1" ] "x-forwarded-proto" => array:1 [ 0 => "https" ] "cdn-loop" => array:1 [ 0 => "cloudflare; loops=1" ] "accept-encoding" => array:1 [ 0 => "gzip, br" ] "sec-fetch-dest" => array:1 [ 0 => "document" ] "sec-ch-ua-platform" => array:1 [ 0 => ""Windows"" ] "x-forwarded-for" => array:1 [ 0 => "18.219.145.197" ] "cf-ray" => array:1 [ 0 => "92fc9f4099b8e81a-ORD" ] "host" => array:1 [ 0 => "www.corspedia.com" ] "content-length" => array:1 [ 0 => "" ] "content-type" => array:1 [ 0 => "" ] ]
        request_server
        0 of 0
        array:50 [ "USER" => "www-data" "HOME" => "/var/www" "HTTP_SEC_CH_UA_MOBILE" => "?0" "HTTP_SEC_CH_UA" => ""HeadlessChrome";v="129", "Not=A?Brand";v="8", "Chromium";v="129"" "HTTP_CACHE_CONTROL" => "no-cache" "HTTP_PRAGMA" => "no-cache" "HTTP_UPGRADE_INSECURE_REQUESTS" => "1" "HTTP_PRIORITY" => "u=0, i" "HTTP_USER_AGENT" => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)" "HTTP_CF_IPCOUNTRY" => "US" "HTTP_CF_CONNECTING_IP" => "18.219.145.197" "HTTP_ACCEPT" => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7" "HTTP_SEC_FETCH_SITE" => "none" "HTTP_CF_VISITOR" => "{"scheme":"https"}" "HTTP_SEC_FETCH_MODE" => "navigate" "HTTP_SEC_FETCH_USER" => "?1" "HTTP_X_FORWARDED_PROTO" => "https" "HTTP_CDN_LOOP" => "cloudflare; loops=1" "HTTP_ACCEPT_ENCODING" => "gzip, br" "HTTP_SEC_FETCH_DEST" => "document" "HTTP_SEC_CH_UA_PLATFORM" => ""Windows"" "HTTP_X_FORWARDED_FOR" => "18.219.145.197" "HTTP_CF_RAY" => "92fc9f4099b8e81a-ORD" "HTTP_HOST" => "www.corspedia.com" "REDIRECT_STATUS" => "200" "SERVER_NAME" => "corspedia.com" "SERVER_PORT" => "443" "SERVER_ADDR" => "141.95.147.152" "REMOTE_USER" => "" "REMOTE_PORT" => "46990" "REMOTE_ADDR" => "172.71.254.176" "SERVER_SOFTWARE" => "nginx/1.18.0" "GATEWAY_INTERFACE" => "CGI/1.1" "HTTPS" => "on" "REQUEST_SCHEME" => "https" "SERVER_PROTOCOL" => "HTTP/2.0" "DOCUMENT_ROOT" => "/var/www/corspedia/public" "DOCUMENT_URI" => "/index.php" "REQUEST_URI" => "/ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/managing-machine-learning-projects" "SCRIPT_NAME" => "/index.php" "CONTENT_LENGTH" => "" "CONTENT_TYPE" => "" "REQUEST_METHOD" => "GET" "QUERY_STRING" => "" "SCRIPT_FILENAME" => "/var/www/corspedia/public/index.php" "PATH_INFO" => "" "FCGI_ROLE" => "RESPONDER" "PHP_SELF" => "/index.php" "REQUEST_TIME_FLOAT" => 1744564700.4947 "REQUEST_TIME" => 1744564700 ]
        request_cookies
        []
        
        response_headers
        0 of 0
        array:5 [ "content-type" => array:1 [ 0 => "text/html; charset=UTF-8" ] "cache-control" => array:1 [ 0 => "no-cache, private" ] "date" => array:1 [ 0 => "Sun, 13 Apr 2025 17:18:20 GMT" ] "set-cookie" => array:2 [ 0 => "XSRF-TOKEN=eyJpdiI6ImZIZDNSRnhzT3NQUS8yYVhHbXkyRkE9PSIsInZhbHVlIjoiVENKdFFIdnJWUnY4dUh3MVFYRjZPajdab2hVd29uZFJkbk5MdkxXekIwZndKWjRwOUQrVjZPcVgyU0lvUDRiQmk3NzlpSjFNMU54bTg2VzFLUXlST29OSmI2UzJ6ZU0yVm5XN1QvZSt3YjM5cFo3WHhhNEwyZTlIOThQR2ZpQzUiLCJtYWMiOiIzYjRjNGNlMTA3MzhjMTllZjhhYzkwYTE1OGFjOThmMTM0NTZmNjBlNmRjOGI5MDRlNTdhMmZjMGM2MzY3YmNkIiwidGFnIjoiIn0%3D; expires=Sun, 13 Apr 2025 19:18:20 GMT; Max-Age=7200; path=/; samesite=laxXSRF-TOKEN=eyJpdiI6ImZIZDNSRnhzT3NQUS8yYVhHbXkyRkE9PSIsInZhbHVlIjoiVENKdFFIdnJWUnY4dUh3MVFYRjZPajdab2hVd29uZFJkbk5MdkxXekIwZndKWjRwOUQrVjZPcVgyU0lvUDRiQmk3NzlpS" 1 => "laravel_session=eyJpdiI6IitGM01wV1lnVGhLSFZFck85ZkVqWHc9PSIsInZhbHVlIjoiazY2eVhGUHNJL2U0QTExZE05aDJWUXpLUWxuSDNjWThVS1ovZHlSM1RmSFViZ09sVjBoWTRCUjIzZTJpc25BRStmRlF4TUNVQ2IvWHdHZHBXWWxSUis0ZHFoak9OSmladHJDaE5DN2s1a0J5TGh5RVZsN0NMZ3NGZzNFZm1ZNE8iLCJtYWMiOiI4YTExZDAyOWQwYmM1MzY2ZjJmZWEwMGU1MzU0YTA3NmRlYjZjOTJiNmE2MDdlNWQzYTI5MGZiMGFjZjM1OTIyIiwidGFnIjoiIn0%3D; expires=Sun, 13 Apr 2025 19:18:20 GMT; Max-Age=7200; path=/; httponly; samesite=laxlaravel_session=eyJpdiI6IitGM01wV1lnVGhLSFZFck85ZkVqWHc9PSIsInZhbHVlIjoiazY2eVhGUHNJL2U0QTExZE05aDJWUXpLUWxuSDNjWThVS1ovZHlSM1RmSFViZ09sVjBoWTRCUjIzZTJpc25BRStm" ] "Set-Cookie" => array:2 [ 0 => "XSRF-TOKEN=eyJpdiI6ImZIZDNSRnhzT3NQUS8yYVhHbXkyRkE9PSIsInZhbHVlIjoiVENKdFFIdnJWUnY4dUh3MVFYRjZPajdab2hVd29uZFJkbk5MdkxXekIwZndKWjRwOUQrVjZPcVgyU0lvUDRiQmk3NzlpSjFNMU54bTg2VzFLUXlST29OSmI2UzJ6ZU0yVm5XN1QvZSt3YjM5cFo3WHhhNEwyZTlIOThQR2ZpQzUiLCJtYWMiOiIzYjRjNGNlMTA3MzhjMTllZjhhYzkwYTE1OGFjOThmMTM0NTZmNjBlNmRjOGI5MDRlNTdhMmZjMGM2MzY3YmNkIiwidGFnIjoiIn0%3D; expires=Sun, 13-Apr-2025 19:18:20 GMT; path=/XSRF-TOKEN=eyJpdiI6ImZIZDNSRnhzT3NQUS8yYVhHbXkyRkE9PSIsInZhbHVlIjoiVENKdFFIdnJWUnY4dUh3MVFYRjZPajdab2hVd29uZFJkbk5MdkxXekIwZndKWjRwOUQrVjZPcVgyU0lvUDRiQmk3NzlpS" 1 => "laravel_session=eyJpdiI6IitGM01wV1lnVGhLSFZFck85ZkVqWHc9PSIsInZhbHVlIjoiazY2eVhGUHNJL2U0QTExZE05aDJWUXpLUWxuSDNjWThVS1ovZHlSM1RmSFViZ09sVjBoWTRCUjIzZTJpc25BRStmRlF4TUNVQ2IvWHdHZHBXWWxSUis0ZHFoak9OSmladHJDaE5DN2s1a0J5TGh5RVZsN0NMZ3NGZzNFZm1ZNE8iLCJtYWMiOiI4YTExZDAyOWQwYmM1MzY2ZjJmZWEwMGU1MzU0YTA3NmRlYjZjOTJiNmE2MDdlNWQzYTI5MGZiMGFjZjM1OTIyIiwidGFnIjoiIn0%3D; expires=Sun, 13-Apr-2025 19:18:20 GMT; path=/; httponlylaravel_session=eyJpdiI6IitGM01wV1lnVGhLSFZFck85ZkVqWHc9PSIsInZhbHVlIjoiazY2eVhGUHNJL2U0QTExZE05aDJWUXpLUWxuSDNjWThVS1ovZHlSM1RmSFViZ09sVjBoWTRCUjIzZTJpc25BRStm" ] ]
        session_attributes
        0 of 0
        array:5 [ "_token" => "kk4vZSu8SR1Dnv5ti65E6A540wizfkJja89Mct0a" "locale" => "ar" "_previous" => array:1 [ "url" => "https://www.corspedia.com/ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/managing-machine-learning-projects" ] "_flash" => array:2 [ "old" => [] "new" => [] ] "PHPDEBUGBAR_STACK_DATA" => [] ]