Production Machine Learning Systems

Brought by: Coursera

Overview

In this course, we dive into the components and best practices of building high-performing ML systems in production environments.

We cover some of the most common considerations behind building these systems, e.g. static training, dynamic training, static inference, dynamic inference, distributed TensorFlow, and TPUs.

This course is devoted to exploring the characteristics that make for a good ML system beyond its ability to make good predictions.

Syllabus

  • Introduction to Advanced Machine Learning on Google Cloud
    • This module previews the topics covered in the course and how to use Qwiklabs to complete each of your labs using Google Cloud.
  • Architecting Production ML Systems
    • This module explores what else a production ML system needs to do and how to meet those needs. You review how to make important, high-level, design decisions around training and model serving need to make in order to get the right performance profile for your model.
  • Designing Adaptable ML Systems
    • In this module, you learn how to recognize the ways that our model is dependent on our data, make cost-conscious engineering decisions, know when to roll back our models to earlier versions, debug the causes of observed model behavior and implement a pipeline that is immune to one type of dependency.
  • Designing High-Performance ML Systems
    • In this module, you identify performance considerations for machine learning models.
      Machine learning models are not all identical. For some models, you focus on improving I/O performance, and on others, you focus on squeezing out more computational speed.
  • Building Hybrid ML Systems
    • Understand the tools and systems available and when to leverage hybrid machine learning models.
  • Summary
    • This module reviews what you learned in this course.

Taught by

Google Cloud Training

Production Machine Learning Systems
Go to course

Production Machine Learning Systems

Brought by: Coursera

  • Coursera
  • Free
  • English
  • Certificate Available
  • Available at any time
  • All
  • English
8.1.2PHP Version206msRequest Duration2MBMemory UsageGET en/courses/{slug}Route
    • Booting (129ms)
    • Application (76.53ms)
    • 1 x Booting (62.66%)
      129.25ms
      1 x Application (37.1%)
      76.53ms
      14 templates were rendered
      • public.courses.show (resources/views/public/courses/show.blade.php)3bladefile
        Params
        0
        course
        1
        links
        2
        config
      • public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        classes
      • public.courses.partials.details (resources/views/public/courses/partials/details.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        classes
      • public.layouts.main (resources/views/public/layouts/main.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.layouts.partials.meta (resources/views/public/layouts/partials/meta.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.layouts.partials.navbar (resources/views/public/layouts/partials/navbar.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.auth.profile.partials.links (resources/views/public/auth/profile/partials/links.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.layouts.partials.flash-session (resources/views/public/layouts/partials/flash-session.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      uri
      GET en/courses/{slug}
      middleware
      web, localize:en
      controller
      App\Http\Controllers\CourseController@show
      as
      en.courses.show
      namespace
      prefix
      /en
      where
      file
      app/Http/Controllers/CourseController.php:17-35
      7 statements were executed4.36ms
      • select * from `courses` where `slug_en` = 'production-machine-learning-systems' limit 1
        2.81ms/app/Http/Controllers/CourseController.php:20corspedia
        Metadata
        Bindings
        • 0. production-machine-learning-systems
        Backtrace
        • 17. /app/Http/Controllers/CourseController.php:20
        • 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • update `courses` set `visitors` = `visitors` + 1, `courses`.`updated_at` = '2025-01-11 13:09:02' where `id` = 300
        390μs/app/Http/Controllers/CourseController.php:21corspedia
        Metadata
        Bindings
        • 0. 2025-01-11 13:09:02
        • 1. 300
        Backtrace
        • 17. /app/Http/Controllers/CourseController.php:21
        • 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select `id`, `name_en`, `name_ar`, `topic_id`, `slug_en`, `slug_ar` from `subjects` where `subjects`.`id` in (4)
        260μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select `id`, `name_en`, `name_ar`, `slug_en`, `slug_ar` from `topics` where `topics`.`id` in (1)
        190μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 25. /app/Http/Controllers/CourseController.php:23
        • 26. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 27. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 28. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 29. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `institutions` where `institutions`.`id` in (54) and `institutions`.`deleted_at` is null
        220μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `providers` where `providers`.`id` in (2) and `providers`.`deleted_at` is null
        200μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `html_files` where `html_files`.`id` = 294 limit 1
        290μs/app/Models/Course.php:84corspedia
        Metadata
        Bindings
        • 0. 294
        Backtrace
        • 21. /app/Models/Course.php:84
        • 28. view::public.courses.show:29
        • 30. /vendor/laravel/framework/src/Illuminate/Filesystem/Filesystem.php:125
        • 31. /vendor/laravel/framework/src/Illuminate/View/Engines/PhpEngine.php:58
        • 32. /vendor/laravel/framework/src/Illuminate/View/Engines/CompilerEngine.php:72
      App\Models\HtmlFile
      1
      App\Models\Provider
      1
      App\Models\Institution
      1
      App\Models\Topic
      1
      App\Models\Subject
      1
      App\Models\Course
      1
        _token
        6CUhO6kSmL8D21llsQJZSS3t6RvJRpegyupc5oUT
        locale
        en
        _previous
        array:1 [ "url" => "https://www.corspedia.com/en/courses/production-machine-learning-systems" ]
        _flash
        array:2 [ "old" => [] "new" => [] ]
        PHPDEBUGBAR_STACK_DATA
        []
        path_info
        /en/courses/production-machine-learning-systems
        status_code
        200
        
        status_text
        OK
        format
        html
        content_type
        text/html; charset=UTF-8
        request_query
        []
        
        request_request
        []
        
        request_headers
        0 of 0
        array:24 [ "sec-ch-ua-mobile" => array:1 [ 0 => "?0" ] "sec-ch-ua" => array:1 [ 0 => ""HeadlessChrome";v="129", "Not=A?Brand";v="8", "Chromium";v="129"" ] "cache-control" => array:1 [ 0 => "no-cache" ] "pragma" => array:1 [ 0 => "no-cache" ] "cdn-loop" => array:1 [ 0 => "cloudflare; loops=1" ] "sec-fetch-dest" => array:1 [ 0 => "document" ] "upgrade-insecure-requests" => array:1 [ 0 => "1" ] "priority" => array:1 [ 0 => "u=0, i" ] "cf-connecting-ip" => array:1 [ 0 => "18.118.210.79" ] "user-agent" => array:1 [ 0 => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)" ] "accept" => array:1 [ 0 => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7" ] "cf-visitor" => array:1 [ 0 => "{"scheme":"https"}" ] "sec-fetch-site" => array:1 [ 0 => "none" ] "sec-fetch-mode" => array:1 [ 0 => "navigate" ] "x-forwarded-proto" => array:1 [ 0 => "https" ] "cf-ipcountry" => array:1 [ 0 => "US" ] "accept-encoding" => array:1 [ 0 => "gzip, br" ] "sec-fetch-user" => array:1 [ 0 => "?1" ] "sec-ch-ua-platform" => array:1 [ 0 => ""Windows"" ] "x-forwarded-for" => array:1 [ 0 => "18.118.210.79" ] "cf-ray" => array:1 [ 0 => "900523921a0f609a-ORD" ] "host" => array:1 [ 0 => "www.corspedia.com" ] "content-length" => array:1 [ 0 => "" ] "content-type" => array:1 [ 0 => "" ] ]
        request_server
        0 of 0
        array:50 [ "USER" => "www-data" "HOME" => "/var/www" "HTTP_SEC_CH_UA_MOBILE" => "?0" "HTTP_SEC_CH_UA" => ""HeadlessChrome";v="129", "Not=A?Brand";v="8", "Chromium";v="129"" "HTTP_CACHE_CONTROL" => "no-cache" "HTTP_PRAGMA" => "no-cache" "HTTP_CDN_LOOP" => "cloudflare; loops=1" "HTTP_SEC_FETCH_DEST" => "document" "HTTP_UPGRADE_INSECURE_REQUESTS" => "1" "HTTP_PRIORITY" => "u=0, i" "HTTP_CF_CONNECTING_IP" => "18.118.210.79" "HTTP_USER_AGENT" => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)" "HTTP_ACCEPT" => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7" "HTTP_CF_VISITOR" => "{"scheme":"https"}" "HTTP_SEC_FETCH_SITE" => "none" "HTTP_SEC_FETCH_MODE" => "navigate" "HTTP_X_FORWARDED_PROTO" => "https" "HTTP_CF_IPCOUNTRY" => "US" "HTTP_ACCEPT_ENCODING" => "gzip, br" "HTTP_SEC_FETCH_USER" => "?1" "HTTP_SEC_CH_UA_PLATFORM" => ""Windows"" "HTTP_X_FORWARDED_FOR" => "18.118.210.79" "HTTP_CF_RAY" => "900523921a0f609a-ORD" "HTTP_HOST" => "www.corspedia.com" "REDIRECT_STATUS" => "200" "SERVER_NAME" => "corspedia.com" "SERVER_PORT" => "443" "SERVER_ADDR" => "141.95.147.152" "REMOTE_USER" => "" "REMOTE_PORT" => "32402" "REMOTE_ADDR" => "172.69.7.195" "SERVER_SOFTWARE" => "nginx/1.18.0" "GATEWAY_INTERFACE" => "CGI/1.1" "HTTPS" => "on" "REQUEST_SCHEME" => "https" "SERVER_PROTOCOL" => "HTTP/2.0" "DOCUMENT_ROOT" => "/var/www/corspedia/public" "DOCUMENT_URI" => "/index.php" "REQUEST_URI" => "/en/courses/production-machine-learning-systems" "SCRIPT_NAME" => "/index.php" "CONTENT_LENGTH" => "" "CONTENT_TYPE" => "" "REQUEST_METHOD" => "GET" "QUERY_STRING" => "" "SCRIPT_FILENAME" => "/var/www/corspedia/public/index.php" "PATH_INFO" => "" "FCGI_ROLE" => "RESPONDER" "PHP_SELF" => "/index.php" "REQUEST_TIME_FLOAT" => 1736600942.6655 "REQUEST_TIME" => 1736600942 ]
        request_cookies
        []
        
        response_headers
        0 of 0
        array:5 [ "content-type" => array:1 [ 0 => "text/html; charset=UTF-8" ] "cache-control" => array:1 [ 0 => "no-cache, private" ] "date" => array:1 [ 0 => "Sat, 11 Jan 2025 13:09:02 GMT" ] "set-cookie" => array:2 [ 0 => "XSRF-TOKEN=eyJpdiI6InI1SVYwWjVZS0NmY0FCdlo5cWdQYXc9PSIsInZhbHVlIjoibnRUa3V5NkZQajFqKzFSaWlXUVh0aHFOWkVieTVpY1RCUDd4L0pzRlVQRm1mSVV4YXFIdEliRkQ5ZlU1Y1gwK0owbW1wTVRGci9RcGYwYktWeW9EQWkvSlRSNDJLWCs1MUlXMW9qS0RnR3NnRHIyVWpwTnQwdm5SeVV6aVRvd1YiLCJtYWMiOiI2NjZkNzExODdiMTVmMjA2ZjMzMDNmZWVhOGU1MDYwYzVmZTJmYjdlZmRjY2U1NGIxOGZkZmQ3NWVjOWM1YjZkIiwidGFnIjoiIn0%3D; expires=Sat, 11 Jan 2025 15:09:02 GMT; Max-Age=7200; path=/; samesite=laxXSRF-TOKEN=eyJpdiI6InI1SVYwWjVZS0NmY0FCdlo5cWdQYXc9PSIsInZhbHVlIjoibnRUa3V5NkZQajFqKzFSaWlXUVh0aHFOWkVieTVpY1RCUDd4L0pzRlVQRm1mSVV4YXFIdEliRkQ5ZlU1Y1gwK0owbW1wT" 1 => "laravel_session=eyJpdiI6ImtsbG1ucXpoakxnMysxM2NYZE1GTXc9PSIsInZhbHVlIjoiV0JKMWJ0eFRzTy9rZjl4R2NCb3VoNVNvb29DOHNDYjJ1TVRnRElqdk1ZNjFmMGswYmdDUjRyQXVzTTJxa1NMU2NlaU1SNW5EVWlqZDZ4cEg0dUdXZ0xDZDZUUXRZYWw5NTd2Q281K1FjZ1pkc0QwS2RHbVJ6elozbjVHSlVDZ2YiLCJtYWMiOiI2ODM4ZTYxODk2YmUwOGVlM2ExZTIwNDRiMTUxZmFlMzRlZDRhOWI4MTJiM2ZlYzI5MzllNjVlNDIyNGMwZTAyIiwidGFnIjoiIn0%3D; expires=Sat, 11 Jan 2025 15:09:02 GMT; Max-Age=7200; path=/; httponly; samesite=laxlaravel_session=eyJpdiI6ImtsbG1ucXpoakxnMysxM2NYZE1GTXc9PSIsInZhbHVlIjoiV0JKMWJ0eFRzTy9rZjl4R2NCb3VoNVNvb29DOHNDYjJ1TVRnRElqdk1ZNjFmMGswYmdDUjRyQXVzTTJxa1NMU2Nl" ] "Set-Cookie" => array:2 [ 0 => "XSRF-TOKEN=eyJpdiI6InI1SVYwWjVZS0NmY0FCdlo5cWdQYXc9PSIsInZhbHVlIjoibnRUa3V5NkZQajFqKzFSaWlXUVh0aHFOWkVieTVpY1RCUDd4L0pzRlVQRm1mSVV4YXFIdEliRkQ5ZlU1Y1gwK0owbW1wTVRGci9RcGYwYktWeW9EQWkvSlRSNDJLWCs1MUlXMW9qS0RnR3NnRHIyVWpwTnQwdm5SeVV6aVRvd1YiLCJtYWMiOiI2NjZkNzExODdiMTVmMjA2ZjMzMDNmZWVhOGU1MDYwYzVmZTJmYjdlZmRjY2U1NGIxOGZkZmQ3NWVjOWM1YjZkIiwidGFnIjoiIn0%3D; expires=Sat, 11-Jan-2025 15:09:02 GMT; path=/XSRF-TOKEN=eyJpdiI6InI1SVYwWjVZS0NmY0FCdlo5cWdQYXc9PSIsInZhbHVlIjoibnRUa3V5NkZQajFqKzFSaWlXUVh0aHFOWkVieTVpY1RCUDd4L0pzRlVQRm1mSVV4YXFIdEliRkQ5ZlU1Y1gwK0owbW1wT" 1 => "laravel_session=eyJpdiI6ImtsbG1ucXpoakxnMysxM2NYZE1GTXc9PSIsInZhbHVlIjoiV0JKMWJ0eFRzTy9rZjl4R2NCb3VoNVNvb29DOHNDYjJ1TVRnRElqdk1ZNjFmMGswYmdDUjRyQXVzTTJxa1NMU2NlaU1SNW5EVWlqZDZ4cEg0dUdXZ0xDZDZUUXRZYWw5NTd2Q281K1FjZ1pkc0QwS2RHbVJ6elozbjVHSlVDZ2YiLCJtYWMiOiI2ODM4ZTYxODk2YmUwOGVlM2ExZTIwNDRiMTUxZmFlMzRlZDRhOWI4MTJiM2ZlYzI5MzllNjVlNDIyNGMwZTAyIiwidGFnIjoiIn0%3D; expires=Sat, 11-Jan-2025 15:09:02 GMT; path=/; httponlylaravel_session=eyJpdiI6ImtsbG1ucXpoakxnMysxM2NYZE1GTXc9PSIsInZhbHVlIjoiV0JKMWJ0eFRzTy9rZjl4R2NCb3VoNVNvb29DOHNDYjJ1TVRnRElqdk1ZNjFmMGswYmdDUjRyQXVzTTJxa1NMU2Nl" ] ]
        session_attributes
        0 of 0
        array:5 [ "_token" => "6CUhO6kSmL8D21llsQJZSS3t6RvJRpegyupc5oUT" "locale" => "en" "_previous" => array:1 [ "url" => "https://www.corspedia.com/en/courses/production-machine-learning-systems" ] "_flash" => array:2 [ "old" => [] "new" => [] ] "PHPDEBUGBAR_STACK_DATA" => [] ]