CS125x: Advanced Distributed Machine Learning with Apache Spark

بواسطة: edX

Overview

Building on the core ideas presented in Distributed Machine Learning with Spark, this course covers advanced topics for training and deploying large-scale learning pipelines. You will study state-of-the-art distributed algorithms for collaborative filtering, ensemble methods (e.g., random forests), clustering and topic modeling, with a focus on model parallelism and the crucial tradeoffs between computation and communication.

After completing this course, you will have a thorough understanding of the statistical and algorithmic principles required to develop and deploy distributed machine learning pipelines. You will further have the expertise to write efficient and scalable code in Spark, using MLlib and the spark.ml package in particular.

Taught by

Ameet Talwalkar and Jon Bates

CS125x: Advanced Distributed Machine Learning with Apache Spark
الذهاب الي الدورة

CS125x: Advanced Distributed Machine Learning with Apache Spark

بواسطة: edX

  • edX
  • مجانية
  • الإنجليزية
  • متاح شهادة
  • أيام محددة
  • الجميع
  • N/A
8.1.2PHP Version264msRequest Duration2MBMemory UsageGET ar/الدورات/{slug}Route
    • Booting (165ms)
    • Application (98.99ms)
    • 1 x Booting (62.3%)
      164.67ms
      1 x Application (37.45%)
      98.99ms
      14 templates were rendered
      • public.courses.show (resources/views/public/courses/show.blade.php)3bladefile
        Params
        0
        course
        1
        links
        2
        config
      • public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        classes
      • public.courses.partials.details (resources/views/public/courses/partials/details.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        classes
      • public.layouts.main (resources/views/public/layouts/main.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.layouts.partials.meta (resources/views/public/layouts/partials/meta.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.layouts.partials.navbar (resources/views/public/layouts/partials/navbar.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.auth.profile.partials.links (resources/views/public/auth/profile/partials/links.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.layouts.partials.flash-session (resources/views/public/layouts/partials/flash-session.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      uri
      GET ar/الدورات/{slug}
      middleware
      web, localize:ar
      controller
      App\Http\Controllers\CourseController@show
      as
      ar.courses.show
      namespace
      prefix
      /ar
      where
      file
      app/Http/Controllers/CourseController.php:17-35
      7 statements were executed8.78ms
      • select * from `courses` where `slug_ar` = 'cs125x:-advanced-distributed-machine-learning-with-apache-spark' limit 1
        6.94ms/app/Http/Controllers/CourseController.php:20corspedia
        Metadata
        Bindings
        • 0. cs125x:-advanced-distributed-machine-learning-with-apache-spark
        Backtrace
        • 17. /app/Http/Controllers/CourseController.php:20
        • 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • update `courses` set `visitors` = `visitors` + 1, `courses`.`updated_at` = '2025-04-23 20:40:04' where `id` = 2342
        950μs/app/Http/Controllers/CourseController.php:21corspedia
        Metadata
        Bindings
        • 0. 2025-04-23 20:40:04
        • 1. 2342
        Backtrace
        • 17. /app/Http/Controllers/CourseController.php:21
        • 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select `id`, `name_en`, `name_ar`, `topic_id`, `slug_en`, `slug_ar` from `subjects` where `subjects`.`id` in (4)
        260μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select `id`, `name_en`, `name_ar`, `slug_en`, `slug_ar` from `topics` where `topics`.`id` in (1)
        140μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 25. /app/Http/Controllers/CourseController.php:23
        • 26. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 27. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 28. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 29. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `institutions` where `institutions`.`id` in (65) and `institutions`.`deleted_at` is null
        160μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `providers` where `providers`.`id` in (1) and `providers`.`deleted_at` is null
        150μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `html_files` where `html_files`.`id` = 2333 limit 1
        180μs/app/Models/Course.php:84corspedia
        Metadata
        Bindings
        • 0. 2333
        Backtrace
        • 21. /app/Models/Course.php:84
        • 28. view::public.courses.show:29
        • 30. /vendor/laravel/framework/src/Illuminate/Filesystem/Filesystem.php:125
        • 31. /vendor/laravel/framework/src/Illuminate/View/Engines/PhpEngine.php:58
        • 32. /vendor/laravel/framework/src/Illuminate/View/Engines/CompilerEngine.php:72
      App\Models\HtmlFile
      1
      App\Models\Provider
      1
      App\Models\Institution
      1
      App\Models\Topic
      1
      App\Models\Subject
      1
      App\Models\Course
      1
        _token
        CJ8CizBmZNBbGAhue1mUPV0c10zTygdIB58jQakr
        locale
        ar
        _previous
        array:1 [ "url" => "https://www.corspedia.com/ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/cs125x...
        _flash
        array:2 [ "old" => [] "new" => [] ]
        PHPDEBUGBAR_STACK_DATA
        []
        path_info
        /ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/cs125x:-advanced-distributed-machine-learning-with-apache-spark
        status_code
        200
        
        status_text
        OK
        format
        html
        content_type
        text/html; charset=UTF-8
        request_query
        []
        
        request_request
        []
        
        request_headers
        0 of 0
        array:24 [ "cf-ipcountry" => array:1 [ 0 => "US" ] "cf-connecting-ip" => array:1 [ 0 => "13.58.115.236" ] "cdn-loop" => array:1 [ 0 => "cloudflare; loops=1" ] "x-forwarded-proto" => array:1 [ 0 => "https" ] "cf-visitor" => array:1 [ 0 => "{"scheme":"https"}" ] "sec-fetch-site" => array:1 [ 0 => "none" ] "accept" => array:1 [ 0 => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7" ] "user-agent" => array:1 [ 0 => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)" ] "upgrade-insecure-requests" => array:1 [ 0 => "1" ] "sec-ch-ua-platform" => array:1 [ 0 => ""Windows"" ] "sec-ch-ua-mobile" => array:1 [ 0 => "?0" ] "sec-ch-ua" => array:1 [ 0 => ""HeadlessChrome";v="129", "Not=A?Brand";v="8", "Chromium";v="129"" ] "cache-control" => array:1 [ 0 => "no-cache" ] "pragma" => array:1 [ 0 => "no-cache" ] "sec-fetch-dest" => array:1 [ 0 => "document" ] "cf-ray" => array:1 [ 0 => "93502c7e5a44d250-ORD" ] "accept-encoding" => array:1 [ 0 => "gzip, br" ] "priority" => array:1 [ 0 => "u=0, i" ] "sec-fetch-user" => array:1 [ 0 => "?1" ] "sec-fetch-mode" => array:1 [ 0 => "navigate" ] "x-forwarded-for" => array:1 [ 0 => "13.58.115.236" ] "host" => array:1 [ 0 => "www.corspedia.com" ] "content-length" => array:1 [ 0 => "" ] "content-type" => array:1 [ 0 => "" ] ]
        request_server
        0 of 0
        array:50 [ "USER" => "www-data" "HOME" => "/var/www" "HTTP_CF_IPCOUNTRY" => "US" "HTTP_CF_CONNECTING_IP" => "13.58.115.236" "HTTP_CDN_LOOP" => "cloudflare; loops=1" "HTTP_X_FORWARDED_PROTO" => "https" "HTTP_CF_VISITOR" => "{"scheme":"https"}" "HTTP_SEC_FETCH_SITE" => "none" "HTTP_ACCEPT" => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7" "HTTP_USER_AGENT" => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)" "HTTP_UPGRADE_INSECURE_REQUESTS" => "1" "HTTP_SEC_CH_UA_PLATFORM" => ""Windows"" "HTTP_SEC_CH_UA_MOBILE" => "?0" "HTTP_SEC_CH_UA" => ""HeadlessChrome";v="129", "Not=A?Brand";v="8", "Chromium";v="129"" "HTTP_CACHE_CONTROL" => "no-cache" "HTTP_PRAGMA" => "no-cache" "HTTP_SEC_FETCH_DEST" => "document" "HTTP_CF_RAY" => "93502c7e5a44d250-ORD" "HTTP_ACCEPT_ENCODING" => "gzip, br" "HTTP_PRIORITY" => "u=0, i" "HTTP_SEC_FETCH_USER" => "?1" "HTTP_SEC_FETCH_MODE" => "navigate" "HTTP_X_FORWARDED_FOR" => "13.58.115.236" "HTTP_HOST" => "www.corspedia.com" "REDIRECT_STATUS" => "200" "SERVER_NAME" => "corspedia.com" "SERVER_PORT" => "443" "SERVER_ADDR" => "141.95.147.152" "REMOTE_USER" => "" "REMOTE_PORT" => "22400" "REMOTE_ADDR" => "172.69.17.52" "SERVER_SOFTWARE" => "nginx/1.18.0" "GATEWAY_INTERFACE" => "CGI/1.1" "HTTPS" => "on" "REQUEST_SCHEME" => "https" "SERVER_PROTOCOL" => "HTTP/2.0" "DOCUMENT_ROOT" => "/var/www/corspedia/public" "DOCUMENT_URI" => "/index.php" "REQUEST_URI" => "/ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/cs125x:-advanced-distributed-machine-learning-with-apache-spark" "SCRIPT_NAME" => "/index.php" "CONTENT_LENGTH" => "" "CONTENT_TYPE" => "" "REQUEST_METHOD" => "GET" "QUERY_STRING" => "" "SCRIPT_FILENAME" => "/var/www/corspedia/public/index.php" "PATH_INFO" => "" "FCGI_ROLE" => "RESPONDER" "PHP_SELF" => "/index.php" "REQUEST_TIME_FLOAT" => 1745440803.8451 "REQUEST_TIME" => 1745440803 ]
        request_cookies
        []
        
        response_headers
        0 of 0
        array:5 [ "content-type" => array:1 [ 0 => "text/html; charset=UTF-8" ] "cache-control" => array:1 [ 0 => "no-cache, private" ] "date" => array:1 [ 0 => "Wed, 23 Apr 2025 20:40:04 GMT" ] "set-cookie" => array:2 [ 0 => "XSRF-TOKEN=eyJpdiI6IlRDODhxNUMxM0huQmhPZ3BPa3VVeFE9PSIsInZhbHVlIjoiODMwaHNQbUdmdUhyd0ZhMlpZVDhGUm9QeFhnMUJpRXJpYThHNzRaQ0J4eUpsVUlsM0xHQUJnSzF6RVJOcnpiODd3cHpzWnpMaDdUOWJCeEN6aXlRNHU5dW1WVWNZRWJXRFdvbDBORHNYd1ZRQlV3bTE3SmNJbmYrMG91cFNFbVAiLCJtYWMiOiI1MWIwY2RlOWI5NTA1NWE1YzQ4MGQ4MDRhZTQ3ODhmNDEyYmM1Y2M3OWExM2EzOTQzZmEwZTRhNGMwNjI1ZTI5IiwidGFnIjoiIn0%3D; expires=Wed, 23 Apr 2025 22:40:04 GMT; Max-Age=7200; path=/; samesite=laxXSRF-TOKEN=eyJpdiI6IlRDODhxNUMxM0huQmhPZ3BPa3VVeFE9PSIsInZhbHVlIjoiODMwaHNQbUdmdUhyd0ZhMlpZVDhGUm9QeFhnMUJpRXJpYThHNzRaQ0J4eUpsVUlsM0xHQUJnSzF6RVJOcnpiODd3cHpzW" 1 => "laravel_session=eyJpdiI6ImljVHZJVWlwMnRLWFFVTWdvMnZTM3c9PSIsInZhbHVlIjoiWm15RlFoMmQyUXA4eVN0V0FVb2gyVzNJTnY4V1pmUEh0eGJ2a1ZzYnBHWHZpUEZZTDJvMnRRRmttMzhrYVZoY1JUM09ES2R2TGZoeExoanMxamFTVXRtRmZ2SFJKU3R2dWZoSFFuamx2MjZhM0tJcnk2dG5qVXMvRUtMVnVlbEsiLCJtYWMiOiJhNmYzZTZhNjgzODYyNDJiODA1MDNlOGQ2NDVkMTZiODU4Mjg4YzYzMmY3ZGZhMTVkMzVlZWZiNDc2OGQzMWVhIiwidGFnIjoiIn0%3D; expires=Wed, 23 Apr 2025 22:40:04 GMT; Max-Age=7200; path=/; httponly; samesite=laxlaravel_session=eyJpdiI6ImljVHZJVWlwMnRLWFFVTWdvMnZTM3c9PSIsInZhbHVlIjoiWm15RlFoMmQyUXA4eVN0V0FVb2gyVzNJTnY4V1pmUEh0eGJ2a1ZzYnBHWHZpUEZZTDJvMnRRRmttMzhrYVZoY1JU" ] "Set-Cookie" => array:2 [ 0 => "XSRF-TOKEN=eyJpdiI6IlRDODhxNUMxM0huQmhPZ3BPa3VVeFE9PSIsInZhbHVlIjoiODMwaHNQbUdmdUhyd0ZhMlpZVDhGUm9QeFhnMUJpRXJpYThHNzRaQ0J4eUpsVUlsM0xHQUJnSzF6RVJOcnpiODd3cHpzWnpMaDdUOWJCeEN6aXlRNHU5dW1WVWNZRWJXRFdvbDBORHNYd1ZRQlV3bTE3SmNJbmYrMG91cFNFbVAiLCJtYWMiOiI1MWIwY2RlOWI5NTA1NWE1YzQ4MGQ4MDRhZTQ3ODhmNDEyYmM1Y2M3OWExM2EzOTQzZmEwZTRhNGMwNjI1ZTI5IiwidGFnIjoiIn0%3D; expires=Wed, 23-Apr-2025 22:40:04 GMT; path=/XSRF-TOKEN=eyJpdiI6IlRDODhxNUMxM0huQmhPZ3BPa3VVeFE9PSIsInZhbHVlIjoiODMwaHNQbUdmdUhyd0ZhMlpZVDhGUm9QeFhnMUJpRXJpYThHNzRaQ0J4eUpsVUlsM0xHQUJnSzF6RVJOcnpiODd3cHpzW" 1 => "laravel_session=eyJpdiI6ImljVHZJVWlwMnRLWFFVTWdvMnZTM3c9PSIsInZhbHVlIjoiWm15RlFoMmQyUXA4eVN0V0FVb2gyVzNJTnY4V1pmUEh0eGJ2a1ZzYnBHWHZpUEZZTDJvMnRRRmttMzhrYVZoY1JUM09ES2R2TGZoeExoanMxamFTVXRtRmZ2SFJKU3R2dWZoSFFuamx2MjZhM0tJcnk2dG5qVXMvRUtMVnVlbEsiLCJtYWMiOiJhNmYzZTZhNjgzODYyNDJiODA1MDNlOGQ2NDVkMTZiODU4Mjg4YzYzMmY3ZGZhMTVkMzVlZWZiNDc2OGQzMWVhIiwidGFnIjoiIn0%3D; expires=Wed, 23-Apr-2025 22:40:04 GMT; path=/; httponlylaravel_session=eyJpdiI6ImljVHZJVWlwMnRLWFFVTWdvMnZTM3c9PSIsInZhbHVlIjoiWm15RlFoMmQyUXA4eVN0V0FVb2gyVzNJTnY4V1pmUEh0eGJ2a1ZzYnBHWHZpUEZZTDJvMnRRRmttMzhrYVZoY1JU" ] ]
        session_attributes
        0 of 0
        array:5 [ "_token" => "CJ8CizBmZNBbGAhue1mUPV0c10zTygdIB58jQakr" "locale" => "ar" "_previous" => array:1 [ "url" => "https://www.corspedia.com/ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/cs125x:-advanced-distributed-machine-learning-with-apache-spark" ] "_flash" => array:2 [ "old" => [] "new" => [] ] "PHPDEBUGBAR_STACK_DATA" => [] ]