Évaluez et améliorez les performances d'un modèle de machine learning

Brought by: OpenClassrooms

Overview

‌Dans le cours Initiez-vous au machine learning, vous avez découvert les fondements de l'analyse de donnée automatisée. Dans ce deuxième cours, vous apprendrez à évaluer vos algorithmes pour les rendre plus performants.

De nombreux choix d'algorithmes d'apprentissage et de leurs hyperparamètres s'offrent aux Data Scientists. La nature du problème à résoudre permet en partie de guider ce choix. Par exemple, on n'appliquera pas un algorithme de classification à un problème de régression.

Néanmoins, il est nécessaire de savoir évaluer n'importe quel algorithme d'apprentissage sur son jeu de données, en évitant au mieux le biais de sur-apprentissage. Une évaluation rigoureuse des performances d'un algorithme est une étape indispensable à son déploiement.

Suivez ce cours pour apprendre à évaluer un modèle d'apprentissage supervisé afin de choisir le bon modèle pour votre problème, en évitant de tomber dans un des principaux pièges qui guettent les Data Scientists.

Prérequis :

Ce cours de Data Science se situe au croisement des mathématiques et de l'informatique. Pour en profiter pleinement, n'hésitez pas à vous rafraîchir la mémoire, avant ou pendant le cours, sur :

  • Python pour le calcul numérique que nous utiliserons dans la partie TP du cours (librairie numpy et création de graphes avec pyplot)
  • Quelques notions d'algèbre linéaire, telles que manipulation de vecteurs, multiplications de matrices, normes
  • Quelques notions de probabilités et statistiques, telles que distribution de loi de probabilité et variance
  • Le cours d'initiation au machine learning, afin d'avoir une meilleure idée du cycle global de travail d'un data scientist et comprendre où ce situe cette phase d'amélioration & mesure de performances

Syllabus

Part #1 - Évaluez vos modèles sans sur-apprentissage
1. Comprenez ce qui fait un bon modèle d’apprentissage
2. Mettez en place un cadre de validation croisée
3. TP – Sélectionnez le nombre de voisins dans un kNN
Activity: Implémentez une validation croisée

Part #2 - Évaluez un modèle de classification
1. Évaluez un algorithme de classification qui retourne des valeurs binaires
2. Évaluez un algorithme de classification qui retourne des scores
3. Comparez votre algorithme à des approches de classification naïves
Quiz: Partie 2

Part #3 - Évaluez un modèle de régression
1. Évaluez un algorithme de régression
2. Comparez votre algorithme à des approches de régression naïves
Activity: Sélectionnez le nombre de voisins dans un kNN pour une régression

Taught by

Chloé-Agathe Azencott

Évaluez et améliorez les performances d'un modèle de machine learning
Go to course

Évaluez et améliorez les performances d'un modèle de machine learning

Brought by: OpenClassrooms

  • OpenClassrooms
  • Free
  • French
  • Certificate Available
  • Available at any time
  • All
  • N/A
8.1.2PHP Version268msRequest Duration2MBMemory UsageGET en/courses/{slug}Route
    • Booting (173ms)
    • Application (94.05ms)
    • 1 x Booting (64.65%)
      173.12ms
      1 x Application (35.12%)
      94.05ms
      14 templates were rendered
      • public.courses.show (resources/views/public/courses/show.blade.php)3bladefile
        Params
        0
        course
        1
        links
        2
        config
      • public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        classes
      • public.courses.partials.details (resources/views/public/courses/partials/details.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        classes
      • public.layouts.main (resources/views/public/layouts/main.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.layouts.partials.meta (resources/views/public/layouts/partials/meta.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.layouts.partials.navbar (resources/views/public/layouts/partials/navbar.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.auth.profile.partials.links (resources/views/public/auth/profile/partials/links.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.layouts.partials.flash-session (resources/views/public/layouts/partials/flash-session.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      uri
      GET en/courses/{slug}
      middleware
      web, localize:en
      controller
      App\Http\Controllers\CourseController@show
      as
      en.courses.show
      namespace
      prefix
      /en
      where
      file
      app/Http/Controllers/CourseController.php:17-35
      6 statements were executed5.17ms
      • select * from `courses` where `slug_en` = 'évaluez-et-améliorez-les-performances-d\'un-modèle-de-machine-learning' limit 1
        4.19ms/app/Http/Controllers/CourseController.php:20corspedia
        Metadata
        Bindings
        • 0. évaluez-et-améliorez-les-performances-d'un-modèle-de-machine-learning
        Backtrace
        • 17. /app/Http/Controllers/CourseController.php:20
        • 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • update `courses` set `visitors` = `visitors` + 1, `courses`.`updated_at` = '2025-04-10 00:12:22' where `id` = 1929
        360μs/app/Http/Controllers/CourseController.php:21corspedia
        Metadata
        Bindings
        • 0. 2025-04-10 00:12:22
        • 1. 1929
        Backtrace
        • 17. /app/Http/Controllers/CourseController.php:21
        • 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select `id`, `name_en`, `name_ar`, `topic_id`, `slug_en`, `slug_ar` from `subjects` where `subjects`.`id` in (4)
        150μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select `id`, `name_en`, `name_ar`, `slug_en`, `slug_ar` from `topics` where `topics`.`id` in (1)
        120μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 25. /app/Http/Controllers/CourseController.php:23
        • 26. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 27. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 28. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 29. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `providers` where `providers`.`id` in (36) and `providers`.`deleted_at` is null
        170μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `html_files` where `html_files`.`id` = 1920 limit 1
        180μs/app/Models/Course.php:84corspedia
        Metadata
        Bindings
        • 0. 1920
        Backtrace
        • 21. /app/Models/Course.php:84
        • 28. view::public.courses.show:29
        • 30. /vendor/laravel/framework/src/Illuminate/Filesystem/Filesystem.php:125
        • 31. /vendor/laravel/framework/src/Illuminate/View/Engines/PhpEngine.php:58
        • 32. /vendor/laravel/framework/src/Illuminate/View/Engines/CompilerEngine.php:72
      App\Models\HtmlFile
      1
      App\Models\Provider
      1
      App\Models\Topic
      1
      App\Models\Subject
      1
      App\Models\Course
      1
        _token
        bwLPH8K1HLMpHJmP34YReqmW8Wr8DW1R0IWxNRSR
        locale
        en
        _previous
        array:1 [ "url" => "https://www.corspedia.com/en/courses/%C3%A9valuez-et-am%C3%A9liorez-les-perfor...
        _flash
        array:2 [ "old" => [] "new" => [] ]
        PHPDEBUGBAR_STACK_DATA
        []
        path_info
        /en/courses/%C3%A9valuez-et-am%C3%A9liorez-les-performances-d%27un-mod%C3%A8le-de-machine-learning
        status_code
        200
        
        status_text
        OK
        format
        html
        content_type
        text/html; charset=UTF-8
        request_query
        []
        
        request_request
        []
        
        request_headers
        0 of 0
        array:24 [ "cf-ipcountry" => array:1 [ 0 => "US" ] "cf-connecting-ip" => array:1 [ 0 => "18.119.11.179" ] "cdn-loop" => array:1 [ 0 => "cloudflare; loops=1" ] "x-forwarded-proto" => array:1 [ 0 => "https" ] "cf-visitor" => array:1 [ 0 => "{"scheme":"https"}" ] "sec-fetch-site" => array:1 [ 0 => "none" ] "accept" => array:1 [ 0 => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7" ] "user-agent" => array:1 [ 0 => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)" ] "upgrade-insecure-requests" => array:1 [ 0 => "1" ] "sec-ch-ua-platform" => array:1 [ 0 => ""Windows"" ] "sec-ch-ua-mobile" => array:1 [ 0 => "?0" ] "sec-ch-ua" => array:1 [ 0 => ""HeadlessChrome";v="129", "Not=A?Brand";v="8", "Chromium";v="129"" ] "cache-control" => array:1 [ 0 => "no-cache" ] "pragma" => array:1 [ 0 => "no-cache" ] "sec-fetch-dest" => array:1 [ 0 => "document" ] "cf-ray" => array:1 [ 0 => "92de083b0d8e870b-ORD" ] "accept-encoding" => array:1 [ 0 => "gzip, br" ] "priority" => array:1 [ 0 => "u=0, i" ] "sec-fetch-user" => array:1 [ 0 => "?1" ] "sec-fetch-mode" => array:1 [ 0 => "navigate" ] "x-forwarded-for" => array:1 [ 0 => "18.119.11.179" ] "host" => array:1 [ 0 => "www.corspedia.com" ] "content-length" => array:1 [ 0 => "" ] "content-type" => array:1 [ 0 => "" ] ]
        request_server
        0 of 0
        array:50 [ "USER" => "www-data" "HOME" => "/var/www" "HTTP_CF_IPCOUNTRY" => "US" "HTTP_CF_CONNECTING_IP" => "18.119.11.179" "HTTP_CDN_LOOP" => "cloudflare; loops=1" "HTTP_X_FORWARDED_PROTO" => "https" "HTTP_CF_VISITOR" => "{"scheme":"https"}" "HTTP_SEC_FETCH_SITE" => "none" "HTTP_ACCEPT" => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7" "HTTP_USER_AGENT" => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)" "HTTP_UPGRADE_INSECURE_REQUESTS" => "1" "HTTP_SEC_CH_UA_PLATFORM" => ""Windows"" "HTTP_SEC_CH_UA_MOBILE" => "?0" "HTTP_SEC_CH_UA" => ""HeadlessChrome";v="129", "Not=A?Brand";v="8", "Chromium";v="129"" "HTTP_CACHE_CONTROL" => "no-cache" "HTTP_PRAGMA" => "no-cache" "HTTP_SEC_FETCH_DEST" => "document" "HTTP_CF_RAY" => "92de083b0d8e870b-ORD" "HTTP_ACCEPT_ENCODING" => "gzip, br" "HTTP_PRIORITY" => "u=0, i" "HTTP_SEC_FETCH_USER" => "?1" "HTTP_SEC_FETCH_MODE" => "navigate" "HTTP_X_FORWARDED_FOR" => "18.119.11.179" "HTTP_HOST" => "www.corspedia.com" "REDIRECT_STATUS" => "200" "SERVER_NAME" => "corspedia.com" "SERVER_PORT" => "443" "SERVER_ADDR" => "141.95.147.152" "REMOTE_USER" => "" "REMOTE_PORT" => "16526" "REMOTE_ADDR" => "172.70.131.174" "SERVER_SOFTWARE" => "nginx/1.18.0" "GATEWAY_INTERFACE" => "CGI/1.1" "HTTPS" => "on" "REQUEST_SCHEME" => "https" "SERVER_PROTOCOL" => "HTTP/2.0" "DOCUMENT_ROOT" => "/var/www/corspedia/public" "DOCUMENT_URI" => "/index.php" "REQUEST_URI" => "/en/courses/%C3%A9valuez-et-am%C3%A9liorez-les-performances-d%27un-mod%C3%A8le-de-machine-learning" "SCRIPT_NAME" => "/index.php" "CONTENT_LENGTH" => "" "CONTENT_TYPE" => "" "REQUEST_METHOD" => "GET" "QUERY_STRING" => "" "SCRIPT_FILENAME" => "/var/www/corspedia/public/index.php" "PATH_INFO" => "" "FCGI_ROLE" => "RESPONDER" "PHP_SELF" => "/index.php" "REQUEST_TIME_FLOAT" => 1744243941.8815 "REQUEST_TIME" => 1744243941 ]
        request_cookies
        []
        
        response_headers
        0 of 0
        array:5 [ "content-type" => array:1 [ 0 => "text/html; charset=UTF-8" ] "cache-control" => array:1 [ 0 => "no-cache, private" ] "date" => array:1 [ 0 => "Thu, 10 Apr 2025 00:12:22 GMT" ] "set-cookie" => array:2 [ 0 => "XSRF-TOKEN=eyJpdiI6Ii9ha3VyZ1luK2pvNTFwQzZWV1Bnc1E9PSIsInZhbHVlIjoiaGJRaWcrNk9xTzFCZ0srTklIU2FTek9rWlFudVJOOVE5YTJtMUo1VSs4WDRIZXp6NHJiUVVmT3pHUm1HV3dzbFhER3d4d1RYdFRZUUtSMjAyelY0WngrZC9zVWNIZlhubWRDVlRra1RWY3FXdzdVbmFZclNTdllGdXRYY1Z5UDIiLCJtYWMiOiI3OTVjNzYwYjQ3OGFhOGYxOTczY2IxYTMxY2RlMTNmODVlZDRiMzVjMTVlZTc5Nzc4Yjk3NTU2ZTBlYWU3OWU3IiwidGFnIjoiIn0%3D; expires=Thu, 10 Apr 2025 02:12:22 GMT; Max-Age=7200; path=/; samesite=laxXSRF-TOKEN=eyJpdiI6Ii9ha3VyZ1luK2pvNTFwQzZWV1Bnc1E9PSIsInZhbHVlIjoiaGJRaWcrNk9xTzFCZ0srTklIU2FTek9rWlFudVJOOVE5YTJtMUo1VSs4WDRIZXp6NHJiUVVmT3pHUm1HV3dzbFhER3d4d" 1 => "laravel_session=eyJpdiI6Im95eEZjQStMYnhnOERvaXN0b2c4dUE9PSIsInZhbHVlIjoiTE0zVTRjTnNXbFZaMjdaNnJBbFN4a0tBd25oUm5rS3Y0WjFBQWlPbHFrMFI0N0lNbHdCZE8ybG1sT2tmdkNkODV0SVU1UnJtTkhiTXB3dUw2RXdWSjZLQXozM1VDZm1pbVkvUXNYT1hMS2FaS2RRK05zaWQwSVRZT1RxdTlUTGkiLCJtYWMiOiI1MjFiOTAwNjIxOWUwZGQwYjRmNWYwMzdjYWQ5ODNjOTBhODBhNWQwZDAyMGYyOGFmZjE1MjAwNDgwNjJiMDk5IiwidGFnIjoiIn0%3D; expires=Thu, 10 Apr 2025 02:12:22 GMT; Max-Age=7200; path=/; httponly; samesite=laxlaravel_session=eyJpdiI6Im95eEZjQStMYnhnOERvaXN0b2c4dUE9PSIsInZhbHVlIjoiTE0zVTRjTnNXbFZaMjdaNnJBbFN4a0tBd25oUm5rS3Y0WjFBQWlPbHFrMFI0N0lNbHdCZE8ybG1sT2tmdkNkODV0" ] "Set-Cookie" => array:2 [ 0 => "XSRF-TOKEN=eyJpdiI6Ii9ha3VyZ1luK2pvNTFwQzZWV1Bnc1E9PSIsInZhbHVlIjoiaGJRaWcrNk9xTzFCZ0srTklIU2FTek9rWlFudVJOOVE5YTJtMUo1VSs4WDRIZXp6NHJiUVVmT3pHUm1HV3dzbFhER3d4d1RYdFRZUUtSMjAyelY0WngrZC9zVWNIZlhubWRDVlRra1RWY3FXdzdVbmFZclNTdllGdXRYY1Z5UDIiLCJtYWMiOiI3OTVjNzYwYjQ3OGFhOGYxOTczY2IxYTMxY2RlMTNmODVlZDRiMzVjMTVlZTc5Nzc4Yjk3NTU2ZTBlYWU3OWU3IiwidGFnIjoiIn0%3D; expires=Thu, 10-Apr-2025 02:12:22 GMT; path=/XSRF-TOKEN=eyJpdiI6Ii9ha3VyZ1luK2pvNTFwQzZWV1Bnc1E9PSIsInZhbHVlIjoiaGJRaWcrNk9xTzFCZ0srTklIU2FTek9rWlFudVJOOVE5YTJtMUo1VSs4WDRIZXp6NHJiUVVmT3pHUm1HV3dzbFhER3d4d" 1 => "laravel_session=eyJpdiI6Im95eEZjQStMYnhnOERvaXN0b2c4dUE9PSIsInZhbHVlIjoiTE0zVTRjTnNXbFZaMjdaNnJBbFN4a0tBd25oUm5rS3Y0WjFBQWlPbHFrMFI0N0lNbHdCZE8ybG1sT2tmdkNkODV0SVU1UnJtTkhiTXB3dUw2RXdWSjZLQXozM1VDZm1pbVkvUXNYT1hMS2FaS2RRK05zaWQwSVRZT1RxdTlUTGkiLCJtYWMiOiI1MjFiOTAwNjIxOWUwZGQwYjRmNWYwMzdjYWQ5ODNjOTBhODBhNWQwZDAyMGYyOGFmZjE1MjAwNDgwNjJiMDk5IiwidGFnIjoiIn0%3D; expires=Thu, 10-Apr-2025 02:12:22 GMT; path=/; httponlylaravel_session=eyJpdiI6Im95eEZjQStMYnhnOERvaXN0b2c4dUE9PSIsInZhbHVlIjoiTE0zVTRjTnNXbFZaMjdaNnJBbFN4a0tBd25oUm5rS3Y0WjFBQWlPbHFrMFI0N0lNbHdCZE8ybG1sT2tmdkNkODV0" ] ]
        session_attributes
        0 of 0
        array:5 [ "_token" => "bwLPH8K1HLMpHJmP34YReqmW8Wr8DW1R0IWxNRSR" "locale" => "en" "_previous" => array:1 [ "url" => "https://www.corspedia.com/en/courses/%C3%A9valuez-et-am%C3%A9liorez-les-performances-d%27un-mod%C3%A8le-de-machine-learning" ] "_flash" => array:2 [ "old" => [] "new" => [] ] "PHPDEBUGBAR_STACK_DATA" => [] ]