Sequence Models

Brought by: Coursera

Overview

In the fifth course of the Deep Learning Specialization, you will become familiar with sequence models and their exciting applications such as speech recognition, music synthesis, chatbots, machine translation, natural language processing (NLP), and more.

By the end, you will be able to build and train Recurrent Neural Networks (RNNs) and commonly-used variants such as GRUs and LSTMs; apply RNNs to Character-level Language Modeling; gain experience with natural language processing and Word Embeddings; and use HuggingFace tokenizers and transformer models to solve different NLP tasks such as NER and Question Answering.

The Deep Learning Specialization is a foundational program that will help you understand the capabilities, challenges, and consequences of deep learning and prepare you to participate in the development of leading-edge AI technology. It provides a pathway for you to take the definitive step in the world of AI by helping you gain the knowledge and skills to level up your career.

Syllabus

  • Recurrent Neural Networks
    • Discover recurrent neural networks, a type of model that performs extremely well on temporal data, and several of its variants, including LSTMs, GRUs and Bidirectional RNNs,
  • Natural Language Processing & Word Embeddings
    • Natural language processing with deep learning is a powerful combination. Using word vector representations and embedding layers, train recurrent neural networks with outstanding performance across a wide variety of applications, including sentiment analysis, named entity recognition and neural machine translation.
  • Sequence Models & Attention Mechanism
    • Augment your sequence models using an attention mechanism, an algorithm that helps your model decide where to focus its attention given a sequence of inputs. Then, explore speech recognition and how to deal with audio data.
  • Transformer Network

Taught by

Andrew Ng

Sequence Models
Go to course

Sequence Models

Brought by: Coursera

  • Coursera
  • Free
  • English
  • Certificate Available
  • Available at any time
  • intermediate
  • Chinese, Arabic, French, Portuguese, Italian, German, Russian, English, Spanish, Korean, Thai, Indonesian, Kazakh, Hindi, Swedish, Greek, Ukrainian, Japanese, Polish, Dutch, Turkish
8.1.2PHP Version301msRequest Duration2MBMemory UsageGET en/courses/{slug}Route
    • Booting (190ms)
    • Application (111ms)
    • 1 x Booting (62.97%)
      189.58ms
      1 x Application (36.78%)
      110.73ms
      14 templates were rendered
      • public.courses.show (resources/views/public/courses/show.blade.php)3bladefile
        Params
        0
        course
        1
        links
        2
        config
      • public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        classes
      • public.courses.partials.details (resources/views/public/courses/partials/details.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        classes
      • public.layouts.main (resources/views/public/layouts/main.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.layouts.partials.meta (resources/views/public/layouts/partials/meta.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.layouts.partials.navbar (resources/views/public/layouts/partials/navbar.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.auth.profile.partials.links (resources/views/public/auth/profile/partials/links.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.layouts.partials.flash-session (resources/views/public/layouts/partials/flash-session.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      uri
      GET en/courses/{slug}
      middleware
      web, localize:en
      controller
      App\Http\Controllers\CourseController@show
      as
      en.courses.show
      namespace
      prefix
      /en
      where
      file
      app/Http/Controllers/CourseController.php:17-35
      7 statements were executed5.46ms
      • select * from `courses` where `slug_en` = 'sequence-models' limit 1
        3.67ms/app/Http/Controllers/CourseController.php:20corspedia
        Metadata
        Bindings
        • 0. sequence-models
        Backtrace
        • 17. /app/Http/Controllers/CourseController.php:20
        • 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • update `courses` set `visitors` = `visitors` + 1, `courses`.`updated_at` = '2025-04-22 09:38:52' where `id` = 690
        570μs/app/Http/Controllers/CourseController.php:21corspedia
        Metadata
        Bindings
        • 0. 2025-04-22 09:38:52
        • 1. 690
        Backtrace
        • 17. /app/Http/Controllers/CourseController.php:21
        • 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select `id`, `name_en`, `name_ar`, `topic_id`, `slug_en`, `slug_ar` from `subjects` where `subjects`.`id` in (36)
        270μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select `id`, `name_en`, `name_ar`, `slug_en`, `slug_ar` from `topics` where `topics`.`id` in (1)
        140μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 25. /app/Http/Controllers/CourseController.php:23
        • 26. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 27. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 28. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 29. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `institutions` where `institutions`.`id` in (34) and `institutions`.`deleted_at` is null
        180μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `providers` where `providers`.`id` in (2) and `providers`.`deleted_at` is null
        150μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `html_files` where `html_files`.`id` = 684 limit 1
        480μs/app/Models/Course.php:84corspedia
        Metadata
        Bindings
        • 0. 684
        Backtrace
        • 21. /app/Models/Course.php:84
        • 28. view::public.courses.show:29
        • 30. /vendor/laravel/framework/src/Illuminate/Filesystem/Filesystem.php:125
        • 31. /vendor/laravel/framework/src/Illuminate/View/Engines/PhpEngine.php:58
        • 32. /vendor/laravel/framework/src/Illuminate/View/Engines/CompilerEngine.php:72
      App\Models\HtmlFile
      1
      App\Models\Provider
      1
      App\Models\Institution
      1
      App\Models\Topic
      1
      App\Models\Subject
      1
      App\Models\Course
      1
        _token
        vVzcGnHdmeMINCBSlZXavWg09T1SVLDo6Q6u2EvP
        locale
        en
        _previous
        array:1 [ "url" => "https://www.corspedia.com/en/courses/sequence-models" ]
        _flash
        array:2 [ "old" => [] "new" => [] ]
        PHPDEBUGBAR_STACK_DATA
        []
        path_info
        /en/courses/sequence-models
        status_code
        200
        
        status_text
        OK
        format
        html
        content_type
        text/html; charset=UTF-8
        request_query
        []
        
        request_request
        []
        
        request_headers
        0 of 0
        array:24 [ "cf-ipcountry" => array:1 [ 0 => "US" ] "cf-connecting-ip" => array:1 [ 0 => "3.141.2.184" ] "cdn-loop" => array:1 [ 0 => "cloudflare; loops=1" ] "x-forwarded-proto" => array:1 [ 0 => "https" ] "cf-visitor" => array:1 [ 0 => "{"scheme":"https"}" ] "sec-fetch-site" => array:1 [ 0 => "none" ] "accept" => array:1 [ 0 => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7" ] "user-agent" => array:1 [ 0 => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)" ] "upgrade-insecure-requests" => array:1 [ 0 => "1" ] "sec-ch-ua-platform" => array:1 [ 0 => ""Windows"" ] "sec-ch-ua-mobile" => array:1 [ 0 => "?0" ] "sec-ch-ua" => array:1 [ 0 => ""HeadlessChrome";v="129", "Not=A?Brand";v="8", "Chromium";v="129"" ] "cache-control" => array:1 [ 0 => "no-cache" ] "pragma" => array:1 [ 0 => "no-cache" ] "sec-fetch-dest" => array:1 [ 0 => "document" ] "cf-ray" => array:1 [ 0 => "93442691c90a620c-ORD" ] "accept-encoding" => array:1 [ 0 => "gzip, br" ] "priority" => array:1 [ 0 => "u=0, i" ] "sec-fetch-user" => array:1 [ 0 => "?1" ] "sec-fetch-mode" => array:1 [ 0 => "navigate" ] "x-forwarded-for" => array:1 [ 0 => "3.141.2.184" ] "host" => array:1 [ 0 => "www.corspedia.com" ] "content-length" => array:1 [ 0 => "" ] "content-type" => array:1 [ 0 => "" ] ]
        request_server
        0 of 0
        array:50 [ "USER" => "www-data" "HOME" => "/var/www" "HTTP_CF_IPCOUNTRY" => "US" "HTTP_CF_CONNECTING_IP" => "3.141.2.184" "HTTP_CDN_LOOP" => "cloudflare; loops=1" "HTTP_X_FORWARDED_PROTO" => "https" "HTTP_CF_VISITOR" => "{"scheme":"https"}" "HTTP_SEC_FETCH_SITE" => "none" "HTTP_ACCEPT" => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7" "HTTP_USER_AGENT" => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)" "HTTP_UPGRADE_INSECURE_REQUESTS" => "1" "HTTP_SEC_CH_UA_PLATFORM" => ""Windows"" "HTTP_SEC_CH_UA_MOBILE" => "?0" "HTTP_SEC_CH_UA" => ""HeadlessChrome";v="129", "Not=A?Brand";v="8", "Chromium";v="129"" "HTTP_CACHE_CONTROL" => "no-cache" "HTTP_PRAGMA" => "no-cache" "HTTP_SEC_FETCH_DEST" => "document" "HTTP_CF_RAY" => "93442691c90a620c-ORD" "HTTP_ACCEPT_ENCODING" => "gzip, br" "HTTP_PRIORITY" => "u=0, i" "HTTP_SEC_FETCH_USER" => "?1" "HTTP_SEC_FETCH_MODE" => "navigate" "HTTP_X_FORWARDED_FOR" => "3.141.2.184" "HTTP_HOST" => "www.corspedia.com" "REDIRECT_STATUS" => "200" "SERVER_NAME" => "corspedia.com" "SERVER_PORT" => "443" "SERVER_ADDR" => "141.95.147.152" "REMOTE_USER" => "" "REMOTE_PORT" => "37096" "REMOTE_ADDR" => "172.69.7.121" "SERVER_SOFTWARE" => "nginx/1.18.0" "GATEWAY_INTERFACE" => "CGI/1.1" "HTTPS" => "on" "REQUEST_SCHEME" => "https" "SERVER_PROTOCOL" => "HTTP/2.0" "DOCUMENT_ROOT" => "/var/www/corspedia/public" "DOCUMENT_URI" => "/index.php" "REQUEST_URI" => "/en/courses/sequence-models" "SCRIPT_NAME" => "/index.php" "CONTENT_LENGTH" => "" "CONTENT_TYPE" => "" "REQUEST_METHOD" => "GET" "QUERY_STRING" => "" "SCRIPT_FILENAME" => "/var/www/corspedia/public/index.php" "PATH_INFO" => "" "FCGI_ROLE" => "RESPONDER" "PHP_SELF" => "/index.php" "REQUEST_TIME_FLOAT" => 1745314732.0793 "REQUEST_TIME" => 1745314732 ]
        request_cookies
        []
        
        response_headers
        0 of 0
        array:5 [ "content-type" => array:1 [ 0 => "text/html; charset=UTF-8" ] "cache-control" => array:1 [ 0 => "no-cache, private" ] "date" => array:1 [ 0 => "Tue, 22 Apr 2025 09:38:52 GMT" ] "set-cookie" => array:2 [ 0 => "XSRF-TOKEN=eyJpdiI6IjlYQW9lVTh0YzNLMC9PdGI1S2RJcnc9PSIsInZhbHVlIjoiRmRyVm1aa1BidFhPa1Q0ZGNSQ3V6U0hGZXBFSmxZVGs2eGExeTJIcmJUbjRGbmh6b0hvNFB6THNKa3JrNUVVN3Exa092SFpFOFZPWEZIanVsM2Q0ZTFxMzB4MjU4ZGFDL1dxVU9VeDgyalhaaWoyQm1LUENLN2plT1hHMVpZK2EiLCJtYWMiOiJiN2U4MDNhMGRlODVkODk5N2E2MWQ2N2JiZTU3M2Q5ZGJkYmZjNTdjYWQwNmI1NDFmNTFhNjI2NTE3YzA4NWI3IiwidGFnIjoiIn0%3D; expires=Tue, 22 Apr 2025 11:38:52 GMT; Max-Age=7200; path=/; samesite=laxXSRF-TOKEN=eyJpdiI6IjlYQW9lVTh0YzNLMC9PdGI1S2RJcnc9PSIsInZhbHVlIjoiRmRyVm1aa1BidFhPa1Q0ZGNSQ3V6U0hGZXBFSmxZVGs2eGExeTJIcmJUbjRGbmh6b0hvNFB6THNKa3JrNUVVN3Exa092S" 1 => "laravel_session=eyJpdiI6IlM1VjJaSlhMdzZsRi9ONEI4ekNQYWc9PSIsInZhbHVlIjoiN1B0c0gzbEZTYVhaeVdpS0o3ZVhycnNzWjh1Z1JvN1lUZFltbWNnRHlLdkZFemVUVTQyT21mYzRkYkhJZ20zZXRmV2lEcmNaVGR4T3E0ZGNhNGd4VW9zSDA5NkRJYkk0cFRpNjlzYWlUb3owZTFEemhzdG5kZVl0RE9OR2EzbEkiLCJtYWMiOiI3N2ZkYzdkZDg1ZDNlYTI0MmI2YmRiYmE0NWVhM2QzNjg4MzUzNGE0M2YyMjY1NDQxNWExMTM2ZjUxNjI3NWEzIiwidGFnIjoiIn0%3D; expires=Tue, 22 Apr 2025 11:38:52 GMT; Max-Age=7200; path=/; httponly; samesite=laxlaravel_session=eyJpdiI6IlM1VjJaSlhMdzZsRi9ONEI4ekNQYWc9PSIsInZhbHVlIjoiN1B0c0gzbEZTYVhaeVdpS0o3ZVhycnNzWjh1Z1JvN1lUZFltbWNnRHlLdkZFemVUVTQyT21mYzRkYkhJZ20zZXRm" ] "Set-Cookie" => array:2 [ 0 => "XSRF-TOKEN=eyJpdiI6IjlYQW9lVTh0YzNLMC9PdGI1S2RJcnc9PSIsInZhbHVlIjoiRmRyVm1aa1BidFhPa1Q0ZGNSQ3V6U0hGZXBFSmxZVGs2eGExeTJIcmJUbjRGbmh6b0hvNFB6THNKa3JrNUVVN3Exa092SFpFOFZPWEZIanVsM2Q0ZTFxMzB4MjU4ZGFDL1dxVU9VeDgyalhaaWoyQm1LUENLN2plT1hHMVpZK2EiLCJtYWMiOiJiN2U4MDNhMGRlODVkODk5N2E2MWQ2N2JiZTU3M2Q5ZGJkYmZjNTdjYWQwNmI1NDFmNTFhNjI2NTE3YzA4NWI3IiwidGFnIjoiIn0%3D; expires=Tue, 22-Apr-2025 11:38:52 GMT; path=/XSRF-TOKEN=eyJpdiI6IjlYQW9lVTh0YzNLMC9PdGI1S2RJcnc9PSIsInZhbHVlIjoiRmRyVm1aa1BidFhPa1Q0ZGNSQ3V6U0hGZXBFSmxZVGs2eGExeTJIcmJUbjRGbmh6b0hvNFB6THNKa3JrNUVVN3Exa092S" 1 => "laravel_session=eyJpdiI6IlM1VjJaSlhMdzZsRi9ONEI4ekNQYWc9PSIsInZhbHVlIjoiN1B0c0gzbEZTYVhaeVdpS0o3ZVhycnNzWjh1Z1JvN1lUZFltbWNnRHlLdkZFemVUVTQyT21mYzRkYkhJZ20zZXRmV2lEcmNaVGR4T3E0ZGNhNGd4VW9zSDA5NkRJYkk0cFRpNjlzYWlUb3owZTFEemhzdG5kZVl0RE9OR2EzbEkiLCJtYWMiOiI3N2ZkYzdkZDg1ZDNlYTI0MmI2YmRiYmE0NWVhM2QzNjg4MzUzNGE0M2YyMjY1NDQxNWExMTM2ZjUxNjI3NWEzIiwidGFnIjoiIn0%3D; expires=Tue, 22-Apr-2025 11:38:52 GMT; path=/; httponlylaravel_session=eyJpdiI6IlM1VjJaSlhMdzZsRi9ONEI4ekNQYWc9PSIsInZhbHVlIjoiN1B0c0gzbEZTYVhaeVdpS0o3ZVhycnNzWjh1Z1JvN1lUZFltbWNnRHlLdkZFemVUVTQyT21mYzRkYkhJZ20zZXRm" ] ]
        session_attributes
        0 of 0
        array:5 [ "_token" => "vVzcGnHdmeMINCBSlZXavWg09T1SVLDo6Q6u2EvP" "locale" => "en" "_previous" => array:1 [ "url" => "https://www.corspedia.com/en/courses/sequence-models" ] "_flash" => array:2 [ "old" => [] "new" => [] ] "PHPDEBUGBAR_STACK_DATA" => [] ]