Attention Mechanism

بواسطة: Coursera

Overview

This course will introduce you to the attention mechanism, a powerful technique that allows neural networks to focus on specific parts of an input sequence. You will learn how attention works, and how it can be used to improve the performance of a variety of machine learning tasks, including machine translation, text summarization, and question answering.

Syllabus

Introduction

In this module you will learn how attention works, and how it can be used to improve the performance of a variety of machine learning tasks, including machine translation, text summarization, and question answering.

Taught by

Google Cloud Training

Computer Science / Neural Networks

الذهاب الي الدورة

Attention Mechanism

بواسطة: Coursera

Coursera
مجانية
الإنجليزية
متاح شهادة
متاح في أي وقت
الجميع
English

Messages Timeline Exceptions Views14 Route Queries7 Models6 Gate Session Request

8.1.2207ms2MBGET ar/الدورات/{slug}

Booting (124ms)
Application (82.45ms)
1 x Booting (59.96%)
124.25ms
1 x Application (39.79%)
82.45ms

14 templates were rendered

public.courses.show (resources/views/public/courses/show.blade.php)3bladefile
Params
0
course
1
links
2
config
public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
6
classes
public.courses.partials.details (resources/views/public/courses/partials/details.blade.php)6bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
6
classes
public.layouts.main (resources/views/public/layouts/main.blade.php)6bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
public.layouts.partials.meta (resources/views/public/layouts/partials/meta.blade.php)6bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
public.layouts.partials.navbar (resources/views/public/layouts/partials/navbar.blade.php)6bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
public.auth.profile.partials.links (resources/views/public/auth/profile/partials/links.blade.php)6bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
6
route
7
title
public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
6
route
7
title
public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
6
route
7
title
public.layouts.partials.flash-session (resources/views/public/layouts/partials/flash-session.blade.php)6bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config

Params
0	`course`
1	`links`
2	`config`

Params
0	`__env`
1	`app`
2	`errors`
3	`course`
4	`links`
5	`config`

Params
0	`__env`
1	`app`
2	`errors`
3	`course`
4	`links`
5	`config`
6	`classes`

Params
0	`__env`
1	`app`
2	`errors`
3	`course`
4	`links`
5	`config`

Params
0	`__env`
1	`app`
2	`errors`
3	`course`
4	`links`
5	`config`

Params
0	`__env`
1	`app`
2	`errors`
3	`course`
4	`links`
5	`config`
6	`classes`

Params
0	`__env`
1	`app`
2	`errors`
3	`course`
4	`links`
5	`config`

Params
0	`__env`
1	`app`
2	`errors`
3	`course`
4	`links`
5	`config`

Params
0	`__env`
1	`app`
2	`errors`
3	`course`
4	`links`
5	`config`

Params
0	`__env`
1	`app`
2	`errors`
3	`course`
4	`links`
5	`config`

Params
0	`__env`
1	`app`
2	`errors`
3	`course`
4	`links`
5	`config`
6	`route`
7	`title`

Params
0	`__env`
1	`app`
2	`errors`
3	`course`
4	`links`
5	`config`
6	`route`
7	`title`

Params
0	`__env`
1	`app`
2	`errors`
3	`course`
4	`links`
5	`config`
6	`route`
7	`title`

Params
0	`__env`
1	`app`
2	`errors`
3	`course`
4	`links`
5	`config`

uri: GET ar/الدورات/{slug}
middleware: web, localize:ar
controller: App\Http\Controllers\CourseController@show
as: ar.courses.show
namespace
prefix: /ar
where
file: app/Http/Controllers/CourseController.php:17-35

7 statements were executed4.46ms

select * from `courses` where `slug_ar` = 'attention-mechanism' limit 1

2.39ms/app/Http/Controllers/CourseController.php:20corspedia

Metadata
Bindings	0. attention-mechanism
Backtrace	17. /app/Http/Controllers/CourseController.php:20 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205

update `courses` set `visitors` = `visitors` + 1, `courses`.`updated_at` = '2025-04-12 02:06:50' where `id` = 530

850μs/app/Http/Controllers/CourseController.php:21corspedia

Metadata
Bindings	0. 2025-04-12 02:06:50 1. 530
Backtrace	17. /app/Http/Controllers/CourseController.php:21 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205

select `id`, `name_en`, `name_ar`, `topic_id`, `slug_en`, `slug_ar` from `subjects` where `subjects`.`id` in (59)

190μs/app/Http/Controllers/CourseController.php:23corspedia

Metadata
Backtrace	20. /app/Http/Controllers/CourseController.php:23 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205

select `id`, `name_en`, `name_ar`, `slug_en`, `slug_ar` from `topics` where `topics`.`id` in (1)

170μs/app/Http/Controllers/CourseController.php:23corspedia

Metadata
Backtrace	25. /app/Http/Controllers/CourseController.php:23 26. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54 27. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43 28. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260 29. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205

select * from `institutions` where `institutions`.`id` in (54) and `institutions`.`deleted_at` is null

200μs/app/Http/Controllers/CourseController.php:23corspedia

Metadata
Backtrace	20. /app/Http/Controllers/CourseController.php:23 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205

select * from `providers` where `providers`.`id` in (2) and `providers`.`deleted_at` is null

190μs/app/Http/Controllers/CourseController.php:23corspedia

Metadata
Backtrace	20. /app/Http/Controllers/CourseController.php:23 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205

select * from `html_files` where `html_files`.`id` = 524 limit 1

470μs/app/Models/Course.php:84corspedia

Metadata
Bindings	0. 524
Backtrace	21. /app/Models/Course.php:84 28. view::public.courses.show:29 30. /vendor/laravel/framework/src/Illuminate/Filesystem/Filesystem.php:125 31. /vendor/laravel/framework/src/Illuminate/View/Engines/PhpEngine.php:58 32. /vendor/laravel/framework/src/Illuminate/View/Engines/CompilerEngine.php:72

App\Models\HtmlFile: 1
App\Models\Provider: 1
App\Models\Institution: 1
App\Models\Topic: 1
App\Models\Subject: 1
App\Models\Course: 1

_token: WCxYyhNC1QGO6NwmBBLjCLG1G1At7czCQSH4l0j1
locale: ar
_previous: array:1 [ "url" => "https://www.corspedia.com/ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/attent...
_flash: array:2 [ "old" => [] "new" => [] ]
PHPDEBUGBAR_STACK_DATA: []

path_info

/ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/attention-mechanism

status_code

status_text

format

html

content_type

text/html; charset=UTF-8

request_query

[]

request_request

[]

request_headers

  0 of 0   
array:24 [▼
  "sec-ch-ua-mobile" => array:1 [▶
    0 => "?0"
  ]
  "sec-ch-ua" => array:1 [▶
    0 => ""HeadlessChrome";v="129", "Not=A?Brand";v="8", "Chromium";v="129""
  ]
  "cache-control" => array:1 [▶
    0 => "no-cache"
  ]
  "pragma" => array:1 [▶
    0 => "no-cache"
  ]
  "upgrade-insecure-requests" => array:1 [▶
    0 => "1"
  ]
  "priority" => array:1 [▶
    0 => "u=0, i"
  ]
  "user-agent" => array:1 [▶
    0 => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)"
  ]
  "cf-ipcountry" => array:1 [▶
    0 => "US"
  ]
  "cf-connecting-ip" => array:1 [▶
    0 => "18.191.112.81"
  ]
  "accept" => array:1 [▶
    0 => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7"
  ]
  "sec-fetch-site" => array:1 [▶
    0 => "none"
  ]
  "cf-visitor" => array:1 [▶
    0 => "{"scheme":"https"}"
  ]
  "sec-fetch-mode" => array:1 [▶
    0 => "navigate"
  ]
  "sec-fetch-user" => array:1 [▶
    0 => "?1"
  ]
  "x-forwarded-proto" => array:1 [▶
    0 => "https"
  ]
  "cdn-loop" => array:1 [▶
    0 => "cloudflare; loops=1"
  ]
  "accept-encoding" => array:1 [▶
    0 => "gzip, br"
  ]
  "sec-fetch-dest" => array:1 [▶
    0 => "document"
  ]
  "sec-ch-ua-platform" => array:1 [▶
    0 => ""Windows""
  ]
  "x-forwarded-for" => array:1 [▶
    0 => "18.191.112.81"
  ]
  "cf-ray" => array:1 [▶
    0 => "92ef2aad3e93a3db-ORD"
  ]
  "host" => array:1 [▶
    0 => "www.corspedia.com"
  ]
  "content-length" => array:1 [▶
    0 => ""
  ]
  "content-type" => array:1 [▶
    0 => ""
  ]
]

request_server

  0 of 0   
array:50 [▼
  "USER" => "www-data"
  "HOME" => "/var/www"
  "HTTP_SEC_CH_UA_MOBILE" => "?0"
  "HTTP_SEC_CH_UA" => ""HeadlessChrome";v="129", "Not=A?Brand";v="8", "Chromium";v="129""
  "HTTP_CACHE_CONTROL" => "no-cache"
  "HTTP_PRAGMA" => "no-cache"
  "HTTP_UPGRADE_INSECURE_REQUESTS" => "1"
  "HTTP_PRIORITY" => "u=0, i"
  "HTTP_USER_AGENT" => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)"
  "HTTP_CF_IPCOUNTRY" => "US"
  "HTTP_CF_CONNECTING_IP" => "18.191.112.81"
  "HTTP_ACCEPT" => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7"
  "HTTP_SEC_FETCH_SITE" => "none"
  "HTTP_CF_VISITOR" => "{"scheme":"https"}"
  "HTTP_SEC_FETCH_MODE" => "navigate"
  "HTTP_SEC_FETCH_USER" => "?1"
  "HTTP_X_FORWARDED_PROTO" => "https"
  "HTTP_CDN_LOOP" => "cloudflare; loops=1"
  "HTTP_ACCEPT_ENCODING" => "gzip, br"
  "HTTP_SEC_FETCH_DEST" => "document"
  "HTTP_SEC_CH_UA_PLATFORM" => ""Windows""
  "HTTP_X_FORWARDED_FOR" => "18.191.112.81"
  "HTTP_CF_RAY" => "92ef2aad3e93a3db-ORD"
  "HTTP_HOST" => "www.corspedia.com"
  "REDIRECT_STATUS" => "200"
  "SERVER_NAME" => "corspedia.com"
  "SERVER_PORT" => "443"
  "SERVER_ADDR" => "141.95.147.152"
  "REMOTE_USER" => ""
  "REMOTE_PORT" => "44736"
  "REMOTE_ADDR" => "172.69.7.93"
  "SERVER_SOFTWARE" => "nginx/1.18.0"
  "GATEWAY_INTERFACE" => "CGI/1.1"
  "HTTPS" => "on"
  "REQUEST_SCHEME" => "https"
  "SERVER_PROTOCOL" => "HTTP/2.0"
  "DOCUMENT_ROOT" => "/var/www/corspedia/public"
  "DOCUMENT_URI" => "/index.php"
  "REQUEST_URI" => "/ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/attention-mechanism"
  "SCRIPT_NAME" => "/index.php"
  "CONTENT_LENGTH" => ""
  "CONTENT_TYPE" => ""
  "REQUEST_METHOD" => "GET"
  "QUERY_STRING" => ""
  "SCRIPT_FILENAME" => "/var/www/corspedia/public/index.php"
  "PATH_INFO" => ""
  "FCGI_ROLE" => "RESPONDER"
  "PHP_SELF" => "/index.php"
  "REQUEST_TIME_FLOAT" => 1744423610.6855
  "REQUEST_TIME" => 1744423610
]

request_cookies

[]

response_headers

  0 of 0   
array:5 [▼
  "content-type" => array:1 [▶
    0 => "text/html; charset=UTF-8"
  ]
  "cache-control" => array:1 [▶
    0 => "no-cache, private"
  ]
  "date" => array:1 [▶
    0 => "Sat, 12 Apr 2025 02:06:50 GMT"
  ]
  "set-cookie" => array:2 [▶
    0 => "XSRF-TOKEN=eyJpdiI6IkgwQ29LVHo3RzFqOHNCZEZYTUhHeUE9PSIsInZhbHVlIjoiNHZINHl1SWhwbnVqZng1dHFkQ2dPaHBuMjNsZGdiblJrdFFvNkl2L3ZQY1M1aVM4TWNRSU13RWxPSGFFaTFjRWdrQlJZMlpST1cxNFIzMGlPZkh4TmV4K24zQXl5ZGtRMEZUeDJuTzJSV0pQRWxhaTFSWGQxc0doa05GTVN6WEwiLCJtYWMiOiI2YWZhZmQ3MTUzMjEwMDhkN2U2M2UxYWM5NWEwMDEwMDlhOGU2Y2VhOGNmNTE5ZTE5NTU2ZjQxNTI1YjdjOGYyIiwidGFnIjoiIn0%3D; expires=Sat, 12 Apr 2025 04:06:50 GMT; Max-Age=7200; path=/; samesite=lax ◀XSRF-TOKEN=eyJpdiI6IkgwQ29LVHo3RzFqOHNCZEZYTUhHeUE9PSIsInZhbHVlIjoiNHZINHl1SWhwbnVqZng1dHFkQ2dPaHBuMjNsZGdiblJrdFFvNkl2L3ZQY1M1aVM4TWNRSU13RWxPSGFFaTFjRWdrQlJZM ▶"
    1 => "laravel_session=eyJpdiI6InFSMjRKMi96YXY1M3J5cmRUUWl4ZUE9PSIsInZhbHVlIjoiRTB1R1cvbmRZYWQraHdqU2ZNZHM2MHNYZWdWcU9hOEZRYm9Ic3U5WUVzQkRmSjJFVDdJQUpjaXFJTjkycmJST0MzWmwyc205MFRydEQ5TDR2N3dZcGFjYktrMlR1ek9RTUN4RXlneVU2dktybTBGaXEwVnJSalpnRmNTTUM5M3oiLCJtYWMiOiIwOGQyOWFiZWYzOWYxMGI4YTA2ZTY2ZGUyMGM2OTA4ZjEzMjU4NDBhNTMxNWZkOTczM2VjYmEwMmNjNWQyNDEzIiwidGFnIjoiIn0%3D; expires=Sat, 12 Apr 2025 04:06:50 GMT; Max-Age=7200; path=/; httponly; samesite=lax ◀laravel_session=eyJpdiI6InFSMjRKMi96YXY1M3J5cmRUUWl4ZUE9PSIsInZhbHVlIjoiRTB1R1cvbmRZYWQraHdqU2ZNZHM2MHNYZWdWcU9hOEZRYm9Ic3U5WUVzQkRmSjJFVDdJQUpjaXFJTjkycmJST0Mz ▶"
  ]
  "Set-Cookie" => array:2 [▶
    0 => "XSRF-TOKEN=eyJpdiI6IkgwQ29LVHo3RzFqOHNCZEZYTUhHeUE9PSIsInZhbHVlIjoiNHZINHl1SWhwbnVqZng1dHFkQ2dPaHBuMjNsZGdiblJrdFFvNkl2L3ZQY1M1aVM4TWNRSU13RWxPSGFFaTFjRWdrQlJZMlpST1cxNFIzMGlPZkh4TmV4K24zQXl5ZGtRMEZUeDJuTzJSV0pQRWxhaTFSWGQxc0doa05GTVN6WEwiLCJtYWMiOiI2YWZhZmQ3MTUzMjEwMDhkN2U2M2UxYWM5NWEwMDEwMDlhOGU2Y2VhOGNmNTE5ZTE5NTU2ZjQxNTI1YjdjOGYyIiwidGFnIjoiIn0%3D; expires=Sat, 12-Apr-2025 04:06:50 GMT; path=/ ◀XSRF-TOKEN=eyJpdiI6IkgwQ29LVHo3RzFqOHNCZEZYTUhHeUE9PSIsInZhbHVlIjoiNHZINHl1SWhwbnVqZng1dHFkQ2dPaHBuMjNsZGdiblJrdFFvNkl2L3ZQY1M1aVM4TWNRSU13RWxPSGFFaTFjRWdrQlJZM ▶"
    1 => "laravel_session=eyJpdiI6InFSMjRKMi96YXY1M3J5cmRUUWl4ZUE9PSIsInZhbHVlIjoiRTB1R1cvbmRZYWQraHdqU2ZNZHM2MHNYZWdWcU9hOEZRYm9Ic3U5WUVzQkRmSjJFVDdJQUpjaXFJTjkycmJST0MzWmwyc205MFRydEQ5TDR2N3dZcGFjYktrMlR1ek9RTUN4RXlneVU2dktybTBGaXEwVnJSalpnRmNTTUM5M3oiLCJtYWMiOiIwOGQyOWFiZWYzOWYxMGI4YTA2ZTY2ZGUyMGM2OTA4ZjEzMjU4NDBhNTMxNWZkOTczM2VjYmEwMmNjNWQyNDEzIiwidGFnIjoiIn0%3D; expires=Sat, 12-Apr-2025 04:06:50 GMT; path=/; httponly ◀laravel_session=eyJpdiI6InFSMjRKMi96YXY1M3J5cmRUUWl4ZUE9PSIsInZhbHVlIjoiRTB1R1cvbmRZYWQraHdqU2ZNZHM2MHNYZWdWcU9hOEZRYm9Ic3U5WUVzQkRmSjJFVDdJQUpjaXFJTjkycmJST0Mz ▶"
  ]
]

session_attributes

  0 of 0   
array:5 [▼
  "_token" => "WCxYyhNC1QGO6NwmBBLjCLG1G1At7czCQSH4l0j1"
  "locale" => "ar"
  "_previous" => array:1 [▶
    "url" => "https://www.corspedia.com/ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/attention-mechanism"
  ]
  "_flash" => array:2 [▶
    "old" => []
    "new" => []
  ]
  "PHPDEBUGBAR_STACK_DATA" => []
]

1 x Booting (59.96%)	124.25ms
1 x Application (39.79%)	82.45ms