Computer Science / Machine Learning

Overview of Advanced Methods of Reinforcement Learning in Finance

بواسطة: Coursera

Overview

In the last course of our specialization, Overview of Advanced Methods of Reinforcement Learning in Finance, we will take a deeper look into topics discussed in our third course, Reinforcement Learning in Finance.

In particular, we will talk about links between Reinforcement Learning, option pricing and physics, implications of Inverse Reinforcement Learning for modeling market impact and price dynamics, and perception-action cycles in Reinforcement Learning. Finally, we will overview trending and potential applications of Reinforcement Learning for high-frequency trading, cryptocurrencies, peer-to-peer lending, and more.

After taking this course, students will be able to
- explain fundamental concepts of finance such as market equilibrium, no arbitrage, predictability,
- discuss market modeling,
- Apply the methods of Reinforcement Learning to high-frequency trading, credit risk peer-to-peer lending, and cryptocurrencies trading.

Syllabus

Black-Scholes-Merton model, Physics and Reinforcement Learning
Reinforcement Learning for Optimal Trading and Market Modeling
Perception - Beyond Reinforcement Learning
Other Applications of Reinforcement Learning: P-2-P Lending, Cryptocurrency, etc.

Taught by

Igor Halperin

Computer Science / Machine Learning

Overview of Advanced Methods of Reinforcement Learning in Finance

الذهاب الي الدورة

Overview of Advanced Methods of Reinforcement Learning in Finance

بواسطة: Coursera

Coursera
مجانية
الإنجليزية
متاح شهادة
متاح في أي وقت
الجميع
English, Arabic, French, Portuguese, German, Thai, Indonesian, Spanish, Kazakh, Hindi, Russian, Swedish, Korean, Greek, Italian, Chinese, Ukrainian, Japanese, Polish, Dutch, Turkish

Messages Timeline Exceptions Views14 Route Queries7 Models6 Gate Session Request

8.1.2247ms2MBGET ar/الدورات/{slug}

Booting (157ms)
Application (89.44ms)
1 x Booting (63.54%)
156.96ms
1 x Application (36.21%)
89.44ms

14 templates were rendered

public.courses.show (resources/views/public/courses/show.blade.php)3bladefile
Params
0
course
1
links
2
config
public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
6
classes
public.courses.partials.details (resources/views/public/courses/partials/details.blade.php)6bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
6
classes
public.layouts.main (resources/views/public/layouts/main.blade.php)6bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
public.layouts.partials.meta (resources/views/public/layouts/partials/meta.blade.php)6bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
public.layouts.partials.navbar (resources/views/public/layouts/partials/navbar.blade.php)6bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
public.auth.profile.partials.links (resources/views/public/auth/profile/partials/links.blade.php)6bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
6
route
7
title
public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
6
route
7
title
public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
6
route
7
title
public.layouts.partials.flash-session (resources/views/public/layouts/partials/flash-session.blade.php)6bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config

uri: GET ar/الدورات/{slug}
middleware: web, localize:ar
controller: App\Http\Controllers\CourseController@show
as: ar.courses.show
namespace
prefix: /ar
where
file: app/Http/Controllers/CourseController.php:17-35

7 statements were executed3.6ms

select * from `courses` where `slug_ar` = 'overview-of-advanced-methods-of-reinforcement-learning-in-finance' limit 1

2.28ms/app/Http/Controllers/CourseController.php:20corspedia

Metadata
Bindings	0. overview-of-advanced-methods-of-reinforcement-learning-in-finance
Backtrace	17. /app/Http/Controllers/CourseController.php:20 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205

update `courses` set `visitors` = `visitors` + 1, `courses`.`updated_at` = '2025-04-10 03:18:44' where `id` = 298

460μs/app/Http/Controllers/CourseController.php:21corspedia

Metadata
Bindings	0. 2025-04-10 03:18:44 1. 298
Backtrace	17. /app/Http/Controllers/CourseController.php:21 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205

select `id`, `name_en`, `name_ar`, `topic_id`, `slug_en`, `slug_ar` from `subjects` where `subjects`.`id` in (4)

200μs/app/Http/Controllers/CourseController.php:23corspedia

Metadata
Backtrace	20. /app/Http/Controllers/CourseController.php:23 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205

select `id`, `name_en`, `name_ar`, `slug_en`, `slug_ar` from `topics` where `topics`.`id` in (1)

150μs/app/Http/Controllers/CourseController.php:23corspedia

Metadata
Backtrace	25. /app/Http/Controllers/CourseController.php:23 26. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54 27. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43 28. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260 29. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205

select * from `institutions` where `institutions`.`id` in (32) and `institutions`.`deleted_at` is null

180μs/app/Http/Controllers/CourseController.php:23corspedia

Metadata
Backtrace	20. /app/Http/Controllers/CourseController.php:23 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205

select * from `providers` where `providers`.`id` in (2) and `providers`.`deleted_at` is null

150μs/app/Http/Controllers/CourseController.php:23corspedia

Metadata
Backtrace	20. /app/Http/Controllers/CourseController.php:23 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205

select * from `html_files` where `html_files`.`id` = 292 limit 1

180μs/app/Models/Course.php:84corspedia

Metadata
Bindings	0. 292
Backtrace	21. /app/Models/Course.php:84 28. view::public.courses.show:29 30. /vendor/laravel/framework/src/Illuminate/Filesystem/Filesystem.php:125 31. /vendor/laravel/framework/src/Illuminate/View/Engines/PhpEngine.php:58 32. /vendor/laravel/framework/src/Illuminate/View/Engines/CompilerEngine.php:72

App\Models\HtmlFile: 1
App\Models\Provider: 1
App\Models\Institution: 1
App\Models\Topic: 1
App\Models\Subject: 1
App\Models\Course: 1

_token: 5NQ1A8VRIsssioMJP9Y7AirzV6OYM2pg5L59JqEE
locale: ar
_previous: array:1 [ "url" => "https://www.corspedia.com/ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/overvi...
_flash: array:2 [ "old" => [] "new" => [] ]
PHPDEBUGBAR_STACK_DATA: []

path_info

/ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/overview-of-advanced-methods-of-reinforcement-learning-in-finance

status_code

status_text

OK

format

html

content_type

text/html; charset=UTF-8

request_query

[]

request_request

[]

request_headers

  0 of 0   
array:24 [▼
  "cf-ipcountry" => array:1 [▶
    0 => "US"
  ]
  "cf-connecting-ip" => array:1 [▶
    0 => "3.14.253.99"
  ]
  "cdn-loop" => array:1 [▶
    0 => "cloudflare; loops=1"
  ]
  "x-forwarded-proto" => array:1 [▶
    0 => "https"
  ]
  "cf-visitor" => array:1 [▶
    0 => "{"scheme":"https"}"
  ]
  "sec-fetch-site" => array:1 [▶
    0 => "none"
  ]
  "accept" => array:1 [▶
    0 => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7"
  ]
  "user-agent" => array:1 [▶
    0 => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)"
  ]
  "upgrade-insecure-requests" => array:1 [▶
    0 => "1"
  ]
  "sec-ch-ua-platform" => array:1 [▶
    0 => ""Windows""
  ]
  "sec-ch-ua-mobile" => array:1 [▶
    0 => "?0"
  ]
  "sec-ch-ua" => array:1 [▶
    0 => ""HeadlessChrome";v="129", "Not=A?Brand";v="8", "Chromium";v="129""
  ]
  "cache-control" => array:1 [▶
    0 => "no-cache"
  ]
  "pragma" => array:1 [▶
    0 => "no-cache"
  ]
  "sec-fetch-dest" => array:1 [▶
    0 => "document"
  ]
  "cf-ray" => array:1 [▶
    0 => "92df193b7cf6d94a-ORD"
  ]
  "accept-encoding" => array:1 [▶
    0 => "gzip, br"
  ]
  "priority" => array:1 [▶
    0 => "u=0, i"
  ]
  "sec-fetch-user" => array:1 [▶
    0 => "?1"
  ]
  "sec-fetch-mode" => array:1 [▶
    0 => "navigate"
  ]
  "x-forwarded-for" => array:1 [▶
    0 => "3.14.253.99"
  ]
  "host" => array:1 [▶
    0 => "www.corspedia.com"
  ]
  "content-length" => array:1 [▶
    0 => ""
  ]
  "content-type" => array:1 [▶
    0 => ""
  ]
]

request_server

  0 of 0   
array:50 [▼
  "USER" => "www-data"
  "HOME" => "/var/www"
  "HTTP_CF_IPCOUNTRY" => "US"
  "HTTP_CF_CONNECTING_IP" => "3.14.253.99"
  "HTTP_CDN_LOOP" => "cloudflare; loops=1"
  "HTTP_X_FORWARDED_PROTO" => "https"
  "HTTP_CF_VISITOR" => "{"scheme":"https"}"
  "HTTP_SEC_FETCH_SITE" => "none"
  "HTTP_ACCEPT" => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7"
  "HTTP_USER_AGENT" => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)"
  "HTTP_UPGRADE_INSECURE_REQUESTS" => "1"
  "HTTP_SEC_CH_UA_PLATFORM" => ""Windows""
  "HTTP_SEC_CH_UA_MOBILE" => "?0"
  "HTTP_SEC_CH_UA" => ""HeadlessChrome";v="129", "Not=A?Brand";v="8", "Chromium";v="129""
  "HTTP_CACHE_CONTROL" => "no-cache"
  "HTTP_PRAGMA" => "no-cache"
  "HTTP_SEC_FETCH_DEST" => "document"
  "HTTP_CF_RAY" => "92df193b7cf6d94a-ORD"
  "HTTP_ACCEPT_ENCODING" => "gzip, br"
  "HTTP_PRIORITY" => "u=0, i"
  "HTTP_SEC_FETCH_USER" => "?1"
  "HTTP_SEC_FETCH_MODE" => "navigate"
  "HTTP_X_FORWARDED_FOR" => "3.14.253.99"
  "HTTP_HOST" => "www.corspedia.com"
  "REDIRECT_STATUS" => "200"
  "SERVER_NAME" => "corspedia.com"
  "SERVER_PORT" => "443"
  "SERVER_ADDR" => "141.95.147.152"
  "REMOTE_USER" => ""
  "REMOTE_PORT" => "52422"
  "REMOTE_ADDR" => "172.69.17.94"
  "SERVER_SOFTWARE" => "nginx/1.18.0"
  "GATEWAY_INTERFACE" => "CGI/1.1"
  "HTTPS" => "on"
  "REQUEST_SCHEME" => "https"
  "SERVER_PROTOCOL" => "HTTP/2.0"
  "DOCUMENT_ROOT" => "/var/www/corspedia/public"
  "DOCUMENT_URI" => "/index.php"
  "REQUEST_URI" => "/ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/overview-of-advanced-methods-of-reinforcement-learning-in-finance"
  "SCRIPT_NAME" => "/index.php"
  "CONTENT_LENGTH" => ""
  "CONTENT_TYPE" => ""
  "REQUEST_METHOD" => "GET"
  "QUERY_STRING" => ""
  "SCRIPT_FILENAME" => "/var/www/corspedia/public/index.php"
  "PATH_INFO" => ""
  "FCGI_ROLE" => "RESPONDER"
  "PHP_SELF" => "/index.php"
  "REQUEST_TIME_FLOAT" => 1744255124.0042
  "REQUEST_TIME" => 1744255124
]

request_cookies

[]

response_headers

  0 of 0   
array:5 [▼
  "content-type" => array:1 [▶
    0 => "text/html; charset=UTF-8"
  ]
  "cache-control" => array:1 [▶
    0 => "no-cache, private"
  ]
  "date" => array:1 [▶
    0 => "Thu, 10 Apr 2025 03:18:44 GMT"
  ]
  "set-cookie" => array:2 [▶
    0 => "XSRF-TOKEN=eyJpdiI6Ik5Nd0tvTlRRaVlDTm1Wa3ZkUzZOUHc9PSIsInZhbHVlIjoiNkRUTDJMa0ptajFPRExSeHJyc1dpNkp6ekhiNlh4RlBHclo4Q0dFNjQ4UlZmS0EwK0tzc0NldHJHekVKR2R6Z0NuUVVMMGFsblp1cFVKMVIzNXplc21Gd1FTMmZ0N1h5MnpDT0xiN0wzdTc3dFBGVUtDVHJsL0JjL0JKNExNL3oiLCJtYWMiOiJjMDI0YjljYzMzOTZlMmFmYzIwYjA3ODc5ZWE3ZTllZmE2YmNhNDRjODFmMGIwMDE2YTIzODk1MjNkZTQ3ODZkIiwidGFnIjoiIn0%3D; expires=Thu, 10 Apr 2025 05:18:44 GMT; Max-Age=7200; path=/; samesite=lax ◀XSRF-TOKEN=eyJpdiI6Ik5Nd0tvTlRRaVlDTm1Wa3ZkUzZOUHc9PSIsInZhbHVlIjoiNkRUTDJMa0ptajFPRExSeHJyc1dpNkp6ekhiNlh4RlBHclo4Q0dFNjQ4UlZmS0EwK0tzc0NldHJHekVKR2R6Z0NuUVVMM ▶"
    1 => "laravel_session=eyJpdiI6IlJhOEk2OUZmSDJkWjdBb245Y2JodHc9PSIsInZhbHVlIjoiWXcxOUFzUmRJYTd3dzBTbEZRWTZBQkJ3M1JTU1VpM0V2QUI4OUMrV2IwWnNlam9CcmpuTktmQVFJMkRwZ1dGbXQxOUdRU1dqR2UzdTE1anJjWHJ6cFMvOEFZR090Wm1VeTN2OXJVV3ppMDhPU0dqQjhSK2d2b1VyR0JmL2JNaUQiLCJtYWMiOiJiZjY4OTQxM2I3NTk2MDRhNmVkYTE3MzkyZmJmN2M4Y2E2ODc2YWQzM2Q5NzI0NzJlMDg2MzNlMzhhNTIwOGYyIiwidGFnIjoiIn0%3D; expires=Thu, 10 Apr 2025 05:18:44 GMT; Max-Age=7200; path=/; httponly; samesite=lax ◀laravel_session=eyJpdiI6IlJhOEk2OUZmSDJkWjdBb245Y2JodHc9PSIsInZhbHVlIjoiWXcxOUFzUmRJYTd3dzBTbEZRWTZBQkJ3M1JTU1VpM0V2QUI4OUMrV2IwWnNlam9CcmpuTktmQVFJMkRwZ1dGbXQx ▶"
  ]
  "Set-Cookie" => array:2 [▶
    0 => "XSRF-TOKEN=eyJpdiI6Ik5Nd0tvTlRRaVlDTm1Wa3ZkUzZOUHc9PSIsInZhbHVlIjoiNkRUTDJMa0ptajFPRExSeHJyc1dpNkp6ekhiNlh4RlBHclo4Q0dFNjQ4UlZmS0EwK0tzc0NldHJHekVKR2R6Z0NuUVVMMGFsblp1cFVKMVIzNXplc21Gd1FTMmZ0N1h5MnpDT0xiN0wzdTc3dFBGVUtDVHJsL0JjL0JKNExNL3oiLCJtYWMiOiJjMDI0YjljYzMzOTZlMmFmYzIwYjA3ODc5ZWE3ZTllZmE2YmNhNDRjODFmMGIwMDE2YTIzODk1MjNkZTQ3ODZkIiwidGFnIjoiIn0%3D; expires=Thu, 10-Apr-2025 05:18:44 GMT; path=/ ◀XSRF-TOKEN=eyJpdiI6Ik5Nd0tvTlRRaVlDTm1Wa3ZkUzZOUHc9PSIsInZhbHVlIjoiNkRUTDJMa0ptajFPRExSeHJyc1dpNkp6ekhiNlh4RlBHclo4Q0dFNjQ4UlZmS0EwK0tzc0NldHJHekVKR2R6Z0NuUVVMM ▶"
    1 => "laravel_session=eyJpdiI6IlJhOEk2OUZmSDJkWjdBb245Y2JodHc9PSIsInZhbHVlIjoiWXcxOUFzUmRJYTd3dzBTbEZRWTZBQkJ3M1JTU1VpM0V2QUI4OUMrV2IwWnNlam9CcmpuTktmQVFJMkRwZ1dGbXQxOUdRU1dqR2UzdTE1anJjWHJ6cFMvOEFZR090Wm1VeTN2OXJVV3ppMDhPU0dqQjhSK2d2b1VyR0JmL2JNaUQiLCJtYWMiOiJiZjY4OTQxM2I3NTk2MDRhNmVkYTE3MzkyZmJmN2M4Y2E2ODc2YWQzM2Q5NzI0NzJlMDg2MzNlMzhhNTIwOGYyIiwidGFnIjoiIn0%3D; expires=Thu, 10-Apr-2025 05:18:44 GMT; path=/; httponly ◀laravel_session=eyJpdiI6IlJhOEk2OUZmSDJkWjdBb245Y2JodHc9PSIsInZhbHVlIjoiWXcxOUFzUmRJYTd3dzBTbEZRWTZBQkJ3M1JTU1VpM0V2QUI4OUMrV2IwWnNlam9CcmpuTktmQVFJMkRwZ1dGbXQx ▶"
  ]
]

session_attributes

  0 of 0   
array:5 [▼
  "_token" => "5NQ1A8VRIsssioMJP9Y7AirzV6OYM2pg5L59JqEE"
  "locale" => "ar"
  "_previous" => array:1 [▶
    "url" => "https://www.corspedia.com/ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/overview-of-advanced-methods-of-reinforcement-learning-in-finance"
  ]
  "_flash" => array:2 [▶
    "old" => []
    "new" => []
  ]
  "PHPDEBUGBAR_STACK_DATA" => []
]