Creative Applications of Deep Learning with TensorFlow II

Brought by: Kadenze

Overview

This course extends the material from the first course on Creative Applications of Deep Learning, providing an updated landscape on the state of the art techniques in recurrent neural networks. We begin by recapping what we've done up until now and show how to extend our practice to the cloud where we can make use of much better hardware including state-of-the- art GPU clusters. We'll also see how the models we train can be deployed for production environments. The techniques learned here will give us a much stronger basis for developing even more advanced algorithms in the final course of the program. We then move on to some state-of-the-art developments in Deep Learning, including adding recurrent networks to a variational autoencoder in order to learn where to look and write. We also look at how to use neural networks to model parameterized distributions using a mixture density network. Finally, we look at a recent development in Generative Adversarial Networks capable of learning how to translate unpaired image collections so that each collection looks like the other one. Along the way, we develop a firm understanding in theory and code about some of the components in each of these architectures that make them possible.

Syllabus

Session 1: Cloud Computing, GPUs, Deploying 
This session recaps the techniques learned in Course 1 and then goes on to describe how to setup an environment for learning on the cloud. Then shows how to use a pre-trained network in a production environment using a simple RESTful API using a Python flask web application. Session 2: Mixture Density Networks, Handwriting Synthesis 
This session covers a technique for predicting distributions of data called the mixture density network. We covers its importance and use case in the recurrent modeling of handwriting from x,y positions. Session 3: Modeling Attention With RNNs, DRAW 
This session shows how to model one of the most fundamental aspects to intelligence: attention. We'll see how we can teach an autoencoding neural network where to look and where to decode. This will greatly simplify the amount of information that it needs to learn by conditioning on previous time steps, all while gaining an enormous amount of expressivity. Session 4: PixelCNN And PixelRNN, Generative Images 
This session develops an understanding for a major breakthrough in convolutional networks: dilated/atrous convolution.

Taught by

Parag Mital

Creative Applications of Deep Learning with TensorFlow II
Go to course

Creative Applications of Deep Learning with TensorFlow II

Brought by: Kadenze

  • Kadenze
  • Paid
  • English
  • Certificate Available
  • Available at any time
  • All
  • N/A
8.1.2PHP Version364msRequest Duration2MBMemory UsageGET en/courses/{slug}Route
    • Booting (233ms)
    • Application (129ms)
    • 1 x Booting (64.14%)
      233.25ms
      1 x Application (35.56%)
      129.33ms
      14 templates were rendered
      • public.courses.show (resources/views/public/courses/show.blade.php)3bladefile
        Params
        0
        course
        1
        links
        2
        config
      • public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        classes
      • public.courses.partials.details (resources/views/public/courses/partials/details.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        classes
      • public.layouts.main (resources/views/public/layouts/main.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.layouts.partials.meta (resources/views/public/layouts/partials/meta.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.layouts.partials.navbar (resources/views/public/layouts/partials/navbar.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.auth.profile.partials.links (resources/views/public/auth/profile/partials/links.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.layouts.partials.flash-session (resources/views/public/layouts/partials/flash-session.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      uri
      GET en/courses/{slug}
      middleware
      web, localize:en
      controller
      App\Http\Controllers\CourseController@show
      as
      en.courses.show
      namespace
      prefix
      /en
      where
      file
      app/Http/Controllers/CourseController.php:17-35
      6 statements were executed5.45ms
      • select * from `courses` where `slug_en` = 'creative-applications-of-deep-learning-with-tensorflow-ii' limit 1
        4.38ms/app/Http/Controllers/CourseController.php:20corspedia
        Metadata
        Bindings
        • 0. creative-applications-of-deep-learning-with-tensorflow-ii
        Backtrace
        • 17. /app/Http/Controllers/CourseController.php:20
        • 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • update `courses` set `visitors` = `visitors` + 1, `courses`.`updated_at` = '2025-02-20 05:15:19' where `id` = 1818
        330μs/app/Http/Controllers/CourseController.php:21corspedia
        Metadata
        Bindings
        • 0. 2025-02-20 05:15:19
        • 1. 1818
        Backtrace
        • 17. /app/Http/Controllers/CourseController.php:21
        • 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select `id`, `name_en`, `name_ar`, `topic_id`, `slug_en`, `slug_ar` from `subjects` where `subjects`.`id` in (43)
        180μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select `id`, `name_en`, `name_ar`, `slug_en`, `slug_ar` from `topics` where `topics`.`id` in (1)
        160μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 25. /app/Http/Controllers/CourseController.php:23
        • 26. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 27. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 28. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 29. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `providers` where `providers`.`id` in (5) and `providers`.`deleted_at` is null
        190μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `html_files` where `html_files`.`id` = 1809 limit 1
        210μs/app/Models/Course.php:84corspedia
        Metadata
        Bindings
        • 0. 1809
        Backtrace
        • 21. /app/Models/Course.php:84
        • 28. view::public.courses.show:29
        • 30. /vendor/laravel/framework/src/Illuminate/Filesystem/Filesystem.php:125
        • 31. /vendor/laravel/framework/src/Illuminate/View/Engines/PhpEngine.php:58
        • 32. /vendor/laravel/framework/src/Illuminate/View/Engines/CompilerEngine.php:72
      App\Models\HtmlFile
      1
      App\Models\Provider
      1
      App\Models\Topic
      1
      App\Models\Subject
      1
      App\Models\Course
      1
        _token
        0GZbnfTM6jpFsqtowjhm2PDnMAadDJWyfmnkc63C
        locale
        en
        _previous
        array:1 [ "url" => "https://www.corspedia.com/en/courses/creative-applications-of-deep-learning-wi...
        _flash
        array:2 [ "old" => [] "new" => [] ]
        PHPDEBUGBAR_STACK_DATA
        []
        path_info
        /en/courses/creative-applications-of-deep-learning-with-tensorflow-ii
        status_code
        200
        
        status_text
        OK
        format
        html
        content_type
        text/html; charset=UTF-8
        request_query
        []
        
        request_request
        []
        
        request_headers
        0 of 0
        array:24 [ "sec-ch-ua-mobile" => array:1 [ 0 => "?0" ] "sec-ch-ua" => array:1 [ 0 => ""HeadlessChrome";v="129", "Not=A?Brand";v="8", "Chromium";v="129"" ] "cache-control" => array:1 [ 0 => "no-cache" ] "pragma" => array:1 [ 0 => "no-cache" ] "cdn-loop" => array:1 [ 0 => "cloudflare; loops=1" ] "priority" => array:1 [ 0 => "u=0, i" ] "upgrade-insecure-requests" => array:1 [ 0 => "1" ] "user-agent" => array:1 [ 0 => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)" ] "cf-connecting-ip" => array:1 [ 0 => "3.141.46.110" ] "accept" => array:1 [ 0 => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7" ] "sec-fetch-site" => array:1 [ 0 => "none" ] "cf-visitor" => array:1 [ 0 => "{"scheme":"https"}" ] "sec-fetch-mode" => array:1 [ 0 => "navigate" ] "sec-fetch-user" => array:1 [ 0 => "?1" ] "x-forwarded-proto" => array:1 [ 0 => "https" ] "cf-ipcountry" => array:1 [ 0 => "US" ] "accept-encoding" => array:1 [ 0 => "gzip, br" ] "sec-fetch-dest" => array:1 [ 0 => "document" ] "sec-ch-ua-platform" => array:1 [ 0 => ""Windows"" ] "x-forwarded-for" => array:1 [ 0 => "3.141.46.110" ] "cf-ray" => array:1 [ 0 => "914c04a0bdaf22c7-ORD" ] "host" => array:1 [ 0 => "www.corspedia.com" ] "content-length" => array:1 [ 0 => "" ] "content-type" => array:1 [ 0 => "" ] ]
        request_server
        0 of 0
        array:50 [ "USER" => "www-data" "HOME" => "/var/www" "HTTP_SEC_CH_UA_MOBILE" => "?0" "HTTP_SEC_CH_UA" => ""HeadlessChrome";v="129", "Not=A?Brand";v="8", "Chromium";v="129"" "HTTP_CACHE_CONTROL" => "no-cache" "HTTP_PRAGMA" => "no-cache" "HTTP_CDN_LOOP" => "cloudflare; loops=1" "HTTP_PRIORITY" => "u=0, i" "HTTP_UPGRADE_INSECURE_REQUESTS" => "1" "HTTP_USER_AGENT" => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)" "HTTP_CF_CONNECTING_IP" => "3.141.46.110" "HTTP_ACCEPT" => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7" "HTTP_SEC_FETCH_SITE" => "none" "HTTP_CF_VISITOR" => "{"scheme":"https"}" "HTTP_SEC_FETCH_MODE" => "navigate" "HTTP_SEC_FETCH_USER" => "?1" "HTTP_X_FORWARDED_PROTO" => "https" "HTTP_CF_IPCOUNTRY" => "US" "HTTP_ACCEPT_ENCODING" => "gzip, br" "HTTP_SEC_FETCH_DEST" => "document" "HTTP_SEC_CH_UA_PLATFORM" => ""Windows"" "HTTP_X_FORWARDED_FOR" => "3.141.46.110" "HTTP_CF_RAY" => "914c04a0bdaf22c7-ORD" "HTTP_HOST" => "www.corspedia.com" "REDIRECT_STATUS" => "200" "SERVER_NAME" => "corspedia.com" "SERVER_PORT" => "443" "SERVER_ADDR" => "141.95.147.152" "REMOTE_USER" => "" "REMOTE_PORT" => "26164" "REMOTE_ADDR" => "172.71.254.73" "SERVER_SOFTWARE" => "nginx/1.18.0" "GATEWAY_INTERFACE" => "CGI/1.1" "HTTPS" => "on" "REQUEST_SCHEME" => "https" "SERVER_PROTOCOL" => "HTTP/2.0" "DOCUMENT_ROOT" => "/var/www/corspedia/public" "DOCUMENT_URI" => "/index.php" "REQUEST_URI" => "/en/courses/creative-applications-of-deep-learning-with-tensorflow-ii" "SCRIPT_NAME" => "/index.php" "CONTENT_LENGTH" => "" "CONTENT_TYPE" => "" "REQUEST_METHOD" => "GET" "QUERY_STRING" => "" "SCRIPT_FILENAME" => "/var/www/corspedia/public/index.php" "PATH_INFO" => "" "FCGI_ROLE" => "RESPONDER" "PHP_SELF" => "/index.php" "REQUEST_TIME_FLOAT" => 1740028518.7636 "REQUEST_TIME" => 1740028518 ]
        request_cookies
        []
        
        response_headers
        0 of 0
        array:5 [ "content-type" => array:1 [ 0 => "text/html; charset=UTF-8" ] "cache-control" => array:1 [ 0 => "no-cache, private" ] "date" => array:1 [ 0 => "Thu, 20 Feb 2025 05:15:19 GMT" ] "set-cookie" => array:2 [ 0 => "XSRF-TOKEN=eyJpdiI6InMrclJuSTZRQzNRb0VxOXlzNG9jaFE9PSIsInZhbHVlIjoiYmRuQi9QUmlqdU1icXlLUjFQd3pqZzdNbXVNdHlmSEdVMlZCa3c1Ly8zYys5cTRjTWVaTjZoQUNGcmNaaS81QmlNQVZ2VERxZ0M0SlZCejMrT0RidHMva0dValFJeTVvY3VSV0VWOXF4RUp1MlVHZjcrUFJXeHZUR3lUQVVWVjYiLCJtYWMiOiIxMWZjZTE4ZDUwMGYxMGU1NDM2MmZhOWIyY2U4MzFhN2VhYzFjMDY0ZjZjMzUxM2RkNDBiM2MyNjIyNGRjZmE1IiwidGFnIjoiIn0%3D; expires=Thu, 20 Feb 2025 07:15:19 GMT; Max-Age=7200; path=/; samesite=laxXSRF-TOKEN=eyJpdiI6InMrclJuSTZRQzNRb0VxOXlzNG9jaFE9PSIsInZhbHVlIjoiYmRuQi9QUmlqdU1icXlLUjFQd3pqZzdNbXVNdHlmSEdVMlZCa3c1Ly8zYys5cTRjTWVaTjZoQUNGcmNaaS81QmlNQVZ2V" 1 => "laravel_session=eyJpdiI6IkQ0dXVKdUl1MmlGaEF1NWQ0OS9sWEE9PSIsInZhbHVlIjoiSHlKY0dyNGYzdzZ6UWtzNkRieWkwaDY0RzRmUW5PTzkyQ0tHZ2YxRU40REU2WGw1VkJLNEVhc2dJRjZoR0VaY2luZkc0TlhWMS96dWRheml0dmM3MEpreVRwaThRbjZBMi9FT01LKzMvZEpvRDEweDMvYURnZ3NKcE1NbmZzVjMiLCJtYWMiOiJiMmY0NjNlYjAyY2JjOTNlNTRlMGFmZDI4MWVhNzljYWI1NmVkNWZhNWMwMjZjOGFlNzQ5NmZjNDFlZTg1N2I3IiwidGFnIjoiIn0%3D; expires=Thu, 20 Feb 2025 07:15:19 GMT; Max-Age=7200; path=/; httponly; samesite=laxlaravel_session=eyJpdiI6IkQ0dXVKdUl1MmlGaEF1NWQ0OS9sWEE9PSIsInZhbHVlIjoiSHlKY0dyNGYzdzZ6UWtzNkRieWkwaDY0RzRmUW5PTzkyQ0tHZ2YxRU40REU2WGw1VkJLNEVhc2dJRjZoR0VaY2lu" ] "Set-Cookie" => array:2 [ 0 => "XSRF-TOKEN=eyJpdiI6InMrclJuSTZRQzNRb0VxOXlzNG9jaFE9PSIsInZhbHVlIjoiYmRuQi9QUmlqdU1icXlLUjFQd3pqZzdNbXVNdHlmSEdVMlZCa3c1Ly8zYys5cTRjTWVaTjZoQUNGcmNaaS81QmlNQVZ2VERxZ0M0SlZCejMrT0RidHMva0dValFJeTVvY3VSV0VWOXF4RUp1MlVHZjcrUFJXeHZUR3lUQVVWVjYiLCJtYWMiOiIxMWZjZTE4ZDUwMGYxMGU1NDM2MmZhOWIyY2U4MzFhN2VhYzFjMDY0ZjZjMzUxM2RkNDBiM2MyNjIyNGRjZmE1IiwidGFnIjoiIn0%3D; expires=Thu, 20-Feb-2025 07:15:19 GMT; path=/XSRF-TOKEN=eyJpdiI6InMrclJuSTZRQzNRb0VxOXlzNG9jaFE9PSIsInZhbHVlIjoiYmRuQi9QUmlqdU1icXlLUjFQd3pqZzdNbXVNdHlmSEdVMlZCa3c1Ly8zYys5cTRjTWVaTjZoQUNGcmNaaS81QmlNQVZ2V" 1 => "laravel_session=eyJpdiI6IkQ0dXVKdUl1MmlGaEF1NWQ0OS9sWEE9PSIsInZhbHVlIjoiSHlKY0dyNGYzdzZ6UWtzNkRieWkwaDY0RzRmUW5PTzkyQ0tHZ2YxRU40REU2WGw1VkJLNEVhc2dJRjZoR0VaY2luZkc0TlhWMS96dWRheml0dmM3MEpreVRwaThRbjZBMi9FT01LKzMvZEpvRDEweDMvYURnZ3NKcE1NbmZzVjMiLCJtYWMiOiJiMmY0NjNlYjAyY2JjOTNlNTRlMGFmZDI4MWVhNzljYWI1NmVkNWZhNWMwMjZjOGFlNzQ5NmZjNDFlZTg1N2I3IiwidGFnIjoiIn0%3D; expires=Thu, 20-Feb-2025 07:15:19 GMT; path=/; httponlylaravel_session=eyJpdiI6IkQ0dXVKdUl1MmlGaEF1NWQ0OS9sWEE9PSIsInZhbHVlIjoiSHlKY0dyNGYzdzZ6UWtzNkRieWkwaDY0RzRmUW5PTzkyQ0tHZ2YxRU40REU2WGw1VkJLNEVhc2dJRjZoR0VaY2lu" ] ]
        session_attributes
        0 of 0
        array:5 [ "_token" => "0GZbnfTM6jpFsqtowjhm2PDnMAadDJWyfmnkc63C" "locale" => "en" "_previous" => array:1 [ "url" => "https://www.corspedia.com/en/courses/creative-applications-of-deep-learning-with-tensorflow-ii" ] "_flash" => array:2 [ "old" => [] "new" => [] ] "PHPDEBUGBAR_STACK_DATA" => [] ]