Machine Learning for Musicians and Artists

Brought by: Kadenze

Overview

Have you ever wanted to build a new musical instrument that responded to your gestures by making sound? Or create live visuals to accompany a dancer? Or create an interactive art installation that reacts to the movements or actions of an audience? If so, take this course!

In this course, students will learn fundamental machine learning techniques that can be used to make sense of human gesture, musical audio, and other real-time data. The focus will be on learning about algorithms, software tools, and best practices that can be immediately employed in creating new real-time systems in the arts.

Specific topics of discussion include:

• What is machine learning?

• Common types of machine learning for making sense of human actions and sensor data, with a focus on classification, regression, and segmentation

• The “machine learning pipeline”: understanding how signals, features, algorithms, and models fit together, and how to select and configure each part of this pipeline to get good analysis results

• Off-the-shelf tools for machine learning (e.g., Wekinator, Weka, GestureFollower)

• Feature extraction and analysis techniques that are well-suited for music, dance, gaming, and visual art, especially for human motion analysis and audio analysis

• How to connect your machine learning tools to common digital arts tools such as Max/MSP, PD, ChucK, Processing, Unity 3D, SuperCollider, OpenFrameworks

• Introduction to cheap & easy sensing technologies that can be used as inputs to machine learning systems (e.g., Kinect, computer vision, hardware sensors, gaming controllers)

Syllabus

Session 1: Introduction 
What is machine learning? And what is it good for? Session 2: Classification 
This session will cover fundamentals, how to use Wekinator for classification, and an introduction to classification algorithms: kNN, Decision trees, AdaBoost, SVM. Session 3: Regression 
In this session we will discuss the fundamentals of regression, using Wekinator for regression, and neural networks for more complex types of models. Session 4: Dynamic Time Warping 
In this session you will learn what dynamic time warping is and what it's useful for, as well as how to use Wekinator for dynamic time warping. Session 5: Sensors & Features Part I: Basic Signal Processing For Learning 
This session will cover retrieving data from devices: Streaming data vs events; Smoothing noisy signals; Throttling, downsampling, and upsampling; First and second order differences; Buffering & chunking. Session 6: Sensors & Features Part II: Intro To A Few Fun/Popular Types Of Sensors & Sensing Systems 
This session will introduce Kinect, Leap, and basic physical computing sensors such as accelerometers, gyros, FSRs, ultrasonic distance sensors, and photosensors. Session 7: Wrap Up 
This session will provide a wrap up for the course, and will discuss practical tools, books, and resources students can access for furthering their work in this field.

Taught by

Rebecca Fiebrink

Machine Learning for Musicians and Artists
Go to course

Machine Learning for Musicians and Artists

Brought by: Kadenze

  • Kadenze
  • Free
  • English
  • Certificate Available
  • Available at any time
  • intermediate
  • N/A
8.1.2PHP Version288msRequest Duration2MBMemory UsageGET en/courses/{slug}Route
    • Booting (183ms)
    • Application (104ms)
    • 1 x Booting (63.49%)
      182.90ms
      1 x Application (36.27%)
      104.50ms
      14 templates were rendered
      • public.courses.show (resources/views/public/courses/show.blade.php)3bladefile
        Params
        0
        course
        1
        links
        2
        config
      • public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        classes
      • public.courses.partials.details (resources/views/public/courses/partials/details.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        classes
      • public.layouts.main (resources/views/public/layouts/main.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.layouts.partials.meta (resources/views/public/layouts/partials/meta.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.layouts.partials.navbar (resources/views/public/layouts/partials/navbar.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.auth.profile.partials.links (resources/views/public/auth/profile/partials/links.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.layouts.partials.flash-session (resources/views/public/layouts/partials/flash-session.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      uri
      GET en/courses/{slug}
      middleware
      web, localize:en
      controller
      App\Http\Controllers\CourseController@show
      as
      en.courses.show
      namespace
      prefix
      /en
      where
      file
      app/Http/Controllers/CourseController.php:17-35
      6 statements were executed3.43ms
      • select * from `courses` where `slug_en` = 'machine-learning-for-musicians-and-artists' limit 1
        2.2ms/app/Http/Controllers/CourseController.php:20corspedia
        Metadata
        Bindings
        • 0. machine-learning-for-musicians-and-artists
        Backtrace
        • 17. /app/Http/Controllers/CourseController.php:20
        • 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • update `courses` set `visitors` = `visitors` + 1, `courses`.`updated_at` = '2025-02-20 05:39:25' where `id` = 10
        260μs/app/Http/Controllers/CourseController.php:21corspedia
        Metadata
        Bindings
        • 0. 2025-02-20 05:39:25
        • 1. 10
        Backtrace
        • 17. /app/Http/Controllers/CourseController.php:21
        • 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select `id`, `name_en`, `name_ar`, `topic_id`, `slug_en`, `slug_ar` from `subjects` where `subjects`.`id` in (4)
        200μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select `id`, `name_en`, `name_ar`, `slug_en`, `slug_ar` from `topics` where `topics`.`id` in (1)
        220μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 25. /app/Http/Controllers/CourseController.php:23
        • 26. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 27. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 28. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 29. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `providers` where `providers`.`id` in (5) and `providers`.`deleted_at` is null
        220μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `html_files` where `html_files`.`id` = 10 limit 1
        330μs/app/Models/Course.php:84corspedia
        Metadata
        Bindings
        • 0. 10
        Backtrace
        • 21. /app/Models/Course.php:84
        • 28. view::public.courses.show:29
        • 30. /vendor/laravel/framework/src/Illuminate/Filesystem/Filesystem.php:125
        • 31. /vendor/laravel/framework/src/Illuminate/View/Engines/PhpEngine.php:58
        • 32. /vendor/laravel/framework/src/Illuminate/View/Engines/CompilerEngine.php:72
      App\Models\HtmlFile
      1
      App\Models\Provider
      1
      App\Models\Topic
      1
      App\Models\Subject
      1
      App\Models\Course
      1
        _token
        VKesTRcUlwAGOlX7gk5Q4vR3KxMNjTS9wVysTLkg
        locale
        en
        _previous
        array:1 [ "url" => "https://www.corspedia.com/en/courses/machine-learning-for-musicians-and-artist...
        _flash
        array:2 [ "old" => [] "new" => [] ]
        PHPDEBUGBAR_STACK_DATA
        []
        path_info
        /en/courses/machine-learning-for-musicians-and-artists
        status_code
        200
        
        status_text
        OK
        format
        html
        content_type
        text/html; charset=UTF-8
        request_query
        []
        
        request_request
        []
        
        request_headers
        0 of 0
        array:24 [ "sec-ch-ua-mobile" => array:1 [ 0 => "?0" ] "sec-ch-ua" => array:1 [ 0 => ""HeadlessChrome";v="129", "Not=A?Brand";v="8", "Chromium";v="129"" ] "cache-control" => array:1 [ 0 => "no-cache" ] "pragma" => array:1 [ 0 => "no-cache" ] "cdn-loop" => array:1 [ 0 => "cloudflare; loops=1" ] "priority" => array:1 [ 0 => "u=0, i" ] "upgrade-insecure-requests" => array:1 [ 0 => "1" ] "user-agent" => array:1 [ 0 => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)" ] "cf-connecting-ip" => array:1 [ 0 => "3.21.41.164" ] "accept" => array:1 [ 0 => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7" ] "sec-fetch-site" => array:1 [ 0 => "none" ] "cf-visitor" => array:1 [ 0 => "{"scheme":"https"}" ] "sec-fetch-mode" => array:1 [ 0 => "navigate" ] "sec-fetch-user" => array:1 [ 0 => "?1" ] "x-forwarded-proto" => array:1 [ 0 => "https" ] "cf-ipcountry" => array:1 [ 0 => "US" ] "accept-encoding" => array:1 [ 0 => "gzip, br" ] "sec-fetch-dest" => array:1 [ 0 => "document" ] "sec-ch-ua-platform" => array:1 [ 0 => ""Windows"" ] "x-forwarded-for" => array:1 [ 0 => "3.21.41.164" ] "cf-ray" => array:1 [ 0 => "914c27f2cbdde806-ORD" ] "host" => array:1 [ 0 => "www.corspedia.com" ] "content-length" => array:1 [ 0 => "" ] "content-type" => array:1 [ 0 => "" ] ]
        request_server
        0 of 0
        array:50 [ "USER" => "www-data" "HOME" => "/var/www" "HTTP_SEC_CH_UA_MOBILE" => "?0" "HTTP_SEC_CH_UA" => ""HeadlessChrome";v="129", "Not=A?Brand";v="8", "Chromium";v="129"" "HTTP_CACHE_CONTROL" => "no-cache" "HTTP_PRAGMA" => "no-cache" "HTTP_CDN_LOOP" => "cloudflare; loops=1" "HTTP_PRIORITY" => "u=0, i" "HTTP_UPGRADE_INSECURE_REQUESTS" => "1" "HTTP_USER_AGENT" => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)" "HTTP_CF_CONNECTING_IP" => "3.21.41.164" "HTTP_ACCEPT" => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7" "HTTP_SEC_FETCH_SITE" => "none" "HTTP_CF_VISITOR" => "{"scheme":"https"}" "HTTP_SEC_FETCH_MODE" => "navigate" "HTTP_SEC_FETCH_USER" => "?1" "HTTP_X_FORWARDED_PROTO" => "https" "HTTP_CF_IPCOUNTRY" => "US" "HTTP_ACCEPT_ENCODING" => "gzip, br" "HTTP_SEC_FETCH_DEST" => "document" "HTTP_SEC_CH_UA_PLATFORM" => ""Windows"" "HTTP_X_FORWARDED_FOR" => "3.21.41.164" "HTTP_CF_RAY" => "914c27f2cbdde806-ORD" "HTTP_HOST" => "www.corspedia.com" "REDIRECT_STATUS" => "200" "SERVER_NAME" => "corspedia.com" "SERVER_PORT" => "443" "SERVER_ADDR" => "141.95.147.152" "REMOTE_USER" => "" "REMOTE_PORT" => "40704" "REMOTE_ADDR" => "172.70.100.153" "SERVER_SOFTWARE" => "nginx/1.18.0" "GATEWAY_INTERFACE" => "CGI/1.1" "HTTPS" => "on" "REQUEST_SCHEME" => "https" "SERVER_PROTOCOL" => "HTTP/2.0" "DOCUMENT_ROOT" => "/var/www/corspedia/public" "DOCUMENT_URI" => "/index.php" "REQUEST_URI" => "/en/courses/machine-learning-for-musicians-and-artists" "SCRIPT_NAME" => "/index.php" "CONTENT_LENGTH" => "" "CONTENT_TYPE" => "" "REQUEST_METHOD" => "GET" "QUERY_STRING" => "" "SCRIPT_FILENAME" => "/var/www/corspedia/public/index.php" "PATH_INFO" => "" "FCGI_ROLE" => "RESPONDER" "PHP_SELF" => "/index.php" "REQUEST_TIME_FLOAT" => 1740029965.4866 "REQUEST_TIME" => 1740029965 ]
        request_cookies
        []
        
        response_headers
        0 of 0
        array:5 [ "content-type" => array:1 [ 0 => "text/html; charset=UTF-8" ] "cache-control" => array:1 [ 0 => "no-cache, private" ] "date" => array:1 [ 0 => "Thu, 20 Feb 2025 05:39:25 GMT" ] "set-cookie" => array:2 [ 0 => "XSRF-TOKEN=eyJpdiI6InhmaXVzS1ZYQThKWm94blp3dERpaVE9PSIsInZhbHVlIjoiV3NodVp6d1lkTWpINE9FdVcvOW4zcWpIa09CTFBmTHA3ZllNdkdSaDJuOW5EM2ovUXYyVEpvY3EwZXZBYWZZcVViU0Y5TXRnS1MvOVZpSmJlZ0hvdTFBam55dDRGYkpyZ0RRWDUzNHhDNW5leExuZ2E1Ulg1bDU0djRKSTh3QXYiLCJtYWMiOiI4ZTFjNTZhMDU2YjNmMWI3NjYwN2ZiODhmNjQ0MWFjMGViOTk2MjZhYmMxYTFjODQ0OGRlYjQwYjI3ZjkwYTdjIiwidGFnIjoiIn0%3D; expires=Thu, 20 Feb 2025 07:39:25 GMT; Max-Age=7200; path=/; samesite=laxXSRF-TOKEN=eyJpdiI6InhmaXVzS1ZYQThKWm94blp3dERpaVE9PSIsInZhbHVlIjoiV3NodVp6d1lkTWpINE9FdVcvOW4zcWpIa09CTFBmTHA3ZllNdkdSaDJuOW5EM2ovUXYyVEpvY3EwZXZBYWZZcVViU0Y5T" 1 => "laravel_session=eyJpdiI6Im83dEh3cWpSVmZLZ1R1YXVvVi9iUnc9PSIsInZhbHVlIjoiQTRmbWhvWWlqc3Qza1BGeDJuMEE3dFdQZmF2eU1IdCtZNW1YckZHSEcyc0xnLzNzc092R2pwcE9sWEo3RVlMSkxqUzBtYi9jQnQxdnEwVlZkL01yUDRkK0E3WEp2UWhVbVllZTl1bWxkdE5tYm1XcGJpV1ZNQ2NTRWJqLzBCa1oiLCJtYWMiOiI2YTk3MzdiZjRlNDk2ZTUyZDljOGUzNzY1MDYyZDIxOTVmOTUxNzYxODgyYTRlY2VhZDA2OTJkMTQ2ZWEzZWY5IiwidGFnIjoiIn0%3D; expires=Thu, 20 Feb 2025 07:39:25 GMT; Max-Age=7200; path=/; httponly; samesite=laxlaravel_session=eyJpdiI6Im83dEh3cWpSVmZLZ1R1YXVvVi9iUnc9PSIsInZhbHVlIjoiQTRmbWhvWWlqc3Qza1BGeDJuMEE3dFdQZmF2eU1IdCtZNW1YckZHSEcyc0xnLzNzc092R2pwcE9sWEo3RVlMSkxq" ] "Set-Cookie" => array:2 [ 0 => "XSRF-TOKEN=eyJpdiI6InhmaXVzS1ZYQThKWm94blp3dERpaVE9PSIsInZhbHVlIjoiV3NodVp6d1lkTWpINE9FdVcvOW4zcWpIa09CTFBmTHA3ZllNdkdSaDJuOW5EM2ovUXYyVEpvY3EwZXZBYWZZcVViU0Y5TXRnS1MvOVZpSmJlZ0hvdTFBam55dDRGYkpyZ0RRWDUzNHhDNW5leExuZ2E1Ulg1bDU0djRKSTh3QXYiLCJtYWMiOiI4ZTFjNTZhMDU2YjNmMWI3NjYwN2ZiODhmNjQ0MWFjMGViOTk2MjZhYmMxYTFjODQ0OGRlYjQwYjI3ZjkwYTdjIiwidGFnIjoiIn0%3D; expires=Thu, 20-Feb-2025 07:39:25 GMT; path=/XSRF-TOKEN=eyJpdiI6InhmaXVzS1ZYQThKWm94blp3dERpaVE9PSIsInZhbHVlIjoiV3NodVp6d1lkTWpINE9FdVcvOW4zcWpIa09CTFBmTHA3ZllNdkdSaDJuOW5EM2ovUXYyVEpvY3EwZXZBYWZZcVViU0Y5T" 1 => "laravel_session=eyJpdiI6Im83dEh3cWpSVmZLZ1R1YXVvVi9iUnc9PSIsInZhbHVlIjoiQTRmbWhvWWlqc3Qza1BGeDJuMEE3dFdQZmF2eU1IdCtZNW1YckZHSEcyc0xnLzNzc092R2pwcE9sWEo3RVlMSkxqUzBtYi9jQnQxdnEwVlZkL01yUDRkK0E3WEp2UWhVbVllZTl1bWxkdE5tYm1XcGJpV1ZNQ2NTRWJqLzBCa1oiLCJtYWMiOiI2YTk3MzdiZjRlNDk2ZTUyZDljOGUzNzY1MDYyZDIxOTVmOTUxNzYxODgyYTRlY2VhZDA2OTJkMTQ2ZWEzZWY5IiwidGFnIjoiIn0%3D; expires=Thu, 20-Feb-2025 07:39:25 GMT; path=/; httponlylaravel_session=eyJpdiI6Im83dEh3cWpSVmZLZ1R1YXVvVi9iUnc9PSIsInZhbHVlIjoiQTRmbWhvWWlqc3Qza1BGeDJuMEE3dFdQZmF2eU1IdCtZNW1YckZHSEcyc0xnLzNzc092R2pwcE9sWEo3RVlMSkxq" ] ]
        session_attributes
        0 of 0
        array:5 [ "_token" => "VKesTRcUlwAGOlX7gk5Q4vR3KxMNjTS9wVysTLkg" "locale" => "en" "_previous" => array:1 [ "url" => "https://www.corspedia.com/en/courses/machine-learning-for-musicians-and-artists" ] "_flash" => array:2 [ "old" => [] "new" => [] ] "PHPDEBUGBAR_STACK_DATA" => [] ]