WEBVTT

00:00:00.000 --> 00:00:04.750 align:middle line:90%


00:00:04.750 --> 00:00:07.570 align:middle line:90%
Quantitative movement analysis.

00:00:07.570 --> 00:00:10.300 align:middle line:84%
In addition to qualitative
analysis techniques,

00:00:10.300 --> 00:00:13.250 align:middle line:84%
such as the lab annotation
and lab and movement analysis,

00:00:13.250 --> 00:00:15.250 align:middle line:84%
there are also numerous
methods and technologies

00:00:15.250 --> 00:00:17.860 align:middle line:84%
for numerical recording
or music-led motion,

00:00:17.860 --> 00:00:20.440 align:middle line:84%
or what is often
called motion capture.

00:00:20.440 --> 00:00:22.990 align:middle line:84%
Very generally, we will
talk about two main types

00:00:22.990 --> 00:00:25.270 align:middle line:90%
of technologies.

00:00:25.270 --> 00:00:27.760 align:middle line:84%
We have the
camera-based systems,

00:00:27.760 --> 00:00:30.370 align:middle line:84%
and we have the
sensor-based systems.

00:00:30.370 --> 00:00:33.727 align:middle line:84%
And each of these have
a few subcategories.

00:00:33.727 --> 00:00:35.560 align:middle line:84%
First we are going to
look a little bit more

00:00:35.560 --> 00:00:37.810 align:middle line:90%
at the camera-based systems.

00:00:37.810 --> 00:00:40.030 align:middle line:84%
The great thing about
cameras is that they

00:00:40.030 --> 00:00:43.330 align:middle line:84%
are an easy, fast, cheap,
and not the least, available

00:00:43.330 --> 00:00:45.670 align:middle line:84%
solution to working
systematically

00:00:45.670 --> 00:00:48.220 align:middle line:84%
with the study of
music related motion.

00:00:48.220 --> 00:00:49.900 align:middle line:90%
[BACKGROUND VIDEO CHATTER]

00:00:49.900 --> 00:00:53.230 align:middle line:84%
Nowadays everyone has access
to high quality video cameras,

00:00:53.230 --> 00:00:55.420 align:middle line:90%
even in their mobile phones.

00:00:55.420 --> 00:00:57.940 align:middle line:84%
And the cost of professional
quality video cameras

00:00:57.940 --> 00:01:00.640 align:middle line:84%
is also within the
reach for many.

00:01:00.640 --> 00:01:02.230 align:middle line:84%
But in the world
of motion capture,

00:01:02.230 --> 00:01:05.050 align:middle line:84%
there are many other types
of camera-based systems

00:01:05.050 --> 00:01:08.340 align:middle line:90%
beyond the regular cameras.

00:01:08.340 --> 00:01:11.280 align:middle line:84%
Here we often talk about two
different types of variables

00:01:11.280 --> 00:01:13.968 align:middle line:84%
that we need to
take into account.

00:01:13.968 --> 00:01:15.510 align:middle line:84%
The first one is
whether we are going

00:01:15.510 --> 00:01:18.270 align:middle line:84%
to use cameras that capture
the same thing that we see,

00:01:18.270 --> 00:01:20.490 align:middle line:84%
that is, regular
light, or use cameras

00:01:20.490 --> 00:01:23.257 align:middle line:84%
that record, for example,
only the infrared light.

00:01:23.257 --> 00:01:24.450 align:middle line:90%
[CLUB MUSIC]

00:01:24.450 --> 00:01:26.172 align:middle line:84%
Infrared cameras
can, for example,

00:01:26.172 --> 00:01:27.630 align:middle line:84%
be very useful if
you want to study

00:01:27.630 --> 00:01:30.210 align:middle line:84%
people dancing in a
dark club or other types

00:01:30.210 --> 00:01:34.420 align:middle line:90%
of dark environments.

00:01:34.420 --> 00:01:35.940 align:middle line:84%
The second we need
to think about

00:01:35.940 --> 00:01:39.380 align:middle line:84%
is whether we are using
markers on the body or not.

00:01:39.380 --> 00:01:42.590 align:middle line:84%
Markers can help identify
people or specific body parts

00:01:42.590 --> 00:01:46.220 align:middle line:84%
in a much more detailed way
than a marker-less system can.

00:01:46.220 --> 00:01:48.020 align:middle line:84%
Of course, putting
markers on a body

00:01:48.020 --> 00:01:50.578 align:middle line:84%
makes the whole setup
much more complex.

00:01:50.578 --> 00:01:52.370 align:middle line:84%
We're later going to
look at demonstrations

00:01:52.370 --> 00:01:54.350 align:middle line:84%
of how both regular
cameras and a more

00:01:54.350 --> 00:01:56.780 align:middle line:84%
advanced camera-based
motion capture system

00:01:56.780 --> 00:02:00.130 align:middle line:84%
can be used to
capture human motion.

00:02:00.130 --> 00:02:02.770 align:middle line:84%
But first let us talk a little
bit about sensor-based motion

00:02:02.770 --> 00:02:03.640 align:middle line:90%
capture.

00:02:03.640 --> 00:02:08.449 align:middle line:84%
Sensor-based systems are
built around sensors.

00:02:08.449 --> 00:02:09.860 align:middle line:84%
And here again
there are a number

00:02:09.860 --> 00:02:12.680 align:middle line:84%
of different types
of technologies,

00:02:12.680 --> 00:02:16.070 align:middle line:84%
such as acoustic sensors,
mechanical sensors,

00:02:16.070 --> 00:02:18.860 align:middle line:84%
magnetic sensors,
inertial sensors,

00:02:18.860 --> 00:02:21.110 align:middle line:90%
and electrical sensors.

00:02:21.110 --> 00:02:22.730 align:middle line:84%
Common to all of
these is that they

00:02:22.730 --> 00:02:25.430 align:middle line:84%
require to be put on
the body of the people

00:02:25.430 --> 00:02:27.620 align:middle line:84%
to be studied, which
makes them less

00:02:27.620 --> 00:02:30.620 align:middle line:84%
attractive for many
musical applications.

00:02:30.620 --> 00:02:33.430 align:middle line:84%
However, as the
technologies are constantly

00:02:33.430 --> 00:02:36.430 align:middle line:84%
getting smaller, faster,
and more reliable,

00:02:36.430 --> 00:02:40.682 align:middle line:84%
they are still very interesting
to use also musical contexts.

00:02:40.682 --> 00:02:42.140 align:middle line:84%
In this course, we
will demonstrate

00:02:42.140 --> 00:02:44.500 align:middle line:84%
[GUITAR PLAYING] only one
type of these systems,

00:02:44.500 --> 00:02:47.030 align:middle line:90%
the inertial ones.

00:02:47.030 --> 00:02:49.910 align:middle line:84%
But first, to conclude,
there are a number

00:02:49.910 --> 00:02:51.830 align:middle line:84%
of analytical approaches
and technologies

00:02:51.830 --> 00:02:54.260 align:middle line:84%
available for studying
music related motion.

00:02:54.260 --> 00:02:58.420 align:middle line:84%
And these are ranging from
qualitative to quantitative,

00:02:58.420 --> 00:03:02.950 align:middle line:84%
from cheap to expensive,
from small to large,

00:03:02.950 --> 00:03:06.090 align:middle line:90%
and from simple to advanced.

00:03:06.090 --> 00:03:09.390 align:middle line:84%
It is impossible to give one
answer to what type of method

00:03:09.390 --> 00:03:11.280 align:middle line:90%
or technology to use.

00:03:11.280 --> 00:03:15.520 align:middle line:84%
They all have their strengths
and their weaknesses.

00:03:15.520 --> 00:03:18.550 align:middle line:84%
For that reason, it is important
to decide on the right analysis

00:03:18.550 --> 00:03:21.340 align:middle line:90%
method for the question at hand.

00:03:21.340 --> 00:03:23.320 align:middle line:84%
And the perhaps most
important factor

00:03:23.320 --> 00:03:25.060 align:middle line:84%
that should be
taken into account

00:03:25.060 --> 00:03:28.660 align:middle line:84%
is whether to work in a
controlled laboratory setting

00:03:28.660 --> 00:03:34.550 align:middle line:84%
or in a more ecological
setting, such as a concert hall.

00:03:34.550 --> 00:03:36.590 align:middle line:84%
This will to a
large extent guide

00:03:36.590 --> 00:03:38.360 align:middle line:90%
which methods and tools to use.

00:03:38.360 --> 00:03:41.010 align:middle line:90%


00:03:41.010 --> 00:03:43.020 align:middle line:84%
We can say that more
specialised motion capture

00:03:43.020 --> 00:03:46.800 align:middle line:84%
systems, like for example
infrared, marker-based systems,

00:03:46.800 --> 00:03:50.220 align:middle line:84%
or the electromagnetic
systems, and various types

00:03:50.220 --> 00:03:54.000 align:middle line:84%
of those inertial sensors often
provide the highest recording

00:03:54.000 --> 00:03:58.450 align:middle line:84%
speeds and also very high
spatial accuracy and precision.

00:03:58.450 --> 00:04:02.380 align:middle line:84%
But such systems also come
with several drawbacks.

00:04:02.380 --> 00:04:03.510 align:middle line:90%
Price is one.

00:04:03.510 --> 00:04:07.330 align:middle line:84%
Although such systems have
quickly become more affordable.

00:04:07.330 --> 00:04:09.720 align:middle line:84%
More problematic is that
the person being studied

00:04:09.720 --> 00:04:12.390 align:middle line:84%
has to wear markers,
sensors on the body,

00:04:12.390 --> 00:04:15.390 align:middle line:84%
something that may be both
alienating to the performer

00:04:15.390 --> 00:04:18.398 align:middle line:84%
and obtrusive to the
motion being performed.

00:04:18.398 --> 00:04:19.440 align:middle line:90%
[CABLES AND VELCRO NOISE]

00:04:19.440 --> 00:04:21.110 align:middle line:84%
This is particularly
problematic when

00:04:21.110 --> 00:04:23.450 align:middle line:84%
using electromagnetic
and mechanical systems

00:04:23.450 --> 00:04:27.438 align:middle line:84%
with fairly large and
heavy sensors and cables.

00:04:27.438 --> 00:04:27.980 align:middle line:90%
[PIANO MUSIC]

00:04:27.980 --> 00:04:31.250 align:middle line:84%
But also the lightweight
reflective markers

00:04:31.250 --> 00:04:33.260 align:middle line:84%
typically used in
optical infrared systems

00:04:33.260 --> 00:04:36.860 align:middle line:84%
are noticed by the performer,
albeit to a lesser degree.

00:04:36.860 --> 00:04:39.380 align:middle line:84%
The perhaps biggest challenge
with the larger systems

00:04:39.380 --> 00:04:42.110 align:middle line:84%
is the non-ecological
setting they require.

00:04:42.110 --> 00:04:45.230 align:middle line:84%
While small inertial
systems, on the other hand,

00:04:45.230 --> 00:04:48.710 align:middle line:84%
can be mobile, wireless,
and more or less invisible,

00:04:48.710 --> 00:04:51.330 align:middle line:84%
although the physical sensors
need to be placed on the body.

00:04:51.330 --> 00:04:52.560 align:middle line:90%
[GUITAR MUSIC]

00:04:52.560 --> 00:04:55.250 align:middle line:84%
So if the aim is to study
musicians in the real world

00:04:55.250 --> 00:04:58.130 align:middle line:84%
concert situation,
playing video recordings

00:04:58.130 --> 00:05:01.030 align:middle line:84%
may be the only
realistic solution.

00:05:01.030 --> 00:05:03.000 align:middle line:90%