For this research, the Author come up with an idea to create
two separate software. Each of the software serves its own
particular purpose.
The first software will be focused on performance. Students
will be able to perform music, strictly monophonic melody.
The inspiration behind this software is one of the oldest
motion recognition musical instrument which is Theremin.
The way we perform with the software is by using both of our
hand. By positioning their hand on top of the Leap Motion, the
student can play and perform a melody.
The right hand will control the pitch. By moving their hand
vertically, the student can control which pitch that they want
to perform. The display on the software will show the student
which note they are playing at the time. On the image below,
if the student put their hand on the position of the note Re then
the software will show the note name on the display.
The left hand will control the note on and off situation. By
clenching their fist, the student will send signal to the Leap
Motion to start playing a musical melody based on the pitch
information that's relayed from the right hand position. By
unclenching their fist, the student will send signal to the Leap
Motion to stop playing the note. The students can tell if the
note is on or off by looking at the right bottom part of the
software visual. If the note is on it will spell play, if the note is
off it will spell stop.
The music education aspect comes in to play with the
additional note information. This way, the student can learn,
memorize, and understand more about the musical notes that
they perform. The second software will be a music video game. Students
will be able to practice their mastery of using the Leap Motion
by playing a game. The inspiration behind this software is
commercial music video game such as Rock Band and Guitar
Hero.
The way the student play with the game is almost the same
with any other note scrolling music video game. A series of
note will come from the right and left side of the screen as
instruction for the student. The student will then have to
position their hand at the right vertical position to trigger the
right note. based on the game instruction. If the student hit the
wrong note or didn't position their hand correctly, the melody
for that note will not be played. If the student hit the right
note, only then the melody for that note will be played.
By playing with this interactive music video game the student
can learn the name of the notes that they are playing with
through the information from the game visual. Every time the
student hit the right note, the screen will show the name of the
note that they are hitting. On the next screenshot, if the student hit the note F at the right time it is shown in the middle of the
screen.