A new fun and intuitive way to learn the piano using Augmented Reality
For more details check out https://magickeys.app
OverviewMagic Keys is a Mixed Reality piano learning app using a fun and innovative way of learning the instrument. With a very accessible 3D notation system, similar to the likes of Guitar Hero, users can play along simple pieces within minutes without having to read sheet music. Using Mixed Reality technology the notes are directly projected on top of the real-world piano keyboard providing a seamless interface to the music. On top of that Magic Keys aims to become a fully-featured virtual piano teacher including a learning schedule and interactive lessons for learning technique, music theory, improvisation and much more.
My VisionMy goal with Magic Keys is to lower the barrier of entry for anyone wishing to learn the piano. I want to provide an innovative new way of learning or just having fun. Learning and playing the piano has been one of the most meaningful and rewarding activites I have done in my life. More and more people wish to learn the piano as an adult, however, for many the beginning seems too daunting to even try - from reading sheet music to navigating the 88 keys to coordinating left and right hand. My mission is to keep all these people enganged in following their dream and give them a fun platform to explore this wonderful instrument.
The Virtual Piano TeacherMy long-term goal for this project has always been to turn it into a virtual environment for home piano learning. In the last years more and more people have started to learn the piano in self-study due to the increasing number of online resources including high-quality YouTube video lessons but also online learning apps and platforms. However, with the power of Mixed Reality and the sensory capabilities of modern devices like the Quest, virtual piano teaching can be brought to a whole new level. There are so many potential ways to enrich the piano learning experience but here are a few ideas:
- Learning notes and the piano keyboard
Simple exercises or games to recognize the note names and match them with the proper keys could increase the early-stage learning rate.
- Technical exercises
A whole lot of enjoyable and still pianistically valuable exercises could be realized. By adding a level system, students would be even more aware of their progress and more likely to remain motivated.
- Dictionary of chords, scales etc.
Players could look up all possible chords and scales and would be able to see them highlighted right on top of the keyboard.
- Theory Lessons
With AR and a 3D notation system music theory lessons could be designed in a very visual and interactive way.