Robohub.org
 

Write and play your own sheet music with the Gocen


by
09 November 2012



share this:
12-0205-r

The Gocen is a device which scans and plays handwritten sheet music in real time. It is being developed by a group at the Tokyo Metropolitan University led by Assistant Professor Tetsuaki Baba.

“First, the system looks at the stave, then at the notes, then at the position of the notes, to determine the high notes. In addition, it directly reads words such as piano or guitar. The computer automatically recognizes them, and changes the instrument. Also, for example, if this melody is in F minor, rather than C major, when the system reads the letters Fm, it has the ability to add four flats.”

The sheet music image is analyzed using the OpenCV library in combination with a unique algorithm. While the play head is above a note it will continue to sound that key, and in the case of stringed instruments, if you move it up and down it can make the pitch fluctuate. Also, the size of the notes determines the volume level and it can handle chords as well.

“This idea arose when we were talking with music publishing companies. Until now, sheet music was really only used by placing it on a stand to play an instrument. But it could be played by computer in real time, and given various expressions. We think a system like this will make it easier for children and beginners to learn about musical notation.”

“Lots of people use computers to compose music, but it’s been found through research that paper works well at the initial stage, for deciding what kind of composition, or what kind of melody. In that regard, I feel that this system is very effective as a composition support system.”



tags:


DigInfo TV is a Tokyo-based online video news platform dedicated to producing original coverage of cutting edge technology, research and products from Japan.
DigInfo TV is a Tokyo-based online video news platform dedicated to producing original coverage of cutting edge technology, research and products from Japan.

            AUAI is supported by:



Subscribe to Robohub newsletter on substack



Related posts :

Soft exosuit makes it easier to stand up

Robotic system helps users stand up and walk more efficiently.

Robot swarms trained by trial and error in simulation keep working on real robots

  17 Nov 2026
Researchers have developed a new approach to reinforcement learning that helps robot swarms, allowing behaviours learned in simulation to transfer reliably to real-world robots.

Watch the IROS 2026 plenary and keynote talks

  16 Nov 2026
Catch up on the invited presentations from the International Conference on Intelligent Robots and Systems.

Robot Talk Episode 170 – Robots in the real world, with Daniela Shchegelskaya

  13 Nov 2026
In the latest episode of the Robot Talk podcast, Claire chatted to Daniela Shchegelskaya from the University of Twente about getting robots to operate reliably in safety-critical environments.

AI100 report released: embodied AI highlighted as grand challenge

  11 Nov 2026
Embodied AI is listed as one of the most inspiring open grand challenges.

AIhub coffee corner: Are humanoids the future of embodied AI?

  09 Nov 2026
The AIhub coffee corner captures the musings of AI experts over a short conversation.

Robot Talk Episode 169 – Robot sensing inspired by nature, with Dexter Shepherd

  06 Nov 2026
In the latest episode of the Robot Talk podcast, Claire chatted to Dexter Shepherd from the University of Sussex about using artificial intelligence to help robots understand and adapt to their environment.

Robots in society, business and culture: October 2026

We showcase a selection of robotics stories from society, business, research and culture.


↑


AUAI is supported by:







Subscribe to Robohub newsletter on substack




 















©2026.05 - Association for the Understanding of Artificial Intelligence