Play a Bach duet with an AI counterpoint

To enjoy a duet with German composer Johann Sebastian Bach, you really do not have to travel back again to the 18th century many thanks to a new plan formulated by scientists at the College of Rochester, you only need to have a laptop.

Scientists at the College of Rochester Hajim School of Engineering & Applied Sciences have developed a world-wide-web-centered method named BachDuet that will allow users to improvise duets with synthetic intelligence (AI) counterparts in true-time. By browsing the BachDuet site, users can play duets with the AI agent working with a computer keyboard, mouse, touchscreen, or MIDI keyboard.

The website-dependent software, called BachDuet, was produced by Zhiyao Duan, an affiliate professor of electrical and pc engineering and of laptop or computer science, and associates of his lab, which includes Yongi Zang ’23 and PhD college student Christodoulos Benetatos. BachDuet makes it possible for a particular person to improvise duets in the design of Bach with an artificial intelligence (AI) counterpoint in authentic-time. By going to the BachDuet internet site, a person can engage in duets with the AI agent utilizing a pc keyboard, mouse, touchscreen, or MIDI keyboard.

In BachDuet, the AI agent will either abide by the human musician, lead the improvisation, or “just goof about,” Duan suggests.

But the researchers foresee the system could have applications in new music education and learning, enjoyment, and songs remedy. For instance, claims Duan, “most of the existing musical therapies are listening-dependent, but in recent decades we have seen some participating in-based mostly music therapies that have been shown to enable enhance cognitive features.”

BachDuet is aspect of Duan’s analysis challenge, funded by a Nationwide Science Foundation College Early Career Development (Profession) award, to develop algorithms and techniques that allow humans to work with equipment to harmonize pitch, coordinate musical timing, and express expression in audio.

His lab makes use of sign processing, artificial intelligence, and equipment learning algorithms, which can empower devices with audio perception techniques, a lot more expressive performance, and further “understanding” of new music theory and composition. For this job, the staff input hundreds of Bach’s compositions and utilised device finding out approaches to let the software to “study” the music. All through improvisation, the system assumes a 4/4 time signature and decides which notice to cause or sustain.

“The objective of our project is to produce applications that allow individuals to play new music with pc units equivalent to human musicians collaborating,” Duan says. “With BachDuet, we wanted to develop a device that will allow musicians and novices alike to apply counterpoint improvisation.”

“And,” he adds, “to have fun.”

Source: College of Rochester