Prompt2Binaural: Demo Page

This page demonstrates our model's ability to generate binaural audio from different types of prompts and spatial parameters.

🎧 Please wear headphones for the best binaural listening experience.

Method Overview

Overview of the Prompt2Binaural method
Add your method figure as method-figure.jpg to show it at the top of this page.
Text Speaker Prompt Binaural Prompt
or Parameter
GT M2B TTS-HRTF TTS-M2B Prompt2Binaural
(Speech)
Prompt2Binaural
(Description)
Front (0°)
"Clearly, it can go either way." Reference Speaker
Speech Prompt
Description Prompt "The speaker moved from close to distant in front"
Binaural Parameter "Direction:0°,Distance: near to far"
"Others were in hiding, in fear of their lives." Reference Speaker
Speech Prompt
Description Prompt "The speaker is motionless in front"
Binaural Parameter "Direction:0°,Distance: stationary"
"Six spoons of fresh snow peas, five thick slabs of blue cheese, and maybe a snack for her brother Bob." Reference Speaker
Speech Prompt
Description Prompt "The speaker came closer from a far position in front"
Binaural Parameter "Direction:0°,Distance: far to near"
Left Front (45°)
"By then, he was walking on water." Reference Speaker
Speech Prompt
Description Prompt "The speaker transitioned from a close location to a distant one from the left front"
Binaural Parameter "Direction:45°,Distance: near to far"
"It carried a double message." Reference Speaker
Speech Prompt
Description Prompt "The speaker stands unmoving in the left front position"
Binaural Parameter "Direction:45°,Distance: stationary"
"Of course, on Tuesday, United were beaten despite this." Reference Speaker
Speech Prompt
Description Prompt "The speaker advanced from far away to nearby from the left front"
Binaural Parameter "Direction:45°,Distance: far to near"
Left (90°)
"We also need a small plastic snake and a big toy frog for the kids." Reference Speaker
Speech Prompt
Description Prompt "The speaker approached from a remote position to a closer one from the left"
Binaural Parameter "Direction:90°,Distance: far to near"
"It's really no great surprise, because the price difference is so much." Reference Speaker
Speech Prompt
Description Prompt "The speaker remains fixed on the left"
Binaural Parameter "Direction:90°,Distance: stationary"
"There is , according to legend, a boiling pot of gold at one end." Reference Speaker
Speech Prompt
Description Prompt "The speaker moved from near to far from the left"
Binaural Parameter "Direction:90°,Distance: near to far"
Back Left (135°)
"Six spoons of fresh snow peas, five thick slabs of blue cheese, and maybe a snack for her brother Bob." Reference Speaker
Speech Prompt
Description Prompt "The speaker relocated from near to far from the back left"
Binaural Parameter "Direction:135,Distance: near to far"
"Mexico City was a wonderful experience." Reference Speaker
Speech Prompt
Description Prompt "The speaker is motionless at the back left"
Binaural Parameter "Direction:135°,Distance: stationary"
"Ask her to bring these things with her from the store." Reference Speaker
Speech Prompt
Description Prompt "The speaker shifted from a distant spot to a closer one from the back left"
Binaural Parameter "Direction:135°,Distance: far to near"
Back (180°)
"The rainbow is a division of white light into many beautiful colors." Reference Speaker
Speech Prompt
Description Prompt "The speaker moved from near to far from behind"
Binaural Parameter "Direction:180°,Distance: near to far"
"Ask her to bring these things with her from the store." Reference Speaker
Speech Prompt
Description Prompt "The speaker remains motionless in the back"
Binaural Parameter "Direction:180°,Distance: stationary"
"Aristotle thought that the rainbow was caused by reflection of the sun's rays by the rain." Reference Speaker
Speech Prompt
Description Prompt "The speaker advanced from far away to nearby from behind"
Binaural Parameter "Direction:180°,Distance: far to near"
Back Right (225°)
"There is , according to legend, a boiling pot of gold at one end." Reference Speaker
Speech Prompt
Description Prompt "The speaker relocated from near to far from the back right"
Binaural Parameter "Direction:225°,Distance: near to far"
"Their courage, and their honesty, should be respected." Reference Speaker
Speech Prompt
Description Prompt "The speaker stays rooted in place at the back right"
Binaural Parameter "Direction:225°,Distance: stationary"
"These awards will deliver improvements on the ground." Reference Speaker
Speech Prompt
Description Prompt "The speaker approached from a remote position to a closer one from the back right"
Binaural Parameter "Direction:225°,Distance: far to near"
Right (270°)
"There is , according to legend, a boiling pot of gold at one end." Reference Speaker
Speech Prompt
Description Prompt "The speaker progressed from a distant location to a nearby one on the right"
Binaural Parameter "Direction:270°,Distance: far to near"
"Please call Stella." Reference Speaker
Speech Prompt
Description Prompt "The speaker holds her position on the right"
Binaural Parameter "Direction:270°,Distance: stationary"
"The rainbow is a division of white light into many beautiful colors." Reference Speaker
Speech Prompt
Description Prompt "The speaker shifted from a near spot to a farther one on the right"
Binaural Parameter "Direction:270°,Distance: near to far"
Front Right (315°)
"People look, but no one ever finds it." Reference Speaker
Speech Prompt
Description Prompt "The speaker traveled from nearby to far away from the front right"
Binaural Parameter "Direction:315°,Distance: near to far"
"Schools do not create that." Reference Speaker
Speech Prompt
Description Prompt "The speaker remains fixed at the front right"
Binaural Parameter "Direction:315°,Distance: stationary"
"The Greeks used to imagine that it was a sign from the gods to foretell war or heavy rain." Reference Speaker
Speech Prompt
Description Prompt "The speaker transitioned from far to near from the front right"
Binaural Parameter "Direction:315°,Distance: far to near"