Prompt2Binaural: Demo Page
This page demonstrates our model's ability to generate binaural audio from different types of prompts and spatial parameters.
🎧
Please wear headphones for the best binaural listening experience.
Method Overview
Add your method figure as
method-figure.jpg to show it at the top of this page.
| Text | Speaker Prompt | Binaural Prompt or Parameter |
GT | M2B | TTS-HRTF | TTS-M2B | Prompt2Binaural (Speech) |
Prompt2Binaural (Description) |
|---|---|---|---|---|---|---|---|---|
| Front (0°) | ||||||||
| "Clearly, it can go either way." | Reference Speaker |
Speech Prompt
Description Prompt
"The speaker moved from close to distant in front"
Binaural Parameter
"Direction:0°,Distance: near to far"
|
||||||
| "Others were in hiding, in fear of their lives." | Reference Speaker |
Speech Prompt
Description Prompt
"The speaker is motionless in front"
Binaural Parameter
"Direction:0°,Distance: stationary"
|
||||||
| "Six spoons of fresh snow peas, five thick slabs of blue cheese, and maybe a snack for her brother Bob." | Reference Speaker |
Speech Prompt
Description Prompt
"The speaker came closer from a far position in front"
Binaural Parameter
"Direction:0°,Distance: far to near"
|
||||||
| Left Front (45°) | ||||||||
| "By then, he was walking on water." | Reference Speaker |
Speech Prompt
Description Prompt
"The speaker transitioned from a close location to a distant one from the left front"
Binaural Parameter
"Direction:45°,Distance: near to far"
|
||||||
| "It carried a double message." | Reference Speaker |
Speech Prompt
Description Prompt
"The speaker stands unmoving in the left front position"
Binaural Parameter
"Direction:45°,Distance: stationary"
|
||||||
| "Of course, on Tuesday, United were beaten despite this." | Reference Speaker |
Speech Prompt
Description Prompt
"The speaker advanced from far away to nearby from the left front"
Binaural Parameter
"Direction:45°,Distance: far to near"
|
||||||
| Left (90°) | ||||||||
| "We also need a small plastic snake and a big toy frog for the kids." | Reference Speaker |
Speech Prompt
Description Prompt
"The speaker approached from a remote position to a closer one from the left"
Binaural Parameter
"Direction:90°,Distance: far to near"
|
||||||
| "It's really no great surprise, because the price difference is so much." | Reference Speaker |
Speech Prompt
Description Prompt
"The speaker remains fixed on the left"
Binaural Parameter
"Direction:90°,Distance: stationary"
|
||||||
| "There is , according to legend, a boiling pot of gold at one end." | Reference Speaker |
Speech Prompt
Description Prompt
"The speaker moved from near to far from the left"
Binaural Parameter
"Direction:90°,Distance: near to far"
|
||||||
| Back Left (135°) | ||||||||
| "Six spoons of fresh snow peas, five thick slabs of blue cheese, and maybe a snack for her brother Bob." | Reference Speaker |
Speech Prompt
Description Prompt
"The speaker relocated from near to far from the back left"
Binaural Parameter
"Direction:135,Distance: near to far"
|
||||||
| "Mexico City was a wonderful experience." | Reference Speaker |
Speech Prompt
Description Prompt
"The speaker is motionless at the back left"
Binaural Parameter
"Direction:135°,Distance: stationary"
|
||||||
| "Ask her to bring these things with her from the store." | Reference Speaker |
Speech Prompt
Description Prompt
"The speaker shifted from a distant spot to a closer one from the back left"
Binaural Parameter
"Direction:135°,Distance: far to near"
|
||||||
| Back (180°) | ||||||||
| "The rainbow is a division of white light into many beautiful colors." | Reference Speaker |
Speech Prompt
Description Prompt
"The speaker moved from near to far from behind"
Binaural Parameter
"Direction:180°,Distance: near to far"
|
||||||
| "Ask her to bring these things with her from the store." | Reference Speaker |
Speech Prompt
Description Prompt
"The speaker remains motionless in the back"
Binaural Parameter
"Direction:180°,Distance: stationary"
|
||||||
| "Aristotle thought that the rainbow was caused by reflection of the sun's rays by the rain." | Reference Speaker |
Speech Prompt
Description Prompt
"The speaker advanced from far away to nearby from behind"
Binaural Parameter
"Direction:180°,Distance: far to near"
|
||||||
| Back Right (225°) | ||||||||
| "There is , according to legend, a boiling pot of gold at one end." | Reference Speaker |
Speech Prompt
Description Prompt
"The speaker relocated from near to far from the back right"
Binaural Parameter
"Direction:225°,Distance: near to far"
|
||||||
| "Their courage, and their honesty, should be respected." | Reference Speaker |
Speech Prompt
Description Prompt
"The speaker stays rooted in place at the back right"
Binaural Parameter
"Direction:225°,Distance: stationary"
|
||||||
| "These awards will deliver improvements on the ground." | Reference Speaker |
Speech Prompt
Description Prompt
"The speaker approached from a remote position to a closer one from the back right"
Binaural Parameter
"Direction:225°,Distance: far to near"
|
||||||
| Right (270°) | ||||||||
| "There is , according to legend, a boiling pot of gold at one end." | Reference Speaker |
Speech Prompt
Description Prompt
"The speaker progressed from a distant location to a nearby one on the right"
Binaural Parameter
"Direction:270°,Distance: far to near"
|
||||||
| "Please call Stella." | Reference Speaker |
Speech Prompt
Description Prompt
"The speaker holds her position on the right"
Binaural Parameter
"Direction:270°,Distance: stationary"
|
||||||
| "The rainbow is a division of white light into many beautiful colors." | Reference Speaker |
Speech Prompt
Description Prompt
"The speaker shifted from a near spot to a farther one on the right"
Binaural Parameter
"Direction:270°,Distance: near to far"
|
||||||
| Front Right (315°) | ||||||||
| "People look, but no one ever finds it." | Reference Speaker |
Speech Prompt
Description Prompt
"The speaker traveled from nearby to far away from the front right"
Binaural Parameter
"Direction:315°,Distance: near to far"
|
||||||
| "Schools do not create that." | Reference Speaker |
Speech Prompt
Description Prompt
"The speaker remains fixed at the front right"
Binaural Parameter
"Direction:315°,Distance: stationary"
|
||||||
| "The Greeks used to imagine that it was a sign from the gods to foretell war or heavy rain." | Reference Speaker |
Speech Prompt
Description Prompt
"The speaker transitioned from far to near from the front right"
Binaural Parameter
"Direction:315°,Distance: far to near"
|
||||||