Voxon VX1
Producer
Gameplay Programmer
VFX Technical Artist
NOV – DEC, 2023
About this project
Beatbox was a game project developed during Round 4 of Carnegie Mellon University’s renowned course, Building Virtual Worlds (BVW) at the Entertainment Technology Center (ETC). The goal of this project was to create an interactive and engaging experience for an emerging platform beyond traditional VR headsets.
Our team developed a musical rhythm game for the Voxon VX1, a volumetric display system created by Voxon Photonics. This innovative technology generates true three-dimensional (3D) images that can be viewed from any angle without the need for special glasses. It achieves this by rapidly projecting images onto a high-speed moving screen, using a combination of motion and light to create a fully 3D holographic effect.
BeatBox Gamplay Demo
My Roles
As the producer on the team, I oversee all aspects of the project’s production, including course logistics, game ideation and brainstorming, in-game features, gameplay programming, visual effects, and sound design. My role is to ensure that the final build is delivered on time and meets our expectations.
In my role as the gameplay programmer and VFX technical artist, I focus on programming and implementing sound-reactive visual effects that sync with the beat, creating a dynamic and visually engaging experience for the audience.
My Development Recap
Sound-reactive VFX prototypes
I divided the sound frequency range (20Hz–20,000Hz) of a sound clip into multiple sub-ranges, using 3D rectangles to visually represent each one. The size of each rectangle dynamically responds to the volume within its corresponding frequency range, creating a real-time visual reaction to the audio.
Next, I applied colorful materials to the blocks to enhance their visual appeal and tested the Voxon VX1’s ability to render these effects effectively.
In addition to the block materials, I also created various 3D objects that react to the sound beats. For example, I designed a disco ball and positioned it at the center of the scene to enhance the overall visual dynamics. (The capsules flying toward the edges represent the keys or notes that players must hit in time with the rhythm by pressing the button.)
Finally, I introduced block pattern variations and bubble-flying visual effects to make the game feel more dynamic and engaging, while ensuring these elements remained subtle enough not to distract players from hitting the keys.
Festival Preparation
BeatBox was also selected to be showcased and played by guests at the ETC Festival. To match the game’s vibrant theme, we decorated our show room with fluorescent artwork and reflective materials, creating a neon, disco-inspired atmosphere.
Team 54
A fun fact about our team is that one of our members, Uju Anya, is actually an associate professor of Second Language Acquisition at Carnegie Mellon University. She took on the role of sound designer for this project, and thanks to her, our show room looked and felt amazing. I’m really thankful for all my teammates. They were super supportive throughout the entire project. Whether it was handling course logistics, creating assets, or helping with gameplay features, everyone pitched in and made this a great experience.
