Google: Building the First Tool to Record Spatial Audio in a New Format

Client

Google was building support for a new spatial audio format called Eclipsa Audio, based on a new open standard for recording surround sound. Since the format was brand new, no recording tools for it existed yet. Rather than build an entirely new app, Google wanted a plugin that let audio engineers record in this format using software they already knew, starting with Pro Tools, a tool trusted by many senior audio engineers.

Challenge

There was no existing tool for recording in this new format, and the format itself was complex enough that hiding that complexity from users would matter as much as making it work at all. Google needed a plugin that felt natural to professional audio engineers, performed reliably, and could prove out whether the new format would hold up in real studio conditions.

Solution

We started by talking directly to the audio engineers who’d actually use the plugin, learning what tools they already relied on and where those tools fell short, then designed around those needs instead of guessing. We built two connected plugins, one for placing sound in 3D space and one for recording everything into the new file format, with both talking to each other in real time so engineers could monitor exactly what they were creating. We also handled the certification and signing process required to get the plugin running safely inside Pro Tools.

Results

A Working Recorder for a Format That Didn’t Exist Yet.

Google had a functioning plugin that could record real spatial audio into the new Eclipsa Audio format, tested and validated by their own team and ready to move into distribution. We’re now helping prepare it for wider release and supporting the next version of the format standard. This phase of the project continued into a second one, extending the plugin to more editing tools, covered in a separate case study.

Technical Details

Built two connected JUCE-based plugins: an Audio Element plugin for spatial placement and a Renderer plugin for recording, communicating over a Publish/Subscribe model built with JUCE and ZeroMQ. Used a 5th-order ambisonics mix bus to keep each audio element’s channels separate inside Pro Tools’ internal mixing, and a custom matrix-multiplication system for low-latency upmixing and downmixing between speaker layouts. Wrote output using IAMF-format libraries alongside JUCE, and completed Pro Tools and Apple developer signing and certification for installer distribution.

What’s Next

Google moved quickly from a finished MVP into preparing for wider distribution. We’re helping build that distribution process, alongside user-facing documentation, gathering feedback from audio engineers, and updating the plugin to support the newest changes to the IAMF standard.

Building the First Tool for Something That Doesn’t Exist Yet?

If you’re turning a brand-new spec or format into a real, usable product, we can help you build the first version right.