DAW-XR: Revolutionary Browser-based VR/AR Digital Audio Workstation
Welcome to the future of music production. DAW-XR combines WebAudio and WebXR technologies to create a powerful, accessible Digital Audio Workstation right in your browser.
Team: ZenonO|CharlesC|KaunakB|KevinO|DevonW

by Charles Cai

Reimagining Music Production
Democratizing Creation
DAW-XR eliminates the need for expensive hardware and software. All you need is a browser and your creativity.
Immersive Experience
Visualize and interact with your music in 3D/4D space using WebXR technology.
Screenshots
Your "music" has been loaded into 3D/XR space.
Different music has different shape.
Core Features: Visualization and Interaction

3D/4D Visualization
Upload MIDI files to see notes visualized in 3D space, representing pitch, timing, duration, and velocity.
(done)

Interactive Editing
Use VR/XR controllers to manipulate individual notes and apply transformations in real-time.
(Work-in-Progress)

Browser-Based
Access powerful music production tools from any WebXR-compatible browser.
(done)
Technology Stack
React Three Fiber
Leveraging Three.js for powerful 3D rendering within React applications.
React Three XR
Enabling seamless integration of WebXR for immersive VR and AR experiences.
WebAudio API
Providing high-performance audio processing and synthesis capabilities in the browser.
Development Journey

1

Learning Curve
Mastering new frameworks and wrappers presented initial challenges.

2

Functional Programming
Implementing precise timing and animations using React hooks like UseRef and UseFrame.

3

Collision Detection
Developing 3D object interactivity for intuitive music manipulation.
Key Achievements
Functional Prototype
Successfully implemented core visualization and basic interaction features.
Cutting-Edge Compatibility
DAW-XR is compatible with the latest Android XR announced by Google and Samsung.
Skill Acquisition
Better at React Three Fiber, React Three XR, and advanced animation techniques using GSAP, etc… still a lot to learn!
Future Roadmap
1
Enhanced Interaction
Complete full note manipulation and transformation capabilities.
2
Dual Interface
Support both browser-based interaction and XR glasses for versatile use.
3
Plug-ins, AI Integration
Implement AI-assisted composition and sound design features (via WASM from C++ plug-ins, Multimodality API)
4
Collaborative Tools
Develop real-time multi-user sessions for remote collaboration (via WebSocket)
Join the DAW-XR Revolution

1

Try the Demo
Experience DAW-XR's capabilities firsthand in your browser.

2

Contribute
Join our open-source community and help shape the future of music production.

3

Stay Updated
Follow our development progress and be the first to access new features.
Made with Gamma