Photon Presents New Mixed Reality Solutions at AWE 2024: Exploring Cross-Platform Collaboration with Fusion Sticky Notes
As a leader in multiplayer networking services, we are introducing two new mixed reality (MR) solutions at AWE 2024, the largest event for extended reality (XR) technology. Built using our powerful Fusion networking engine, these solutions – Fusion Sticky Notes Cross-Platform Remote Relocation and Fusion Sticky Notes Meta SSA Colocalization – demonstrate how shared virtual spaces can transform collaboration across devices and environments.
Our new samples explore how familiar tools, like sticky notes, can take on new dimensions in MR. Users can interact with virtual notes, draw collaboratively in 3D, and seamlessly share content – whether they’re using Meta Quest, Apple Vision Pro, or other headsets, and whether they’re in the same room or working remotely.
Fusion Sticky Notes: Cross-Platform Remote Relocation
This sample enables fully immersive remote collaboration across devices, bringing teams together even when they’re physically apart. Users can pick a reference point in their physical space (like a wall) when launching the application. From there, the system synchronizes spatial alignment, creating a shared Unity scene that bridges real-world environments across different devices.
Key Features
- Cross-Platform Collaboration: Regardless of the headset—whether Apple Vision Pro or Meta Quest—users can work in a shared virtual space while staying rooted in their own environments.
- Multiple Interaction Methods:
- Finger and controller tracking for hand-based interaction.
- Spatial touch input for Apple Vision Pro users.
- Logitech MX Ink support on Meta Quest for precise, controller-free input.
- Drawing Capabilities:
- Sticky Note Manipulation: Users can draw directly on sticky notes and interact with them in real-time. Virtual and real surfaces remain fully interactive, thanks to Fusion’s seamless synchronization.
- 2D Drawing on Textures: With multiple users drawing simultaneously, the system ensures real-time updates, late joiner support through Fusion’s streaming API, and smooth performance through shader-based rendering.
- 3D Drawing: Using either virtual pens or Logitech MX Ink, users can create 3D drawings on Meta Quest, which are viewable and editable across all supported platforms.
The Cross-Platform Remote Relocation sample offers teams a collaborative environment that works regardless of location or device preference, making it particularly suited for distributed workforces. Download the sample here!
Fusion Sticky Notes: Meta SSA Colocalization
The second sample focuses on same-room collaboration, leveraging Meta’s Shared Spatial Anchors (SSA) technology to align sticky notes and 3D drawings in the physical environment. This solution offers an optimized experience for colocated users, making it easy to collaborate seamlessly in real-time.
Key Features
- Colocalized Collaboration: In-room users interact with virtual sticky notes and 3D drawings that stay precisely aligned with the physical space through SSA technology.
- Concurrent Drawing: Thanks to Fusion’s synchronization and interpolation, multiple users can edit the same surface at the same time, creating a fluid, shared experience.
- Performance Optimization: A shader-based drawing system ensures smooth operation even with multiple users, while performance overhead is minimized through smart memory management.
This solution offers a straightforward, intuitive experience tailored for same-room collaboration, streamlining the process for colocated teams using Meta Quest devices. Download the sample here!
Technical Highlights
Both solutions are designed to provide high-quality, low-latency interactions, making use of several advanced networking techniques:
- Network-Driven Synchronization: Fusion ensures real-time updates, supporting concurrent editing with smooth interpolation. Users see remote changes immediately.
- Late Joiner Support: Anyone joining mid-session can access the complete history of the shared drawing, allowing them to engage fully without missing any earlier collaboration.
- Performance Optimization: The shader-based drawing engine minimizes performance overhead, ensuring consistent operation, even when the number of participants grows. A drawing budget system keeps the experience smooth under heavy loads.
Photon at AWE 2024
We invite XR developers, technical teams, and innovators to explore these solutions in person at AWE 2024. These samples highlight Photon’s ongoing work to push the boundaries of cross-platform multiplayer networking, fostering meaningful collaboration for both remote and colocated teams.
Photon remains committed to delivering tools that empower teams to work together seamlessly, regardless of their preferred platforms or physical location. Whether for gaming, enterprise applications, or XR solutions, our technology continues to unlock new possibilities for real-time, shared experiences.
About Photon
Photon powers real-time multiplayer experiences for developers across gaming, XR, and enterprise applications. With Photon Fusion, we provide scalable, high-performance networking solutions that enable cross-platform collaboration—from small teams to large enterprises.
For more information, visit the Photon website or drop by our booth (#320) at AWE 2024.
Ready to build your own successful multiplayer game? With Fusion and Quantum by Photon, it’s never been easier to integrate cutting-edge multiplayer features into your project. We offer the industry’s most advanced tools, comprehensive support, and everything you need to get started – from downloadable samples to detailed documentation.
Take the first step today – download Fusion or download Quantum and start building. If you’re looking for in-depth assistance, join our Gaming Circle, where you can connect directly with our developers and get expert guidance throughout your journey.
Your multiplayer success story starts here!
