Introduction
3D Interactive Flows in Mixed Reality offer a unique and immersive experience that sets them apart from other platforms. Here, you can witness animations unfolding on your real-life model, and holograms assist you in performing both simple and complex procedures relevant to your daily work.
After completing the object anchoring process and placing the Digital Twin in your surroundings, it's time to familiarize yourself with interacting within the app while a 3D flow is in progress. This will enable you to seamlessly navigate and engage with the virtual environment as you carry out the Interactive Flow.
Getting Started
To access an Interactive Flow in the Mixed Reality - Knowledge Zone, you have two options. Firstly, you can directly search for the desired flow in the folders from the main menu. Alternatively, if you have already launched the Digital Twin, you can select a Flow from the Procedure menu.
Another convenient feature is the ability to launch procedures through QR codes. Simply look at a QR code and press the play symbol at its center. You don't even need to have the application running for this. The device will automatically detect the QR code, load the selected program, and initiate the Interactive Flow with the corresponding content. It's a seamless and efficient way to start an Interactive Flow without any additional steps.
Similar to the initial set of menus in the Knowledge Zone, the folder hierarchy remains the same. However, in this case, you will only see Interactive Flows that are relevant to your specific project. This streamlined approach ensures that you can easily locate and choose the flow that are most applicable to your needs.
After selecting the relevant Interactive Flow, you will proceed to view the step-by-step instructions and details of the Flow. This will guide you through the necessary actions and provide the necessary information to successfully carry out the Interactive Flow.
Interactive Flow User Interface
When you access the relevant Interactive Flow, you will encounter three main components in the user interface. These elements are designed to enhance your understanding and interaction with the Flow.
Description Box: This box provides step-by-step instructions for the Interactive Flow. It includes relevant text, media elements, and interactive options in the top menu. The description box serves as your primary guide throughout the Flow.
Breadcrumb: A visual breadcrumb is displayed, connecting the description box to the relevant step hologram. This breadcrumb line assists in directing your attention and navigation within your surroundings, ensuring you know where to look or proceed next.
Hologram with Animations: The hologram presents the animated visuals that guide you through the Interactive Flow. It highlights the relevant parts and actions of each step, either through animated sequences or by indicating specific points of interest with blinking cues. This interactive element aids in understanding and performing the required tasks accurately.
Together, these components create an intuitive and immersive user interface, empowering you to follow the Interactive Flow effectively while leveraging the Mixed Reality environment for a seamless experience.
Description Box
The description box serves as the primary user interface within an Interactive Flow. Understanding its various components will facilitate easier interaction.
Top Menu Row
Pin Menu: This option allows you to lock the menu in place, preventing it from following your movements.
Speech On/Off: Enables or disables voice commands for hands-free interaction.
TTS On/Off: Enables or disables the text-to-speech functionality for auditory instructions.
Move: Pressing and holding this button gives you control over the window, allowing you to move it around within your surroundings.
Placement: Opens the object detection function, enabling you to re-anchor the model if necessary.
Help: Provides a list of voice commands you can use.
Language: If multiple language options are available for the procedure, they will be displayed here.
Description Box Elements
Header:
The header typically displays the title of the current step, though it may be empty if not filled by the content creators.
On either side of the header, you will find two icons:
X Button: This closes the Interactive Flow and returns you to the Flow menu.
Mute the Current Step: This allows you to toggle the text-to-speech feature on or off for the current step.
Description Area:
Within this area, you will find a detailed description of the current step. It provides important instructions and information.
Below the description, there are blue buttons for navigating through the steps: Next and Back.
Additionally, for specific steps, you may encounter a Continue button or question/multiple choice node options.
Side Tab:
The blue tab located at the side of the description box is usually closed. It opens when media elements, such as images, videos, or documents, are attached to the step. This tab serves as a space for displaying and interacting with the associated media content.
Magic Leap 2 App Differences
When you explore the Digital Twin feature in the Magic Leap 2 App, you'll notice some subtle yet significant differences that enhance your experience.
1. Mixed Reality Mode Button
On the Digital Twin main menu, you'll find the MR button. A simple air tap activates or de-activates your Digital Twin, allowing you to view the entire Digital Twin, not just holograms. It provides a comprehensive perspective during Interactive Flows.
2. Extract Button
Similar to the Interactive mode in the PC app, the Magic Leap 2 App, lets you manipulate parts effortlessly. Just air-tap the extract button, and you can move model parts around you as needed.
Inside the Extract mode, you have 3 different buttons:
Back Button: Quickly exit the extract mode with a tap, returning you to the previous state.
Return Active Object: Instantly reset the selected part to its original position, simplifying the reassembly process.
Return All Objects: Effortlessly restore all parts to their default locations, ensuring a smooth workflow.
4. Seamless Transition
During Interactive Flows, you can switch between the Mixed Reality view and the hologram view with ease. By air-tapping the MR button at the top of the description box, you can toggle between the two modes, providing flexibility tailored to your needs.
Conclusion
Mixed Reality 3D Interactive Flows offer an immersive and intuitive experience. The description box provides step-by-step instructions, while the breadcrumb guides your navigation. The hologram with animations highlights important steps. Customization options in the top menu enhance your interaction. By leveraging these features, you can confidently perform Interactive Flows in the Mixed Reality environment.
Keep Learning about our Mixed Reality App: Mixed Reality - Remote Support