Environment Scanning for Annotations and Digital Twin Placement

Environment Scanning for Annotations and Digital Twin Placement

We’re excited to introduce our latest enhancement to Remote Support—a powerful, camera-based scanning feature that makes annotating your surroundings easier and more precise, while also enabling accurate placement of digital twins in real-world environments.

What’s New?

  1. Scanning Animation

    • When you open your camera to use the AR features, you’ll see a scanning animation prompting you to move your phone around. This step helps map your environment more accurately before you place annotations or a digital twin.

  1. Camera Scan Data (Dots “Carpet”)

    • After enabling this option, you’ll see a pattern of dots over the areas your device’s camera has scanned.
    • Moving your camera to cover unscanned areas expands the dot pattern, allowing for more precise annotations and more stable digital twin placement.

How It Works

1. Open the Camera

Launch the camera within Remote Support. A short animation will guide you to move your phone in different directions to capture your surrounding space.

2. Access the Annotation Menu

  1. Tap the Annotation button at the bottom of the camera screen.
  2. This opens the annotations menu at the top of your screen.

3. Enable Scan Data (Dots “Carpet”)

  1. Look for the new button on the left side of the annotations menu—a sphere made of dots. Tap it to overlay the dot pattern on your screen.
  2. Move your camera around to cover areas not yet scanned. The dot “carpet” will expand as more of your environment is mapped.

4. Place Annotations or Digital Twin
  1. Once your environment is sufficiently scanned, you can:
  2. Place Annotations: Select the annotation tool to add arrows, notes, and markers.
  3. Place a Digital Twin: Position and scale the digital twin model so it aligns accurately with your real-world surroundings.

Best Practices for Working in an AR Environment

To get the most out of your AR experience, keep the following tips in mind:

  1. Ensure Good Lighting
    A well-lit space helps your camera detect surfaces more accurately. Try to use natural light or adequate ambient lighting to reduce shadows.

  2. Avoid Reflective or Transparent Surfaces
    Mirrors, glass, and other shiny or see-through materials can confuse the camera. If possible, scan around these surfaces or minimize their impact.

  3. Pay Attention to Surface Colors
    Surfaces with moderate contrast or texture are easier for the camera to track. Overly dark or busy patterns can reduce scanning accuracy.

  4. Maintain a Steady Hand
    Move your camera smoothly at a moderate speed. Quick, jerky movements may result in less accurate scanning.

  5. Scan All Critical Areas
    Cover the key surfaces and spaces where you’ll place annotations or a digital twin. The more complete your scan, the more stable your AR content will be.

  6. Keep Your Device Updated
    AR technology benefits from the latest software. Make sure your device’s operating system is up to date for optimal performance.

NotesDevice Compatibility Note

Important: This technology relies heavily on your device’s camera and sensors. Performance and accuracy may vary depending on your device’s capabilities. For the best results, ensure you’re using a device with an up-to-date operating system and robust camera technology.

Conclusion

We designed this new environment scanning feature with you in mind, making it easier to identify the details that matter and visualize them in real-world settings—whether it’s through clear annotations or placing a digital twin. Your feedback has been essential in helping us improve and grow, and we’ll keep listening to your ideas as we continue refining the app. Together, we’re making remote support simpler, smarter, and more user-friendly every day.

If you have any questions or run into issues, feel free to reach out to our support team. We’re here to help!


    • Related Articles

    • Digital Twin

      The frontline.io Digital Twin is a virtual representation of a physical object within the frontline.io platform. It is created by integrating data using the Fast Track Pro feature, resulting in a comprehensive digital version of the object. By ...

    • Mixed Reality - Digital Twin Anchoring

      Introduction To enhance your experience in the mixed reality app, it is essential to perform object anchoring before engaging with the digital twin. This process can be done automatically through object detection or manually. Once your digital twin ...

    • How to do Augmented Reality (AR) with the Digital Twin?

      See Your Digital Twin in Your Space Ever wondered how a 3D model would look in your real-world environment? Augmented Reality (AR) in frontline.io lets you place and interact with Digital Twins, helping you understand scale, positioning, and ...

    • Digital Twin - Anchoring on Mobile devices

      Introduction In your Digital twin 3D scene or a remote support call, you can bring up your digital twin, put it next to you, or link it to a real machine. This lets you easily talk with your coworkers and customers about it, and even go through ...

    • Mixed Reality - Digital Twin

      Introduction Starting with version 24.2, users can interact with their Digital Twin on HoloLens 2 in a way similar to how they do on the Magic Leap 2. Let’s explore the options available in the Digital Twin menu. Getting Started First, choose the ...