Environment Scanning for Annotations and Digital Twin Placement

Environment Scanning for Annotations and Digital Twin Placement

We’re excited to introduce our latest enhancement to Remote Support—a powerful, camera-based scanning feature that makes annotating your surroundings easier and more precise, while also enabling accurate placement of digital twins in real-world environments.

What’s New?

  1. Scanning Animation

    • When you open your camera to use the AR features, you’ll see a scanning animation prompting you to move your phone around. This step helps map your environment more accurately before you place annotations or a digital twin.

  1. Camera Scan Data (Dots “Carpet”)

    • After enabling this option, you’ll see a pattern of dots over the areas your device’s camera has scanned.
    • Moving your camera to cover unscanned areas expands the dot pattern, allowing for more precise annotations and more stable digital twin placement.

How It Works

1. Open the Camera

Launch the camera within Remote Support. A short animation will guide you to move your phone in different directions to capture your surrounding space.

2. Access the Annotation Menu

  1. Tap the Annotation button at the bottom of the camera screen.
  2. This opens the annotations menu at the top of your screen.

3. Enable Scan Data (Dots “Carpet”)

  1. Look for the new button on the left side of the annotations menu—a sphere made of dots. Tap it to overlay the dot pattern on your screen.
  2. Move your camera around to cover areas not yet scanned. The dot “carpet” will expand as more of your environment is mapped.

4. Place Annotations or Digital Twin
  1. Once your environment is sufficiently scanned, you can:
  2. Place Annotations: Select the annotation tool to add arrows, notes, and markers.
  3. Place a Digital Twin: Position and scale the digital twin model so it aligns accurately with your real-world surroundings.

Best Practices for Working in an AR Environment

To get the most out of your AR experience, keep the following tips in mind:

  1. Ensure Good Lighting
    A well-lit space helps your camera detect surfaces more accurately. Try to use natural light or adequate ambient lighting to reduce shadows.

  2. Avoid Reflective or Transparent Surfaces
    Mirrors, glass, and other shiny or see-through materials can confuse the camera. If possible, scan around these surfaces or minimize their impact.

  3. Pay Attention to Surface Colors
    Surfaces with moderate contrast or texture are easier for the camera to track. Overly dark or busy patterns can reduce scanning accuracy.

  4. Maintain a Steady Hand
    Move your camera smoothly at a moderate speed. Quick, jerky movements may result in less accurate scanning.

  5. Scan All Critical Areas
    Cover the key surfaces and spaces where you’ll place annotations or a digital twin. The more complete your scan, the more stable your AR content will be.

  6. Keep Your Device Updated
    AR technology benefits from the latest software. Make sure your device’s operating system is up to date for optimal performance.

NotesDevice Compatibility Note

Important: This technology relies heavily on your device’s camera and sensors. Performance and accuracy may vary depending on your device’s capabilities. For the best results, ensure you’re using a device with an up-to-date operating system and robust camera technology.

Conclusion

We designed this new environment scanning feature with you in mind, making it easier to identify the details that matter and visualize them in real-world settings—whether it’s through clear annotations or placing a digital twin. Your feedback has been essential in helping us improve and grow, and we’ll keep listening to your ideas as we continue refining the app. Together, we’re making remote support simpler, smarter, and more user-friendly every day.

If you have any questions or run into issues, feel free to reach out to our support team. We’re here to help!


    • Related Articles

    • Remote Support - Annotations

      Annotations Annotations in a remote support call refer to a set of tools that allow you to draw, add arrows, highlight specific areas, and place beacons of different colors on the remote screen to convey information to the other person. These tools ...

    • Remote Support and Extended Reality (XR) - Mobile to Mobile

      Combining Remote Support with XR presents immense possibilities, offering a powerful tool for various applications. One example is leveraging Augmented Reality (AR) to showcase the Digital Twin within your office environment while explaining machine ...

    • Remote Support: Sharing Made Simple

      Introduction We are excited to announce a new feature in the 23.2 app version that will revolutionize the way you collaborate. With this update, we have introduced the ability to share digital twins, procedures, and media elements directly within the ...

    • Remote Support Capabilities

      Introduction frontline.io includes an AR-based Remote Support application, running on a wide range of devices. A participant in each call can hold one of the following roles, field user or supporter. User in the field Usually the side on the call ...

    • Remote Support: High-Resolution Image Capturing

      Frontline.io now includes an option for capturing high-resolution images during remote support calls. The "request HD" button on the toolbar allows users to freeze the video stream and capture a detailed image. This enhancement enables faster and ...