How to enable debug mode

To effectively use debug mode for object tracking in the WorkLink app, please follow these steps:

Enable Debug Mode:

If you have v2.19.0 or later, access the settings menu in the app and toggle the Object Tracking Debug setting on.

If you have an earlier version (before v2.19.0) of the app, you can enable by tapping on the version five times to make the Developer Settings button appear and then enable Object Tracking Debug.

Load Your Scenario: Open the specific scenario where you want to apply object tracking.

Access Tracking Debug Options: Once your scenario is loaded and you are using an object AR tracker, look for the menu button in the bottom-left of the screen on a mobile device or the window on Hololens 2. In v2.19.0 or later, it should appear as a gear/settings icon. Tap on it to open the Object Tracking Debug menu and then enable the Show Line Model setting and press "Apply."

In debug mode, you will be able to see the line model generated by the 3D object in two colors: red lines indicate parts of the line model that did not find a matching contrasting line in the video feed, while green lines show a successful match. This mode helps you visualize the process of the line model searching for contrasts in the video feed and provides insights into the inlier ratio, which is crucial for initiating and maintaining object tracking.

Using debug mode allows for a deeper understanding of how object tracking works and aids in fine-tuning the tracking setup for better performance and a smoother end-user experience.

How to video

This video provides a comprehensive guide on setting up object tracking in Create and enhancing the end-user experience in the Worklink app.

The guide covers the following key points:

Introduction to Object Tracking: The video starts by presenting the basics of object tracking technology. Object tracking compares a line model, generated from a 3D model, with hard contrast lines in the video feed. This comparison is measured by a percentage-based match known as the inlier ratio.

Debug Mode: It explains how to enable object tracking debug mode in the app to get insights into how object tracking works. Users can enable this mode in settings, which allows them to view the line model and its interaction with the video feed. Debug mode visualizes successful matches in green and unsuccessful ones in red, offering a clear understanding of the tracking process.

Selecting Tracking Candidates: The guide advises on selecting good candidates for tracking, emphasizing the importance of choosing static parts with clearly defined edges and minimal occlusion by other objects. It provides an example using a 3D model of a turbofan engine, showing how to create a tracker and select an optimal device pose for the end user.

Fine-Tuning Settings: It discusses the significance of fine-tuning settings for smoother tracking initiation and higher inlier ratio. The video highlights two critical settings: the Laplace threshold and the normal threshold. The Laplace threshold helps generate lines based on depth jumps between surfaces, while the normal threshold focuses on changes in surface direction. The guide suggests experimenting with these settings in debug mode to achieve the best results.

Inlier Ratio Settings: Lastly, the video details the inlier ratio settings, which determine when tracking is initiated and when it stops. It recommends setting the inlier ratio tracking initiation between 0.4 and 0.7 for optimal performance, with inlier ratio values of 0.7 to 0.8 during the experience considered good. The inlier ratio tracking minimum setting is crucial for maintaining active tracking.