Tracking World is a program to control a character through the use of VR. It can be used to produce videos, livestreams and other content. It offers many customization features such as creating hand gestures, binding expressions and gestures to buttons and keys, saving and replaying motion, etc...
Tracking World supports characters in VRM format. For more information about VRM, consult https://dwango.github.io/en/vrm/.
From the start screen, select an avatar. The avatar will be displayed on screen. Press start to begin.
In VR, you will be able to see the avatar. There is a number of elements that can be interacted with inside VR.
To adjust your size relative to the character, grab and move the sliders.
The vertical slider will rescale the whole area to make it bigger or smaller
The horizontal slider doesn't have an immediate impact, but it will display transparent versions of the controllers and every tracker. These transparent objects will need to be aligned with the hands instead of the controllers themselves.
The button with an arrow resets the slider's position.
Align yourself with the avatar, then activate the Calibrate button. A 5 seconds timer will appear. Once the calibration is done, the character will move according to your motion.
The VR environment also contains a way to see and interact with the desktop. A short press on the desktop sphere will trigger the desktop on or off. A constant press will grab it to be able to move it.
The cursor button next to it activate or deactive the use of the controller as a desktop cursor.
The camera can be controlled from both VR and desktop. In VR, the camera can be grabbed and moved. On desktop, the camera is controlled by clicking in the window.
Left button: rotate the camera
Right button: translate the camera
Both buttons: move the camera forward and backward
Middle button: rotate around the character
Mouse wheel: change the camera's field of view
The configuration menu can be accessed from the desktop window by moving the mouse on the top right and clicking on the gear icon that appears.
The configuration menu will then appear.
This button will trigger calibration instantly. When calibrated, the button will reset to pre-calibration state
Additional settings for the application
Turn off VR rendering: This button deactivate rendering on the headset. This is useful if you don't need the headset, or if you want to run a secondary VR program alongside Tracking World
Save and load calibration: Allows you to save or reload an existing calibration profile. All the trackers's relative position will be kept, allowing you to quickly get back into movement without running configuration again
This window will display all shortcut keys for the application. The list will show all the functionalities of the application that can be triggered with shortcuts, as well as all the expressions available in the model, and every hand gesture created through the Gesture editor.
Shortcuts can be associated to either a keyboard key or a button on either controllers. Every button on the controller is bound to an action Expression 1-8. The bindings can be changed through SteamvR's binding interface.
The number field in some rows indicate the time (in seconds) for the effect to apply.
This window lists all the blendshapes in the model and allows you to control them.
This window controls the lipsync of the character. There are two modes, audio file input and microphone.
On Audio file, it is possible to load an audio file in wav, mp3 or ogg format and play it to activate lipsync. The delay field indicate the time delay between the sound and the actual lipsync.
On Microphone, you can choose a microphone device as the input to drive lipsync. You can adjust the sensitivity and volume of the input relative to the lipsync.
This window controls how the eyes of the character move. There are multiple modes available
This window can be used to save and reload camera positions. Use the Save position button then select one of the 10 numbered buttons to save the current camera position to this slot. Click on the slot button to return the camera to the saved position.
The Reset button returns the camera to the starting position.
This window controls the lighting of the scene. The sliders affect the different aspects, such as the orientation and intensity of the sun, as well as the ambient lighting.
This window allows you to record motion and replay it. Use the record and play buttons to save all the motions done during the duration. The Play audio checkbox indicates if the audio file from the Audio panel be played at the same time. The other options control if you want certain aspects of the recording to be ignored when replaying.
It is also possible to save and load motion from a file.
This window allows you to create new hand gestures. Use the arrows to move the fingers into position, then add a new gesture to the list. The gesture marked as default will be the one active when none of the others are.
Once a gesture has been created, it can be assigned a shortcut from the shortcuts window.
This window controls the color of the background. The alpha component can be useful with recording programs that support transparent sources.
Renders the camera in panorama mode, allowing the recording of 360° videos