IV. Interface and Interaction

1. Sensor Selection

Data Acquisition Control Area

Figure 1: Data Acquisition Control Area

Under the “Select Sensor” option in the current Data Acquisition Control Area, you can monitor the multimodal perception information of the sensor in real time.

Device Selection Area

Figure 2: Device Selection Area

The software supports connecting multiple sensors simultaneously and enables quick switching between them. The Device Selection Area displays the names of all sensors. By clicking Select Button , you can quickly switch from the list of detected sensors to the target sensor, and its collected information will be displayed in the visualization area.

Sensor Status Indicators

Online Icon : Indicates the device is online

Offline Icon : Indicates the device is offline

Error Icon : Indicates a sensor error. Hovering the mouse over it will display the error message (sensor config file failed to load).

After unplugging/plugging in the sensor, you need to click Rescan Icon to rescan the sensors.

Perception Mode Configuration

Perception Mode Configuration Area

Default Selected Icon / Default Unselected Icon Default: When the program is newly launched or the “Default” icon on the left side of the Perception Mode Configuration Area is clicked, the visualization area will display the sensor’s tactile image information

Contact Force Selected Icon / Contact Force Unselected Icon Contact Force: Click the “Contact Force” icon on the left side of the Perception Mode Configuration Area, and the visualization area will display the contact force reconstruction results and surface deformation field

Figure 3: Perception Mode Configuration Area

Perception Mode Switching

Perception Mode switching enables flexible conversion of the tactile and contact force information fed back by the sensor between 2D planar and 3D spatial views. It presents the information in multimodal forms such as tactile images, contact force, and surface deformation field.




Tactile Information

Figure 5: Tactile Information


When the tactile image information is distorted or sensor data retention occurs, click the Calibration Button at the bottom center under no-load condition. This allows recalibrating the sensor to refresh the display.


Contact Force Information

Figure 6: Contact Force Information


The arrows in the 3D view are the results of contact force reconstruction. The direction of the arrow indicates the direction of the force, and the length of the arrow indicates the magnitude of the force. The curved surface area below the arrow displays the perception result of the contact deformation field. In the 2D view, only the surface deformation field is displayed due to the limitation of visualization dimensions.

1. Toolbar

Toolbar

Figure 7: Toolbar

Settings Button Settings: Theme appearance and language type in the settings interface

Help Button Help: Open help documentation and FAQ (Frequently Asked Questions)

About Button About: Display application information

Minimize Button Minimize: Minimize the application to the background

Maximize Button Maximize: Maximize the application to occupy the entire screen

Exit Button Exit: Close the current application