IV. User Interface and Interaction

1. Select Sensor

数采控制区

Figure 1: Data Acquisition Control Area

Under the “Select Sensor” option in the current Data Acquisition Control Area, real-time monitoring of the sensor’s multimodal perception information is available. It also supports recording the sensor’s feedback information for later “opening data stream” to conduct review, recap, and analysis.

设备选择区

Figure 2: Device Selection Area

The software supports simultaneous connection of multiple sensors and quick switching between them. The Device Selection Area can display all sensor names. By clicking 选择按钮, you can quickly switch to the target sensor from the list of detected sensors and display its collected information in the visualization area.

Sensor Status Prompt

在线图标 : Indicates the device is online

离线图标 : Indicates the device is offline

错误图标 : Indicates a sensor abnormality; hovering the mouse will display the abnormal information (sensor config file reading failed).

After unplugging/plugging in the sensor, you need to click 重新扫描图标 to rescan the sensor.

Perception Mode Configuration

感知模态配置区

默认选中图标 / 默认未选中图标 Default: When the program is newly launched or the “Default” icon on the left side of the Perception Mode Configuration Area is clicked, the visualization area will display the sensor’s tactile image information

接触力选中图标 / 接触力未选中图标 Contact Force: When the “Contact Force” icon on the left side of the Perception Module Configuration Area is clicked, the visualization area will display the contact force reconstruction results and surface deformation field

视频选中图标 / 视频未选中图标 Recording: Click the “Recording” icon on the left side of the Perception Module Configuration Area, click the bottom right corner to select the data stream storage location, then click 录制按钮 at the bottom center to start recording, and click 暂停按钮 to stop recording and save the file to the target path

Figure 3: Perception Mode Configuration Area

View Switching

View Switching

Figure 4: View Switching

View switching enables flexible conversion of the sensor’s feedback tactile and contact force information between 2D plane and 3D space, and presents it in multimodal forms such as tactile images, contact force, and surface deformation field.




触觉信息

Figure 5: Tactile Information


When the tactile image information is distorted or sensor data stagnation occurs, click the 校准按钮 at the bottom center under no-load condition to recalibrate the sensor and refresh the display.


接触力

Figure 6: Contact Force Information


The arrows in the 3D view are the results of contact force reconstruction. The direction of the arrow indicates the direction of the force, the length of the arrow indicates the magnitude of the force, and the curved surface part under the arrow displays the perception result of the contact deformation field. In the 2D view, only the surface deformation field is displayed due to the limitation of visualization dimensions.

2. Open Data Stream

Click “Open Data Stream” in the Data Acquisition Control Area, then click 打开数据流按钮 to load the previously recorded data stream file. After loading, the software will cyclically display the information obtained from the data stream file and show the calculation results. The Sensor Selection Area displays the name of the saved data stream file 传感器名称 ; the name of the virtual sensor is derived from the data stream file name. After loading the data stream, see 3.1 Default Mode and Contact Force Mode for details, but there is no Recording Mode. For Perception Mode Configuration, refer to 3.1.2 ( 视频选中图标 / 视频未选中图标 Recording ); for View Switching, refer to 3.1.3.

3. Toolbar

工具栏

Figure 7: Toolbar

主题切换按钮 Theme Switch: Click to select the interface theme

帮助按钮 Help: Open help documentation and FAQ

关于按钮 About: Display application information

最小化按钮 Minimize: Minimize the application to the background

退出按钮 Exit: Close the current application