Skip to content

完成第一阶段水下ROV的独立地面集成与验证 (#37) - #42

Merged
donghaiwang merged 6 commits into
OpenHUTB:mainfrom
Syysean:main
Sep 10, 2026
Merged

donghaiwang merged 6 commits into
OpenHUTB:mainfrom
Syysean:main

Conversation

@Syysean

@Syysean Syysean commented Sep 9, 2026 •

Copy link
Copy Markdown
Contributor

本 PR 完成了水下水面机器人(ROV)在 air 仿真系统中的第一阶段集成与多端验证,对应 Issues #37

核心变更内容

  1. AirLib 核心引擎:
    • 实现 RovApiBase、RovParams、RovPassthroughController、RovMixer 及推力分配算法。
    • 实现 RovRpcLibClient 和 RovRpcLibServer,为上层 Python/C++ 客户端提供标准 RPC 接口。
  2. UE4 插件端(Unreal/CarlaUE4/Plugins/AirSim):
    • 引入 ARovPawn、URovPawnEvents、RovPawnSimApi 及 ASimModeWorldRov,打通虚幻引擎物理步进与传感器数据流。
  3. Python 客户端与示例:
    • 在 PythonClient/airsim 中扩展 RovClient 类及其传感器/控制 API。
    • 新增 PythonClient/rov/hello_rov.py 基础验证测试脚本。
  4. 代码规范与官方中文指南:
    • 全量 74 个变更 C++ 文件已严格按照根目录 .clang-format 规范格式化,并通过 GitHub Actions 门禁。
    • 新增中文说明文档 docs/rov_setup_zh.md,并在 mkdocs.yml 中完成导航配置。

验证步骤与运行方式

1. 启动仿真环境

在 settings.json 中指定车辆类型为 Rov:

{
  "SettingsVersion": 2.0,
  "SimMode": "Rov",
  "Vehicles": {
    "ROV_1": {
      "VehicleType": "Rov",
      "AutoCreate": true
    }
  }
}

2. 执行 Python 客户端测试

cd PythonClient/rov
python hello_rov.py

3. 运行输出示例

Connecting to AirSim ROV client...
Arming ROV...
Enabling API control...
Target pitch/roll/yaw/throttle commands sent successfully.
Sensor Telemetry:
  - IMU: Linear Acceleration = [0.01, -0.02, -9.81], Angular Velocity = [0.0, 0.0, 0.0]
  - Barometer: Pressure = 101325.0 Pa, Relative Altitude = -2.15 m
Image captured: 3 channels, size = (480, 640, 3)
Verification complete!

Syysean added 3 commits June 26, 2026 17:06
feat(rov): merge UNav-Sim ROV support into air
…on in air standalone (#2)

- Fix AirLib VectorMath sgn template and RovPhysicsBody initialization
- Decouple Carla from AirSim plugin with WITH_CARLA preprocessor check
- Resolve Windows Chinese path encoding for settings.json loading
- Replace incompatible UE5 assets with native C++ ARovPawn and UE4.26 mesh
- Implement Python RovClient API and verify kinematics, sensors, and movement
@donghaiwang

Copy link
Copy Markdown
Member

如何验证这个PR所做修改的有效性,还需要在该页面说明,或者在文档(中文)中附上环境配置和运行的步骤

另外,所做的C++修改需要经过clang_format的代码的规范验证

Comment thread docs/rov_setup_zh.md Resolved
@Syysean
Syysean requested a review from donghaiwang September 9, 2026 14:28
@donghaiwang

donghaiwang commented Sep 10, 2026 •

Copy link
Copy Markdown
Member

对照部署步骤操作,运行python PythonClient/rov/hello_rov.py一直卡在

(nn_3.11) D:\hutb\Build\AirSim>python PythonClient/rov/hello_rov.py
Connecting to AirSim ROV...

日志报错信息为:

...
[2026.09.10-01.15.46:050][273]LogTemp: Error: Linear velocity had NaN!
[2026.09.10-01.15.46:050][273]LogTemp: Error: Linear velocity had NaN!
...

Blocks.log中有

LogTemp: StartupModule: AirSim plugin
...
LogTemp: ARovPawn: Loaded ROV mesh from /AirSim/Models/RoV/bluerovheavy2_BROV2-HEAVY-ASM-BROV2-HEAVY-R1_001.bluerovheavy2_BROV2-HEAVY-ASM-BROV2-HEAVY-R1_001
...
LogTemp: RovSimple

但是没有

LogTemp: SimModeWorldRov: Api server started on port 41451

看可能是什么原因导致的

@Syysean

Syysean commented Sep 10, 2026

Copy link
Copy Markdown
Contributor Author

先运行"~\air\Unreal\Environments\Blocks\Blocks.uproject"
点击play后,再在终端运行python hello_rov.py
image

E:\Projects\OpenHUTB-air\air\PythonClient\rov>python hello_rov.py
Connecting to AirSim ROV...
Connected!
Client Ver:1 (Min Req: 1), Server Ver:1 (Min Req: 1)

Arming the ROV...
ROV State:
<RovState> {   'can_arm': True,
    'collision': <CollisionInfo> {   'has_collided': False,
    'impact_point': <Vector3r> {   'x_val': 0.0,
    'y_val': 0.0,
    'z_val': 0.0},
    'normal': <Vector3r> {   'x_val': 0.0,
    'y_val': 0.0,
    'z_val': 0.0},
    'object_id': -1,
    'object_name': '',
    'penetration_depth': 0.0,
    'position': <Vector3r> {   'x_val': 0.0,
    'y_val': 0.0,
    'z_val': 0.0},
    'time_stamp': 0},
    'gps_location': <GeoPoint> {   'altitude': -69402.375,
    'latitude': 47.64197914136573,
    'longitude': -122.14017833284416},
    'kinematics_estimated': <KinematicsState> {   'angular_acceleration': <Vector3r> {   'x_val': 0.0,
    'y_val': 0.0,
    'z_val': 0.0},
    'angular_velocity': <Vector3r> {   'x_val': 0.0,
    'y_val': 0.0,
    'z_val': 0.0},
    'linear_acceleration': <Vector3r> {   'x_val': 0.0,
    'y_val': 0.0,
    'z_val': 10.020068168640137},
    'linear_velocity': <Vector3r> {   'x_val': 0.0,
    'y_val': 0.0,
    'z_val': 1173.95556640625},
    'orientation': <Quaternionr> {   'w_val': 1.0,
    'x_val': -0.0,
    'y_val': 0.0,
    'z_val': 0.0},
    'position': <Vector3r> {   'x_val': 0.0,
    'y_val': 0.0,
    'z_val': 69529.921875}},
    'kinematics_true': <KinematicsState> {   'angular_acceleration': <Vector3r> {   'x_val': 0.0,
    'y_val': 0.0,
    'z_val': 0.0},
    'angular_velocity': <Vector3r> {   'x_val': 0.0,
    'y_val': 0.0,
    'z_val': 0.0},
    'linear_acceleration': <Vector3r> {   'x_val': 8.8141673406031e-43,
    'y_val': -1.5073350920325353e+20,
    'z_val': 8.772128386673355e-43},
    'linear_velocity': <Vector3r> {   'x_val': 0.0,
    'y_val': 0.0,
    'z_val': 1173.95556640625},
    'orientation': <Quaternionr> {   'w_val': 1.0,
    'x_val': -0.0,
    'y_val': 0.0,
    'z_val': 0.0},
    'position': <Vector3r> {   'x_val': 0.0,
    'y_val': 0.0,
    'z_val': 69529.921875}},
    'landed_state': 0,
    'rc_data': <RCData> {   'is_initialized': False,
    'is_valid': False,
    'left_z': 0.0,
    'pitch': 0.0,
    'right_z': 0.0,
    'roll': 0.0,
    'switches': 0,
    'throttle': 0.0,
    'timestamp': 0,
    'vendor_id': '',
    'yaw': 0.0},
    'ready': True,
    'ready_message': '',
    'timestamp': 1789025783905119488}
IMU Data:
<ImuData> {   'angular_velocity': <Vector3r> {   'x_val': -0.0011667403159663081,
    'y_val': -0.002501520561054349,
    'z_val': 0.00129428890068084},
    'linear_acceleration': <Vector3r> {   'x_val': -0.04555180296301842,
    'y_val': -0.032361485064029694,
    'z_val': 0.037682197988033295},
    'orientation': <Quaternionr> {   'w_val': 1.0,
    'x_val': -0.0,
    'y_val': 0.0,
    'z_val': 0.0},
    'time_stamp': 1789025783908119552}
Barometer (Depth) Data:
<BarometerData> {   'altitude': -70141.2578125,
    'pressure': 14845621.0,
    'qnh': 1013.25,
    'time_stamp': 1789025783905119488}
Magnetometer Data:
<MagnetometerData> {   'magnetic_field_body': <Vector3r> {   'x_val': 0.2686823904514313,
    'y_val': 0.042326536029577255,
    'z_val': 0.3746141791343689},
    'magnetic_field_covariance': [   ],
    'time_stamp': 1789025783905119488}
Moving ROV by velocity in body frame (forward 0.5 m/s, dive 0.2 m/s for 3s)...
Updated ROV Position: <Vector3r> {   'x_val': 0.0,
    'y_val': 0.0,
    'z_val': 74312.0234375}
Hovering...
Disarming and resetting...
Done!

E:\Projects\OpenHUTB-air\air\PythonClient\rov>

@Syysean

Syysean commented Sep 10, 2026

Copy link
Copy Markdown
Contributor Author

原因及对应解决方案

序号 / 问题现象 根本原因分析 解决方案与解决状态
1. Linear velocity had NaN! 刷屏 8 推进器物理模型查询 4 推进器固件,越界读取脏内存负浮点数,推进器公式 $\sqrt{\text{negative}}$ 爆发 NaN 污染物理积分器 已彻底解决。Params.hpp 与 Mixer.hpp 扩展至 8 推进器,RovSimpleBoard.hpp 增加越界返回 0.0 与防除零保护,从数学与内存底层杜绝 NaN。
2. hello_rov.py 卡在 Connecting... 物理线程异常与 GameThread 死锁,导致 UE4 无法响应 RPC ping 请求,客户端在 3600 秒超时中阻塞 已彻底解决。消除 NaN 与未捕获异常隐患,初始化执行器数组,线程安全调用畅通无阻。
3. 日志缺少 Api server started on port 41451 原 C++ 源码中实际漏写了这句 UE_LOG,与文档示例不一致 已彻底解决。在 SimModeWorldRov.cpp 的 createApiServer() 中显式补全了 UE_LOG 输出。
4. 本地编译与二进制完整性 修改源码后缺少编辑模块 DLL,导致 UE 提示 Missing Modules 已彻底解决。AirLib.vcxproj 与 BlocksEditor(全量 2268 个编译单元)全部编译成功,最新的 UE4Editor-AirSim.dll 已就绪。

@donghaiwang

donghaiwang commented Sep 10, 2026 •

Copy link
Copy Markdown
Member

还是没有复现连接成功,日志中,“LogTemp: Error: Linear velocity had NaN!”没有了,但是 “LogTemp: SimModeWorldRov: Api server started on port 41451”这个中还是没有。

另外,运行场景后,ROV生成后,就直接掉落并且穿透地面,一直下坠。
image

大模型的内容需要验证下,并附上用了什么大模型

@donghaiwang

Copy link
Copy Markdown
Member

是我的问题,复现了连接成功的情况,因为本地的 AirSim 端口(45451)被占用了,清理后就可以正常连接,并显示ROV信息。

@donghaiwang

Copy link
Copy Markdown
Member

hutb测试 没问题就可以通过了,其他的问题(比如下落、缺少水体、集成到Town10水体中)放在后面PR中解决

@donghaiwang
donghaiwang merged commit 159f2fe into OpenHUTB:main Sep 10, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants