Skip to content
Merged
Changes from all commits
Commits
Show all changes
68 commits
Select commit Hold shift + click to select a range
d113f75
init project
qiqi678 Sep 8, 2025
4e99912
init project
qiqi678 Sep 8, 2025
df58c95
补充详细注释、结构化代码
qiqi678 Sep 9, 2025
b56ed65
Remove .vscode directory (personal editor config)
qiqi678 Sep 10, 2025
4a1042d
基础人形机器人模型
qiqi678 Sep 15, 2025
0c60433
修改文件名及主函数中循环模拟功能
qiqi678 Sep 22, 2025
6399701
删除不必要的日志文件
qiqi678 Sep 22, 2025
f305ac3
Merge branch 'main' into main
qiqi678 Sep 22, 2025
ed8cdcc
实现仿真机器人的弹跳功能
qiqi678 Sep 26, 2025
4e7b97a
实现仿真机器人的弹跳功能
qiqi678 Sep 26, 2025
556131f
删除重复的带空格文件夹 humanoid_motion control
qiqi678 Sep 26, 2025
9e558fe
增加一个Python文件
qiqi678 Sep 29, 2025
a2731a8
Save local changes of README.md
qiqi678 Sep 29, 2025
e0da6e2
Fix merge conflict in README.md with upstream/main
qiqi678 Sep 29, 2025
bd05420
Save local changes of README.md
qiqi678 Sep 29, 2025
1b7cbf2
添加随机动作策略函数
qiqi678 Oct 5, 2025
b5e696f
解决合并冲突,合并 upstream/main 分支内容
qiqi678 Oct 5, 2025
f06d238
重新提交添加随机动作策略函数
qiqi678 Oct 6, 2025
d13b322
添加一个有空隙的走廊形竞技场环境
qiqi678 Oct 10, 2025
0b816b3
通过删除run_walls.py解决合并冲突
qiqi678 Oct 10, 2025
2df51c9
恢复run_walls.py并准备解决冲突
qiqi678 Oct 10, 2025
88f9b94
Merge branch 'main' into qiqi678-main
qiqi678 Oct 10, 2025
38e1b8e
修改文件名
qiqi678 Oct 20, 2025
700b3c4
Merge branch 'qiqi678-main' of https://github.com/qiqi678/nn into qiq…
qiqi678 Oct 20, 2025
33bc1b9
删除重复的humanoid_motion_control模块
qiqi678 Oct 20, 2025
5ccfa00
删除 main 分支残留的旧目录 humanoid_motion_control
qiqi678 Oct 20, 2025
44070f8
解决冲突:保留新目录humanoid_Simulation_Environment_Establish,删除旧目录残留
qiqi678 Oct 20, 2025
c331e10
解决冲突:同步课程仓库motion_main.py到新目录
qiqi678 Oct 20, 2025
30b9bd7
删除FETCH_HEAD和git文件
qiqi678 Oct 20, 2025
2d86570
完善README.md说明文件
qiqi678 Oct 20, 2025
e2cda97
将main.py添加ROS节点并初始化代码
qiqi678 Oct 21, 2025
833b7d4
Merge branch 'main' into qiqi678-main
qiqi678 Oct 21, 2025
38d80f9
为main.py添加launch启动文件
qiqi678 Oct 27, 2025
544f1f9
Merge branch 'qiqi678-main' of https://github.com/qiqi678/nn into qiq…
qiqi678 Oct 27, 2025
1ea7ed7
为main.launch中路径添加注释
qiqi678 Oct 28, 2025
ce34b58
为main_humanoid.py添加ROS节点
qiqi678 Oct 28, 2025
b028a35
为main_humanoid.py文件添加详细注释
qiqi678 Nov 2, 2025
25ba501
Merge branch 'main' into qiqi678-main
qiqi678 Nov 2, 2025
272b96a
规范模块名
qiqi678 Nov 3, 2025
88864b4
Merge branch 'qiqi678-main' of https://github.com/qiqi678/nn into qiq…
qiqi678 Nov 3, 2025
196732c
Standardize filename case: track main.py (lowercase)
qiqi678 Nov 3, 2025
64287e6
Merge branch 'main' of https://github.com/OpenHUTB/nn into qiqi678-main
qiqi678 Nov 3, 2025
8df2fe7
Retain both Main.py and main.py from upstream (case-sensitive enabled)
qiqi678 Nov 3, 2025
15e1d51
为main_humanoid.py添加launch启动文件
qiqi678 Nov 4, 2025
e472647
优化main_humanoid.py,添加键盘控制功能
qiqi678 Nov 11, 2025
7857978
Merge branch 'main' into qiqi678-main
qiqi678 Nov 11, 2025
a696643
优化motion_main.py,重构带空隙的走廊环境构建逻辑
qiqi678 Nov 17, 2025
1ddbff5
Merge branch 'qiqi678-main' of https://github.com/qiqi678/nn into qiq…
qiqi678 Nov 18, 2025
f8a4241
恢复并合并本地button_control_vehicle文件夹的备份文件
qiqi678 Nov 18, 2025
4cbeaab
优化motion_main内容,重构空隙的走廊环境构建逻辑
qiqi678 Nov 18, 2025
9233641
恢复carla_manual_control.launch至原作者版本(哈希68c9df5)
qiqi678 Nov 18, 2025
418cea7
优化文件目录结构,确保以main.py为启动入口,将原各文件实现功能整合至main.py
qiqi678 Nov 24, 2025
2d20430
优化文件目录结构,确保以main.py为启动入口,将原各文件实现功能整合至main.py
qiqi678 Nov 24, 2025
adf9506
从课程仓库main分支恢复main_humanoid.py文件
qiqi678 Nov 24, 2025
6684b9f
删除旧的 main_humanoid.py 文件(优化目录结构后已不需要,并优化 main.py
qiqi678 Nov 25, 2025
1e91c2a
合并课程仓库main分支的更新,解决main.py冲突
qiqi678 Nov 25, 2025
fefd95c
添加无重力模式支持并优化键盘控制器
qiqi678 Dec 2, 2025
6214b84
Merge branch 'main' into qiqi678-main
qiqi678 Dec 2, 2025
f045055
优化main.py人形机器人控制逻辑
qiqi678 Dec 8, 2025
86fb13e
Merge branch 'qiqi678-main' of https://github.com/qiqi678/nn into qiq…
qiqi678 Dec 8, 2025
0305eb0
Merge branch 'main' into qiqi678-main
qiqi678 Dec 8, 2025
25d5bb6
集成深度学习控制器,优化步态自然度与无重力模式稳定性
qiqi678 Dec 12, 2025
756c044
完善README.md说明文件
qiqi678 Dec 13, 2025
e0937a4
增强监控模块+优化格式+新增衍生指标
qiqi678 Dec 20, 2025
f8790d9
Merge branch 'main' into qiqi678-main
qiqi678 Dec 20, 2025
9a4271e
git commit -m 优化后退/转向动作并精简终端输出
qiqi678 Dec 23, 2025
227ba1c
Merge branch 'qiqi678-main' of https://github.com/qiqi678/nn into qiq…
qiqi678 Dec 23, 2025
a3073ab
Merge branch 'main' into qiqi678-main
qiqi678 Dec 23, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
116 changes: 37 additions & 79 deletions src/humanoid_simulation_environment_establish/main.py
Original file line number Diff line number Diff line change
Expand Up @@ -557,17 +557,26 @@ def _create_walking_action(self, forward=True, turn_direction=0):
if not self.actuator_indices:
return action

# 根据方向调节步频与强度:后退更慢、更谨慎
step_freq = self.step_frequency if forward else self.step_frequency * 0.8

# 计算步行动作相位(保持连续性)
phase = 2 * np.pi * self.step_time * self.step_frequency
phase = 2 * np.pi * self.step_time * step_freq
direction = 1 if forward else -1

# 计算步态强度(基于step_time,用于平滑停止)
# 当step_time衰减时,动作幅度也平滑减小
gait_strength = min(1.0, self.step_time * self.step_frequency * 2.0) # 在第一个周期内从0到1
gait_strength = min(1.0, self.step_time * step_freq * 2.0) # 在第一个周期内从0到1
# 如果step_time很小,进一步减小强度,实现平滑停止
if self.step_time < 0.1:
gait_strength *= self.step_time / 0.1 # 在最后0.1秒内平滑衰减到0

# 后退或转向时整体动作幅度更柔和
if not forward:
gait_strength *= 0.75
if turn_direction != 0:
gait_strength *= 0.9

# 人类步态特点:
# 1. 支撑相约占60%,摆动相约占40%
# 2. 摆动相时:抬腿、膝关节弯曲、踝关节背屈
Expand Down Expand Up @@ -602,7 +611,8 @@ def support_phase_weight(phi):
# 髋关节前后摆动(主要推进力)- 更自然的协调
# 使用更平滑的正弦波,在摆动相向前,支撑相向后推
# 添加轻微的相位偏移,让动作更自然
right_hip_swing = 0.45 * direction * np.sin(right_phase + 0.1) * gait_strength
base_hip_amp = 0.45 if forward else 0.32
right_hip_swing = base_hip_amp * direction * np.sin(right_phase + 0.1) * gait_strength
self._set_action(action, "hip_x_right", right_hip_swing)

# 髋关节上下(抬腿)- 更自然的抬腿动作
Expand Down Expand Up @@ -722,7 +732,7 @@ def support_phase_weight(phi):
self._set_action(action, "hip_z_left", -hip_z_balance)
else:
# 转向时,外侧腿稍微外展,内侧腿稍微内收
turn_strength = 0.4 * turn_direction
turn_strength = 0.25 * turn_direction * gait_strength
self._set_action(action, "hip_z_right", turn_strength)
self._set_action(action, "hip_z_left", -turn_strength)
# 添加躯干旋转辅助转向
Expand Down Expand Up @@ -905,25 +915,25 @@ def _create_turning_only_action(self, turn_direction, dt=0.03):

# 躯干控制 - 更自然的轻微摆动
# 轻微前倾以辅助前进(减小前倾幅度,更自然)
abdomen_pitch = 0.08 * direction * gait_strength
abdomen_pitch = 0.07 * direction * gait_strength
# 添加轻微的上下摆动(配合步态,与腿部动作协调)
# 在支撑相时稍微下沉,在摆动相时稍微上升
abdomen_pitch += 0.02 * np.sin(phase + np.pi/4) * gait_strength
self._set_action(action, "abdomen_y", abdomen_pitch)

# 转向时允许侧倾(减小侧倾幅度)
self._set_action(action, "abdomen_x", 0.05 * turn_direction * gait_strength)
self._set_action(action, "abdomen_x", 0.04 * turn_direction * gait_strength)

# 转向控制(减小转向幅度,更自然)
if turn_direction != 0:
self._set_action(action, "abdomen_z", 0.25 * turn_direction * gait_strength)
self._set_action(action, "abdomen_z", 0.22 * turn_direction * gait_strength)
else:
self._set_action(action, "abdomen_z", 0.0)

return action

def _create_turning_only_action(self, turn_direction, dt=0.03):
"""创建仅转向动作(不产生腿部摆动,只在原地转向,目标转向45度)"""
"""创建仅转向动作:更平滑的原地转身"""
action = np.zeros(self.action_dim)

if not self.actuator_indices:
Expand All @@ -939,8 +949,8 @@ def _create_turning_only_action(self, turn_direction, dt=0.03):
if abs(turn_error) < 0.1: # 接近目标时,设置新的目标
self.target_turn_angle += turn_direction * self.turn_angle_per_step

# 计算转向速度(基于误差)
turn_velocity = np.clip(turn_error * 3.0, -self.turn_speed, self.turn_speed)
# 计算转向速度(基于误差),限制更小避免生硬
turn_velocity = np.clip(turn_error * 2.0, -self.turn_speed * 0.7, self.turn_speed * 0.7)

# 更新当前转向角度(模拟)
self.current_turn_angle += turn_velocity * dt
Expand All @@ -957,33 +967,19 @@ def _create_turning_only_action(self, turn_direction, dt=0.03):
normalized_turn = turn_direction * 0.8 # 直接使用方向,强度0.8

# 原地转向:通过髋关节外展和躯干旋转实现
# 增大转向强度,使转向更明显
hip_turn_strength = 0.6 * normalized_turn # 从0.25增大到0.6
# 略微减小强度并加入轻微屈膝,让转身更稳
hip_turn_strength = 0.45 * normalized_turn
self._set_action(action, "hip_z_right", hip_turn_strength)
self._set_action(action, "hip_z_left", -hip_turn_strength)

# 躯干旋转辅助转向(主要转向来源,范围±45度)
abdomen_turn_strength = 0.8 * normalized_turn # 从0.15增大到0.8,充分利用±45度范围
abdomen_turn_strength = 0.65 * normalized_turn
self._set_action(action, "abdomen_z", abdomen_turn_strength)
self._set_action(action, "abdomen_x", 0.1 * normalized_turn)

return action

def _create_turning_only_action(self, turn_direction):
"""创建仅转向动作(不产生腿部摆动,只在原地转向)"""
action = np.zeros(self.action_dim)

if not self.actuator_indices:
return action

# 只设置转向相关的动作,不产生腿部摆动
# 转向控制通过髋关节外展实现
turn_strength = 0.3 * turn_direction # 减小转向强度
self._set_action(action, "hip_z_right", turn_strength)
self._set_action(action, "hip_z_left", -turn_strength)

# 可以添加轻微的躯干倾斜来辅助转向
self._set_action(action, "abdomen_x", 0.1 * turn_direction)
# 轻微屈膝降低质心
self._set_action(action, "knee_right", 0.12 * abs(normalized_turn))
self._set_action(action, "knee_left", 0.12 * abs(normalized_turn))

return action

Expand Down Expand Up @@ -1903,25 +1899,11 @@ def main():

env.render(viewer_handle)

if step % 100 == 0:
# 获取各个身体部位的位置
if step % 200 == 0:
# 获取身体位置
torso_id = mujoco.mj_name2id(env.model, mujoco.mjtObj.mjOBJ_BODY, "torso")
torso_pos = env.data.xpos[torso_id].copy() if torso_id >= 0 else None

head_id = mujoco.mj_name2id(env.model, mujoco.mjtObj.mjOBJ_BODY, "head")
head_pos = env.data.xpos[head_id].copy() if head_id >= 0 else None

# 尝试获取左右脚位置(可能有不同的命名)
foot_right_id = mujoco.mj_name2id(env.model, mujoco.mjtObj.mjOBJ_BODY, "foot_right")
if foot_right_id < 0:
foot_right_id = mujoco.mj_name2id(env.model, mujoco.mjtObj.mjOBJ_BODY, "right_foot")
foot_right_pos = env.data.xpos[foot_right_id].copy() if foot_right_id >= 0 else None

foot_left_id = mujoco.mj_name2id(env.model, mujoco.mjtObj.mjOBJ_BODY, "foot_left")
if foot_left_id < 0:
foot_left_id = mujoco.mj_name2id(env.model, mujoco.mjtObj.mjOBJ_BODY, "left_foot")
foot_left_pos = env.data.xpos[foot_left_id].copy() if foot_left_id >= 0 else None


# 获取速度信息
linear_vel = np.zeros(6)
angular_vel = np.zeros(6)
Expand Down Expand Up @@ -1977,48 +1959,24 @@ def main():
if gait_info:
print(f"🚶 {gait_info}")

# 速度和运动信息
print(f"\n⚡ 运动信息:")
print(f" 线性速度: X={vx:+.3f} m/s, Y={vy:+.3f} m/s, Z={vz:+.3f} m/s")
print(f" 速度大小: {speed:.3f} m/s")
print(f" 角速度: Z轴旋转={np.degrees(angular_vz):+.2f} °/s")
# 速度和运动信息(精简)
print(f"\n⚡ 速度: |V|={speed:.3f} m/s, vx={vx:+.3f}, vy={vy:+.3f}, yaw_rate={np.degrees(angular_vz):+.2f} °/s")

# 位置信息(关键部位)
print(f"\n📍 身体部位位置:")
# 关键位置
if torso_pos is not None:
print(f" 躯干: X={torso_pos[0]:+.3f}, Y={torso_pos[1]:+.3f}, Z={torso_pos[2]:+.3f} m")
if head_pos is not None:
head_height = head_pos[2] - (torso_pos[2] if torso_pos is not None else 0)
print(f" 头部: X={head_pos[0]:+.3f}, Y={head_pos[1]:+.3f}, Z={head_pos[2]:+.3f} m (相对高度: {head_height:+.3f} m)")
if foot_right_pos is not None:
print(f" 右脚: X={foot_right_pos[0]:+.3f}, Y={foot_right_pos[1]:+.3f}, Z={foot_right_pos[2]:+.3f} m")
if foot_left_pos is not None:
print(f" 左脚: X={foot_left_pos[0]:+.3f}, Y={foot_left_pos[1]:+.3f}, Z={foot_left_pos[2]:+.3f} m")
# 计算步长(两脚间的X距离)
if foot_right_pos is not None:
step_length = abs(foot_right_pos[0] - foot_left_pos[0])
print(f" 步长: {step_length:.3f} m")
print(f"📍 位置: X={torso_pos[0]:+.3f}, Y={torso_pos[1]:+.3f}, Z={torso_pos[2]:+.3f} m")

# 动作信息
print(f"\n🎯 动作统计:")
print(f" 动作维度: {len(action)}")
print(f" 最大幅度: {action_magnitude:.3f}")
print(f" 平均幅度: {action_mean:.3f}")
print(f" 标准差: {action_std:.3f}")
print(f"🎯 动作: max={action_magnitude:.3f}, mean={action_mean:.3f}, std={action_std:.3f}")

# 奖励信息
print(f"\n🏆 奖励信息:")
print(f" 当前步奖励: {recent_reward:+.4f}")
print(f" 累计奖励: {total_reward:+.4f}")
print(f" 平均奖励/步: {avg_reward_per_step:+.4f}")
print(f"🏆 奖励: step={recent_reward:+.4f}, total={total_reward:+.4f}, avg/step={avg_reward_per_step:+.4f}")

# 深度学习信息(如果启用)
if controller.use_deep_learning and controller.deep_controller is not None:
buffer_size = len(controller.deep_controller.replay_buffer)
print(f"\n🧠 深度学习控制器:")
print(f" 经验缓冲区: {buffer_size}/{controller.deep_controller.replay_buffer.maxlen}")
print(f" 训练步数: {controller.deep_controller.step_count}")
print(f" 状态维度: {controller.deep_controller.state_dim}, 动作维度: {controller.deep_controller.action_dim}")
max_buffer = controller.deep_controller.replay_buffer.maxlen
print(f"🧠 训练: buffer={buffer_size}/{max_buffer}, steps={controller.deep_controller.step_count}")

print("="*80 + "\n")

Expand Down
Loading