1230 版本,长时间 AC 出现 BMC 不通且 OS 未自动上电,有 shm lock 报错

问题描述

做长时间 AC 测试,出现 AC 起来半小时 BMC 仍不通的情况,且 OS 没有自动上电,近端插拔电源线后问题消失;观察此时段,发现 BMC 组件一直在循环重启,并伴有 shm lock 报错打印,想确认是否有已知问题,及问题解决计划

2026-02-24 08:50:05.822581 framework ERROR: shmlock.c(498): verify process pid=8005 failed, process is not alive, owner_pid=2377
2026-02-24 08:50:05.822630 framework ERROR: shmlock_health.c(568): DEAD Process Detected: logical_id: 14 (mapping_count=14), pid=8005
2026-02-24 08:50:06.250507 framework NOTICE: shmlock.c(600): unregister_process: start remove process map (logical_id=14)
2026-02-24 08:50:07.346069 [:00000002] security: LAUNCH snlua bootstrap
2026-02-24 08:50:07.406185 [:00000003] security: LAUNCH snlua launcher
2026-02-24 08:50:07.446722 [:00000004] security: LAUNCH snlua cdummy
2026-02-24 08:50:07.483648 [:00000005] security: LAUNCH harbor 0 4
2026-02-24 08:50:07.487975 [:00000006] security: LAUNCH snlua datacenterd
2026-02-24 08:50:07.532653 [:00000007] security: LAUNCH snlua service_mgr
2026-02-24 08:50:07.573511 [:00000008] security: LAUNCH snlua hica/subsys/security/service/main
2026-02-24 08:50:07.624073 [:00000009] security: LAUNCH snlua sd_bus
2026-02-24 08:50:08.283455 [:0000000a] security: LAUNCH snlua harbor
2026-02-24 08:50:08.356056 [:0000000b] security: LAUNCH snlua debug_console 0.0.0.0 40021
2026-02-24 08:50:08.357175 [:0000000c] security: LAUNCH snlua trust/service/main
2026-02-24 08:50:08.411759 [:0000000d] security: LAUNCH snlua iam/service/main
2026-02-24 08:50:08.774410 [:0000000e] security: LAUNCH snlua capability_proxy/service/main
2026-02-24 08:50:08.907389 [:0000000b] security: Start debug console at 0.0.0.0:40021
2026-02-24 08:50:08.981005 [:0000000f] security: LAUNCH snlua certificate/service/main
2026-02-24 08:50:09.004452 [:00000010] security: LAUNCH snlua spdm/service/main
2026-02-24 08:50:09.006105 [:00000010] security: lua loader error : /opt/bmc/skynet/lualib/loader.lua:0: cannot open /opt/bmc/libmc/service/spdm/service/main.lua: No such file or directory cannot open /opt/bmc/libmc/service/spdm/service/main/init.lua: No such file or directory cannot open /opt/bmc/skynet/service/spdm/service/main.lua: No such file or directory cannot open /opt/bmc/skynet/service/spdm/service/main/init.lua: No such file or directory cannot open /opt/bmc/apps/spdm/service/main.lua: No such file or directory cannot open /opt/bmc/apps/spdm/service/main/init.lua: No such file or directory stack traceback:  [C]: in function 'error'  /opt/bmc/skynet/lualib/loader.lua: in function </opt/bmc/skynet/lualib/loader.lua:0>
2026-02-24 08:50:09.009400 [:00000010] security: KILL self
2026-02-24 08:50:09.016413 [:00000002] security: KILL self
2026-02-24 08:50:09.929494 maca NOTICE: base.lua(393): monitor component certificate added, service: bmc.kepler.certificate [repeated 5 times in 305s from 2026-02-24 08:45:04.195118 to 2026-02-24 08:50:09.929494]
2026-02-24 08:50:10.065947 maca NOTICE: base.lua(393): monitor component trust added, service: bmc.kepler.trust
2026-02-24 08:50:10.150103 maca NOTICE: base.lua(393): monitor component iam added, service: bmc.kepler.iam [repeated 5 times in 306s from 2026-02-24 08:45:04.346309 to 2026-02-24 08:50:10.150103]
2026-02-24 08:50:10.228158 maca NOTICE: base.lua(393): monitor component capability_proxy added, service: bmc.kepler.capability_proxy
2026-02-24 08:50:38.270042 framework ERROR: shmlock.c(498): verify process pid=8067 failed, process is not alive, owner_pid=2377
2026-02-24 08:50:38.270117 framework ERROR: shmlock_health.c(568): DEAD Process Detected: logical_id: 13 (mapping_count=14), pid=8067
2026-02-24 08:50:38.589098 framework NOTICE: shmlock.c(600): unregister_process: start remove process map (logical_id=13)
2026-02-24 08:50:39.920372 [:00000002] bmc_core: LAUNCH snlua bootstrap
2026-02-24 08:50:39.980767 [:00000003] bmc_core: LAUNCH snlua launcher
2026-02-24 08:50:40.031212 [:00000004] bmc_core: LAUNCH snlua cdummy
2026-02-24 08:50:40.057690 [:00000005] bmc_core: LAUNCH harbor 0 4
2026-02-24 08:50:40.061516 [:00000006] bmc_core: LAUNCH snlua datacenterd
2026-02-24 08:50:40.101980 [:00000007] bmc_core: LAUNCH snlua service_mgr
2026-02-24 08:50:40.142360 [:00000008] bmc_core: LAUNCH snlua hica/subsys/bmc_core/service/main
2026-02-24 08:50:40.193043 [:00000009] bmc_core: LAUNCH snlua sd_bus
2026-02-24 08:50:40.592455 framework ERROR: shmlock.c(498): verify process pid=8179 failed, process is not alive, owner_pid=2377
2026-02-24 08:50:40.592525 framework ERROR: shmlock_health.c(568): DEAD Process Detected: logical_id: 14 (mapping_count=14), pid=8179
2026-02-24 08:50:40.984939 framework NOTICE: shmlock.c(600): unregister_process: start remove process map (logical_id=14)
2026-02-24 08:50:41.675660 [:0000000a] bmc_core: LAUNCH snlua harbor
2026-02-24 08:50:41.756829 [:00000002] bmc_core: KILL self
2026-02-24 08:50:41.766155 [:0000000b] bmc_core: LAUNCH snlua debug_console 0.0.0.0 40020
2026-02-24 08:50:42.393985 [:0000000c] bmc_core: LAUNCH snlua bmc_time/service/main
2026-02-24 08:50:42.394202 [:0000000d] bmc_core: LAUNCH snlua firmware_mgmt/service/main
2026-02-24 08:50:42.394301 [:0000000e] bmc_core: LAUNCH snlua bmc_upgrade/service/main
2026-02-24 08:50:42.394412 [:0000000f] bmc_core: LAUNCH snlua fructrl/service/main
2026-02-24 08:50:42.394492 [:00000010] bmc_core: LAUNCH snlua bmc_network/service/main
2026-02-24 08:50:42.394568 [:00000012] bmc_core: LAUNCH snlua bmc_health/service/main
2026-02-24 08:50:42.394640 [:00000013] bmc_core: LAUNCH snlua ipmi_core/service/main
2026-02-24 08:50:42.394713 [:00000014] bmc_core: LAUNCH snlua bmc_soc/service/main
2026-02-24 08:50:42.572419 [:00000015] bmc_core: LAUNCH snlua manufacture/service/main
2026-02-24 08:50:42.598319 [:0000000b] bmc_core: Start debug console at 0.0.0.0:40020
2026-02-24 08:50:42.828727 [:00000002] security: LAUNCH snlua bootstrap
2026-02-24 08:50:42.915462 [:00000003] security: LAUNCH snlua launcher
2026-02-24 08:50:43.017138 [:00000004] security: LAUNCH snlua cdummy
2026-02-24 08:50:43.067816 maca NOTICE: base.lua(393): monitor component bmc_upgrade added, service: bmc.kepler.bmc_upgrade [repeated 6 times in 342s from 2026-02-24 08:45:01.964362 to 2026-02-24 08:50:43.067816]
2026-02-24 08:50:43.106595 [:00000005] security: LAUNCH harbor 0 4
2026-02-24 08:50:43.118118 [:00000006] security: LAUNCH snlua datacenterd
2026-02-24 08:50:43.161894 maca NOTICE: base.lua(393): monitor component fructrl added, service: bmc.kepler.fructrl [repeated 6 times in 342s from 2026-02-24 08:45:01.841967 to 2026-02-24 08:50:43.161894]
2026-02-24 08:50:43.183449 [:00000007] security: LAUNCH snlua service_mgr
2026-02-24 08:50:43.243791 [:00000008] security: LAUNCH snlua hica/subsys/security/service/main
2026-02-24 08:50:43.247567 maca NOTICE: base.lua(393): monitor component bmc_time added, service: bmc.kepler.bmc_time [repeated 6 times in 342s from 2026-02-24 08:45:01.740815 to 2026-02-24 08:50:43.247567]
2026-02-24 08:50:43.324999 [:00000009] security: LAUNCH snlua sd_bus
2026-02-24 08:50:43.338901 maca NOTICE: base.lua(393): monitor component bmc_soc added, service: bmc.kepler.bmc_soc [repeated 6 times in 341s from 2026-02-24 08:45:02.164514 to 2026-02-24 08:50:43.338901]
2026-02-24 08:50:43.414157 maca NOTICE: base.lua(393): monitor component ipmi_core added, service: bmc.kepler.ipmi_core [repeated 6 times in 341s from 2026-02-24 08:45:02.345737 to 2026-02-24 08:50:43.414157]
2026-02-24 08:50:43.509302 maca NOTICE: base.lua(393): monitor component firmware_mgmt added, service: bmc.kepler.firmware_mgmt [repeated 6 times in 341s from 2026-02-24 08:45:02.254655 to 2026-02-24 08:50:43.509302]
2026-02-24 08:50:43.642839 maca NOTICE: base.lua(393): monitor component manufacture added, service: bmc.kepler.manufacture [repeated 6 times in 341s from 2026-02-24 08:45:02.052370 to 2026-02-24 08:50:43.642839]
2026-02-24 08:50:43.745923 maca NOTICE: base.lua(393): monitor component bmc_health added, service: bmc.kepler.bmc_health [repeated 6 times in 341s from 2026-02-24 08:45:02.464951 to 2026-02-24 08:50:43.745923]
2026-02-24 08:50:43.857249 maca NOTICE: base.lua(393): monitor component bmc_network added, service: bmc.kepler.bmc_network [repeated 6 times in 341s from 2026-02-24 08:45:02.616388 to 2026-02-24 08:50:43.857249]
2026-02-24 08:50:44.097032 [:0000000a] security: LAUNCH snlua harbor
2026-02-24 08:50:44.178326 [:0000000b] security: LAUNCH snlua debug_console 0.0.0.0 40021
2026-02-24 08:50:44.179329 [:0000000c] security: LAUNCH snlua trust/service/main
2026-02-24 08:50:44.219755 [:0000000d] security: LAUNCH snlua iam/service/main
2026-02-24 08:50:44.773506 [:0000000e] security: LAUNCH snlua capability_proxy/service/main
2026-02-24 08:50:44.899719 [:0000000b] security: Start debug console at 0.0.0.0:40021
2026-02-24 08:50:44.953688 [:0000000f] security: LAUNCH snlua certificate/service/main
2026-02-24 08:50:44.968335 [:00000010] security: LAUNCH snlua spdm/service/main
2026-02-24 08:50:44.969042 [:00000010] security: lua loader error : /opt/bmc/skynet/lualib/loader.lua:0: cannot open /opt/bmc/libmc/service/spdm/service/main.lua: No such file or directory cannot open /opt/bmc/libmc/service/spdm/service/main/init.lua: No such file or directory cannot open /opt/bmc/skynet/service/spdm/service/main.lua: No such file or directory cannot open /opt/bmc/skynet/service/spdm/service/main/init.lua: No such file or directory cannot open /opt/bmc/apps/spdm/service/main.lua: No such file or directory cannot open /opt/bmc/apps/spdm/service/main/init.lua: No such file or directory stack traceback:  [C]: in function 'error'  /opt/bmc/skynet/lualib/loader.lua: in function </opt/bmc/skynet/lualib/loader.lua:0>
2026-02-24 08:50:44.972219 [:00000010] security: KILL self
2026-02-24 08:50:44.976704 [:00000002] security: KILL self
2026-02-24 08:50:47.010677 [:00000016] bmc_core: LAUNCH snlua ipmi_core/service/bt
2026-02-24 08:50:47.040190 [:00000017] bmc_core: LAUNCH snlua ipmi_core/service/edma
2026-02-24 08:50:47.040477 [:00000018] bmc_core: LAUNCH snlua ipmi_core/service/btc
2026-02-24 08:50:47.042821 [:00000019] bmc_core: LAUNCH snlua ipmi_core/service/btc
2026-02-24 08:50:48.814105 [:0000001a] bmc_core: LAUNCH snlua bmc_network/service/fusionpod
2026-02-24 08:50:49.137688 [:0000001b] bmc_core: LAUNCH snlua ipmi_core/service/ipmb
2026-02-24 08:50:53.095301 [:00000016] bmc_core: KILL self
2026-02-24 08:51:18.011225 framework ERROR: shmlock.c(498): verify process pid=8353 failed, process is not alive, owner_pid=2377
2026-02-24 08:51:18.011275 framework ERROR: shmlock_health.c(568): DEAD Process Detected: logical_id: 14 (mapping_count=14), pid=8353
2026-02-24 08:51:18.367775 framework NOTICE: shmlock.c(600): unregister_process: start remove process map (logical_id=14)
2026-02-24 08:51:19.944891 [:00000002] security: LAUNCH snlua bootstrap
2026-02-24 08:51:20.015709 [:00000003] security: LAUNCH snlua launcher
2026-02-24 08:51:20.046144 [:00000004] security: LAUNCH snlua cdummy
2026-02-24 08:51:20.079072 [:00000005] security: LAUNCH harbor 0 4
2026-02-24 08:51:20.086924 [:00000006] security: LAUNCH snlua datacenterd
2026-02-24 08:51:20.127572 [:00000007] security: LAUNCH snlua service_mgr
2026-02-24 08:51:20.168843 [:00000008] security: LAUNCH snlua hica/subsys/security/service/main
2026-02-24 08:51:20.209326 [:00000009] security: LAUNCH snlua sd_bus
2026-02-24 08:51:20.902306 [:0000000a] security: LAUNCH snlua harbor
2026-02-24 08:51:20.982400 [:0000000b] security: LAUNCH snlua debug_console 0.0.0.0 40021
2026-02-24 08:51:20.983373 [:0000000c] security: LAUNCH snlua trust/service/main
2026-02-24 08:51:21.020350 [:0000000d] security: LAUNCH snlua iam/service/main
2026-02-24 08:51:21.721289 [:0000000e] security: LAUNCH snlua capability_proxy/service/main
2026-02-24 08:51:21.842287 [:0000000b] security: Start debug console at 0.0.0.0:40021
2026-02-24 08:51:21.914240 [:0000000f] security: LAUNCH snlua certificate/service/main
2026-02-24 08:51:21.929436 [:00000010] security: LAUNCH snlua spdm/service/main
2026-02-24 08:51:21.930207 [:00000010] security: lua loader error : /opt/bmc/skynet/lualib/loader.lua:0: cannot open /opt/bmc/libmc/service/spdm/service/main.lua: No such file or directory cannot open /opt/bmc/libmc/service/spdm/service/main/init.lua: No such file or directory cannot open /opt/bmc/skynet/service/spdm/service/main.lua: No such file or directory cannot open /opt/bmc/skynet/service/spdm/service/main/init.lua: No such file or directory cannot open /opt/bmc/apps/spdm/service/main.lua: No such file or directory cannot open /opt/bmc/apps/spdm/service/main/init.lua: No such file or directory stack traceback:  [C]: in function 'error'  /opt/bmc/skynet/lualib/loader.lua: in function </opt/bmc/skynet/lualib/loader.lua:0>
2026-02-24 08:51:21.933651 [:00000010] security: KILL self
2026-02-24 08:51:21.938850 [:00000002] security: KILL self
2026-02-24 08:51:28.374127 framework ERROR: shmlock.c(498): verify process pid=8330 failed, process is not alive, owner_pid=2377
2026-02-24 08:51:28.374182 framework ERROR: shmlock_health.c(568): DEAD Process Detected: logical_id: 13 (mapping_count=14), pid=8330
2026-02-24 08:51:28.749548 framework NOTICE: shmlock.c(600): unregister_process: start remove process map (logical_id=13)
2026-02-24 08:51:29.856980 [:00000002] bmc_core: LAUNCH snlua bootstrap
2026-02-24 08:51:29.897070 [:00000003] bmc_core: LAUNCH snlua launcher
2026-02-24 08:51:29.937471 [:00000004] bmc_core: LAUNCH snlua cdummy
2026-02-24 08:51:29.965496 [:00000005] bmc_core: LAUNCH harbor 0 4
2026-02-24 08:51:29.967867 [:00000006] bmc_core: LAUNCH snlua datacenterd
2026-02-24 08:51:30.008444 [:00000007] bmc_core: LAUNCH snlua service_mgr
2026-02-24 08:51:30.049027 [:00000008] bmc_core: LAUNCH snlua hica/subsys/bmc_core/service/main
2026-02-24 08:51:30.089417 [:00000009] bmc_core: LAUNCH snlua sd_bus
2026-02-24 08:51:30.787992 [:0000000a] bmc_core: LAUNCH snlua harbor
2026-02-24 08:51:30.849018 [:00000002] bmc_core: KILL self
2026-02-24 08:51:30.850933 [:0000000b] bmc_core: LAUNCH snlua debug_console 0.0.0.0 40020
2026-02-24 08:51:30.860311 [:0000000c] bmc_core: LAUNCH snlua bmc_time/service/main
2026-02-24 08:51:30.861337 [:0000000d] bmc_core: LAUNCH snlua firmware_mgmt/service/main
2026-02-24 08:51:30.872016 [:0000000e] bmc_core: LAUNCH snlua bmc_upgrade/service/main
2026-02-24 08:51:30.892582 [:0000000f] bmc_core: LAUNCH snlua fructrl/service/main
2026-02-24 08:51:30.892808 [:00000010] bmc_core: LAUNCH snlua bmc_network/service/main
2026-02-24 08:51:30.892914 [:00000012] bmc_core: LAUNCH snlua bmc_health/service/main
2026-02-24 08:51:30.923776 [:00000013] bmc_core: LAUNCH snlua ipmi_core/service/main
2026-02-24 08:51:31.652735 [:00000014] bmc_core: LAUNCH snlua bmc_soc/service/main
2026-02-24 08:51:31.667425 [:00000015] bmc_core: LAUNCH snlua manufacture/service/main
2026-02-24 08:51:31.668065 [:0000000b] bmc_core: Start debug console at 0.0.0.0:40020
2026-02-24 08:51:36.228913 [:00000016] bmc_core: LAUNCH snlua ipmi_core/service/bt
2026-02-24 08:51:36.231477 [:00000017] bmc_core: LAUNCH snlua ipmi_core/service/edma
2026-02-24 08:51:36.241916 [:00000018] bmc_core: LAUNCH snlua ipmi_core/service/btc
2026-02-24 08:51:36.254006 [:00000019] bmc_core: LAUNCH snlua ipmi_core/service/btc
2026-02-24 08:51:37.090590 [:0000001a] bmc_core: LAUNCH snlua bmc_network/service/fusionpod
2026-02-24 08:51:37.716370 [:0000001b] bmc_core: LAUNCH snlua ipmi_core/service/ipmb
2026-02-24 08:51:38.096038 soctrl NOTICE: uart_circular_log.lua(36): status:0x07 [repeated 13 times in 340s from 2026-02-24 08:45:58.788332 to 2026-02-24 08:51:38.096038]
2026-02-24 08:51:41.608816 [:00000016] bmc_core: KILL self
2026-02-24 08:51:57.766691 framework ERROR: shmlock.c(498): verify process pid=8562 failed, process is not alive, owner_pid=2377
2026-02-24 08:51:57.766767 framework ERROR: shmlock_health.c(568): DEAD Process Detected: logical_id: 14 (mapping_count=14), pid=8562
2026-02-24 08:51:58.157979 framework NOTICE: shmlock.c(600): unregister_process: start remove process map (logical_id=14)
2026-02-24 08:51:59.854408 [:00000002] security: LAUNCH snlua bootstrap
2026-02-24 08:51:59.904591 [:00000003] security: LAUNCH snlua launcher
2026-02-24 08:51:59.934913 [:00000004] security: LAUNCH snlua cdummy
2026-02-24 08:51:59.956101 [:00000005] security: LAUNCH harbor 0 4
2026-02-24 08:51:59.965259 [:00000006] security: LAUNCH snlua datacenterd
2026-02-24 08:51:59.995605 [:00000007] security: LAUNCH snlua service_mgr
2026-02-24 08:52:00.025975 [:00000008] security: LAUNCH snlua hica/subsys/security/service/main
2026-02-24 08:52:00.056308 [:00000009] security: LAUNCH snlua sd_bus
2026-02-24 08:52:00.739897 [:0000000a] security: LAUNCH snlua harbor
2026-02-24 08:52:00.801033 [:0000000b] security: LAUNCH snlua debug_console 0.0.0.0 40021
2026-02-24 08:52:00.802067 [:0000000c] security: LAUNCH snlua trust/service/main
2026-02-24 08:52:00.835174 [:0000000d] security: LAUNCH snlua iam/service/main
2026-02-24 08:52:01.092793 [:0000000e] security: LAUNCH snlua capability_proxy/service/main
2026-02-24 08:52:01.245548 [:0000000b] security: Start debug console at 0.0.0.0:40021
2026-02-24 08:52:01.286337 [:0000000f] security: LAUNCH snlua certificate/service/main
2026-02-24 08:52:01.298021 [:00000010] security: LAUNCH snlua spdm/service/main
2026-02-24 08:52:01.298681 [:00000010] security: lua loader error : /opt/bmc/skynet/lualib/loader.lua:0: cannot open /opt/bmc/libmc/service/spdm/service/main.lua: No such file or directory cannot open /opt/bmc/libmc/service/spdm/service/main/init.lua: No such file or directory cannot open /opt/bmc/skynet/service/spdm/service/main.lua: No such file or directory cannot open /opt/bmc/skynet/service/spdm/service/main/init.lua: No such file or directory cannot open /opt/bmc/apps/spdm/service/main.lua: No such file or directory cannot open /opt/bmc/apps/spdm/service/main/init.lua: No such file or directory stack traceback:  [C]: in function 'error'  /opt/bmc/skynet/lualib/loader.lua: in function </opt/bmc/skynet/lualib/loader.lua:0>
2026-02-24 08:52:01.308424 [:00000010] security: KILL self
2026-02-24 08:52:01.315658 [:00000002] security: KILL self
2026-02-24 08:52:16.169243 framework ERROR: shmlock.c(498): verify process pid=8616 failed, process is not alive, owner_pid=2377
2026-02-24 08:52:16.169318 framework ERROR: shmlock_health.c(568): DEAD Process Detected: logical_id: 13 (mapping_count=14), pid=8616
2026-02-24 08:52:16.569922 framework NOTICE: shmlock.c(600): unregister_process: start remove process map (logical_id=13)
2026-02-24 08:52:18.485736 [:00000002] bmc_core: LAUNCH snlua bootstrap
2026-02-24 08:52:18.557077 [:00000003] bmc_core: LAUNCH snlua launcher
2026-02-24 08:52:18.587414 [:00000004] bmc_core: LAUNCH snlua cdummy
2026-02-24 08:52:18.620948 [:00000005] bmc_core: LAUNCH harbor 0 4
2026-02-24 08:52:18.627749 [:00000006] bmc_core: LAUNCH snlua datacenterd
2026-02-24 08:52:18.658073 [:00000007] bmc_core: LAUNCH snlua service_mgr
2026-02-24 08:52:18.699976 [:00000008] bmc_core: LAUNCH snlua hica/subsys/bmc_core/service/main
2026-02-24 08:52:18.750542 [:00000009] bmc_core: LAUNCH snlua sd_bus
2026-02-24 08:52:19.445096 [:0000000a] bmc_core: LAUNCH snlua harbor
2026-02-24 08:52:19.557916 [:00000002] bmc_core: KILL self
2026-02-24 08:52:19.567588 [:0000000b] bmc_core: LAUNCH snlua debug_console 0.0.0.0 40020
2026-02-24 08:52:19.568274 [:0000000c] bmc_core: LAUNCH snlua bmc_time/service/main
2026-02-24 08:52:19.578321 [:0000000d] bmc_core: LAUNCH snlua firmware_mgmt/service/main
2026-02-24 08:52:19.588341 [:0000000e] bmc_core: LAUNCH snlua bmc_upgrade/service/main
2026-02-24 08:52:19.600368 [:0000000f] bmc_core: LAUNCH snlua fructrl/service/main
2026-02-24 08:52:19.600590 [:00000010] bmc_core: LAUNCH snlua bmc_network/service/main
2026-02-24 08:52:19.600719 [:00000012] bmc_core: LAUNCH snlua bmc_health/service/main
2026-02-24 08:52:19.600810 [:00000013] bmc_core: LAUNCH snlua ipmi_core/service/main
2026-02-24 08:52:20.454615 [:00000014] bmc_core: LAUNCH snlua bmc_soc/service/main
2026-02-24 08:52:20.528117 [:00000015] bmc_core: LAUNCH snlua manufacture/service/main
2026-02-24 08:52:20.547639 [:0000000b] bmc_core: Start debug console at 0.0.0.0:40020
2026-02-24 08:52:24.468557 [:00000016] bmc_core: LAUNCH snlua ipmi_core/service/bt
2026-02-24 08:52:24.469504 [:00000017] bmc_core: LAUNCH snlua ipmi_core/service/edma
2026-02-24 08:52:24.478995 [:00000018] bmc_core: LAUNCH snlua ipmi_core/service/btc
2026-02-24 08:52:24.489711 [:00000019] bmc_core: LAUNCH snlua ipmi_core/service/btc
2026-02-24 08:52:25.018949 soctrl NOTICE: uart_circular_log.lua(36): status:0x01 [repeated 13 times in 335s from 2026-02-24 08:46:49.304023 to 2026-02-24 08:52:25.018949]
2026-02-24 08:52:25.027780 soctrl NOTICE: uart_circular_log.lua(36): status:0x03 [repeated 13 times in 335s from 2026-02-24 08:46:49.311493 to 2026-02-24 08:52:25.027780]
2026-02-24 08:52:25.164002 soctrl NOTICE: uart_circular_log.lua(36): status:0x05 [repeated 13 times in 336s from 2026-02-24 08:46:49.352748 to 2026-02-24 08:52:25.164002]
2026-02-24 08:52:26.156390 [:0000001a] bmc_core: LAUNCH snlua ipmi_core/service/ipmb
2026-02-24 08:52:27.314815 [:0000001b] bmc_core: LAUNCH snlua bmc_network/service/fusionpod
2026-02-24 08:52:29.733023 [:00000016] bmc_core: KILL self
2026-02-24 08:52:39.585378 framework ERROR: shmlock.c(498): verify process pid=8794 failed, process is not alive, owner_pid=2377
2026-02-24 08:52:39.585434 framework ERROR: shmlock_health.c(568): DEAD Process Detected: logical_id: 14 (mapping_count=14), pid=8794
2026-02-24 08:52:39.966084 framework NOTICE: shmlock.c(600): unregister_process: start remove process map (logical_id=14)
2026-02-24 08:52:41.070126 [:00000002] security: LAUNCH snlua bootstrap
2026-02-24 08:52:41.120304 [:00000003] security: LAUNCH snlua launcher
2026-02-24 08:52:41.150487 [:00000004] security: LAUNCH snlua cdummy
2026-02-24 08:52:41.183112 [:00000005] security: LAUNCH harbor 0 4
2026-02-24 08:52:41.191035 [:00000006] security: LAUNCH snlua datacenterd
2026-02-24 08:52:41.221422 [:00000007] security: LAUNCH snlua service_mgr
2026-02-24 08:52:41.262550 [:00000008] security: LAUNCH snlua hica/subsys/security/service/main
2026-02-24 08:52:41.302480 [:00000009] security: LAUNCH snlua sd_bus
2026-02-24 08:52:41.943997 [:0000000a] security: LAUNCH snlua harbor
2026-02-24 08:52:42.004700 [:0000000b] security: LAUNCH snlua debug_console 0.0.0.0 40021
2026-02-24 08:52:42.005674 [:0000000c] security: LAUNCH snlua trust/service/main
2026-02-24 08:52:42.043120 [:0000000d] security: LAUNCH snlua iam/service/main
2026-02-24 08:52:42.545264 [:0000000e] security: LAUNCH snlua capability_proxy/service/main
2026-02-24 08:52:42.673504 [:0000000b] security: Start debug console at 0.0.0.0:40021
2026-02-24 08:52:42.684437 [:0000000f] security: LAUNCH snlua certificate/service/main
2026-02-24 08:52:42.689616 [:00000010] security: LAUNCH snlua spdm/service/main
2026-02-24 08:52:42.690529 [:00000010] security: lua loader error : /opt/bmc/skynet/lualib/loader.lua:0: cannot open /opt/bmc/libmc/service/spdm/service/main.lua: No such file or directory cannot open /opt/bmc/libmc/service/spdm/service/main/init.lua: No such file or directory cannot open /opt/bmc/skynet/service/spdm/service/main.lua: No such file or directory cannot open /opt/bmc/skynet/service/spdm/service/main/init.lua: No such file or directory cannot open /opt/bmc/apps/spdm/service/main.lua: No such file or directory cannot open /opt/bmc/apps/spdm/service/main/init.lua: No such file or directory stack traceback:  [C]: in function 'error'  /opt/bmc/skynet/lualib/loader.lua: in function </opt/bmc/skynet/lualib/loader.lua:0>
2026-02-24 08:52:42.691218 [:00000010] security: KILL self
2026-02-24 08:52:42.695820 [:00000002] security: KILL self
2026-02-24 08:53:02.979470 framework ERROR: shmlock.c(498): verify process pid=8859 failed, process is not alive, owner_pid=2377
2026-02-24 08:53:02.979549 framework ERROR: shmlock_health.c(568): DEAD Process Detected: logical_id: 13 (mapping_count=14), pid=8859
2026-02-24 08:53:03.341757 framework NOTICE: shmlock.c(600): unregister_process: start remove process map (logical_id=13)
2026-02-24 08:53:04.565155 [:00000002] bmc_core: LAUNCH snlua bootstrap
2026-02-24 08:53:04.626855 [:00000003] bmc_core: LAUNCH snlua launcher
2026-02-24 08:53:04.669622 [:00000004] bmc_core: LAUNCH snlua cdummy
2026-02-24 08:53:04.725423 [:00000005] bmc_core: LAUNCH harbor 0 4
2026-02-24 08:53:04.730739 [:00000006] bmc_core: LAUNCH snlua datacenterd
2026-02-24 08:53:04.771279 [:00000007] bmc_core: LAUNCH snlua service_mgr
2026-02-24 08:53:04.803695 [:00000008] bmc_core: LAUNCH snlua hica/subsys/bmc_core/service/main
2026-02-24 08:53:04.844268 [:00000009] bmc_core: LAUNCH snlua sd_bus
2026-02-24 08:53:05.566709 [:0000000a] bmc_core: LAUNCH snlua harbor
2026-02-24 08:53:05.628844 [:00000002] bmc_core: KILL self
2026-02-24 08:53:05.633240 [:0000000b] bmc_core: LAUNCH snlua debug_console 0.0.0.0 40020
2026-02-24 08:53:05.633405 [:0000000c] bmc_core: LAUNCH snlua bmc_time/service/main
2026-02-24 08:53:05.633496 [:0000000d] bmc_core: LAUNCH snlua firmware_mgmt/service/main
2026-02-24 08:53:05.633572 [:0000000e] bmc_core: LAUNCH snlua bmc_upgrade/service/main
2026-02-24 08:53:05.633643 [:0000000f] bmc_core: LAUNCH snlua fructrl/service/main
2026-02-24 08:53:05.633721 [:00000010] bmc_core: LAUNCH snlua bmc_network/service/main
2026-02-24 08:53:05.633799 [:00000012] bmc_core: LAUNCH snlua bmc_health/service/main
2026-02-24 08:53:05.633881 [:00000013] bmc_core: LAUNCH snlua ipmi_core/service/main
2026-02-24 08:53:06.444953 [:00000014] bmc_core: LAUNCH snlua bmc_soc/service/main
2026-02-24 08:53:06.472039 [:00000015] bmc_core: LAUNCH snlua manufacture/service/main
2026-02-24 08:53:06.494018 [:0000000b] bmc_core: Start debug console at 0.0.0.0:40020
2026-02-24 08:53:11.461120 [:00000016] bmc_core: LAUNCH snlua ipmi_core/service/bt
2026-02-24 08:53:11.463459 [:00000017] bmc_core: LAUNCH snlua ipmi_core/service/edma
2026-02-24 08:53:11.476403 [:00000018] bmc_core: LAUNCH snlua ipmi_core/service/btc
2026-02-24 08:53:11.481443 [:00000019] bmc_core: LAUNCH snlua ipmi_core/service/btc
2026-02-24 08:53:12.918580 [:0000001a] bmc_core: LAUNCH snlua bmc_network/service/fusionpod
2026-02-24 08:53:13.182111 [:0000001b] bmc_core: LAUNCH snlua ipmi_core/service/ipmb
2026-02-24 08:53:16.952886 [:00000016] bmc_core: KILL self
2026-02-24 08:53:17.356355 framework ERROR: shmlock.c(498): verify process pid=9027 failed, process is not alive, owner_pid=2377
2026-02-24 08:53:17.356410 framework ERROR: shmlock_health.c(568): DEAD Process Detected: logical_id: 14 (mapping_count=14), pid=9027
2026-02-24 08:53:17.764517 framework NOTICE: shmlock.c(600): unregister_process: start remove process map (logical_id=14)
2026-02-24 08:53:19.673675 [:00000002] security: LAUNCH snlua bootstrap
2026-02-24 08:53:19.733709 [:00000003] security: LAUNCH snlua launcher
2026-02-24 08:53:19.774139 [:00000004] security: LAUNCH snlua cdummy
2026-02-24 08:53:19.806908 [:00000005] security: LAUNCH harbor 0 4
2026-02-24 08:53:19.814579 [:00000006] security: LAUNCH snlua datacenterd
2026-02-24 08:53:19.855005 [:00000007] security: LAUNCH snlua service_mgr
2026-02-24 08:53:19.895432 [:00000008] security: LAUNCH snlua hica/subsys/security/service/main
2026-02-24 08:53:19.945941 [:00000009] security: LAUNCH snlua sd_bus
2026-02-24 08:53:20.603225 [:0000000a] security: LAUNCH snlua harbor
2026-02-24 08:53:20.684165 [:0000000b] security: LAUNCH snlua debug_console 0.0.0.0 40021
2026-02-24 08:53:20.685088 [:0000000c] security: LAUNCH snlua trust/service/main
2026-02-24 08:53:20.746002 [:0000000d] security: LAUNCH snlua iam/service/main
2026-02-24 08:53:21.472001 [:0000000e] security: LAUNCH snlua capability_proxy/service/main
2026-02-24 08:53:21.630406 [:0000000b] security: Start debug console at 0.0.0.0:40021
2026-02-24 08:53:21.696737 [:0000000f] security: LAUNCH snlua certificate/service/main
2026-02-24 08:53:21.718420 [:00000010] security: LAUNCH snlua spdm/service/main
2026-02-24 08:53:21.718854 [:00000010] security: lua loader error : /opt/bmc/skynet/lualib/loader.lua:0: cannot open /opt/bmc/libmc/service/spdm/service/main.lua: No such file or directory cannot open /opt/bmc/libmc/service/spdm/service/main/init.lua: No such file or directory cannot open /opt/bmc/skynet/service/spdm/service/main.lua: No such file or directory cannot open /opt/bmc/skynet/service/spdm/service/main/init.lua: No such file or directory cannot open /opt/bmc/apps/spdm/service/main.lua: No such file or directory cannot open /opt/bmc/apps/spdm/service/main/init.lua: No such file or directory stack traceback:  [C]: in function 'error'  /opt/bmc/skynet/lualib/loader.lua: in function </opt/bmc/skynet/lualib/loader.lua:0>
2026-02-24 08:53:21.726125 [:00000010] security: KILL self
2026-02-24 08:53:21.727018 [:00000002] security: KILL self

相同环境继续跑长时间 AC

1、shm lock 再次出现(2026-02-24 12:28:07 开始)且 BMC 连不通,本次在 2026-02-24 12:35:30 自动触发了 BMC 自动重启;

2、BMC 自动重启后,shm lock 仍有出现,但没有导致 BMC 断连;

3、BMC 自动重启后,PowerState 显示为 ON,但是 KVM no signal,也没有 BIOS 的任何操作日志打印,且伴有 CPU 温度获取失败告警,看起来是带内实际并没有上电,但 BMC 却认为其上电了,怀疑是 shm lock 引起的(因为确实是 shm lock 那次产生的),但需要确认是否真的存在耦合关系;

环境信息

社区 12.30 版本

答案内容由AI生成,仅供参考:

:white_check_mark: 总结

项目 内容
问题类型 已知缺陷
发生版本 openUBMC 1230
根本原因 shmlock 异常 + security/bmc_core 循环崩溃 + 组件缺失
影响表现 BMC 不通、OS 不自动上电
临时方案 清除缓存、避免高频 AC、手动重启服务
修复版本 计划于 330 版本修复

建议您:

  • 升级至 330 或更高版本以彻底解决。
  • 在测试中启用一键日志收集功能,便于定位类似问题。

如有进一步日志或场景复现需求,可联系社区进行深入分析。

点击此处查看详细分析解答

关于 1230 版本长时间 AC 后 BMC 不通且 OS 未自动上电的问题分析与解决方案

根据您提供的日志信息和系统行为,该问题在 openUBMC 社区 1230 版本中是一个已知问题。以下将从问题现象、根因分析、影响范围、解决方案及修复计划等方面进行详细说明。


:magnifying_glass_tilted_left: 一、问题现象

  1. 长时间进行 AC(上电/断电)循环测试后

    • BMC 系统在上电后长达半小时仍无法访问(BMC 不通)。
    • 操作系统(OS)未能自动上电,正常应由 BMC 触发上电。
    • 插拔电源线或手动干预后问题可临时恢复。
  2. BMC 日志中出现关键错误

    • 出现大量 shm lock 错误,如:
      framework ERROR: shmlock.c(498): verify process pid=8005 failed, process is not alive, owner_pid=2377
      framework ERROR: shmlock_health.c(568): DEAD Process Detected
      
    • securitybmc_core 子系统持续 “KILL self” 并重启,形成循环:
      [:00000010] security: KILL self
      [:00000002] security: KILL self
      [:00000002] bmc_core: KILL self
      
  3. 组件启动异常

    • 存在 spdm/service/main.lua: No such file or directory 的文件缺失告警,表明组件依赖异常。

:puzzle_piece: 二、根因分析

结合日志和 openUBMC 社区技术资料,该问题的根源如下:

1. SHM(共享内存)锁机制失效

  • shmlock 报错表明某些关键进程已崩溃,但其共享内存锁未被正确释放。
  • 后续进程尝试获取锁时发现原拥有者进程已“死亡”,触发 DEAD Process Detected
  • 此问题在高频 AC 循环场景下更易发生,因资源未完全释放即重新初始化。

2. security 与 bmc_core 循环崩溃

  • security 组件因尝试加载不存在的 spdm/service/main.lua 脚本失败,导致其启动失败并自我终止(KILL self)。
  • bmc_core 启动依赖 security 成功运行,一旦后者崩溃,前者也因依赖缺失而重启。
  • 形成“依赖-崩溃-重启”循环,导致 BMC 服务无法正常启动。

注:此 spdm 组件缺失问题在特定构建配置中存在,属于构建完整性的配置缺陷。

3. OS 未能自动上电

  • BMC 负责在上电后通过 IPMI 命令自动启动 OS。
  • 当 BMC 处于持续重启状态时,自动上电逻辑未执行,导致 OS 停留在断电状态。

:pushpin: 三、是否为已知问题?

:white_check_mark: 是的,此为已知问题。

  • 在 openUBMC 社区中,同款问题已在 topic/4324 中被用户 guohao 报告:

    “服务器AC后,偶现BMC的web ssh服务均不可用”,初步定位为闭源组件 nsm 初始化异常导致 AddNatRule 失败。

  • 尽管具体组件不同,但问题本质一致:AC 后组件因资源竞争或加载失败导致核心服务循环重启。

  • 社区已在 1230 版本中确认该类问题为已知缺陷,并计划在后续版本中修复。


:hammer_and_wrench: 四、解决方案与规避措施

:white_check_mark: 临时规避方案

措施 操作说明
1. 清除并重建构建缓存 运行 rm -rf ~/.conan/data/* 清除缓存,重新构建固件,避免依赖残留。
2. 确保构建完整性 检查 spdm 组件是否被正确包含在构建配置中,防止文件缺失。
3. 避免高频 AC 测试 在测试中引入合理延时(如每次 AC 间隔 > 2 分钟),减少系统压力。
4. 重启 bmc_core 若问题发生,可通过串口登录并尝试重启 bmc_core 服务以临时恢复:
killall bmc_core

:date: 五、修复计划

  • 问题已提交至社区跟踪
  • 计划在 330 版本中修复,重点优化以下方面:
    1. 改进 shmlock 资源管理机制,支持自动回收“僵尸”锁。
    2. 增强组件依赖启动顺序控制,避免关键服务异常导致级联崩溃。
    3. 完善构建脚本,确保 spdm 等可选组件被正确处理或降级兼容。
    4. 添加 AC 后系统自检与恢复机制。

:bell: 参考依据:用户 guohaotopic/4324 中提到:“已解决 1230 版本已知问题,计划 330 版本修复”。


:books: 六、相关参考资料

  1. 服务器AC后,偶现BMC的web ssh服务均不可用

    • 用户:guohao
    • 状态:确认为 1230 版本已知问题,330 版本修复。
  2. 升级常见问题指南

    • 提及类似循环重启问题,建议检查构建一致性和组件依赖。
  3. 持久化机制常见问题

    • 分析 AC 掉电后数据未落盘问题,与资源未释放场景相关。

:white_check_mark: 总结

项目 内容
问题类型 已知缺陷
发生版本 openUBMC 1230
根本原因 shmlock 异常 + security/bmc_core 循环崩溃 + 组件缺失
影响表现 BMC 不通、OS 不自动上电
临时方案 清除缓存、避免高频 AC、手动重启服务
修复版本 计划于 330 版本修复

建议您:

  • 升级至 330 或更高版本以彻底解决。
  • 在测试中启用一键日志收集功能,便于定位类似问题。

如有进一步日志或场景复现需求,可联系社区进行深入分析。

日志看起来security和bmc_core在反复coredump,与已知的共享内存锁并发写入场景导致coredump的问题现象一致,已在发布的LTS补丁版本修复