AC测试时出现系统不上电问题

// 此模板仅供参考,如果不适用可以修改

问题描述

AC测试时出现系统不上电问题

环境信息

  • 操作系统:[如 Ubuntu 24.04]

  • 软件版本:openUBMC2512 LTS SP2

  • 硬件配置:[如 CPU、内存等]

重现步骤

  1. 设置上电策略为保持上电

  2. 开始AC测试

  3. 等待测试完成

期望结果

测试正常完成,每次AC后系统能上电

实际结果

AC测试时出现系统不上电问题

尝试过的解决方案

无

分析结论

fructrl组件出现重启,由于软重启不执行上电策略,所以系统长时间处于下电状态,AC测试失败

Snipaste_2026-09-14_14-42-53

framework有大量error错误打印

还有 lua loader error

2026-09-11 16:05:14.548692 persistence WARNING: harbor_client.lua(386): Receiver Skynet message queue scheduling delay is 1789142658504 ms (threshold: 500 ms), service_name=bmc.kepler.persistence, path=/bmc/kepler/persistence, interface=bmc.kepler.persistence, method_name=BatchRead
2026-09-11 16:05:14.552279 maca NOTICE: base.lua(393): monitor component bmc_health added, service: bmc.kepler.bmc_health
2026-09-11 16:05:14.609555 persistence WARNING: harbor_client.lua(386): Receiver Skynet message queue scheduling delay is 1789142658556 ms (threshold: 500 ms), service_name=bmc.kepler.persistence, path=/bmc/kepler/persistence, interface=bmc.kepler.persistence, method_name=BatchRead
2026-09-11 16:05:14.682398 persistence WARNING: harbor_client.lua(386): Receiver Skynet message queue scheduling delay is 1789142658628 ms (threshold: 500 ms), service_name=bmc.kepler.persistence, path=/bmc/kepler/persistence, interface=org.freedesktop.DBus.Peer, method_name=Ping
2026-09-11 16:05:14.682532 maca NOTICE: base.lua(393): monitor component certificate added, service: bmc.kepler.certificate
2026-09-11 16:05:14.751711 persistence WARNING: harbor_client.lua(386): Receiver Skynet message queue scheduling delay is 1789142658608 ms (threshold: 500 ms), service_name=bmc.kepler.persistence, path=/bmc/kepler/persistence, interface=org.freedesktop.DBus.Peer, method_name=Ping
2026-09-11 16:05:14.753863 persistence WARNING: harbor_client.lua(386): Receiver Skynet message queue scheduling delay is 1789142658501 ms (threshold: 500 ms), service_name=bmc.kepler.persistence, path=/bmc/kepler/persistence, interface=org.freedesktop.DBus.Peer, method_name=Ping
2026-09-11 16:05:14.824830 persistence WARNING: harbor_client.lua(386): Receiver Skynet message queue scheduling delay is 1789142658518 ms (threshold: 500 ms), service_name=bmc.kepler.persistence, path=/bmc/kepler/persistence, interface=org.freedesktop.DBus.Peer, method_name=Ping
2026-09-11 16:05:14.826390 persistence WARNING: harbor_client.lua(386): Receiver Skynet message queue scheduling delay is 1789142658519 ms (threshold: 500 ms), service_name=bmc.kepler.persistence, path=/bmc/kepler/persistence, interface=org.freedesktop.DBus.Peer, method_name=Ping
2026-09-11 16:05:14.827693 persistence WARNING: harbor_client.lua(386): Receiver Skynet message queue scheduling delay is 1789142658461 ms (threshold: 500 ms), service_name=bmc.kepler.persistence, path=/bmc/kepler/persistence, interface=org.freedesktop.DBus.Peer, method_name=Ping
2026-09-11 16:05:14.844348 maca NOTICE: base.lua(393): monitor component spdm added, service: bmc.kepler.spdm
2026-09-11 16:05:14.946782 maca NOTICE: base.lua(393): monitor component iam added, service: bmc.kepler.iam
2026-09-11 16:05:15.132534 maca NOTICE: base.lua(393): monitor component trust added, service: bmc.kepler.trust
2026-09-11 16:05:15.347818 maca NOTICE: base.lua(393): monitor component frudata added, service: bmc.kepler.frudata
2026-09-11 16:05:15.497735 [:00000013] bmc_core: LAUNCH snlua ipmi_core/service/edma
2026-09-11 16:05:15.501639 [:00000014] bmc_core: LAUNCH snlua ipmi_core/service/btc
2026-09-11 16:05:15.519831 [:00000015] bmc_core: LAUNCH snlua ipmi_core/service/btc
2026-09-11 16:05:15.530562 [:00000016] bmc_core: LAUNCH snlua ipmi_core/service/bt
2026-09-11 16:05:15.593663 persistence WARNING: harbor_client.lua(386): Receiver Skynet message queue scheduling delay is 723 ms (threshold: 500 ms), service_name=bmc.kepler.persistence, path=/bmc/kepler/persistence, interface=bmc.kepler.persistence, method_name=BatchRead
2026-09-11 16:05:15.621828 maca NOTICE: base.lua(393): monitor component host_agent added, service: bmc.kepler.host_agent
2026-09-11 16:05:15.728654 persistence WARNING: harbor_client.lua(386): Receiver Skynet message queue scheduling delay is 828 ms (threshold: 500 ms), service_name=bmc.kepler.persistence, path=/bmc/kepler/persistence, interface=bmc.kepler.persistence, method_name=BatchRead
2026-09-11 16:05:15.838642 maca WARNING: harbor_client.lua(386): Receiver Skynet message queue scheduling delay is 1061 ms (threshold: 500 ms), service_name=bmc.kepler.maca, path=/bmc/kepler/MdbService, interface=bmc.kepler.Mdb, method_name=GetInterfaceOwners
2026-09-11 16:05:16.138474 persistence WARNING: harbor_client.lua(386): Receiver Skynet message queue scheduling delay is 1212 ms (threshold: 500 ms), service_name=bmc.kepler.persistence, path=/bmc/kepler/persistence, interface=bmc.kepler.persistence, method_name=BatchRead
2026-09-11 16:05:16.156566 persistence WARNING: harbor_client.lua(386): Receiver Skynet message queue scheduling delay is 984 ms (threshold: 500 ms), service_name=bmc.kepler.persistence, path=/bmc/kepler/persistence, interface=org.freedesktop.DBus.Peer, method_name=Ping
2026-09-11 16:05:16.165120 persistence WARNING: harbor_client.lua(386): Receiver Skynet message queue scheduling delay is 760 ms (threshold: 500 ms), service_name=bmc.kepler.persistence, path=/bmc/kepler/persistence, interface=org.freedesktop.DBus.Peer, method_name=Ping
2026-09-11 16:05:16.250596 persistence WARNING: harbor_client.lua(386): Receiver Skynet message queue scheduling delay is 774 ms (threshold: 500 ms), service_name=bmc.kepler.persistence, path=/bmc/kepler/persistence, interface=bmc.kepler.persistence, method_name=Save
2026-09-11 16:05:16.264129 [:00000002] energy: LAUNCH snlua bootstrap
2026-09-11 16:05:16.635507 [:00000003] energy: LAUNCH snlua launcher
2026-09-11 16:05:16.707301 [:00000002] hardware: LAUNCH snlua bootstrap
2026-09-11 16:05:16.797750 [:00000004] energy: LAUNCH snlua cdummy
2026-09-11 16:05:16.806994 persistence WARNING: harbor_client.lua(386): Receiver Skynet message queue scheduling delay is 552 ms (threshold: 500 ms), service_name=bmc.kepler.persistence, path=/bmc/kepler/persistence, interface=bmc.kepler.persistence, method_name=BatchRead
2026-09-11 16:05:16.895225 [:00000003] hardware: LAUNCH snlua launcher
2026-09-11 16:05:17.034795 [:00000005] energy: LAUNCH harbor 0 4
2026-09-11 16:05:17.069354 [:00000006] energy: LAUNCH snlua datacenterd
2026-09-11 16:05:17.123521 [:00000007] energy: LAUNCH snlua service_mgr
2026-09-11 16:05:17.150479 [:00000004] hardware: LAUNCH snlua cdummy
2026-09-11 16:05:17.216052 [:00000008] energy: LAUNCH snlua hica/subsys/energy/service/main
2026-09-11 16:05:17.281919 maca NOTICE: base.lua(393): monitor component bios added, service: bmc.kepler.bios
2026-09-11 16:05:17.402273 [:00000009] energy: LAUNCH snlua sd_bus
2026-09-11 16:05:17.509552 [:00000017] bmc_core: LAUNCH snlua ipmi_core/service/ipmb
2026-09-11 16:05:17.480751 maca NOTICE: base.lua(393): monitor component compute added, service: bmc.kepler.compute
2026-09-11 16:05:17.563279 [:00000005] hardware: LAUNCH harbor 0 4
2026-09-11 16:05:17.583474 [:00000006] hardware: LAUNCH snlua datacenterd
2026-09-11 16:05:17.592200 hwproxy NOTICE: app_objects.lua(663): scanner: Scanner_SSD_ReadVPDFail_01010201 change scan enabled to: 0
2026-09-11 16:05:17.800165 [:00000007] hardware: LAUNCH snlua service_mgr
2026-09-11 16:05:17.954815 [:00000008] hardware: LAUNCH snlua hica/subsys/hardware/service/main
2026-09-11 16:05:18.123290 persistence NOTICE: persistence_db_intf.lua(327): finish persist save for table: t_fw_inventory_objs, persist_type: protect_temporary, op_type: insert, data_size: 1101, key: Id:ActiveBMC
2026-09-11 16:05:18.257577 [:00000009] hardware: LAUNCH snlua sd_bus
2026-09-11 16:05:18.386291 persistence NOTICE: persistence_db_intf.lua(327): finish persist save for table: t_fw_inventory_objs, persist_type: protect_temporary, op_type: insert, data_size: 1095, key: Id:BackupBMC
2026-09-11 16:05:18.462066 [:0000000a] energy: LAUNCH snlua harbor
2026-09-11 16:05:18.587677 persistence NOTICE: persistence_db_intf.lua(327): finish persist save for table: t_fw_inventory_objs, persist_type: protect_temporary, op_type: insert, data_size: 1105, key: Id:AvailableBMC
2026-09-11 16:05:18.653694 [:0000000b] energy: LAUNCH snlua thermal_mgmt/service/main
2026-09-11 16:05:18.654679 [:0000000c] energy: LAUNCH snlua power_mgmt/service/main
2026-09-11 16:05:18.895249 persistence NOTICE: persistence_db_intf.lua(327): finish persist save for table: t_fw_inventory_objs, persist_type: protect_temporary, op_type: insert, data_size: 1086, key: Id:ActiveUboot
2026-09-11 16:05:19.144504 persistence NOTICE: persistence_db_intf.lua(327): finish persist save for table: t_fw_inventory_objs, persist_type: protect_temporary, op_type: insert, data_size: 1091, key: Id:BackupUboot
2026-09-11 16:05:19.250243 [:0000000a] hardware: LAUNCH snlua harbor
2026-09-11 16:05:19.496947 persistence NOTICE: persistence_db_intf.lua(327): finish persist save for table: t_fw_inventory_objs, persist_type: protect_temporary, op_type: insert, data_size: 1118, key: Id:ActiveSecureBootloader
2026-09-11 16:05:19.547754 [:00000002] hardware: KILL self
2026-09-11 16:05:19.570726 [:0000000b] hardware: LAUNCH snlua general_hardware/service/main
2026-09-11 16:05:19.581012 [:0000000c] hardware: LAUNCH snlua network_adapter/service/main
2026-09-11 16:05:19.581224 [:0000000d] hardware: LAUNCH snlua lsw/service/main
2026-09-11 16:05:19.581936 [:0000000e] hardware: LAUNCH snlua storage/service/main
2026-09-11 16:05:19.601064 [:0000000f] hardware: LAUNCH snlua chassis/service/main
2026-09-11 16:05:19.828737 maca NOTICE: base.lua(393): monitor component sensor added, service: bmc.kepler.sensor
2026-09-11 16:05:20.220334 [:00000018] bmc_core: LAUNCH snlua bmc_network/service/fusionpod
2026-09-11 16:05:20.232640 [:0000000e] hardware: lua loader error : error loading module 'storage.client' from file '/opt/bmc/apps/storage/client.lua':  /opt/bmc/apps/storage/client.lua:1: unexpected symbol stack traceback:  [C]: at 0xffffafc76138  [C]: in function 'require'  ./opt/bmc/apps/storage/lualib/storage_app.lua:11: in main chunk  [C]: in function 'require'  ./opt/bmc/apps/storage/service/main.lua:16: in main chunk  /opt/bmc/skynet/lualib/loader.lua: in function </opt/bmc/skynet/lualib/loader.lua:0>
2026-09-11 16:05:20.251509 [:0000000e] hardware: KILL self
2026-09-11 16:05:20.391411 [:0000000b] energy: lua loader error : error loading module 'fan_object' from file '/opt/bmc/apps/thermal_mgmt/lualib/fan_object.lua':  /opt/bmc/apps/thermal_mgmt/lualib/fan_object.lua: cannot load malformed bytecode stack traceback:  [C]: at 0xffff9af83138  [C]: in function 'require'  ./opt/bmc/apps/thermal_mgmt/lualib/fan_service.lua:14: in main chunk  [C]: in function 'require'  ./opt/bmc/apps/thermal_mgmt/lualib/thermal_mgmt_app.lua:14: in main chunk  [C]: in function 'require'  ./opt/bmc/apps/thermal_mgmt/service/main.lua:14: in main chunk  /opt/bmc/skynet/lualib/loader.lua: in function </opt/bmc/skynet/lualib/loader.lua:0>
2026-09-11 16:05:20.391625 [:0000000b] energy: KILL self
2026-09-11 16:05:20.391760 [:0000000c] energy: KILL self
2026-09-11 16:05:20.404321 [:0000000f] hardware: lua loader error : error loading module 'chassis.service' from file '/opt/bmc/apps/chassis/service.lua':  /opt/bmc/apps/chassis/service.lua:1: unexpected symbol stack traceback:  [C]: at 0xffffafc76138  [C]: in function 'require'  ./opt/bmc/apps/chassis/lualib/chassis_app.lua:20: in main chunk  [C]: in function 'require'  ./opt/bmc/apps/chassis/service/main.lua:15: in main chunk  /opt/bmc/skynet/lualib/loader.lua: in function </opt/bmc/skynet/lualib/loader.lua:0>
2026-09-11 16:05:20.404535 [:0000000f] hardware: KILL self
2026-09-11 16:05:20.703410 persistence NOTICE: persistence_db_intf.lua(327): finish persist save for table: t_fw_inventory_objs, persist_type: protect_temporary, op_type: insert, data_size: 1123, key: Id:BackupSecureBootloader
2026-09-11 16:05:20.823070 [:00000002] om_priv: LAUNCH snlua bootstrap
2026-09-11 16:05:20.860813 [:00000003] om_priv: LAUNCH snlua launcher
2026-09-11 16:05:20.911788 [:00000004] om_priv: LAUNCH snlua cdummy
2026-09-11 16:05:20.945420 [:00000005] om_priv: LAUNCH harbor 0 4
2026-09-11 16:05:20.952404 [:00000006] om_priv: LAUNCH snlua datacenterd
2026-09-11 16:05:20.982876 [:00000007] om_priv: LAUNCH snlua service_mgr
2026-09-11 16:05:21.023493 [:00000008] om_priv: LAUNCH snlua hica/subsys/om_priv/service/main
2026-09-11 16:05:21.074159 [:00000009] om_priv: LAUNCH snlua sd_bus
2026-09-11 16:05:21.105355 [:0000000d] hardware: KILL self
2026-09-11 16:05:21.723943 [:0000000a] om_priv: LAUNCH snlua harbor
2026-09-11 16:05:21.774860 [:00000002] om_priv: KILL self
2026-09-11 16:05:21.784716 [:0000000b] om_priv: LAUNCH snlua nsm/service/main
2026-09-11 16:05:22.211727 [:0000000c] om_priv: LAUNCH snlua ums/service/main
2026-09-11 16:05:22.212912 [:0000000d] om_priv: LAUNCH snlua oms/service/main
2026-09-11 16:05:22.296186 [:0000000e] om_priv: LAUNCH snlua observability/service/main
2026-09-11 16:05:30.587338 [:00000002] om: LAUNCH snlua bootstrap
2026-09-11 16:05:30.627258 [:00000003] om: LAUNCH snlua launcher
2026-09-11 16:05:30.667713 [:00000004] om: LAUNCH snlua cdummy
2026-09-11 16:05:30.697983 [:00000005] om: LAUNCH harbor 0 4
2026-09-11 16:05:30.708125 [:00000006] om: LAUNCH snlua datacenterd
2026-09-11 16:05:30.738449 [:00000007] om: LAUNCH snlua service_mgr
2026-09-11 16:05:30.778848 [:00000008] om: LAUNCH snlua service_provider
2026-09-11 16:05:30.819410 [:00000009] om: LAUNCH snlua service_cell ltls_holder
2026-09-11 16:05:30.870052 [:0000000a] om: LAUNCH snlua hica/subsys/om/service/main
2026-09-11 16:05:30.920553 [:0000000b] om: LAUNCH snlua sd_bus
2026-09-11 16:05:31.547087 [:00000002] bmc_core: KILL self
2026-09-11 16:05:31.555274 [:00000019] bmc_core: LAUNCH snlua manufacture/service/main
2026-09-11 16:05:31.568213 [:0000000c] om: LAUNCH snlua harbor
2026-09-11 16:05:31.624673 [:00000002] om: KILL self
2026-09-11 16:05:31.629574 [:0000000d] om: LAUNCH snlua ddns/service/main
2026-09-11 16:05:31.631348 [:0000000e] om: LAUNCH snlua remote_console/service/main
2026-09-11 16:05:31.993239 [:00000002] ras: KILL self
2026-09-11 16:05:31.997164 [:0000000e] ras: LAUNCH snlua ai_engine/service/main
2026-09-11 16:05:31.997809 [:0000000f] ras: LAUNCH snlua fault_diagnosis/service/main
2026-09-11 16:05:32.014844 [:00000010] ras: LAUNCH snlua metric_analyzer/service/main
2026-09-11 16:05:32.020223 [:0000000f] om: LAUNCH snlua rmcpd/service/main
2026-09-11 16:05:32.217483 [:00000010] om: LAUNCH snlua license/service/main
2026-09-11 16:05:32.218614 [:00000012] om: LAUNCH snlua event_policy/service/main
2026-09-11 16:05:32.228098 [:00000013] om: LAUNCH snlua product_mgmt/service/main
2026-09-11 16:05:32.339050 [:00000014] om: LAUNCH snlua usb_entry/service/main
2026-09-11 16:05:33.500691 [:00000015] om: LAUNCH snlua account/service/main
2026-09-11 16:05:33.509051 [:00000016] om: LAUNCH snlua vnc_proxy/service/main
2026-09-11 16:05:33.644071 [:00000002] energy: KILL self
2026-09-11 16:05:33.649497 [:0000000d] energy: LAUNCH snlua cooling/service/main
2026-09-11 16:05:33.650222 [:0000000e] energy: LAUNCH snlua power_strategy/service/main
2026-09-11 16:05:45.805097 [:00000002] interface: LAUNCH snlua bootstrap
2026-09-11 16:05:45.866721 [:00000003] interface: LAUNCH snlua launcher
2026-09-11 16:05:45.917298 [:00000004] interface: LAUNCH snlua cdummy
2026-09-11 16:05:45.951607 [:00000005] interface: LAUNCH harbor 0 4
2026-09-11 16:05:45.957732 [:00000006] interface: LAUNCH snlua datacenterd
2026-09-11 16:05:45.998256 [:00000007] interface: LAUNCH snlua service_mgr
2026-09-11 16:05:46.048722 [:00000008] interface: LAUNCH snlua hica/subsys/interface/service/main
2026-09-11 16:05:46.129582 [:00000009] interface: LAUNCH snlua sd_bus
2026-09-11 16:05:46.797815 [:0000000a] interface: LAUNCH snlua harbor
2026-09-11 16:05:46.864750 [:00000002] interface: KILL self
2026-09-11 16:05:46.869654 [:0000000b] interface: LAUNCH snlua hica/subsys/interface/service/redfish
2026-09-11 16:05:46.870438 [:0000000c] interface: LAUNCH snlua hica/subsys/interface/service/web_backend
2026-09-11 16:05:46.879704 [:0000000d] interface: LAUNCH snlua dcmid/service/main
2026-09-11 16:05:46.920375 [:0000000e] interface: LAUNCH snlua web_backend/service/portal_agent
2026-09-11 16:05:46.921624 [:0000000f] interface: LAUNCH snlua redfish/service/portal_agent
2026-09-11 16:05:53.203374 [:00000002] security: LAUNCH snlua bootstrap
2026-09-11 16:05:53.253047 [:00000003] security: LAUNCH snlua launcher
2026-09-11 16:05:53.283400 [:00000004] security: LAUNCH snlua cdummy
2026-09-11 16:05:53.312564 [:00000005] security: LAUNCH harbor 0 4
2026-09-11 16:05:53.323892 [:00000006] security: LAUNCH snlua datacenterd
2026-09-11 16:05:53.354245 [:00000007] security: LAUNCH snlua service_mgr
2026-09-11 16:05:53.384636 [:00000008] security: LAUNCH snlua hica/subsys/security/service/main
2026-09-11 16:05:53.435266 [:00000009] security: LAUNCH snlua sd_bus
2026-09-11 16:05:54.072978 [:0000000a] security: LAUNCH snlua harbor
2026-09-11 16:05:54.124804 [:00000002] security: KILL self
2026-09-11 16:05:54.128091 [:0000000b] security: LAUNCH snlua certificate/service/main
2026-09-11 16:05:54.493041 [:0000000c] security: LAUNCH snlua trust/service/main
2026-09-11 16:05:54.494092 [:0000000d] security: LAUNCH snlua iam/service/main
2026-09-11 16:05:54.605709 [:0000000e] security: LAUNCH snlua spdm/service/main
2026-09-11 16:06:10.408262 [:00000000] framework: A message from [ :00000000 ] to [ :0000001b ] maybe in an endless loop (version = 2175)
2026-09-11 16:06:10.408349 [:00000000] framework: Printing Lua stack trace for service :0000001b
2026-09-11 16:06:10.408383 [:0000001b] framework: recv a signal 2
2026-09-11 16:06:10.408430 [:00000000] framework: A message from [ :00000000 ] to [ :0000000a ] maybe in an endless loop (version = 2651)
2026-09-11 16:06:10.408464 [:00000000] framework: Printing Lua stack trace for service :0000000a
2026-09-11 16:06:10.408494 [:0000000a] framework: recv a signal 2
2026-09-11 16:06:10.408540 [:00000000] framework: A message from [ :00000001 ] to [ :0000000b ] maybe in an endless loop (version = 2083)
2026-09-11 16:06:10.408581 [:00000000] framework: Printing Lua stack trace for service :0000000b
2026-09-11 16:06:10.408610 [:0000000b] framework: recv a signal 2
2026-09-11 16:06:10.408653 [:00000000] framework: A message from [ :00000000 ] to [ :00000014 ] maybe in an endless loop (version = 3849)
2026-09-11 16:06:10.408686 [:00000000] framework: Printing Lua stack trace for service :00000014
2026-09-11 16:06:10.408711 [:00000014] framework: recv a signal 2
2026-09-11 16:06:10.408752 [:00000000] framework: A message from [ :00000014 ] to [ :0000000f ] maybe in an endless loop (version = 3899)
2026-09-11 16:06:10.408789 [:00000000] framework: Printing Lua stack trace for service :0000000f
2026-09-11 16:06:10.408817 [:0000000f] framework: recv a signal 2
2026-09-11 16:06:10.408861 [:00000000] framework: A message from [ :00000000 ] to [ :00000019 ] maybe in an endless loop (version = 5105)
2026-09-11 16:06:10.408893 [:00000000] framework: Printing Lua stack trace for service :00000019
2026-09-11 16:06:10.408920 [:00000019] framework: recv a signal 2
2026-09-11 16:06:10.408961 [:00000000] framework: A message from [ :00000000 ] to [ :00000023 ] maybe in an endless loop (version = 6485)
2026-09-11 16:06:10.408994 [:00000000] framework: Printing Lua stack trace for service :00000023
2026-09-11 16:06:10.409021 [:00000023] framework: recv a signal 2
2026-09-11 16:06:10.409061 [:00000000] framework: A message from [ :00000000 ] to [ :00000013 ] maybe in an endless loop (version = 2485)
2026-09-11 16:06:10.409093 [:00000000] framework: Printing Lua stack trace for service :00000013
2026-09-11 16:06:10.409123 [:00000013] framework: recv a signal 2
2026-09-11 16:06:10.481216 [:00000000] bmc_core: A message from [ :00000001 ] to [ :00000012 ] maybe in an endless loop (version = 83)
2026-09-11 16:06:10.481291 [:00000000] bmc_core: Printing Lua stack trace for service :00000012
2026-09-11 16:06:10.481326 [:00000012] bmc_core: recv a signal 2
2026-09-11 16:06:10.481369 [:00000000] bmc_core: A message from [ :00000000 ] to [ :0000000e ] maybe in an endless loop (version = 115)
2026-09-11 16:06:10.481410 [:00000000] bmc_core: Printing Lua stack trace for service :0000000e
2026-09-11 16:06:10.481439 [:0000000e] bmc_core: recv a signal 2
2026-09-11 16:06:10.481480 [:00000000] bmc_core: A message from [ :00000000 ] to [ :00000011 ] maybe in an endless loop (version = 531)
2026-09-11 16:06:10.481520 [:00000000] bmc_core: Printing Lua stack trace for service :00000011
2026-09-11 16:06:10.481547 [:00000011] bmc_core: recv a signal 2
2026-09-11 16:06:10.481589 [:00000000] bmc_core: A message from [ :0000000a ] to [ :00000019 ] maybe in an endless loop (version = 265)
2026-09-11 16:06:10.481620 [:00000000] bmc_core: Printing Lua stack trace for service :00000019
2026-09-11 16:06:10.481647 [:00000019] bmc_core: recv a signal 2
2026-09-11 16:06:10.481687 [:00000000] bmc_core: A message from [ :0000000c ] to [ :0000000c ] maybe in an endless loop (version = 127)
2026-09-11 16:06:10.481727 [:00000000] bmc_core: Printing Lua stack trace for service :0000000c
2026-09-11 16:06:10.481755 [:0000000c] bmc_core: recv a signal 2
2026-09-11 16:06:10.751264 [:00000000] alarm: A message from [ :0000000a ] to [ :0000000c ] maybe in an endless loop (version = 67)
2026-09-11 16:06:10.751335 [:00000000] alarm: Printing Lua stack trace for service :0000000c
2026-09-11 16:06:10.751369 [:0000000c] alarm: recv a signal 2
2026-09-11 16:06:11.279948 [:00000000] ras: A message from [ :0000000a ] to [ :0000000f ] maybe in an endless loop (version = 249)
2026-09-11 16:06:11.280028 [:00000000] ras: Printing Lua stack trace for service :0000000f
2026-09-11 16:06:11.280453 [:0000000f] ras: recv a signal 2
2026-09-11 16:06:11.280515 [:00000000] ras: A message from [ :0000000a ] to [ :0000000e ] maybe in an endless loop (version = 179)
2026-09-11 16:06:11.280550 [:00000000] ras: Printing Lua stack trace for service :0000000e
2026-09-11 16:06:11.280581 [:0000000e] ras: recv a signal 2
2026-09-11 16:06:16.333105 [:00000000] energy: A message from [ :00000000 ] to [ :0000000a ] maybe in an endless loop (version = 111)
2026-09-11 16:06:16.333564 [:00000000] energy: Printing Lua stack trace for service :0000000a
2026-09-11 16:06:16.334190 [:0000000a] energy: recv a signal 2
2026-09-11 16:06:16.715154 [:00000000] hardware: A message from [ :00000000 ] to [ :0000000a ] maybe in an endless loop (version = 27)
2026-09-11 16:06:16.715221 [:00000000] hardware: Printing Lua stack trace for service :0000000a
2026-09-11 16:06:16.715368 [:0000000a] hardware: recv a signal 2
2026-09-11 16:06:20.830826 [:00000000] om_priv: A message from [ :00000000 ] to [ :0000000a ] maybe in an endless loop (version = 127)
2026-09-11 16:06:20.830901 [:00000000] om_priv: Printing Lua stack trace for service :0000000a
2026-09-11 16:06:20.830936 [:0000000a] om_priv: recv a signal 2
2026-09-11 16:06:21.290621 [:00000012] bmc_core: === Lua Stack Trace (endless loop detected) ===
2026-09-11 16:06:21.290838 [:00000012] bmc_core: stack traceback:  ./opt/bmc/libmc/lualib/dbus/bus_base.lua:166: in function 'emit_properties_changed'  ./opt/bmc/libmc/lualib/sd_bus/init.lua:1834: in function 'emit_properties_changed'  ./opt/bmc/libmc/lualib/sd_bus/object.lua:564: in function <./opt/bmc/libmc/lualib/sd_bus/object.lua:563>  [C]: in function 'pcall'  ./opt/bmc/libmc/lualib/sd_bus/object.lua:563: in function 'emit_dbus_properties_changed'  ./opt/bmc/libmc/lualib/sd_bus/object.lua:551: in function <./opt/bmc/libmc/lualib/sd_bus/object.lua:550>  [builtin#21]: at 0xffffb537ed28  [C]: in function 'pcall'  ./opt/bmc/libmc/lualib/mc/context.lua:212: in function 'with_context'  ./opt/bmc/libmc/lualib/mc/app_preloader.lua:97: in function ''  /opt/bmc/skynet/lualib/skynet.lua: in function </opt/bmc/skynet/lualib/skynet.lua:0>
2026-09-11 16:06:21.290873 [:00000012] bmc_core: === End of Lua Stack Trace ===
2026-09-11 16:06:21.387064 framework ERROR: sysv_rwlock_embedded.c(161): reader_wait_until_no_writer: TIMEOUT after 60005 ms
2026-09-11 16:06:21.387176 framework ERROR: shmlock.c(193): LOCK_TIMEOUT: READ lock request timeout on object=1 requester=[logical_proc=1, actual_pid=2392, service=26, incarnation=1]
2026-09-11 16:06:21.387212 framework ERROR: shmlock.c(222): LOCK_TIMEOUT: read holder #1=[logical_proc=2, actual_pid=2665, service=15]
2026-09-11 16:06:21.388620 hwproxy ERROR: shared_object.lua(170): emit properties changed failed, path: /bmc/kepler/Scanner/Scanner_NicLm75_010105, interface: bmc.kepler.Scanner, properties: ["Value"], err: Failed to acquire read lock: Lock timeout
2026-09-11 16:06:21.388778 [:00000019] framework: === Lua Stack Trace (endless loop detected) ===
2026-09-11 16:06:21.388899 [:00000019] framework: stack traceback:  ./opt/bmc/apps/hwproxy/lualib/shared_object.lua:169: in function ''  /opt/bmc/skynet/lualib/skynet.lua: in function </opt/bmc/skynet/lualib/skynet.lua:0>  [builtin#21]: at 0xffff94179d28  [C]: in function 'pcall'  ./opt/bmc/libmc/lualib/mc/context.lua:212: in function 'with_context'  ./opt/bmc/libmc/lualib/mc/app_preloader.lua:97: in function ''  /opt/bmc/skynet/lualib/skynet.lua: in function </opt/bmc/skynet/lualib/skynet.lua:0>
2026-09-11 16:06:21.389641 [:00000019] framework: === End of Lua Stack Trace ===
2026-09-11 16:06:21.406656 framework ERROR: sysv_rwlock_embedded.c(161): reader_wait_until_no_writer: TIMEOUT after 60005 ms
2026-09-11 16:06:21.406744 framework ERROR: shmlock.c(193): LOCK_TIMEOUT: READ lock request timeout on object=1 requester=[logical_proc=1, actual_pid=2392, service=9, incarnation=1]
2026-09-11 16:06:21.406778 framework ERROR: shmlock.c(222): LOCK_TIMEOUT: read holder #1=[logical_proc=2, actual_pid=2665, service=15]
2026-09-11 16:06:21.414280 [:0000000b] framework: === Lua Stack Trace (endless loop detected) ===
2026-09-11 16:06:21.414428 [:0000000b] framework: === End of Lua Stack Trace ===
2026-09-11 16:06:21.487007 framework ERROR: sysv_rwlock_embedded.c(161): reader_wait_until_no_writer: TIMEOUT after 60005 ms
2026-09-11 16:06:21.487134 framework ERROR: shmlock.c(193): LOCK_TIMEOUT: READ lock request timeout on object=1 requester=[logical_proc=1, actual_pid=2392, service=14, incarnation=1]
2026-09-11 16:06:21.487252 framework ERROR: shmlock.c(222): LOCK_TIMEOUT: read holder #1=[logical_proc=2, actual_pid=2665, service=15]
2026-09-11 16:06:21.487804 [:0000000f] framework: === Lua Stack Trace (endless loop detected) ===
2026-09-11 16:06:21.488148 [:0000000f] framework: stack traceback:  ./opt/bmc/libmc/lualib/mc/context.lua:212: in function 'with_context'  ./opt/bmc/libmc/lualib/mc/app_preloader.lua:97: in function ''  /opt/bmc/skynet/lualib/skynet.lua: in function </opt/bmc/skynet/lualib/skynet.lua:0>
2026-09-11 16:06:21.488210 [:0000000f] framework: === End of Lua Stack Trace ===
2026-09-11 16:06:21.488536 hwproxy ERROR: app_preloader.lua(71): co[thread: 0x75308e3f7148] abnormal exit, err: Failed to acquire read lock: Lock timeout, traceback: stack traceback:  ./opt/bmc/libmc/lualib/mc/app_preloader.lua:71: in function ''  /opt/bmc/skynet/lualib/skynet.lua: in function </opt/bmc/skynet/lualib/skynet.lua:0>
2026-09-11 16:06:21.489418 [:0000000f] framework: lua call [14 to :f : 676 msgsz = 10] error : [31m/opt/bmc/skynet/lualib/skynet.lua:0: ./opt/bmc/libmc/lualib/mc/app_preloader.lua:74: Failed to acquire read lock: Lock timeout stack traceback:  [C]: in function 'error'  ./opt/bmc/libmc/lualib/mc/app_preloader.lua:74: in function ''  /opt/bmc/skynet/lualib/skynet.lua: in function </opt/bmc/skynet/lualib/skynet.lua:0> stack traceback:  [C]: in function 'error'  /opt/bmc/lualib/compat53/module.lua:176: in function ''  /opt/bmc/skynet/lualib/skynet.lua: in function </opt/bmc/skynet/lualib/skynet.lua:0>[0m
2026-09-11 16:06:21.497461 framework ERROR: sysv_rwlock_embedded.c(192): writer_wait_until_can_write: TIMEOUT after 60005 ms
2026-09-11 16:06:21.497569 framework ERROR: shmlock.c(193): LOCK_TIMEOUT: WRITE lock request timeout on object=1 requester=[logical_proc=1, actual_pid=2392, service=8, incarnation=1]
2026-09-11 16:06:21.497600 framework ERROR: shmlock.c(222): LOCK_TIMEOUT: read holder #1=[logical_proc=2, actual_pid=2665, service=15]
2026-09-11 16:06:21.502551 framework ERROR: l_matchs.h(88): D-Bus error: match rule basic_string::_S_construct null not valid
2026-09-11 16:06:21.504465 [:0000000a] framework: === Lua Stack Trace (endless loop detected) ===
2026-09-11 16:06:21.504557 [:0000000a] framework: stack traceback:  ./opt/bmc/libmc/lualib/dbus/tree.lua:235: in function <./opt/bmc/libmc/lualib/dbus/tree.lua:234>  [C]: at 0xffff87f2660c  [C]: at 0xffff87f1dfa4
2026-09-11 16:06:21.504611 [:0000000a] framework: === End of Lua Stack Trace ===
2026-09-11 16:06:21.527558 framework ERROR: sysv_rwlock_embedded.c(161): reader_wait_until_no_writer: TIMEOUT after 60005 ms
2026-09-11 16:06:21.527640 framework ERROR: shmlock.c(193): LOCK_TIMEOUT: READ lock request timeout on object=1 requester=[logical_proc=1, actual_pid=2392, service=11, incarnation=1]
2026-09-11 16:06:21.527675 framework ERROR: shmlock.c(222): LOCK_TIMEOUT: read holder #1=[logical_proc=2, actual_pid=2665, service=15]
2026-09-11 16:06:21.528586 maca ERROR: app_preloader.lua(71): co[thread: 0x75302c4a1340] abnormal exit, err: Failed to acquire read lock: Lock timeout, traceback: stack traceback:  ./opt/bmc/libmc/lualib/mc/app_preloader.lua:71: in function ''  /opt/bmc/skynet/lualib/skynet.lua: in function </opt/bmc/skynet/lualib/skynet.lua:0>
2026-09-11 16:06:21.668909 framework ERROR: sysv_rwlock_embedded.c(161): reader_wait_until_no_writer: TIMEOUT after 60005 ms
2026-09-11 16:06:21.668986 framework ERROR: shmlock.c(193): LOCK_TIMEOUT: READ lock request timeout on object=1 requester=[logical_proc=1, actual_pid=2392, service=29, incarnation=1]
2026-09-11 16:06:21.669017 framework ERROR: shmlock.c(222): LOCK_TIMEOUT: read holder #1=[logical_proc=2, actual_pid=2665, service=15]
2026-09-11 16:06:21.670362 hwproxy ERROR: shared_object.lua(170): emit properties changed failed, path: /bmc/kepler/Scanner/Scanner_Lm75_Outlet_0101, interface: bmc.kepler.Scanner, properties: ["Value"], err: Failed to acquire read lock: Lock timeout
2026-09-11 16:06:21.677029 [:0000001b] framework: === Lua Stack Trace (endless loop detected) ===
2026-09-11 16:06:21.677693 [:0000001b] framework: stack traceback:  ./opt/bmc/apps/hwproxy/lualib/shared_object.lua:169: in function ''  /opt/bmc/skynet/lualib/skynet.lua: in function </opt/bmc/skynet/lualib/skynet.lua:0>  [builtin#21]: at 0xffff94179d28  [C]: in function 'pcall'  ./opt/bmc/libmc/lualib/mc/context.lua:212: in function 'with_context'  ./opt/bmc/libmc/lualib/mc/app_preloader.lua:97: in function ''  /opt/bmc/skynet/lualib/skynet.lua: in function </opt/bmc/skynet/lualib/skynet.lua:0>
2026-09-11 16:06:21.678127 [:0000001b] framework: === End of Lua Stack Trace ===
2026-09-11 16:06:21.875545 [:0000000e] bmc_core: === Lua Stack Trace (endless loop detected) ===
2026-09-11 16:06:21.876031 [:0000000e] bmc_core: === End of Lua Stack Trace ===
2026-09-11 16:06:23.732128 framework ERROR: sysv_rwlock_embedded.c(161): reader_wait_until_no_writer: TIMEOUT after 60005 ms
2026-09-11 16:06:23.732214 framework ERROR: shmlock.c(193): LOCK_TIMEOUT: READ lock request timeout on object=1 requester=[logical_proc=1, actual_pid=2392, service=20, incarnation=1]
2026-09-11 16:06:23.732297 framework ERROR: shmlock.c(222): LOCK_TIMEOUT: read holder #1=[logical_proc=2, actual_pid=2665, service=15]
2026-09-11 16:06:23.733053 hwproxy ERROR: shared_object.lua(170): emit properties changed failed, path: /bmc/kepler/Scanner/Scanner_CpuBrdPresenceMntr_0101, interface: bmc.kepler.Scanner.Aggregate, properties: ["AggregateStatus"], err: Failed to acquire read lock: Lock timeout
2026-09-11 16:06:23.738555 [:00000013] framework: === Lua Stack Trace (endless loop detected) ===
2026-09-11 16:06:23.738710 [:00000013] framework: stack traceback:  ./opt/bmc/apps/hwproxy/lualib/shared_object.lua:169: in function ''  /opt/bmc/skynet/lualib/skynet.lua: in function </opt/bmc/skynet/lualib/skynet.lua:0>  [builtin#21]: at 0xffff94179d28  [C]: in function 'pcall'  ./opt/bmc/libmc/lualib/mc/context.lua:212: in function 'with_context'  ./opt/bmc/libmc/lualib/mc/app_preloader.lua:97: in function ''  /opt/bmc/skynet/lualib/skynet.lua: in function </opt/bmc/skynet/lualib/skynet.lua:0>
2026-09-11 16:06:23.738747 [:00000013] framework: === End of Lua Stack Trace ===
2026-09-11 16:06:26.520761 framework ERROR: sysv_rwlock_embedded.c(161): reader_wait_until_no_writer: TIMEOUT after 60005 ms
2026-09-11 16:06:26.520834 framework ERROR: shmlock.c(193): LOCK_TIMEOUT: READ lock request timeout on object=1 requester=[logical_proc=1, actual_pid=2392, service=21, incarnation=1]
2026-09-11 16:06:26.520864 framework ERROR: shmlock.c(222): LOCK_TIMEOUT: read holder #1=[logical_proc=2, actual_pid=2665, service=15]
2026-09-11 16:06:26.521685 hwproxy ERROR: shared_object.lua(170): emit properties changed failed, path: /bmc/kepler/Scanner/Scanner_TPMPresence_010101, interface: bmc.kepler.Scanner.Aggregate, properties: ["AggregateStatus"], err: Failed to acquire read lock: Lock timeout
2026-09-11 16:06:26.521826 [:00000014] framework: === Lua Stack Trace (endless loop detected) ===
2026-09-11 16:06:26.522002 [:00000014] framework: stack traceback:  ./opt/bmc/apps/hwproxy/lualib/shared_object.lua:169: in function ''  /opt/bmc/skynet/lualib/skynet.lua: in function </opt/bmc/skynet/lualib/skynet.lua:0>  [builtin#21]: at 0xffff94179d28  [C]: in function 'pcall'  ./opt/bmc/libmc/lualib/mc/context.lua:212: in function 'with_context'  ./opt/bmc/libmc/lualib/mc/app_preloader.lua:97: in function ''  /opt/bmc/skynet/lualib/skynet.lua: in function </opt/bmc/skynet/lualib/skynet.lua:0>
2026-09-11 16:06:26.522067 [:00000014] framework: === End of Lua Stack Trace ===
2026-09-11 16:06:30.608442 [:00000000] om: A message from [ :00000000 ] to [ :0000000c ] maybe in an endless loop (version = 167)
2026-09-11 16:06:30.608513 [:00000000] om: Printing Lua stack trace for service :0000000c
2026-09-11 16:06:30.608543 [:0000000c] om: recv a signal 2
2026-09-11 16:06:32.696796 framework ERROR: sysv_rwlock_embedded.c(192): writer_wait_until_can_write: TIMEOUT after 60005 ms
2026-09-11 16:06:32.696888 framework ERROR: shmlock.c(193): LOCK_TIMEOUT: WRITE lock request timeout on object=1 requester=[logical_proc=1, actual_pid=2392, service=36, incarnation=1]
2026-09-11 16:06:32.696922 framework ERROR: shmlock.c(222): LOCK_TIMEOUT: read holder #1=[logical_proc=2, actual_pid=2665, service=15]
2026-09-11 16:06:32.697973 mctpd ERROR: app_preloader.lua(71): co[thread: 0x75308dfa40b0] abnormal exit, err: Failed to acquire write lock: Lock timeout, traceback: stack traceback:  ./opt/bmc/libmc/lualib/mc/app_preloader.lua:71: in function ''  /opt/bmc/skynet/lualib/skynet.lua: in function </opt/bmc/skynet/lualib/skynet.lua:0>
2026-09-11 16:06:32.698752 [:00000023] framework: === Lua Stack Trace (endless loop detected) ===
2026-09-11 16:06:32.699136 [:00000023] framework: stack traceback:  ./opt/bmc/libmc/lualib/mc/context.lua:212: in function 'with_context'  ./opt/bmc/libmc/lualib/mc/app_preloader.lua:97: in function ''  /opt/bmc/skynet/lualib/skynet.lua: in function </opt/bmc/skynet/lualib/skynet.lua:0>
2026-09-11 16:06:32.699379 [:00000023] framework: === End of Lua Stack Trace ===
2026-09-11 16:06:32.699553 [:00000023] framework: lua call [0 to :23 : 20 msgsz = 0] error : [31m/opt/bmc/skynet/lualib/skynet.lua:0: ./opt/bmc/libmc/lualib/mc/app_preloader.lua:74: Failed to acquire write lock: Lock timeout stack traceback:  [C]: in function 'error'  ./opt/bmc/libmc/lualib/mc/app_preloader.lua:74: in function ''  /opt/bmc/skynet/lualib/skynet.lua: in function </opt/bmc/skynet/lualib/skynet.lua:0> stack traceback:  [C]: in function 'error'  /opt/bmc/lualib/compat53/module.lua:176: in function ''  /opt/bmc/skynet/lualib/skynet.lua: in function </opt/bmc/skynet/lualib/skynet.lua:0>[0m
2026-09-11 16:06:40.414264 [:00000000] framework: A message from [ :00000000 ] to [ :0000001b ] maybe in an endless loop (version = 2175)
2026-09-11 16:06:40.414356 [:00000000] framework: Printing Lua stack trace for service :0000001b
2026-09-11 16:06:40.414392 [:0000001b] framework: recv a signal 2
2026-09-11 16:06:40.414435 [:00000000] framework: A message from [ :00000001 ] to [ :0000000b ] maybe in an endless loop (version = 2083)
2026-09-11 16:06:40.416408 [:00000000] framework: Printing Lua stack trace for service :0000000b
2026-09-11 16:06:40.416479 [:0000000b] framework: recv a signal 2
2026-09-11 16:06:40.417419 [:00000000] framework: A message from [ :00000000 ] to [ :00000013 ] maybe in an endless loop (version = 2485)
2026-09-11 16:06:40.418133 [:00000013] framework: recv a signal 2
2026-09-11 16:06:40.481208 [:00000000] bmc_core: A message from [ :00000000 ] to [ :00000010 ] maybe in an endless loop (version = 309)
2026-09-11 16:06:40.481301 [:00000000] bmc_core: Printing Lua stack trace for service :00000010
2026-09-11 16:06:40.481334 [:00000010] bmc_core: recv a signal 2
2026-09-11 16:06:40.481377 [:00000000] bmc_core: A message from [ :00000000 ] to [ :00000011 ] maybe in an endless loop (version = 531)
2026-09-11 16:06:40.481410 [:00000000] bmc_core: Printing Lua stack trace for service :00000011
2026-09-11 16:06:40.481438 [:00000011] bmc_core: recv a signal 2
2026-09-11 16:06:40.481479 [:00000000] bmc_core: A message from [ :0000000a ] to [ :00000019 ] maybe in an endless loop (version = 265)
2026-09-11 16:06:40.481514 [:00000000] bmc_core: Printing Lua stack trace for service :00000019
2026-09-11 16:06:40.481543 [:00000019] bmc_core: recv a signal 2
2026-09-11 16:06:40.481583 [:00000000] bmc_core: A message from [ :0000000c ] to [ :0000000c ] maybe in an endless loop (version = 127)
2026-09-11 16:06:40.481616 [:00000000] bmc_core: Printing Lua stack trace for service :0000000c
2026-09-11 16:06:40.481643 [:0000000c] bmc_core: recv a signal 2
2026-09-11 16:06:40.752794 [:00000000] alarm: A message from [ :0000000a ] to [ :0000000c ] maybe in an endless loop (version = 67)
2026-09-11 16:06:40.752867 [:00000000] alarm: Printing Lua stack trace for service :0000000c
2026-09-11 16:06:40.752900 [:0000000c] alarm: recv a signal 2
2026-09-11 16:06:41.439996 [:00000000] ras: A message from [ :0000000a ] to [ :0000000f ] maybe in an endless loop (version = 249)
2026-09-11 16:06:41.440064 [:00000000] ras: Printing Lua stack trace for service :0000000f
2026-09-11 16:06:41.440619 [:0000000f] ras: recv a signal 2
2026-09-11 16:06:41.440691 [:00000000] ras: A message from [ :0000000a ] to [ :0000000e ] maybe in an endless loop (version = 179)
2026-09-11 16:06:41.440730 [:00000000] ras: Printing Lua stack trace for service :0000000e
2026-09-11 16:06:41.440760 [:0000000e] ras: recv a signal 2
2026-09-11 16:06:45.811873 [:00000000] interface: A message from [ :00000000 ] to [ :0000000a ] maybe in an endless loop (version = 55)
2026-09-11 16:06:45.811948 [:00000000] interface: Printing Lua stack trace for service :0000000a
2026-09-11 16:06:45.811982 [:0000000a] interface: recv a signal 2
2026-09-11 16:06:46.342451 [:00000000] energy: A message from [ :00000000 ] to [ :0000000a ] maybe in an endless loop (version = 111)
2026-09-11 16:06:46.342527 [:00000000] energy: Printing Lua stack trace for service :0000000a
2026-09-11 16:06:46.342562 [:0000000a] energy: recv a signal 2
2026-09-11 16:06:46.717303 [:00000000] hardware: A message from [ :00000000 ] to [ :0000000a ] maybe in an endless loop (version = 27)
2026-09-11 16:06:46.717367 [:00000000] hardware: Printing Lua stack trace for service :0000000a
2026-09-11 16:06:46.717404 [:0000000a] hardware: recv a signal 2
2026-09-11 16:06:47.283171 [:00000010] bmc_core: === Lua Stack Trace (endless loop detected) ===
2026-09-11 16:06:47.284410 [:00000010] bmc_core: === End of Lua Stack Trace ===
2026-09-11 16:06:50.838749 [:00000000] om_priv: A message from [ :00000000 ] to [ :0000000a ] maybe in an endless loop (version = 127)
2026-09-11 16:06:50.838819 [:00000000] om_priv: Printing Lua stack trace for service :0000000a
2026-09-11 16:06:50.838849 [:0000000a] om_priv: recv a signal 2
2026-09-11 16:06:53.215602 [:00000000] security: A message from [ :00000000 ] to [ :0000000a ] maybe in an endless loop (version = 111)
2026-09-11 16:06:53.215674 [:00000000] security: Printing Lua stack trace for service :0000000a
2026-09-11 16:06:53.215705 [:0000000a] security: recv a signal 2
2026-09-11 16:07:00.617795 [:00000000] om: A message from [ :00000000 ] to [ :0000000c ] maybe in an endless loop (version = 167)
2026-09-11 16:07:00.618107 [:00000000] om: Printing Lua stack trace for service :0000000c
2026-09-11 16:07:00.618389 [:0000000c] om: recv a signal 2
2026-09-11 16:07:10.418930 [:0000001b] framework: recv a signal 2
2026-09-11 16:07:10.418993 [:00000000] framework: A message from [ :00000004 ] to [ :0000000a ] maybe in an endless loop (version = 2653)
2026-09-11 16:07:10.419030 [:00000000] framework: Printing Lua stack trace for service :0000000a
2026-09-11 16:07:10.419060 [:0000000a] framework: recv a signal 2
2026-09-11 16:07:10.419164 [:0000000b] framework: recv a signal 2
2026-09-11 16:07:10.419205 [:00000000] framework: A message from [ :00000014 ] to [ :00000014 ] maybe in an endless loop (version = 3893)
2026-09-11 16:07:10.419237 [:00000000] framework: Printing Lua stack trace for service :00000014
2026-09-11 16:07:10.419263 [:00000014] framework: recv a signal 2
2026-09-11 16:07:10.419367 [:00000013] framework: recv a signal 2
2026-09-11 16:07:10.483806 [:00000000] bmc_core: A message from [ :00000000 ] to [ :00000012 ] maybe in an endless loop (version = 97)
2026-09-11 16:07:10.483881 [:00000000] bmc_core: Printing Lua stack trace for service :00000012
2026-09-11 16:07:10.483920 [:00000012] bmc_core: recv a signal 2
2026-09-11 16:07:10.483975 [:00000000] bmc_core: A message from [ :00000000 ] to [ :0000000e ] maybe in an endless loop (version = 137)
2026-09-11 16:07:10.484010 [:00000000] bmc_core: Printing Lua stack trace for service :0000000e
2026-09-11 16:07:10.484039 [:0000000e] bmc_core: recv a signal 2
2026-09-11 16:07:10.484083 [:00000000] bmc_core: A message from [ :00000000 ] to [ :00000011 ] maybe in an endless loop (version = 531)
2026-09-11 16:07:10.484117 [:00000000] bmc_core: Printing Lua stack trace for service :00000011
2026-09-11 16:07:10.484148 [:00000011] bmc_core: recv a signal 2
2026-09-11 16:07:10.484189 [:00000000] bmc_core: A message from [ :0000000a ] to [ :00000019 ] maybe in an endless loop (version = 265)
2026-09-11 16:07:10.484249 [:00000019] bmc_core: recv a signal 2
2026-09-11 16:07:10.484386 [:0000000c] bmc_core: recv a signal 2
2026-09-11 16:07:10.758841 [:00000000] alarm: A message from [ :0000000a ] to [ :0000000c ] maybe in an endless loop (version = 67)
2026-09-11 16:07:10.758928 [:00000000] alarm: Printing Lua stack trace for service :0000000c
2026-09-11 16:07:10.758967 [:0000000c] alarm: recv a signal 2
2026-09-11 16:07:11.599973 [:00000000] ras: A message from [ :0000000a ] to [ :0000000f ] maybe in an endless loop (version = 249)
2026-09-11 16:07:11.600081 [:00000000] ras: Printing Lua stack trace for service :0000000f
2026-09-11 16:07:11.600616 [:0000000f] ras: recv a signal 2
2026-09-11 16:07:11.600683 [:00000000] ras: A message from [ :0000000a ] to [ :0000000e ] maybe in an endless loop (version = 179)
2026-09-11 16:07:11.600721 [:00000000] ras: Printing Lua stack trace for service :0000000e
2026-09-11 16:07:11.600754 [:0000000e] ras: recv a signal 2
2026-09-11 16:07:15.816291 [:00000000] interface: A message from [ :00000000 ] to [ :0000000a ] maybe in an endless loop (version = 55)
2026-09-11 16:07:15.816362 [:00000000] interface: Printing Lua stack trace for service :0000000a
2026-09-11 16:07:15.816394 [:0000000a] interface: recv a signal 2
2026-09-11 16:07:16.343520 [:00000000] energy: A message from [ :00000000 ] to [ :0000000a ] maybe in an endless loop (version = 111)
2026-09-11 16:07:16.343593 [:00000000] energy: Printing Lua stack trace for service :0000000a
2026-09-11 16:07:16.343626 [:0000000a] energy: recv a signal 2
2026-09-11 16:07:16.725833 [:00000000] hardware: A message from [ :00000000 ] to [ :0000000a ] maybe in an endless loop (version = 27)
2026-09-11 16:07:16.725906 [:00000000] hardware: Printing Lua stack trace for service :0000000a
2026-09-11 16:07:16.725945 [:0000000a] hardware: recv a signal 2
2026-09-11 16:07:20.836347 [:00000000] om_priv: A message from [ :00000000 ] to [ :0000000a ] maybe in an endless loop (version = 127)
2026-09-11 16:07:20.836417 [:00000000] om_priv: Printing Lua stack trace for service :0000000a
2026-09-11 16:07:20.836448 [:0000000a] om_priv: recv a signal 2
2026-09-11 16:07:21.969120 [:00000012] bmc_core: === Lua Stack Trace (endless loop detected) ===
2026-09-11 16:07:21.969539 [:00000012] bmc_core: === End of Lua Stack Trace ===
2026-09-11 16:07:22.068574 framework ERROR: sysv_rwlock_embedded.c(161): reader_wait_until_no_writer: TIMEOUT after 60005 ms
2026-09-11 16:07:22.068652 framework ERROR: shmlock.c(193): LOCK_TIMEOUT: READ lock request timeout on object=1 requester=[logical_proc=1, actual_pid=2392, service=9, incarnation=1]
2026-09-11 16:07:22.068686 framework ERROR: shmlock.c(222): LOCK_TIMEOUT: read holder #1=[logical_proc=2, actual_pid=2665, service=15]
2026-09-11 16:07:22.069445 persistence ERROR: app_preloader.lua(71): co[thread: 0x753031e43ba0] abnormal exit, err: Failed to acquire read lock: Lock timeout, traceback: stack traceback:  ./opt/bmc/libmc/lualib/mc/app_preloader.lua:71: in function ''  /opt/bmc/skynet/lualib/skynet.lua: in function </opt/bmc/skynet/lualib/skynet.lua:0>
2026-09-11 16:07:22.070524 persistence WARNING: harbor_client.lua(386): Receiver Skynet message queue scheduling delay is 121713 ms (threshold: 500 ms), service_name=bmc.kepler.persistence, path=/bmc/kepler/persistence, interface=bmc.kepler.persistence, method_name=BatchRead
2026-09-11 16:07:22.076010 [:0000000b] framework: === Lua Stack Trace (endless loop detected) ===
2026-09-11 16:07:22.076136 [:0000000b] framework: stack traceback:  ./opt/bmc/libmc/lualib/mc/context.lua:212: in function 'with_context'  ./opt/bmc/libmc/lualib/mc/app_preloader.lua:97: in function ''  /opt/bmc/skynet/lualib/skynet.lua: in function </opt/bmc/skynet/lualib/skynet.lua:0>
2026-09-11 16:07:22.076176 [:0000000b] framework: === End of Lua Stack Trace ===
2026-09-11 16:07:22.076326 [:0000000b] framework: lua call [1 to :b : 0 msgsz = 368] error : [31m/opt/bmc/skynet/lualib/skynet.lua:0: ./opt/bmc/libmc/lualib/mc/app_preloader.lua:74: Failed to acquire read lock: Lock timeout stack traceback:  [C]: in function 'error'  ./opt/bmc/libmc/lualib/mc/app_preloader.lua:74: in function ''  /opt/bmc/skynet/lualib/skynet.lua: in function </opt/bmc/skynet/lualib/skynet.lua:0> stack traceback:  [C]: in function 'error'  /opt/bmc/lualib/compat53/module.lua:176: in function ''  /opt/bmc/skynet/lualib/skynet.lua: in function </opt/bmc/skynet/lualib/skynet.lua:0>[0m
2026-09-11 16:07:22.179815 framework ERROR: sysv_rwlock_embedded.c(192): writer_wait_until_can_write: TIMEOUT after 60005 ms
2026-09-11 16:07:22.179918 framework ERROR: shmlock.c(193): LOCK_TIMEOUT: WRITE lock request timeout on object=1 requester=[logical_proc=1, actual_pid=2392, service=8, incarnation=1]
2026-09-11 16:07:22.179957 framework ERROR: shmlock.c(222): LOCK_TIMEOUT: read holder #1=[logical_proc=2, actual_pid=2665, service=15]
2026-09-11 16:07:22.180469 framework ERROR: l_matchs.h(88): D-Bus error: match rule basic_string::_S_construct null not valid
2026-09-11 16:07:22.181718 [:0000000a] framework: === Lua Stack Trace (endless loop detected) ===
2026-09-11 16:07:22.181818 [:0000000a] framework: stack traceback:  ./opt/bmc/libmc/lualib/dbus/tree.lua:235: in function <./opt/bmc/libmc/lualib/dbus/tree.lua:234>  [C]: at 0xffff87f2660c  [C]: at 0xffff87f1dfa4
2026-09-11 16:07:22.182023 [:0000000a] framework: === End of Lua Stack Trace ===
2026-09-11 16:07:22.182405 [:0000000e] bmc_core: === Lua Stack Trace (endless loop detected) ===
2026-09-11 16:07:22.182871 [:0000000e] bmc_core: === End of Lua Stack Trace ===
2026-09-11 16:07:22.201448 framework ERROR: sysv_rwlock_embedded.c(161): reader_wait_until_no_writer: TIMEOUT after 60005 ms
2026-09-11 16:07:22.201535 framework ERROR: shmlock.c(193): LOCK_TIMEOUT: READ lock request timeout on object=1 requester=[logical_proc=1, actual_pid=2392, service=11, incarnation=1]
2026-09-11 16:07:22.201569 framework ERROR: shmlock.c(222): LOCK_TIMEOUT: read holder #1=[logical_proc=2, actual_pid=2665, service=15]
2026-09-11 16:07:22.202376 maca ERROR: app_preloader.lua(71): co[thread: 0x753034802310] abnormal exit, err: Failed to acquire read lock: Lock timeout, traceback: stack traceback:  ./opt/bmc/libmc/lualib/mc/app_preloader.lua:71: in function ''  /opt/bmc/skynet/lualib/skynet.lua: in function </opt/bmc/skynet/lualib/skynet.lua:0>
2026-09-11 16:07:22.348071 framework ERROR: sysv_rwlock_embedded.c(161): reader_wait_until_no_writer: TIMEOUT after 60005 ms
2026-09-11 16:07:22.348147 framework ERROR: shmlock.c(193): LOCK_TIMEOUT: READ lock request timeout on object=1 requester=[logical_proc=1, actual_pid=2392, service=29, incarnation=1]
2026-09-11 16:07:22.348177 framework ERROR: shmlock.c(222): LOCK_TIMEOUT: read holder #1=[logical_proc=2, actual_pid=2665, service=15]
2026-09-11 16:07:22.348965 hwproxy ERROR: shared_object.lua(170): emit properties changed failed, path: /bmc/kepler/Scanner/Scanner_OutletTemp_0101, interface: bmc.kepler.Scanner, properties: ["Value"], err: Failed to acquire read lock: Lock timeout
2026-09-11 16:07:22.349131 [:0000001b] framework: === Lua Stack Trace (endless loop detected) ===
2026-09-11 16:07:22.349630 [:0000001b] framework: stack traceback:  ./opt/bmc/apps/hwproxy/lualib/shared_object.lua:169: in function ''  /opt/bmc/skynet/lualib/skynet.lua: in function </opt/bmc/skynet/lualib/skynet.lua:0>  [builtin#21]: at 0xffff94179d28  [C]: in function 'pcall'  ./opt/bmc/libmc/lualib/mc/context.lua:212: in function 'with_context'  ./opt/bmc/libmc/lualib/mc/app_preloader.lua:97: in function ''  /opt/bmc/skynet/lualib/skynet.lua: in function </opt/bmc/skynet/lualib/skynet.lua:0>
2026-09-11 16:07:22.349706 [:0000001b] framework: === End of Lua Stack Trace ===
2026-09-11 16:07:23.220646 [:00000000] security: A message from [ :00000000 ] to [ :0000000a ] maybe in an endless loop (version = 111)
2026-09-11 16:07:23.220716 [:00000000] security: Printing Lua stack trace for service :0000000a
2026-09-11 16:07:23.220747 [:0000000a] security: recv a signal 2
2026-09-11 16:07:24.404883 framework ERROR: sysv_rwlock_embedded.c(161): reader_wait_until_no_writer: TIMEOUT after 60005 ms
2026-09-11 16:07:24.404962 framework ERROR: shmlock.c(193): LOCK_TIMEOUT: READ lock request timeout on object=1 requester=[logical_proc=1, actual_pid=2392, service=20, incarnation=1]
2026-09-11 16:07:24.404994 framework ERROR: shmlock.c(222): LOCK_TIMEOUT: read holder #1=[logical_proc=2, actual_pid=2665, service=15]
2026-09-11 16:07:24.405724 hwproxy ERROR: shared_object.lua(170): emit properties changed failed, path: /bmc/kepler/Scanner/Scanner_FanCableMntr_0101, interface: bmc.kepler.Scanner.Aggregate, properties: ["AggregateStatus"], err: Failed to acquire read lock: Lock timeout
2026-09-11 16:07:24.411503 [:00000013] framework: === Lua Stack Trace (endless loop detected) ===
2026-09-11 16:07:24.413159 [:00000013] framework: stack traceback:  ./opt/bmc/apps/hwproxy/lualib/shared_object.lua:169: in function ''  /opt/bmc/skynet/lualib/skynet.lua: in function </opt/bmc/skynet/lualib/skynet.lua:0>  [builtin#21]: at 0xffff94179d28  [C]: in function 'pcall'  ./opt/bmc/libmc/lualib/mc/context.lua:212: in function 'with_context'  ./opt/bmc/libmc/lualib/mc/app_preloader.lua:97: in function ''  /opt/bmc/skynet/lualib/skynet.lua: in function </opt/bmc/skynet/lualib/skynet.lua:0>
2026-09-11 16:07:24.413675 [:00000013] framework: === End of Lua Stack Trace ===

有可能与存储颗粒有关吗

AC启动,概率出现组件启动异常,有日志提示StartupCheck failed,影响PCIe卡加载 - 交流互助区 - openUBMC 论坛

答案内容由AI生成,仅供参考:

结论概述

根据您提供的日志和知识库信息,AC测试出现系统不上电问题的直接原因为:fructrl组件出现重启,由于软重启(BMC重启)不执行上电策略,导致系统长时间处于下电状态,最终AC测试失败。

点击此处查看详细分析解答

AC测试时系统不上电问题分析

结论概述

根据您提供的日志和知识库信息,AC测试出现系统不上电问题的直接原因为:fructrl组件出现重启,由于软重启(BMC重启)不执行上电策略,导致系统长时间处于下电状态,最终AC测试失败。

关键日志分析

1. 框架层面:检测到大量死循环(endless loop)

日志中出现了大量框架错误信息,表示消息循环异常:

  • framework: A message from [ :00000000 ] to [ :0000001b ] maybe in an endless loop (version = 2175) — 框架检测到消息循环疑似卡死
  • 涉及energy、hardware、om_priv、om、ras、security、bmc_core等多个子系统均报出异常
  • 多个服务接收到 signal 2 信号被终止

2. 共享内存锁超时(LOCK_TIMEOUT)

框架层面出现持续的共享内存锁获取失败:

framework ERROR: sysv_rwlock_embedded.c(161): reader_wait_until_no_writer: TIMEOUT after 60005 ms
framework ERROR: shmlock.c(193): LOCK_TIMEOUT: READ lock request timeout on object=1 requester=[logical_proc=1, actual_pid=2392, service=26, incarnation=1]
  • 读锁(READ lock) 和写锁(WRITE lock) 均出现 60 秒超时
  • 锁的持有者为 [logical_proc=2, actual_pid=2665, service=15],该服务一直占用锁未释放
  • 导致 hwproxy、persistence、maca、mctpd 等多个组件协程异常退出(abnormal exit)

3. Lua 模块加载失败

日志中出现存储和机箱等组件的 lua loader error:

[:0000000e] hardware: lua loader error : error loading module 'storage.client' from file '/opt/bmc/apps/storage/client.lua':  /opt/bmc/apps/storage/client.lua:1: unexpected symbol
[:0000000b] energy: lua loader error : error loading module 'fan_object' from file '/opt/bmc/apps/thermal_mgmt/lualib/fan_object.lua':  /opt/bmc/apps/thermal_mgmt/lualib/fan_object.lua: cannot load malformed bytecode
[:0000000f] hardware: lua loader error : error loading module 'chassis.service' from file '/opt/bmc/apps/chassis/service.lua':  /opt/bmc/apps/chassis/service.lua:1: unexpected symbol
  • 加载失败后对应服务均执行了 KILL self 自杀操作
  • storage、thermal_mgmt、chassis 组件未能正常启动

4. persistence 消息队列严重延迟

persistence WARNING: harbor_client.lua(386): Receiver Skynet message queue scheduling delay is 1789142658504 ms

消息队列调度出现极大延迟(远超 500ms 的阈值),表明系统整体处于严重负载或阻塞状态。

问题根因分析

与存储颗粒的关联性

根据知识库信息,AC测试与存储颗粒的关联性可以从以下几个方面判断:

  1. 存储组件加载失败:本次日志中确认 storage 组件因 client.lua 文件出现 unexpected symbol 错误而加载失败,该问题可能与存储颗粒(如NVMe盘、硬盘背板等)相关。

  2. AC Test 对存储系统的已知影响:知识库中提到,AC Test(交流电循环测试)会导致系统行为异常,包括 硬盘背板(Disk Backplane)无法加载、NVMe盘BMC信息磨损率丢失等问题。

  3. 框架死循环可能由存储组件触发:由于 storage 组件加载失败后进程被终止,可能导致依赖该组件的其他服务出现死循环或锁等待,从而引发框架层面的连锁反应。

已知相关问题现象

知识库中包含以下与 AC 测试相关的类似问题:

问题类型 相关实体 现象描述
AC压测后不上电 服务器不上电 AC压测情况下系统偶发无法上电
StartupCheck失败 StartupCheck Failed 初始化时需要加载的组件失败,影响PCIe卡加载
AC测试BMC重启 BMC Restart 长时AC测试后BMC反复重启
AC测试coredump AC Test devmon组件产生coredump导致上电策略不生效

建议排查方向

  1. 确认存储组件加载失败原因:检查 /opt/bmc/apps/storage/client.lua 文件内容是否存在编译异常或格式错误,这可能是导致storage组件无法正常启动的直接原因。

  2. 分析死循环根因:框架中大量的 endless loop 提示表明存在组件间消息循环依赖,需要结合 kbox_info 日志排查是否存在 watch dog 重启现象。

  3. 检查共享内存锁占用:shmlock.c 中锁持有者 [logical_proc=2, actual_pid=2665, service=15] 一直未释放锁,需要确认该服务是否异常挂起。

  4. 对比已知案例:参考知识库中 “AC启动,概率出现组件启动异常,有日志提示StartupCheck failed,影响PCIe卡加载” 的案例(论坛话题链接:https://discuss.openubmc.cn/t/topic/4722/17),该案例与当前问题高度相似,可参考其定位过程和解决方案。

一键日志

S920X20_71001850Z031_20260913-0810.tar.gz (16.8 MB)

看下写上电寄存器是否写入成功

目前发现应该与自己修改有关

目前解决了嘛?