EMQ进程被KILL

环境信息

  • EMQ X 版本:V3.2.8及V4.3.11
  • 操作系统及版本:win Server 2012
  • 其他

问题描述

解决完 Windows 缺失 MSVCR120.dll的问题之后,EMQ每隔10天左右的时间,进程就会被杀。以上两个版本都会出现此问题。

配置文件及日志

配置文件:端口1883改为了2183,其他配置未变动
日志:

** Last event = {info,{'EXIT',<0.2378.5>,killed}}
** When server state  = {connected,
                            {state,esockd_transport,#Port<0.4874>,
                                {{},23938},
                                undefined,running,100,
                                {pstate,external,
                                    #Fun<emqx_channel.1.6475601>,
                                    {{},2181},
                                    {{},23938},
                                    nossl,4,<<"MQTT">>,<<"100192">>,false,
                                    <0.2376.5>,undefined,undefined,<<"test">>,
                                    <0.2378.5>,true,#{},undefined,undefined,
                                    55,false,
                                    #{msg => 4401,pkt => 4403},
                                    #{msg => 1,pkt => 4403},
                                    true,
                                    {1641,535589,889000},
                                    #{from_client => 0,to_client => 0},
                                    emqx_channel,
                                    #{anonymous => true,
                                      auth_result => success,
                                      client_id => <<"100192">>,
                                      mountpoint => undefined,
                                      peername => {{IP},23938},
                                      sockname => {{},2181},
                                      username => <<"test">>,
                                      ws_cookie => undefined,zone => external},
                                    undefined},
                                {none,#{max_size => 1048576,version => 4}},
                                {emqx_gc,
                                    #{cnt => {1000,999},
                                      oct => {1048576,1048162}}},
                                {keepalive,#Fun<emqx_channel.4.6475601>,
                                    1821119,41,
                                    {keepalive,check},
                                    #Ref<0.1585213207.1291845633.21827>,0},
                                undefined,undefined,undefined,true,
                                #Ref<0.1585213207.1291845633.24592>,15000}}
** Reason for termination = exit:badarg
** Callback mode = [state_functions,state_enter]
** Stacktrace =
**  [{mnesia_tm,non_transaction,5,[{file,"mnesia_tm.erl"},{line,747}]},
     {emqx_router,match_routes,1,
                  [{file,"c:/emqx/ce/emqx-rel/_build/emqx/lib/emqx/src/emqx_router.erl"},
                   {line,127}]},
     {emqx_broker,publish,1,
                  [{file,"c:/emqx/ce/emqx-rel/_build/emqx/lib/emqx/src/emqx_broker.erl"},
                   {line,203}]},
     {emqx_hooks,do_run,2,
                 [{file,"c:/emqx/ce/emqx-rel/_build/emqx/lib/emqx/src/emqx_hooks.erl"},
                  {line,118}]},
     {emqx_protocol,terminate,2,
                    [{file,"c:/emqx/ce/emqx-rel/_build/emqx/lib/emqx/src/emqx_protocol.erl"},
                     {line,944}]},
     {gen_statem,terminate,6,[{file,"gen_statem.erl"},{line,1852}]},
     {proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,259}]}]

2022-01-10 15:39:38.275 [error] <<"F91350500122">>@:33398 [Channel] Session <0.27019.7> termiated: killed
2022-01-10 15:39:38.275 [error] <<"200060">>@:26516 [Channel] Session <0.23955.7> termiated: killed
2022-01-10 15:39:38.275 [error] <<"F91350500067">>@:17941 [Channel] Session <0.8161.6> termiated: killed
2022-01-10 15:39:38.275 [error] <<"100061">>@:51007 [Channel] Session <0.8895.0> termiated: killed
2022-01-10 15:39:38.275 [error] <<"F91350500128">>@:15491 [Channel] Session <0.4924.6> termiated: killed
2022-01-10 15:39:38.275 [error] <<"F32550200029">>@:35571 [Channel] Session <0.24334.7> termiated: killed
2022-01-10 15:39:38.275 [error] <<"F91350500119">>@:7866 [Channel] Session <0.15042.2> termiated: killed
2022-01-10 15:39:38.275 [error] <<"F91350500009">>@:12788 [Channel] Session <0.7358.3> termiated: killed
2022-01-10 15:39:38.275 [error] <<"100230">>@:52844 [Channel] Session <0.16381.7> termiated: killed
2022-01-10 15:39:38.275 [error] <<"100142">>@ip:52608 [Channel] Session <0.562.0> termiated: killed
2022-01-10 15:39:38.275 [error] <<"F32550200045">>@ip:62366 [Channel] Session <0.14474.7> termiated: killed
2022-01-10 15:39:38.260 [error] <<"F91350500095">>@ip:28197 ** State machine <0.15149.7> terminating
** Last event = {info,{'EXIT',<0.15151.7>,killed}}
** When server state  = {connected,
                            {state,esockd_transport,#Port<0.6620>,
                                {{ip},28197},
                                undefined,running,100,
                                {pstate,external,
                                    #Fun<emqx_channel.1.6475601>,
                                    {{},2181},
                                    {{ip},28197},
                                    nossl,4,<<"MQTT">>,<<"F91350500095">>,
                                    false,<0.15149.7>,undefined,undefined,
                                    <<"test">>,<0.15151.7>,true,#{},undefined,
                                    undefined,55,false,
                                    #{msg => 1137,pkt => 1139},
                                    #{msg => 1,pkt => 1139},
                                    true,
                                    {1641,732248,825000},
                                    #{from_client => 0,to_client => 0},
                                    emqx_channel,
                                    #{anonymous => true,
                                      auth_result => success,
                                      client_id => <<"F91350500095">>,
                                      mountpoint => undefined,
                                      peername => {{ip},28197},
                                      sockname => {{},2181},
                                      username => <<"test">>,
                                      ws_cookie => undefined,zone => external},
                                    undefined},
                                {none,#{max_size => 1048576,version => 4}},
                                {emqx_gc,
                                    #{cnt => {1000,1000},
                                      oct => {1048576,1048576}}},
                                {keepalive,#Fun<emqx_channel.4.6475601>,
                                    483893,41,
                                    {keepalive,check},
                                    #Ref<0.1585213207.1291845633.24884>,0},
                                undefined,undefined,undefined,true,undefined,
                                15000}}
** Reason for termination = exit:badarg
** Callback mode = [state_functions,state_enter]
** Stacktrace =
**  [{mnesia_tm,non_transaction,5,[{file,"mnesia_tm.erl"},{line,747}]},
     {emqx_router,match_routes,1,
                  [{file,"c:/emqx/ce/emqx-rel/_build/emqx/lib/emqx/src/emqx_router.erl"},
                   {line,127}]},
     {emqx_broker,publish,1,
                  [{file,"c:/emqx/ce/emqx-rel/_build/emqx/lib/emqx/src/emqx_broker.erl"},
                   {line,203}]},
     {emqx_hooks,do_run,2,
                 [{file,"c:/emqx/ce/emqx-rel/_build/emqx/lib/emqx/src/emqx_hooks.erl"},
                  {line,118}]},
     {emqx_protocol,terminate,2,
                    [{file,"c:/emqx/ce/emqx-rel/_build/emqx/lib/emqx/src/emqx_protocol.erl"},
                     {line,944}]},
     {gen_statem,terminate,6,[{file,"gen_statem.erl"},{line,1852}]},
     {proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,259}]}]

问题出现之前的服务器监控图


  1. emqx-1883/data/mnesia/emqx@127.0.0.1
    看一下这个目录的文件多大。
  2. 你最近一次出现kill的时间是多少。
  3. log目录下,有一个erlang.log, runxx.log也提供一下

看emqx.log最新的一次是(最可疑)内置的mnesia数据写文件到磁盘出错,
有可能是磁盘

回复:问题1,目录文件22KB;
问题2:最近一次被kill是1月10日
问题3:由于问题出现之后老版本删除了,目前此版本下没有这个两个日志文件。

关于磁盘出错,1月10日和1月2日启动EMQ的时候出现了磁盘不能写入的问题。此问题出现了三次,每次都是启动EMQ之后出现的磁盘不能写入,这个联系了服务器厂商解决了。

看日志除了1月2号,1月10号外,12月20号也出现了磁盘不能读/写的问题。
从你给的3个日志文件来看,每次都是由于磁盘不能读/写,然后被killed的。

建议让运营商换成好用的的磁盘。然后在windows上搞一个磁盘监控的软件。

当磁盘不可用持续一段时间后,emqx就会被killed

已跟运营商沟通了磁盘的性能,我们这边准备替换高性能的磁盘。
想确认下EMQ对磁盘的一个性能要求,我们要依据这个来选择磁盘的性能。
附件:磁盘参数


天翼云磁盘产品介绍:https://www.ctyun.cn/document/10000019/10000665

要具体看QPS,订阅的topic数量级,
不过客户端小于1000的,一般高IO的就够用了。

能帮忙看下这个报错是什么原因吗?,服务一直启动不起来。
我是emqx stop,然后emqx start。就始终启动不起来了。

2022-01-24T19:29:13.217000+08:00 [error] [Pool] Error: badarg, [{ets,delete_object,[emqx_channel,{<<"100247">>,<0.20125.9>}],[]},{emqx_cm,do_unregister_channel,1,[{file,"emqx_cm.erl"},{line,145}]},{lists,foreach,2,[{file,"lists.erl"},{line,1338}]},{emqx_pool,handle_cast,2,[{file,"emqx_pool.erl"},{line,108}]},{gen_server,try_dispatch,4,[{file,"gen_server.erl"},{line,680}]},{gen_server,handle_msg,6,[{file,"gen_server.erl"},{line,756}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,236}]}]
2022-01-24T19:29:13.217000+08:00 [error] [Pool] Error: badarg, [{ets,delete,[emqx_channel_conn,{<<"100020">>,<0.18154.19>}],[]},{emqx_cm,do_unregister_channel,1,[{file,"emqx_cm.erl"},{line,143}]},{lists,foreach,2,[{file,"lists.erl"},{line,1338}]},{emqx_pool,handle_cast,2,[{file,"emqx_pool.erl"},{line,108}]},{gen_server,try_dispatch,4,[{file,"gen_server.erl"},{line,680}]},{gen_server,handle_msg,6,[{file,"gen_server.erl"},{line,756}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,236}]}]
2022-01-24T19:29:13.217000+08:00 [error] [Pool] Error: badarg, [{ets,delete,[emqx_channel_conn,{<<"EA1250100099">>,<0.7920.21>}],[]},{emqx_cm,do_unregister_channel,1,[{file,"emqx_cm.erl"},{line,143}]},{lists,foreach,2,[{file,"lists.erl"},{line,1338}]},{emqx_pool,handle_cast,2,[{file,"emqx_pool.erl"},{line,108}]},{gen_server,try_dispatch,4,[{file,"gen_server.erl"},{line,680}]},{gen_server,handle_msg,6,[{file,"gen_server.erl"},{line,756}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,236}]}]
2022-01-24T19:29:13.217000+08:00 [error] [Pool] Error: badarg, [{ets,delete,[emqx_channel_conn,{<<"200081">>,<0.21738.19>}],[]},{emqx_cm,do_unregister_channel,1,[{file,"emqx_cm.erl"},{line,143}]},{lists,foreach,2,[{file,"lists.erl"},{line,1338}]},{emqx_pool,handle_cast,2,[{file,"emqx_pool.erl"},{line,108}]},{gen_server,try_dispatch,4,[{file,"gen_server.erl"},{line,680}]},{gen_server,handle_msg,6,[{file,"gen_server.erl"},{line,756}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,236}]}]
2022-01-24T19:29:13.217000+08:00 [error] [Pool] Error: badarg, [{ets,delete,[emqx_channel_conn,{<<"EA1250100054">>,<0.32725.18>}],[]},{emqx_cm,do_unregister_channel,1,[{file,"emqx_cm.erl"},{line,143}]},{lists,foreach,2,[{file,"lists.erl"},{line,1338}]},{emqx_pool,handle_cast,2,[{file,"emqx_pool.erl"},{line,108}]},{gen_server,try_dispatch,4,[{file,"gen_server.erl"},{line,680}]},{gen_server,handle_msg,6,[{file,"gen_server.erl"},{line,756}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,236}]}]
2022-01-24T19:29:13.217000+08:00 [error] [Pool] Error: badarg, [{ets,delete,[emqx_channel_conn,{<<"100076">>,<0.12439.10>}],[]},{emqx_cm,do_unregister_channel,1,[{file,"emqx_cm.erl"},{line,143}]},{lists,foreach,2,[{file,"lists.erl"},{line,1338}]},{emqx_pool,handle_cast,2,[{file,"emqx_pool.erl"},{line,108}]},{gen_server,try_dispatch,4,[{file,"gen_server.erl"},{line,680}]},{gen_server,handle_msg,6,[{file,"gen_server.erl"},{line,756}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,236}]}]
2022-01-24T19:29:13.217000+08:00 [error] [Pool] Error: badarg, [{ets,delete,[emqx_channel_conn,{<<"F32550200045">>,<0.21553.19>}],[]},{emqx_cm,do_unregister_channel,1,[{file,"emqx_cm.erl"},{line,143}]},{lists,foreach,2,[{file,"lists.erl"},{line,1338}]},{emqx_pool,handle_cast,2,[{file,"emqx_pool.erl"},{line,108}]},{gen_server,try_dispatch,4,[{file,"gen_server.erl"},{line,680}]},{gen_server,handle_msg,6,[{file,"gen_server.erl"},{line,756}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,236}]}]
2022-01-24T19:29:13.217000+08:00 [error] [Pool] Error: badarg, [{ets,delete,[emqx_channel_conn,{<<"EA1250100030">>,<0.19671.21>}],[]},{emqx_cm,do_unregister_channel,1,[{file,"emqx_cm.erl"},{line,143}]},{lists,foreach,2,[{file,"lists.erl"},{line,1338}]},{emqx_pool,handle_cast,2,[{file,"emqx_pool.erl"},{line,108}]},{gen_server,try_dispatch,4,[{file,"gen_server.erl"},{line,680}]},{gen_server,handle_msg,6,[{file,"gen_server.erl"},{line,756}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,236}]}]
2022-01-24T19:29:13.217000+08:00 [error] [Pool] Error: badarg, [{ets,delete,[emqx_channel_conn,{<<"F91350500038">>,<0.19622.20>}],[]},{emqx_cm,do_unregister_channel,1,[{file,"emqx_cm.erl"},{line,143}]},{lists,foreach,2,[{file,"lists.erl"},{line,1338}]},{emqx_pool,handle_cast,2,[{file,"emqx_pool.erl"},{line,108}]},{gen_server,try_dispatch,4,[{file,"gen_server.erl"},{line,680}]},{gen_server,handle_msg,6,[{file,"gen_server.erl"},{line,756}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,236}]}]
2022-01-24T19:29:13.217000+08:00 [error] [Pool] Error: badarg, [{ets,lookup,[emqx_submon,<0.31253.21>],[]},{emqx_broker_helper,clean_down,1,[{file,"emqx_broker_helper.erl"},{line,157}]},{lists,foreach,2,[{file,"lists.erl"},{line,1338}]},{emqx_pool,handle_cast,2,[{file,"emqx_pool.erl"},{line,108}]},{gen_server,try_dispatch,4,[{file,"gen_server.erl"},{line,680}]},{gen_server,handle_msg,6,[{file,"gen_server.erl"},{line,756}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,236}]}]
2022-01-24T19:29:13.217000+08:00 [error] [Pool] Error: badarg, [{ets,delete,[emqx_channel_conn,{<<"F32550200028">>,<0.30408.19>}],[]},{emqx_cm,do_unregister_channel,1,[{file,"emqx_cm.erl"},{line,143}]},{lists,foreach,2,[{file,"lists.erl"},{line,1338}]},{emqx_pool,handle_cast,2,[{file,"emqx_pool.erl"},{line,108}]},{gen_server,try_dispatch,4,[{file,"gen_server.erl"},{line,680}]},{gen_server,handle_msg,6,[{file,"gen_server.erl"},{line,756}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,236}]}]
2022-01-24T19:29:13.217000+08:00 [error] [Pool] Error: badarg, [{ets,delete,[emqx_channel_conn,{<<"F22350100021">>,<0.9448.20>}],[]},{emqx_cm,do_unregister_channel,1,[{file,"emqx_cm.erl"},{line,143}]},{lists,foreach,2,[{file,"lists.erl"},{line,1338}]},{emqx_pool,handle_cast,2,[{file,"emqx_pool.erl"},{line,108}]},{gen_server,try_dispatch,4,[{file,"gen_server.erl"},{line,680}]},{gen_server,handle_msg,6,[{file,"gen_server.erl"},{line,756}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,236}]}]
2022-01-24T19:29:13.217000+08:00 [error] [Pool] Error: badarg, [{ets,delete,[emqx_channel_conn,{<<"100043">>,<0.11788.19>}],[]},{emqx_cm,do_unregister_channel,1,[{file,"emqx_cm.erl"},{line,143}]},{lists,foreach,2,[{file,"lists.erl"},{line,1338}]},{emqx_pool,handle_cast,2,[{file,"emqx_pool.erl"},{line,108}]},{gen_server,try_dispatch,4,[{file,"gen_server.erl"},{line,680}]},{gen_server,handle_msg,6,[{file,"gen_server.erl"},{line,756}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,236}]}]
2022-01-24T19:29:13.217000+08:00 [error] [Pool] Error: badarg, [{ets,lookup,[emqx_submon,<0.10954.19>],[]},{emqx_broker_helper,clean_down,1,[{file,"emqx_broker_helper.erl"},{line,157}]},{lists,foreach,2,[{file,"lists.erl"},{line,1338}]},{emqx_pool,handle_cast,2,[{file,"emqx_pool.erl"},{line,108}]},{gen_server,try_dispatch,4,[{file,"gen_server.erl"},{line,680}]},{gen_server,handle_msg,6,[{file,"gen_server.erl"},{line,756}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,236}]}]
2022-01-24T19:29:13.217000+08:00 [error] [Pool] Error: badarg, [{ets,lookup,[emqx_submon,<0.6913.18>],[]},{emqx_broker_helper,clean_down,1,[{file,"emqx_broker_helper.erl"},{line,157}]},{lists,foreach,2,[{file,"lists.erl"},{line,1338}]},{emqx_pool,handle_cast,2,[{file,"emqx_pool.erl"},{line,108}]},{gen_server,try_dispatch,4,[{file,"gen_server.erl"},{line,680}]},{gen_server,handle_msg,6,[{file,"gen_server.erl"},{line,756}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,236}]}]
2022-01-24T19:29:13.217000+08:00 [error] [Pool] Error: badarg, [{ets,lookup,[emqx_submon,<0.18721.18>],[]},{emqx_broker_helper,clean_down,1,[{file,"emqx_broker_helper.erl"},{line,157}]},{lists,foreach,2,[{file,"lists.erl"},{line,1338}]},{emqx_pool,handle_cast,2,[{file,"emqx_pool.erl"},{line,108}]},{gen_server,try_dispatch,4,[{file,"gen_server.erl"},{line,680}]},{gen_server,handle_msg,6,[{file,"gen_server.erl"},{line,756}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,236}]}]
2022-01-24T19:29:13.217000+08:00 [error] [Pool] Error: badarg, [{ets,delete,[emqx_channel_conn,{<<"100005">>,<0.6984.18>}],[]},{emqx_cm,do_unregister_channel,1,[{file,"emqx_cm.erl"},{line,143}]},{lists,foreach,2,[{file,"lists.erl"},{line,1338}]},{emqx_pool,handle_cast,2,[{file,"emqx_pool.erl"},{line,108}]},{gen_server,try_dispatch,4,[{file,"gen_server.erl"},{line,680}]},{gen_server,handle_msg,6,[{file,"gen_server.erl"},{line,756}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,236}]}]
2022-01-24T19:29:13.217000+08:00 [error] [Pool] Error: badarg, [{ets,lookup,[emqx_submon,<0.19814.19>],[]},{emqx_broker_helper,clean_down,1,[{file,"emqx_broker_helper.erl"},{line,157}]},{lists,foreach,2,[{file,"lists.erl"},{line,1338}]},{emqx_pool,handle_cast,2,[{file,"emqx_pool.erl"},{line,108}]},{gen_server,try_dispatch,4,[{file,"gen_server.erl"},{line,680}]},{gen_server,handle_msg,6,[{file,"gen_server.erl"},{line,756}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,236}]}]
2022-01-24T19:29:13.217000+08:00 [error] [Pool] Error: badarg, [{ets,lookup,[emqx_submon,<0.13004.21>],[]},{emqx_broker_helper,clean_down,1,[{file,"emqx_broker_helper.erl"},{line,157}]},{lists,foreach,2,[{file,"lists.erl"},{line,1338}]},{emqx_pool,handle_cast,2,[{file,"emqx_pool.erl"},{line,108}]},{gen_server,try_dispatch,4,[{file,"gen_server.erl"},{line,680}]},{gen_server,handle_msg,6,[{file,"gen_server.erl"},{line,756}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,236}]}]
2022-01-24T19:29:13.217000+08:00 [error] [Pool] Error: badarg, [{ets,delete,[emqx_channel_conn,{<<"F91350500010">>,<0.32008.18>}],[]},{emqx_cm,do_unregister_channel,1,[{file,"emqx_cm.erl"},{line,143}]},{lists,foreach,2,[{file,"lists.erl"},{line,1338}]},{emqx_pool,handle_cast,2,[{file,"emqx_pool.erl"},{line,108}]},{gen_server,try_dispatch,4,[{file,"gen_server.erl"},{line,680}]},{gen_server,handle_msg,6,[{file,"gen_server.erl"},{line,756}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,236}]}]
2022-01-24T19:29:13.217000+08:00 [error] [Pool] Error: badarg, [{ets,delete,[emqx_channel_conn,{<<"100141">>,<0.6968.18>}],[]},{emqx_cm,do_unregister_channel,1,[{file,"emqx_cm.erl"},{line,143}]},{lists,foreach,2,[{file,"lists.erl"},{line,1338}]},{emqx_pool,handle_cast,2,[{file,"emqx_pool.erl"},{line,108}]},{gen_server,try_dispatch,4,[{file,"gen_server.erl"},{line,680}]},{gen_server,handle_msg,6,[{file,"gen_server.erl"},{line,756}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,236}]}]
2022-01-24T19:29:13.217000+08:00 [error] [Pool] Error: badarg, [{ets,lookup,[emqx_submon,<0.9731.19>],[]},{emqx_broker_helper,clean_down,1,[{file,"emqx_broker_helper.erl"},{line,157}]},{lists,foreach,2,[{file,"lists.erl"},{line,1338}]},{emqx_pool,handle_cast,2,[{file,"emqx_pool.erl"},{line,108}]},{gen_server,try_dispatch,4,[{file,"gen_server.erl"},{line,680}]},{gen_server,handle_msg,6,[{file,"gen_server.erl"},{line,756}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,236}]}]
2022-01-24T19:29:13.217000+08:00 [error] [Pool] Error: badarg, [{ets,delete,[emqx_channel_conn,{<<"F22350100084">>,<0.13310.12>}],[]},{emqx_cm,do_unregister_channel,1,[{file,"emqx_cm.erl"},{line,143}]},{lists,foreach,2,[{file,"lists.erl"},{line,1338}]},{emqx_pool,handle_cast,2,[{file,"emqx_pool.erl"},{line,108}]},{gen_server,try_dispatch,4,[{file,"gen_server.erl"},{line,680}]},{gen_server,handle_msg,6,[{file,"gen_server.erl"},{line,756}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,236}]}]
2022-01-24T19:29:13.217000+08:00 [error] [Pool] Error: badarg, [{ets,delete,[emqx_channel_conn,{<<"100045">>,<0.4118.17>}],[]},{emqx_cm,do_unregister_channel,1,[{file,"emqx_cm.erl"},{line,143}]},{lists,foreach,2,[{file,"lists.erl"},{line,1338}]},{emqx_pool,handle_cast,2,[{file,"emqx_pool.erl"},{line,108}]},{gen_server,try_dispatch,4,[{file,"gen_server.erl"},{line,680}]},{gen_server,handle_msg,6,[{file,"gen_server.erl"},{line,756}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,236}]}]
2022-01-24T19:29:13.217000+08:00 [error] [Pool] Error: badarg, [{ets,lookup,[emqx_submon,<0.10214.20>],[]},{emqx_broker_helper,clean_down,1,[{file,"emqx_broker_helper.erl"},{line,157}]},{lists,foreach,2,[{file,"lists.erl"},{line,1338}]},{emqx_pool,handle_cast,2,[{file,"emqx_pool.erl"},{line,108}]},{gen_server,try_dispatch,4,[{file,"gen_server.erl"},{line,680}]},{gen_server,handle_msg,6,[{file,"gen_server.erl"},{line,756}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,236}]}]

要看完整的报错啊,前面应该还有其它的报错吧。

前面的日志信息不是今天的,是之前的。这个日志里面是今天我重新启动的时间点,没有其他时间点的日志。我一会把log下面的日志文件发给您。