2023-12-16T23:28:09.706707+08:00 [error] crasher: initial call: disk_log:init/2, pid: <0.2139.0>, registered_name: , exit: {{{failed,{error,{file_error,“/opt/emqx/data/mnesia/emqx@node2.emqx.io/LATEST.LOG”,enospc}}},[{disk_log,reopen,3}]},[{disk_log,do_exit,4,[{file,“disk_log.erl”},{line,1155}]},{proc_lib,init_p_do_apply,3,[{file,“proc_lib.erl”},{line,226}]}]}, ancestors: [disk_log_sup,kernel_safe_sup,kernel_sup,<0.1436.0>], message_queue_len: 0, messages: , links: [<0.1573.0>], dictionary: [{quiet,false}], trap_exit: true, status: running, heap_size: 987, stack_size: 28, reductions: 222383; neighbours:
2023-12-16T23:28:09.708591+08:00 [error] Supervisor: {local,disk_log_sup}. Context: child_terminated. Reason: {{failed,{error,{file_error,“/opt/emqx/data/mnesia/emqx@node2.emqx.io/LATEST.LOG”,enospc}}},[{disk_log,reopen,3}]}. Offender: id=disk_log,pid=<0.2139.0>.
2023-12-16T23:28:09.796378+08:00 [error] Ekka(Monitor): Mnesia system event: {mnesia_fatal,“~tp~n”,[{error,{“Cannot rename disk_log file”,latest_log,“/opt/emqx/data/mnesia/emqx@node2.emqx.io/PREVIOUS.LOG”,{log_header,trans_log,“4.3”,“4.18.1”,‘emqx@node2.emqx.io’,{1702,740489,701720}},{file_error,“/opt/emqx/data/mnesia/emqx@node2.emqx.io/LATEST.LOG”,enospc}}}],<<131,108,0,0,0,24,104,2,100,0,9,99,114,97,115,104,105,110,102,111,104,2,107,0,5,126,116,112,126,110,108,0,0,0,1,104,2,100,0,5,101,114,114,111,114,104,5,107,0,27,67,97,110,110,111,116,32,114,101,110,97,109,101,32,100,105,115,107,95,108,111,103,32,102,105,108,101,100,0,10,108,97,116,101,115,116,95,108,111,103,107,0,53,47,111,…>>}
2023-12-16T23:28:09.800772+08:00 [error] Mnesia(‘emqx@node2.emqx.io’): ** ERROR ** (could not write core file: enospc), ** FATAL ** {error,{“Cannot rename disk_log file”,latest_log,“/opt/emqx/data/mnesia/emqx@node2.emqx.io/PREVIOUS.LOG”,{log_header,trans_log,“4.3”,“4.18.1”,‘emqx@node2.emqx.io’,{1702,740489,701720}},{file_error,“/opt/emqx/data/mnesia/emqx@node2.emqx.io/LATEST.LOG”,enospc}}}
2023-12-16T23:28:16.202366+08:00 [error] message=channel_closed driver=tcp socket=“#Port<0.49>” action=stopping
2023-12-16T23:28:16.445964+08:00 [error] event=connect_to_remote_server peer="emqx@node1.emqx.io" result=failure reason=“econnrefused”
2023-12-16T23:28:16.446245+08:00 [error] crasher: initial call: gen_rpc_client:init/1, pid: <0.17535.198>, registered_name: , exit: {{badrpc,econnrefused},[{gen_server,init_it,6,[{file,“gen_server.erl”},{line,401}]},{proc_lib,init_p_do_apply,3,[{file,“proc_lib.erl”},{line,226}]}]}, ancestors: [gen_rpc_client_sup,gen_rpc_sup,<0.1547.0>], message_queue_len: 0, messages: , links: [<0.1552.0>], dictionary: , trap_exit: true, status: running, heap_size: 1598, stack_size: 28, reductions: 5759; neighbours:
运行环境：centos7.9 Docker version 20.10.17, build 100c701
emqx版本：4.3.8
以集群方式部署了3个节点，在运行4天后，其中一个节点node2报错如上，其他两个节点node1、node3无报错。