2023-10-16T02:38:38.965056+00:00 [error] Supervisor: {local,emqx_conf_sup}. Context: start_error. Reason: {{badmatch,{error,{node_not_running,‘emqx@172.17.0.2’}}},[{emqx_cluster_rpc,init,1,[{file,“emqx_cluster_rpc.erl”},{line,273}]},{gen_server,init_it,2,[{file,“gen_server.erl”},{line,851}]},{gen_server,init_it,6,[{file,“gen_server.erl”},{line,814}]},{proc_lib,init_p_do_apply,3,[{file,“proc_lib.erl”},{line,240}]}]}. Offender: id=emqx_cluster_rpc,pid=undefined.
2023-10-16T02:38:38.965170+00:00 [error] crasher: initial call: emqx_cluster_rpc:init/1, pid: <0.23781.130>, registered_name: , error: {{badmatch,{error,{node_not_running,‘emqx@172.17.0.2’}}},[{emqx_cluster_rpc,init,1,[{file,“emqx_cluster_rpc.erl”},{line,273}]},{gen_server,init_it,2,[{file,“gen_server.erl”},{line,851}]},{gen_server,init_it,6,[{file,“gen_server.erl”},{line,814}]},{proc_lib,init_p_do_apply,3,[{file,“proc_lib.erl”},{line,240}]}]}, ancestors: [emqx_conf_sup,<0.2171.0>], message_queue_len: 0, messages: , links: [<0.2181.0>], dictionary: , trap_exit: false, status: running, heap_size: 233, stack_size: 28, reductions: 161; neighbours:
2023-10-16T02:38:38.965430+00:00 [error] Supervisor: {local,emqx_conf_sup}. Context: shutdown. Reason: reached_max_restart_intensity. Offender: id=emqx_cluster_rpc,pid={restarting,<0.2182.0>}.
2023-10-16T02:38:38.962545+00:00 [error] mfa: emqx_trace:handle_info/2, line: 278, unexpected_info: {‘EXIT’,<0.1929.0>,killed}
2023-10-16T02:38:38.962123+00:00 [error] crasher: initial call: gen_event:init_it/6, pid: <0.1925.0>, registered_name: mnesia_event, exit: {killed,[{gen_event,terminate_server,4,[{file,“gen_event.erl”},{line,580}]},{proc_lib,init_p_do_apply,3,[{file,“proc_lib.erl”},{line,240}]}]}, ancestors: [mnesia_sup,<0.1923.0>], message_queue_len: 1, messages: [{‘EXIT’,<0.1929.0>,killed}], links: , dictionary: , trap_exit: true, status: running, heap_size: 233, stack_size: 28, reductions: 74539; neighbours:
2023-10-16T02:38:38.964696+00:00 [error] Supervisor: {local,mria_sup}. Context: child_terminated. Reason: killed. Offender: id=mria_schema,pid=<0.1975.0>.
2023-10-16T02:38:38.964806+00:00 [error] Supervisor: {local,emqx_broker_sup}. Context: child_terminated. Reason: killed. Offender: id=shared_sub,pid=<0.2235.0>.
2023-10-16T02:38:38.966526+00:00 [error] msg: unexpected_info, mfa: emqx_router_helper:handle_info/2, line: 165, info: {‘EXIT’,<0.1929.0>,killed}
2023-10-16T02:38:38.969794+00:00 [error] Supervisor: {local,mria_sup}. Context: shutdown. Reason: reached_max_restart_intensity. Offender: id=mria_schema,pid=<0.1975.0>.
2023-10-16T02:38:38.969908+00:00 [error] Supervisor: {local,emqx_broker_sup}. Context: shutdown. Reason: reached_max_restart_intensity. Offender: id=shared_sub,pid=<0.2235.0>.
2023-10-16T02:38:38.975201+00:00 [error] Supervisor: {local,emqx_sup}. Context: child_terminated. Reason: shutdown. Offender: id=emqx_broker_sup,pid=<0.2229.0>.
2023-10-16T02:38:38.975325+00:00 [error] Supervisor: {local,emqx_sup}. Context: shutdown. Reason: reached_max_restart_intensity. Offender: id=emqx_broker_sup,pid=<0.2229.0>.
Listener ssl:default on 0.0.0.0:8883 stopped.
Listener tcp:default on 0.0.0.0:1883 stopped.
Listener ws:default on 0.0.0.0:8083 stopped.
Listener wss:default on 0.0.0.0:8084 stopped.
Stop listener http:dashboard on :18083 successfully.
2023-10-16T02:38:39.121939+00:00 [error] msg: emqx_alarm_safe_call_exception, mfa: emqx_alarm:safe_call/1, line: 492, reason: {noproc,{gen_server,call,[emqx_alarm,{deactivate_alarm,<<“bridge:mqtt:yaole”>>,no_details,<<>>}]}}, stacktrace: [{gen_server,call,2,[{file,“gen_server.erl”},{line,370}]},{emqx_alarm,safe_call,1,[{file,“emqx_alarm.erl”},{line,482}]},{emqx_resource_manager,stop_resource,1,[{file,“emqx_resource_manager.erl”},{line,519}]},{emqx_resource_manager,handle_event,4,[{file,“emqx_resource_manager.erl”},{line,362}]},{gen_statem,loop_state_callback,11,[{file,“gen_statem.erl”},{line,1428}]},{proc_lib,init_p_do_apply,3,[{file,“proc_lib.erl”},{line,240}]}]
2023-10-16T02:38:39.203361+00:00 [error] Generic server emqx_delayed terminating. Reason: {badarg,[{ets,internal_delete_all,[emqx_delayed,undefined],[{error_info,#{cause => id,module => erl_stdlib_errors}}]},{ets,delete_all_objects,1,[{file,“ets.erl”},{line,126}]},{emqx_delayed,do_load_or_unload,2,[{file,“emqx_delayed.erl”},{line,423}]},{gen_server,try_terminate,3,[{file,“gen_server.erl”},{line,1161}]},{gen_server,terminate,10,[{file,“gen_server.erl”},{line,1351}]},{proc_lib,wake_up,3,[{file,“proc_lib.erl”},{line,250}]}]}. Last message: {‘EXIT’,<0.2423.0>,shutdown}. State: #{publish_at => 0,publish_timer => undefined,stats_fun => #Fun<emqx_stats.1.31309504>,stats_timer => #Ref<0.2804871703.1510735873.64066>}.
2023-10-16T02:38:39.203684+00:00 [error] crasher: initial call: emqx_delayed:init/1, pid: <0.2432.0>, registered_name: emqx_delayed, error: {badarg,[{ets,internal_delete_all,[emqx_delayed,undefined],[{error_info,#{cause => id,module => erl_stdlib_errors}}]},{ets,delete_all_objects,1,[{file,“ets.erl”},{line,126}]},{emqx_delayed,do_load_or_unload,2,[{file,“emqx_delayed.erl”},{line,423}]},{gen_server,try_terminate,3,[{file,“gen_server.erl”},{line,1161}]},{gen_server,terminate,10,[{file,“gen_server.erl”},{line,1351}]},{proc_lib,wake_up,3,[{file,“proc_lib.erl”},{line,250}]}]}, ancestors: [emqx_modules_sup,<0.2422.0>], message_queue_len: 0, messages: , links: [<0.2423.0>], dictionary: , trap_exit: true, status: running, heap_size: 6772, stack_size: 28, reductions: 147286338; neighbours:
2023-10-16T02:38:39.204139+00:00 [error] Supervisor: {local,emqx_modules_sup}. Context: shutdown_error. Reason: {badarg,[{ets,internal_delete_all,[emqx_delayed,undefined],[{error_info,#{cause => id,module => erl_stdlib_errors}}]},{ets,delete_all_objects,1,[{file,“ets.erl”},{line,126}]},{emqx_delayed,do_load_or_unload,2,[{file,“emqx_delayed.erl”},{line,423}]},{gen_server,try_terminate,3,[{file,“gen_server.erl”},{line,1161}]},{gen_server,terminate,10,[{file,“gen_server.erl”},{line,1351}]},{proc_lib,wake_up,3,[{file,“proc_lib.erl”},{line,250}]}]}. Offender: id=emqx_delayed,pid=<0.2432.0>.
2023-10-16T02:38:39.252133+00:00 [error] msg: emqx_alarm_safe_call_exception, mfa: emqx_alarm:safe_call/1, line: 492, reason: {noproc,{gen_server,call,[emqx_alarm,{deactivate_alarm,<<“emqx_authn_mysql:1”>>,no_details,<<>>}]}}, stacktrace: [{gen_server,call,2,[{file,“gen_server.erl”},{line,370}]},{emqx_alarm,safe_call,1,[{file,“emqx_alarm.erl”},{line,482}]},{emqx_resource_manager,stop_resource,1,[{file,“emqx_resource_manager.erl”},{line,519}]},{emqx_resource_manager,terminate,3,[{file,“emqx_resource_manager.erl”},{line,332}]},{gen_statem,terminate,7,[{file,“gen_statem.erl”},{line,2602}]},{proc_lib,init_p_do_apply,3,[{file,“proc_lib.erl”},{line,240}]}]
{“Kernel pid terminated”,application_controller,“{application_terminated,emqx,shutdown}”}
Kernel pid terminated (application_controller) ({application_terminated,emqx,shutdown})
Crash dump is being written to: /opt/emqx/log/erl_crash.dump…done
WARNING: Default (insecure) Erlang cookie is in use.
WARNING: Configure node.cookie in /opt/emqx/etc/emqx.conf or override from environment variable EMQX_NODE__COOKIE
WARNING: NOTE: Use the same cookie for all nodes in the cluster.
EMQX_RPC__PORT_DISCOVERY [rpc.port_discovery]: manual
EMQX_NODE__NAME [node.name]: emqx@172.17.0.2
2023-10-16T06:58:36.378445+00:00 [error] Error writing /opt/emqx/data/configs/app.2023.10.16.06.58.34.config: no space left on device
2023-10-16T06:58:36.383887+00:00 [error] Error writing /opt/emqx/data/configs/vm.2023.10.16.06.58.34.args: no space left on device
ERROR: call_hocon_failed: -v -t 2023.10.16.06.58.34 -s emqx_conf_schema -c /opt/emqx/etc/emqx.conf -d /opt/emqx/data/configs generate