connection_pid: <0.2460938.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T00:23:32.055+08:00
emqx              | 2025-10-23T00:23:42.271455+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.2461725.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T00:23:32.265+08:00
emqx              | 2025-10-23T00:23:42.273681+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.2461381.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T00:23:32.266+08:00
emqx              | 2025-10-23T00:23:42.452808+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.2461357.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T00:23:32.442+08:00
emqx              | 2025-10-23T00:24:22.638136+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.2462976.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T00:24:12.272+08:00
emqx              | 2025-10-23T00:24:22.800284+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.2466687.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T00:24:12.671+08:00
emqx              | 2025-10-23T00:24:37.837816+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.2466080.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T00:24:22.938+08:00
emqx              | 2025-10-23T00:24:51.527727+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.2466241.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T00:24:36.973+08:00
emqx              | 2025-10-23T00:25:02.697695+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.2463820.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T00:24:52.639+08:00
emqx              | 2025-10-23T00:25:05.510730+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.2464980.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T00:24:54.457+08:00
emqx              | 2025-10-23T00:25:37.579018+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.2467465.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T00:25:26.135+08:00
emqx              | 2025-10-23T00:25:48.650797+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.2466562.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T00:25:35.649+08:00
emqx              | 2025-10-23T00:26:41.324717+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.2467595.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T00:26:31.168+08:00
emqx              | 2025-10-23T00:27:28.733153+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.2468602.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T00:27:17.939+08:00
emqx              | 2025-10-23T00:28:41.876045+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.2470346.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T00:28:26.157+08:00
emqx              | 2025-10-23T00:51:23.053076+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.2527479.0>, inactive_duration_threshold: 10000, inflight_requests: 33, last_request_expire: 2025-10-23T00:51:13.042+08:00
emqx              | 2025-10-23T00:51:23.053953+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.2527793.0>, inactive_duration_threshold: 10000, inflight_requests: 27, last_request_expire: 2025-10-23T00:51:13.042+08:00
emqx              | 2025-10-23T00:51:23.054219+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.2528103.0>, inactive_duration_threshold: 10000, inflight_requests: 70, last_request_expire: 2025-10-23T00:51:13.042+08:00
emqx              | 2025-10-23T00:51:23.054681+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.2526992.0>, inactive_duration_threshold: 10000, inflight_requests: 4, last_request_expire: 2025-10-23T00:51:13.042+08:00
emqx              | 2025-10-23T00:51:23.054927+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.2526891.0>, inactive_duration_threshold: 10000, inflight_requests: 46, last_request_expire: 2025-10-23T00:51:13.043+08:00
emqx              | 2025-10-23T00:51:23.055562+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.2528467.0>, inactive_duration_threshold: 10000, inflight_requests: 25, last_request_expire: 2025-10-23T00:51:13.042+08:00
emqx              | 2025-10-23T00:51:23.055480+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.2528206.0>, inactive_duration_threshold: 10000, inflight_requests: 12, last_request_expire: 2025-10-23T00:51:13.042+08:00
emqx              | 2025-10-23T00:51:23.055815+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.2527585.0>, inactive_duration_threshold: 10000, inflight_requests: 20, last_request_expire: 2025-10-23T00:51:13.042+08:00
emqx              | 2025-10-23T00:51:23.056026+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.2527188.0>, inactive_duration_threshold: 10000, inflight_requests: 21, last_request_expire: 2025-10-23T00:51:13.043+08:00
emqx              | 2025-10-23T00:51:23.054266+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.2527087.0>, inactive_duration_threshold: 10000, inflight_requests: 11, last_request_expire: 2025-10-23T00:51:13.042+08:00
emqx              | 2025-10-23T00:51:23.054870+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.2528359.0>, inactive_duration_threshold: 10000, inflight_requests: 29, last_request_expire: 2025-10-23T00:51:13.043+08:00
emqx              | 2025-10-23T00:51:23.054162+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.2528000.0>, inactive_duration_threshold: 10000, inflight_requests: 26, last_request_expire: 2025-10-23T00:51:13.043+08:00
emqx              | 2025-10-23T00:51:23.054363+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.2527687.0>, inactive_duration_threshold: 10000, inflight_requests: 45, last_request_expire: 2025-10-23T00:51:13.042+08:00
emqx              | 2025-10-23T00:59:52.185673+08:00 [warning] clientid: server-1760840959486, msg: dropped_msg_due_to_mqueue_is_full, peername: 177.7.0.13:38600, username: fastbee, topic: /140/202412272305/info/post, queue: #{len => 1000,dropped => 10672,store_qos0 => true,max_len => 1000}, payload: {"rssi":16,"firmwareVersion":2.5,"status":3,"userId":111,"longitude":114.8222,"latitude":27.759048,"summary":{"name":"XS-D8001","chip":"CW32L083","author":"bigbao","version":"XS-CAT111V2","creat":"2024-04-23","mobile":"ma307l","CCID":"898608551024D1998695"}}, payload_encode: text
emqx              | 2025-10-23T00:59:56.209017+08:00 [warning] msg: log_events_throttled_during_last_period, period: 1 minutes, 0 seconds, dropped: #{dropped_msg_due_to_mqueue_is_full => 3671}
emqx              | 2025-10-23T00:59:56.209363+08:00 [warning] clientid: server-1760840959486, msg: dropped_msg_due_to_mqueue_is_full, peername: 177.7.0.13:38600, username: fastbee, topic: /140/202412274386/info/post, queue: #{len => 1000,dropped => 14344,store_qos0 => true,max_len => 1000}, payload: {"rssi":13,"firmwareVersion":2.2,"status":3,"userId":111,"longitude":114.75343,"latitude":27.740686,"summary":{"name":"XS-D8001","chip":"CW32L083","author":"bigbao","version":"XS-CAT111V2","creat":"2024-04-23","mobile":"ma307l","CCID":"898608551024D1996537"}}, payload_encode: text
emqx              | 2025-10-23T01:00:56.210011+08:00 [warning] msg: log_events_throttled_during_last_period, period: 1 minutes, 0 seconds, dropped: #{dropped_msg_due_to_mqueue_is_full => 3309}
emqx              | 2025-10-23T01:19:47.998867+08:00 [warning] clientid: server-1760840959486, msg: dropped_msg_due_to_mqueue_is_full, peername: 177.7.0.13:38600, username: fastbee, topic: /140/202503010257/info/post, queue: #{len => 1000,dropped => 17654,store_qos0 => true,max_len => 1000}, payload: {"rssi":13,"firmwareVersion":2.2,"status":3,"userId":111,"longitude":114.81372,"latitude":27.691704,"summary":{"name":"XS-D8001","chip":"CW32L083","author":"bigbao","version":"XS-CAT111V2","creat":"2024-04-23","mobile":"ma307l","CCID":"898608551024D1996918"}}, payload_encode: text
emqx              | 2025-10-23T01:19:56.229056+08:00 [warning] msg: log_events_throttled_during_last_period, period: 1 minutes, 0 seconds, dropped: #{dropped_msg_due_to_mqueue_is_full => 3564}
emqx              | 2025-10-23T17:50:36.886064+08:00 [warning] clientid: server-1760840959486, msg: dropped_msg_due_to_mqueue_is_full, peername: 177.7.0.13:38600, username: fastbee, topic: /140/202412271378/info/post, queue: #{len => 1000,dropped => 21219,store_qos0 => true,max_len => 1000}, payload: {"rssi":26,"firmwareVersion":2.5,"status":3,"userId":111,"longitude":114.89404,"latitude":27.826967,"summary":{"name":"XS-D8001","chip":"CW32L083","author":"bigbao","version":"XS-CAT111V2","creat":"2024-04-23","mobile":"ma307l","CCID":"898608401124D0357671"}}, payload_encode: text
emqx              | 2025-10-23T17:50:57.222051+08:00 [warning] msg: log_events_throttled_during_last_period, period: 1 minutes, 0 seconds, dropped: #{dropped_msg_due_to_mqueue_is_full => 1176}
emqx              | 2025-10-23T17:51:28.131274+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.3388011.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T17:51:11.179+08:00
emqx              | 2025-10-23T17:51:28.132406+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.3387602.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T17:51:14.541+08:00
emqx              | 2025-10-23T17:51:28.132793+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.3387433.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T17:51:18.131+08:00
emqx              | 2025-10-23T17:51:28.132314+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.3386710.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T17:51:14.517+08:00
emqx              | 2025-10-23T17:51:28.132288+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.3387065.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T17:51:14.818+08:00
emqx              | 2025-10-23T17:51:28.131914+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.3387395.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T17:51:08.875+08:00
emqx              | 2025-10-23T17:51:28.133064+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.3387059.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T17:51:11.234+08:00
emqx              | 2025-10-23T17:51:28.133183+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.3387489.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T17:51:13.488+08:00
emqx              | 2025-10-23T17:51:28.132661+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.3390824.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T17:51:18.131+08:00
emqx              | 2025-10-23T17:51:38.177081+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.3387325.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T17:51:18.368+08:00
emqx              | 2025-10-23T17:51:38.177590+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.3389788.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T17:51:18.367+08:00
emqx              | 2025-10-23T17:51:58.149683+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.3387815.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T17:51:48.130+08:00
emqx              | 2025-10-23T17:52:08.150063+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.3401348.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T17:51:58.140+08:00
emqx              | 2025-10-23T17:52:08.152006+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.3396681.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T17:51:58.138+08:00
emqx              | 2025-10-23T17:52:18.196110+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.3403476.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T17:52:08.179+08:00
emqx              | 2025-10-23T17:52:18.196950+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.3401459.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T17:52:08.178+08:00
emqx              | 2025-10-23T17:52:18.196866+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.3401583.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T17:52:08.178+08:00
emqx              | 2025-10-23T17:52:18.196991+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.3402757.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T17:52:08.179+08:00
emqx              | 2025-10-23T17:52:38.161803+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.3403815.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T17:52:28.151+08:00
emqx              | 2025-10-23T17:52:38.161926+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.3403484.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-23T17:52:28.150+08:00
emqx              | 2025-10-24T01:02:47.209612+08:00 [error] clientid: S&202503010333&140Ѣ11, msg: http_connector_do_request_failed, peername: 39.144.171.82:61546, username: 202503010333&140, reason: {unrecoverable_error,#{body => <<"Unauthorized">>,headers => [{<<"vary">>,<<"Origin">>},{<<"vary">>,<<"Access-Control-Request-Method">>},{<<"vary">>,<<"Access-Control-Request-Headers">>},{<<"x-content-type-options">>,<<"nosniff">>},{<<"x-xss-protection">>,<<"1; mode=block">>},{<<"content-type">>,<<"text/plain;charset=UTF-8">>},{<<"content-length">>,<<"12">>},{<<"date">>,<<"Thu, 23 Oct 2025 17:02:46 GMT">>}],status_code => 401}}, request: {[<<>>,47,<<"iot/tool/mqtt/authv5">>],[{<<"content-type">>,<<"application/json">>},{<<"x-request-source">>,<<"EMQX">>}],<<"******">>}, connector: <<"emqx_authn_http:3">>, note: the request body is redacted due to security reasons
emqx              | 2025-10-24T01:02:47.210208+08:00 [error] tag: RESOURCE, clientid: S&202503010333&140Ѣ11, msg: unrecoverable_resource_error, peername: 39.144.171.82:61546, username: 202503010333&140, reason: {unrecoverable_error,#{body => <<"Unauthorized">>,headers => [{<<"vary">>,<<"Origin">>},{<<"vary">>,<<"Access-Control-Request-Method">>},{<<"vary">>,<<"Access-Control-Request-Headers">>},{<<"x-content-type-options">>,<<"nosniff">>},{<<"x-xss-protection">>,<<"1; mode=block">>},{<<"content-type">>,<<"text/plain;charset=UTF-8">>},{<<"content-length">>,<<"12">>},{<<"date">>,<<"Thu, 23 Oct 2025 17:02:46 GMT">>}],status_code => 401}}, resource_id: <<"emqx_authn_http:3">>
emqx              | 2025-10-24T01:02:47.210718+08:00 [warning] tag: AUTHN, clientid: S&202503010333&140Ѣ11, msg: authentication_failure, peername: 39.144.171.82:61546, username: 202503010333&140, reason: not_authorized
emqx              | 2025-10-24T17:50:35.951083+08:00 [warning] clientid: server-1760840959486, msg: dropped_msg_due_to_mqueue_is_full, peername: 177.7.0.13:38766, username: fastbee, topic: /140/202412272662/info/post, queue: #{len => 1000,dropped => 1,store_qos0 => true,max_len => 1000}, payload: {"rssi":28,"firmwareVersion":2.5,"status":3,"userId":111,"longitude":114.88447,"latitude":27.795534,"summary":{"name":"XS-D8001","chip":"CW32L083","author":"bigbao","version":"XS-CAT111V2","creat":"2024-04-23","mobile":"ma307l","CCID":"898608551024D1998509"}}, payload_encode: text
emqx              | 2025-10-24T17:50:58.663025+08:00 [warning] msg: log_events_throttled_during_last_period, period: 1 minutes, 0 seconds, dropped: #{dropped_msg_due_to_mqueue_is_full => 1533}
emqx              | 2025-10-25T17:50:36.595328+08:00 [warning] clientid: server-1760840959486, msg: dropped_msg_due_to_mqueue_is_full, peername: 177.7.0.13:38766, username: fastbee, topic: /140/202503010065/info/post, queue: #{len => 1000,dropped => 1535,store_qos0 => true,max_len => 1000}, payload: {"rssi":14,"firmwareVersion":2.2,"status":3,"userId":111,"longitude":114.82585,"latitude":27.710524,"summary":{"name":"XS-D8001","chip":"CW32L083","author":"bigbao","version":"XS-CAT111V2","creat":"2024-04-23","mobile":"ma307l","CCID":"898608551024D1996046"}}, payload_encode: text
emqx              | 2025-10-25T17:51:00.118037+08:00 [warning] msg: log_events_throttled_during_last_period, period: 1 minutes, 0 seconds, dropped: #{dropped_msg_due_to_mqueue_is_full => 1606}
emqx              | 2025-10-25T17:51:25.560132+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.6467434.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-25T17:51:06.375+08:00
emqx              | 2025-10-25T17:51:25.560354+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.6470575.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-25T17:51:10.983+08:00
emqx              | 2025-10-25T17:51:25.560675+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.6471584.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-25T17:51:10.984+08:00
emqx              | 2025-10-25T17:51:25.560807+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.6412578.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-25T17:51:06.375+08:00
emqx              | 2025-10-25T17:51:25.560913+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.6470430.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-25T17:51:06.375+08:00
emqx              | 2025-10-25T17:51:25.561071+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.6473677.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-25T17:51:11.762+08:00
emqx              | 2025-10-25T17:51:25.561573+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.6470303.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-25T17:51:07.142+08:00
emqx              | 2025-10-25T17:51:55.618035+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.6482287.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-25T17:51:45.561+08:00
emqx              | 2025-10-25T17:52:05.617082+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.6482925.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-25T17:51:55.563+08:00
emqx              | 2025-10-25T17:52:05.617737+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.6479465.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-25T17:51:55.562+08:00
emqx              | 2025-10-25T17:52:05.618224+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.6482788.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-25T17:51:55.561+08:00
emqx              | 2025-10-25T17:52:05.618403+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.6483172.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-25T17:51:55.561+08:00
emqx              | 2025-10-25T17:52:05.618027+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.5697821.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-25T17:51:55.561+08:00
emqx              | 2025-10-25T17:52:05.618976+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.5496437.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-25T17:51:55.561+08:00
emqx              | 2025-10-25T17:52:05.617897+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.6478475.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-25T17:51:55.565+08:00
emqx              | 2025-10-25T17:52:05.619743+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.6476155.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-25T17:51:55.563+08:00
emqx              | 2025-10-25T23:10:51.122139+08:00 [error] tag: AUTHN, clientid: <<83,38,50,48,50,53,47,138,48,49,48,51,52,48,38,49,52,48,38,49>>, msg: generate_http_request_failed, peername: 39.144.171.31:8067, username: 202503010340&140, reason: {encode_error,{non_unicode_data,"clientid"}}, provider: emqx_authn_http, credential: #{peername => {{39,144,171,31},8067},protocol => mqtt,password => <<"[password]">>,username => <<"202503010340&140">>,listener => 'tcp:default',peersni => undefined,peerhost => {39,144,171,31},clientid => <<83,38,50,48,50,53,47,138,48,49,48,51,52,48,38,49,52,48,38,49>>,enable_authn => true,is_superuser => false,is_bridge => false,zone => default,mountpoint => undefined,sockport => 1883}
emqx              | 2025-10-25T23:10:51.122631+08:00 [warning] tag: AUTHN, clientid: <<83,38,50,48,50,53,47,138,48,49,48,51,52,48,38,49,52,48,38,49>>, msg: authentication_failure, peername: 39.144.171.31:8067, username: 202503010340&140, reason: not_authorized
emqx              | 2025-10-26T01:25:14.833800+08:00 [error] tag: AUTHN, clientid: <<20,204,50,48,50,53,48,51,48,49,48,51,52,48,38,49,52,48,38,49>>, msg: generate_http_request_failed, peername: 39.144.171.17:10580, username: 202503010340&140, reason: {encode_error,{non_unicode_data,"clientid"}}, provider: emqx_authn_http, credential: #{peername => {{39,144,171,17},10580},protocol => mqtt,password => <<"[password]">>,username => <<"202503010340&140">>,listener => 'tcp:default',peersni => undefined,peerhost => {39,144,171,17},clientid => <<20,204,50,48,50,53,48,51,48,49,48,51,52,48,38,49,52,48,38,49>>,enable_authn => true,is_superuser => false,is_bridge => false,zone => default,mountpoint => undefined,sockport => 1883}
emqx              | 2025-10-26T01:25:14.834330+08:00 [warning] tag: AUTHN, clientid: <<20,204,50,48,50,53,48,51,48,49,48,51,52,48,38,49,52,48,38,49>>, msg: authentication_failure, peername: 39.144.171.17:10580, username: 202503010340&140, reason: not_authorized
emqx              | 2025-10-26T17:50:36.810266+08:00 [warning] clientid: server-1760840959486, msg: dropped_msg_due_to_mqueue_is_full, peername: 177.7.0.13:38766, username: fastbee, topic: /140/202412271146/info/post, queue: #{len => 1000,dropped => 3142,store_qos0 => true,max_len => 1000}, payload: {"rssi":15,"firmwareVersion":2.2,"status":3,"userId":111,"longitude":114.84203,"latitude":27.730059,"summary":{"name":"XS-D8001","chip":"CW32L083","author":"bigbao","version":"XS-CAT111V2","creat":"2024-04-23","mobile":"ma307l","CCID":"898608401124D0357261"}}, payload_encode: text
emqx              | 2025-10-26T17:51:01.664993+08:00 [warning] msg: log_events_throttled_during_last_period, period: 1 minutes, 0 seconds, dropped: #{dropped_msg_due_to_mqueue_is_full => 1227}
emqx              | 2025-10-26T17:51:14.266476+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7951673.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:51:01.430+08:00
emqx              | 2025-10-26T17:51:14.268808+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7951715.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:51:03.173+08:00
emqx              | 2025-10-26T17:51:14.268944+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7951629.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:50:58.085+08:00
emqx              | 2025-10-26T17:51:14.269192+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7951596.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:51:00.126+08:00
emqx              | 2025-10-26T17:51:14.269525+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7953029.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:51:00.898+08:00
emqx              | 2025-10-26T17:51:24.302084+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7951599.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:51:04.537+08:00
emqx              | 2025-10-26T17:51:54.320128+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7960234.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:51:44.270+08:00
emqx              | 2025-10-26T17:51:54.320398+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7959049.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:51:44.269+08:00
emqx              | 2025-10-26T17:51:54.320463+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7965358.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:51:44.270+08:00
emqx              | 2025-10-26T17:51:54.320700+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7967337.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:51:44.272+08:00
emqx              | 2025-10-26T17:51:54.320577+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7956861.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:51:44.268+08:00
emqx              | 2025-10-26T17:51:54.320606+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7957100.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:51:44.268+08:00
emqx              | 2025-10-26T17:51:54.320534+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7967021.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:51:44.273+08:00
emqx              | 2025-10-26T17:51:54.320813+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7966885.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:51:44.269+08:00
emqx              | 2025-10-26T17:51:54.417495+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7966656.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:51:44.345+08:00
emqx              | 2025-10-26T17:52:34.351017+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7968272.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:52:24.323+08:00
emqx              | 2025-10-26T17:52:34.352367+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7968223.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:52:24.323+08:00
emqx              | 2025-10-26T17:52:34.352700+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7968119.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:52:24.324+08:00
emqx              | 2025-10-26T17:52:34.352603+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7968674.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:52:24.323+08:00
emqx              | 2025-10-26T17:52:34.352849+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7968472.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:52:24.323+08:00
emqx              | 2025-10-26T17:52:34.352763+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7967218.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:52:24.321+08:00
emqx              | 2025-10-26T17:52:34.353057+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7954733.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:52:24.322+08:00
emqx              | 2025-10-26T17:53:14.347072+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7969708.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:52:58.830+08:00
emqx              | 2025-10-26T17:53:14.361039+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7969858.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:53:04.356+08:00
emqx              | 2025-10-26T17:53:14.361614+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7969425.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:53:04.354+08:00
emqx              | 2025-10-26T17:53:14.361680+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7969747.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:53:04.356+08:00
emqx              | 2025-10-26T17:53:14.362220+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7969274.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:53:04.355+08:00
emqx              | 2025-10-26T17:53:14.362427+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7960924.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:53:04.356+08:00
emqx              | 2025-10-26T17:53:14.362417+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7969527.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:53:04.355+08:00
emqx              | 2025-10-26T17:53:14.362265+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7969638.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:53:04.356+08:00
emqx              | 2025-10-26T17:53:14.362448+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7969984.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:53:04.355+08:00
emqx              | 2025-10-26T17:53:54.381073+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7971024.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:53:44.367+08:00
emqx              | 2025-10-26T17:53:54.382120+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7970791.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:53:44.381+08:00
emqx              | 2025-10-26T17:54:04.319094+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7970962.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:53:53.375+08:00
emqx              | 2025-10-26T17:54:14.286066+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7970935.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:53:55.602+08:00
emqx              | 2025-10-26T17:54:34.365212+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7970975.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:54:19.936+08:00
emqx              | 2025-10-26T17:54:44.365143+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7970508.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:54:34.320+08:00
emqx              | 2025-10-26T17:55:44.406080+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7971128.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:55:31.680+08:00
emqx              | 2025-10-26T17:55:54.635940+08:00 [warning] clientid: server-1760840959486, msg: dropped_msg_due_to_mqueue_is_full, peername: 177.7.0.13:38766, username: fastbee, topic: /140/202412274270/ntp/post, queue: #{len => 1000,dropped => 4370,store_qos0 => true,max_len => 1000}, payload: {"deviceSendTime":"943891550000"}, payload_encode: text
emqx              | 2025-10-26T17:56:01.670031+08:00 [warning] msg: log_events_throttled_during_last_period, period: 1 minutes, 0 seconds, dropped: #{dropped_msg_due_to_mqueue_is_full => 715}
emqx              | 2025-10-26T17:56:24.347084+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7972289.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:56:11.024+08:00
emqx              | 2025-10-26T17:56:24.431046+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7971697.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:56:14.406+08:00
emqx              | 2025-10-26T17:56:44.359025+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7972493.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:56:26.918+08:00
emqx              | 2025-10-26T17:56:44.359440+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7972328.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:56:26.409+08:00
emqx              | 2025-10-26T17:56:44.359695+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7972182.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:56:26.955+08:00
emqx              | 2025-10-26T17:56:44.360131+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7972216.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:56:27.230+08:00
emqx              | 2025-10-26T17:56:44.360325+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7971904.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:56:26.411+08:00
emqx              | 2025-10-26T17:56:44.360001+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7972507.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:56:26.497+08:00
emqx              | 2025-10-26T17:56:44.362921+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7971815.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:56:26.918+08:00
emqx              | 2025-10-26T17:57:04.421988+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7973500.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:56:54.414+08:00
emqx              | 2025-10-26T17:57:04.423030+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7973626.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:56:54.420+08:00
emqx              | 2025-10-26T17:57:04.422920+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.7973150.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-26T17:56:54.407+08:00
emqx              | 2025-10-26T21:20:24.447408+08:00 [error] tag: AUTHN, clientid: S&202503010136&140&111, msg: generate_http_request_failed, peername: 39.144.171.11:5236, username: <<"20250301¶Ý36&140">>, reason: {encode_error,{non_unicode_data,"username"}}, provider: emqx_authn_http, credential: #{peername => {{39,144,171,11},5236},protocol => mqtt,password => <<"[password]">>,username => <<"20250301¶Ý36&140">>,listener => 'tcp:default',peersni => undefined,peerhost => {39,144,171,11},clientid => <<"S&202503010136&140&111">>,enable_authn => true,is_superuser => false,is_bridge => false,zone => default,mountpoint => undefined,sockport => 1883}
emqx              | 2025-10-26T21:20:24.447884+08:00 [warning] tag: AUTHN, clientid: S&202503010136&140&111, msg: authentication_failure, peername: 39.144.171.11:5236, username: <<"20250301¶Ý36&140">>, reason: not_authorized
emqx              | 2025-10-27T10:27:20.359245+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9231443.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T10:27:07.960+08:00
emqx              | 2025-10-27T10:27:20.360149+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9231783.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T10:27:08.839+08:00
emqx              | 2025-10-27T10:27:20.360622+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9231136.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T10:27:08.266+08:00
emqx              | 2025-10-27T10:27:20.360650+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9231723.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T10:27:08.096+08:00
emqx              | 2025-10-27T10:27:50.395303+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9234124.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T10:27:40.360+08:00
emqx              | 2025-10-27T17:50:36.656524+08:00 [warning] clientid: server-1760840959486, msg: dropped_msg_due_to_mqueue_is_full, peername: 177.7.0.13:38766, username: fastbee, topic: /140/202412270304/info/post, queue: #{len => 1000,dropped => 5086,store_qos0 => true,max_len => 1000}, payload: {"rssi":27,"firmwareVersion":2.2,"status":3,"userId":111,"longitude":114.83665,"latitude":27.730677,"summary":{"name":"XS-D8001","chip":"CW32L083","author":"bigbao","version":"XS-CAT111V2","creat":"2024-04-23","mobile":"ma307l","CCID":"898608401124D0354626"}}, payload_encode: text
emqx              | 2025-10-27T17:51:03.213060+08:00 [warning] msg: log_events_throttled_during_last_period, period: 1 minutes, 0 seconds, dropped: #{dropped_msg_due_to_mqueue_is_full => 1333}
emqx              | 2025-10-27T17:51:22.991057+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9483093.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:51:11.433+08:00
emqx              | 2025-10-27T17:51:22.991885+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9475474.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:51:06.182+08:00
emqx              | 2025-10-27T17:51:22.991687+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9476981.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:51:12.354+08:00
emqx              | 2025-10-27T17:51:22.992250+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9486587.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:51:12.906+08:00
emqx              | 2025-10-27T17:51:22.991945+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9473251.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:51:05.603+08:00
emqx              | 2025-10-27T17:51:22.992275+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9472297.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:51:05.980+08:00
emqx              | 2025-10-27T17:51:22.992304+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9471884.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:51:05.534+08:00
emqx              | 2025-10-27T17:51:53.043677+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9487017.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:51:42.992+08:00
emqx              | 2025-10-27T17:51:53.044449+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9486878.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:51:42.992+08:00
emqx              | 2025-10-27T17:51:53.045589+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9486722.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:51:42.992+08:00
emqx              | 2025-10-27T17:52:03.044049+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9487350.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:51:52.996+08:00
emqx              | 2025-10-27T17:52:03.044677+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9486452.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:51:52.995+08:00
emqx              | 2025-10-27T17:52:03.044856+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9487559.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:51:52.992+08:00
emqx              | 2025-10-27T17:52:03.044757+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9487997.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:51:52.993+08:00
emqx              | 2025-10-27T17:52:03.045056+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9487137.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:51:52.994+08:00
emqx              | 2025-10-27T17:52:03.044578+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9485080.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:51:52.993+08:00
emqx              | 2025-10-27T17:52:33.062228+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9489262.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:52:23.046+08:00
emqx              | 2025-10-27T17:52:33.063811+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9489242.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:52:23.047+08:00
emqx              | 2025-10-27T17:52:33.062893+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9489169.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:52:23.045+08:00
emqx              | 2025-10-27T17:52:33.208155+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9489080.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:52:23.201+08:00
emqx              | 2025-10-27T17:52:43.074054+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9489254.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:52:33.045+08:00
emqx              | 2025-10-27T17:52:43.075562+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9488641.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:52:33.045+08:00
emqx              | 2025-10-27T17:52:43.075789+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9489008.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:52:33.045+08:00
emqx              | 2025-10-27T17:53:13.069094+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9489999.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:53:03.067+08:00
emqx              | 2025-10-27T17:53:13.070269+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9490735.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:53:03.066+08:00
emqx              | 2025-10-27T17:53:13.070427+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9489840.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:53:03.067+08:00
emqx              | 2025-10-27T17:53:13.070286+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9490409.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:53:03.067+08:00
emqx              | 2025-10-27T17:53:23.075061+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9490427.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:53:04.348+08:00
emqx              | 2025-10-27T17:53:23.076630+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9490617.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:53:13.075+08:00
emqx              | 2025-10-27T17:53:23.103183+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9489982.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:53:13.077+08:00
emqx              | 2025-10-27T17:53:23.104040+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9490583.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:53:13.078+08:00
emqx              | 2025-10-27T17:53:23.104138+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9490213.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:53:13.078+08:00
emqx              | 2025-10-27T17:54:13.082002+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9491432.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:53:53.106+08:00
emqx              | 2025-10-27T17:54:13.083048+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9491541.0>, inactive_duration_threshold: 10000, inflight_requests: 91, last_request_expire: 2025-10-27T17:54:01.781+08:00
emqx              | 2025-10-27T17:54:13.083361+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9491691.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:53:53.106+08:00
emqx              | 2025-10-27T17:54:33.074053+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9491203.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:54:18.760+08:00
emqx              | 2025-10-27T17:54:53.273053+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9491313.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:54:34.022+08:00
emqx              | 2025-10-27T17:54:53.274478+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.9491802.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-27T17:54:43.083+08:00
emqx              | 2025-10-28T17:50:36.871254+08:00 [warning] clientid: server-1760840959486, msg: dropped_msg_due_to_mqueue_is_full, peername: 177.7.0.13:38766, username: fastbee, topic: /140/202412270976/info/post, queue: #{len => 1000,dropped => 6420,store_qos0 => true,max_len => 1000}, payload: {"rssi":24,"firmwareVersion":2.5,"status":3,"userId":111,"longitude":114.86337,"latitude":27.800653,"summary":{"name":"XS-D8001","chip":"CW32L083","author":"bigbao","version":"XS-CAT111V2","creat":"2024-04-23","mobile":"ma307l","CCID":"898608401124D0354365"}}, payload_encode: text
emqx              | 2025-10-28T17:51:04.694022+08:00 [warning] msg: log_events_throttled_during_last_period, period: 1 minutes, 0 seconds, dropped: #{dropped_msg_due_to_mqueue_is_full => 1405}
emqx              | 2025-10-28T17:51:21.753058+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.10988236.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:51:07.969+08:00
emqx              | 2025-10-28T17:51:21.753546+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.10988864.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:51:10.446+08:00
emqx              | 2025-10-28T17:51:21.753744+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.10988740.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:51:09.596+08:00
emqx              | 2025-10-28T17:51:21.754014+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.10988937.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:51:05.040+08:00
emqx              | 2025-10-28T17:51:21.753948+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.10989058.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:51:08.944+08:00
emqx              | 2025-10-28T17:51:21.753933+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.10988277.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:51:06.394+08:00
emqx              | 2025-10-28T17:51:21.753796+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.10988634.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:51:10.535+08:00
emqx              | 2025-10-28T17:51:21.755761+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.10989049.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:51:06.865+08:00
emqx              | 2025-10-28T17:51:51.764257+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.11001386.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:51:41.753+08:00
emqx              | 2025-10-28T17:52:01.765043+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.11000631.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:51:51.756+08:00
emqx              | 2025-10-28T17:52:01.765659+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.11001476.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:51:51.760+08:00
emqx              | 2025-10-28T17:52:01.765678+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.11001107.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:51:51.758+08:00
emqx              | 2025-10-28T17:52:01.765890+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.11001273.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:51:51.756+08:00
emqx              | 2025-10-28T17:52:01.765814+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.11000466.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:51:51.756+08:00
emqx              | 2025-10-28T17:52:01.766179+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.10997290.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:51:51.761+08:00
emqx              | 2025-10-28T17:52:01.767507+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.10991933.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:51:51.756+08:00
emqx              | 2025-10-28T17:52:31.776605+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.11002591.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:52:21.764+08:00
emqx              | 2025-10-28T17:52:31.779461+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.11002808.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:52:21.765+08:00
emqx              | 2025-10-28T17:52:31.777154+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.11002801.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:52:21.765+08:00
emqx              | 2025-10-28T17:52:41.776090+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.11002711.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:52:21.817+08:00
emqx              | 2025-10-28T17:52:41.777265+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.11003016.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:52:31.766+08:00
emqx              | 2025-10-28T17:52:41.776662+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.11002294.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:52:31.766+08:00
emqx              | 2025-10-28T17:52:41.777733+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.11002800.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:52:31.767+08:00
emqx              | 2025-10-28T17:52:41.777706+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.11002927.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:52:31.768+08:00
emqx              | 2025-10-28T17:53:11.784065+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.11003519.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:53:01.783+08:00
emqx              | 2025-10-28T17:53:11.785968+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.11003856.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:53:01.781+08:00
emqx              | 2025-10-28T17:53:21.785070+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.11004133.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:53:11.776+08:00
emqx              | 2025-10-28T17:53:21.785850+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.11003816.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:53:11.779+08:00
emqx              | 2025-10-28T17:53:21.786030+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.11004161.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:53:11.777+08:00
emqx              | 2025-10-28T17:53:21.786431+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.11004164.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:53:11.778+08:00
emqx              | 2025-10-28T17:53:21.786371+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.11003662.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:53:11.780+08:00
emqx              | 2025-10-28T17:53:21.787283+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.11004292.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:53:11.781+08:00
emqx              | 2025-10-28T17:54:01.796097+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.11005239.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:53:51.789+08:00
emqx              | 2025-10-28T17:54:01.797742+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.11005391.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:53:51.787+08:00
emqx              | 2025-10-28T17:54:31.833112+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.11006045.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:54:19.542+08:00
emqx              | 2025-10-28T17:54:41.837058+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.11005756.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:54:31.799+08:00
emqx              | 2025-10-28T17:54:41.837669+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.11005617.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:54:31.799+08:00
emqx              | 2025-10-28T17:54:41.838742+08:00 [error] msg: force_reconnecting_zombie_http_connection, port: 8080, host: java, connection_pid: <0.11005827.0>, inactive_duration_threshold: 10000, inflight_requests: 100, last_request_expire: 2025-10-28T17:54:31.796+08:00
emqx              | 2025-10-28T23:29:04.879749+08:00 [error] crasher: initial call: disk_log:init/2, pid: <0.2353.0>, registered_name: [], exit: {{{failed,{error,{file_error,"/opt/emqx/data/mnesia/emqx@177.7.0.12/LATEST.LOG",enospc}}},[{disk_log,reopen,3}]},[{disk_log,do_exit,4,[{file,"disk_log.erl"},{line,1204}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,241}]}]}, ancestors: [disk_log_sup,kernel_safe_sup,kernel_sup,<0.2020.0>], message_queue_len: 0, messages: [], links: [<0.2341.0>], dictionary: [{quiet,false}], trap_exit: true, status: running, heap_size: 987, stack_size: 28, reductions: 10823195; neighbours:
emqx              | 2025-10-28T23:29:04.881255+08:00 [error] Supervisor: {local,disk_log_sup}. Context: child_terminated. Reason: {{failed,{error,{file_error,"/opt/emqx/data/mnesia/emqx@177.7.0.12/LATEST.LOG",enospc}}},[{disk_log,reopen,3}]}. Offender: id=disk_log,pid=<0.2353.0>.
emqx              | 2025-10-28T23:29:05.071610+08:00 [error] Mnesia('emqx@177.7.0.12'): ** ERROR ** (core dumped to file: "/opt/emqx/MnesiaCore.emqx@177.7.0.12_1761_665345_48269"), ** FATAL ** {error,{"Cannot rename disk_log file",latest_log,"/opt/emqx/data/mnesia/emqx@177.7.0.12/PREVIOUS.LOG",{log_header,trans_log,"4.3","4.23.1",'emqx@177.7.0.12',{1761,665344,879177}},{file_error,"/opt/emqx/data/mnesia/emqx@177.7.0.12/LATEST.LOG",enospc}}}
emqx              | 2025-10-28T23:29:15.049096+08:00 [error] msg: unexpected_info, req: {'EXIT',<0.2329.0>,killed}
emqx              | 2025-10-28T23:29:15.049384+08:00 [error] Supervisor: {local,emqx_broker_sup}. Context: child_terminated. Reason: killed. Offender: id=shared_sub,pid=<0.3410.0>.
emqx              | 2025-10-28T23:29:15.049145+08:00 [error] crasher: initial call: gen_event:init_it/6, pid: <0.2325.0>, registered_name: mnesia_event, exit: {killed,[{gen_event,terminate_server,4,[{file,"gen_event.erl"},{line,592}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,241}]}]}, ancestors: [mnesia_sup,<0.2323.0>], message_queue_len: 1, messages: [{'EXIT',<0.2329.0>,killed}], links: [], dictionary: [], trap_exit: true, status: running, heap_size: 376, stack_size: 28, reductions: 17152; neighbours:
emqx              | 2025-10-28T23:29:15.049591+08:00 [error] Supervisor: {local,emqx_broker_sup}. Context: shutdown. Reason: reached_max_restart_intensity. Offender: id=shared_sub,pid=<0.3410.0>.
emqx              | 2025-10-28T23:29:15.049655+08:00 [error] Supervisor: {local,mria_sup}. Context: child_terminated. Reason: killed. Offender: id=mria_schema,pid=<0.2372.0>.
emqx              | 2025-10-28T23:29:15.049629+08:00 [error] Supervisor: {local,emqx_conf_sup}. Context: child_terminated. Reason: killed. Offender: id=emqx_cluster_rpc,pid=<0.2500.0>.
emqx              | 2025-10-28T23:29:15.049858+08:00 [error] Supervisor: {local,mria_sup}. Context: shutdown. Reason: reached_max_restart_intensity. Offender: id=mria_schema,pid=<0.2372.0>.
emqx              | 2025-10-28T23:29:15.050168+08:00 [error] crasher: initial call: emqx_cluster_rpc:init/1, pid: <0.11724521.0>, registered_name: [], error: {{badmatch,{error,{node_not_running,'emqx@177.7.0.12'}}},[{emqx_cluster_rpc,init,1,[{file,"emqx_cluster_rpc.erl"},{line,358}]},{gen_server,init_it,2,[{file,"gen_server.erl"},{line,980}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,935}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,241}]}]}, ancestors: [emqx_conf_sup,<0.2482.0>], message_queue_len: 0, messages: [], links: [<0.2499.0>], dictionary: [], trap_exit: false, status: running, heap_size: 376, stack_size: 28, reductions: 192; neighbours:
emqx              | 2025-10-28T23:29:15.051576+08:00 [error] Supervisor: {local,emqx_conf_sup}. Context: start_error. Reason: {{badmatch,{error,{node_not_running,'emqx@177.7.0.12'}}},[{emqx_cluster_rpc,init,1,[{file,"emqx_cluster_rpc.erl"},{line,358}]},{gen_server,init_it,2,[{file,"gen_server.erl"},{line,980}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,935}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,241}]}]}. Offender: id=emqx_cluster_rpc,pid=undefined.
emqx              | 2025-10-28T23:29:15.053889+08:00 [error] crasher: initial call: emqx_cluster_rpc:init/1, pid: <0.11724512.0>, registered_name: [], error: {{badmatch,{error,{node_not_running,'emqx@177.7.0.12'}}},[{emqx_cluster_rpc,init,1,[{file,"emqx_cluster_rpc.erl"},{line,358}]},{gen_server,init_it,2,[{file,"gen_server.erl"},{line,980}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,935}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,241}]}]}, ancestors: [emqx_conf_sup,<0.2482.0>], message_queue_len: 0, messages: [], links: [<0.2499.0>], dictionary: [], trap_exit: false, status: running, heap_size: 376, stack_size: 28, reductions: 192; neighbours:
emqx              | 2025-10-28T23:29:15.054199+08:00 [error] Supervisor: {local,emqx_conf_sup}. Context: start_error. Reason: {{badmatch,{error,{node_not_running,'emqx@177.7.0.12'}}},[{emqx_cluster_rpc,init,1,[{file,"emqx_cluster_rpc.erl"},{line,358}]},{gen_server,init_it,2,[{file,"gen_server.erl"},{line,980}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,935}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,241}]}]}. Offender: id=emqx_cluster_rpc,pid=undefined.
emqx              | 2025-10-28T23:29:15.054377+08:00 [error] crasher: initial call: emqx_cluster_rpc:init/1, pid: <0.11724513.0>, registered_name: [], error: {{badmatch,{error,{node_not_running,'emqx@177.7.0.12'}}},[{emqx_cluster_rpc,init,1,[{file,"emqx_cluster_rpc.erl"},{line,358}]},{gen_server,init_it,2,[{file,"gen_server.erl"},{line,980}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,935}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,241}]}]}, ancestors: [emqx_conf_sup,<0.2482.0>], message_queue_len: 0, messages: [], links: [<0.2499.0>], dictionary: [], trap_exit: false, status: running, heap_size: 376, stack_size: 28, reductions: 193; neighbours:
emqx              | 2025-10-28T23:29:15.057495+08:00 [error] Supervisor: {local,emqx_conf_sup}. Context: start_error. Reason: {{badmatch,{error,{node_not_running,'emqx@177.7.0.12'}}},[{emqx_cluster_rpc,init,1,[{file,"emqx_cluster_rpc.erl"},{line,358}]},{gen_server,init_it,2,[{file,"gen_server.erl"},{line,980}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,935}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,241}]}]}. Offender: id=emqx_cluster_rpc,pid=undefined.
emqx              | 2025-10-28T23:29:15.059411+08:00 [error] crasher: initial call: emqx_cluster_rpc:init/1, pid: <0.11721405.0>, registered_name: [], error: {{badmatch,{error,{node_not_running,'emqx@177.7.0.12'}}},[{emqx_cluster_rpc,init,1,[{file,"emqx_cluster_rpc.erl"},{line,358}]},{gen_server,init_it,2,[{file,"gen_server.erl"},{line,980}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,935}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,241}]}]}, ancestors: [emqx_conf_sup,<0.2482.0>], message_queue_len: 0, messages: [], links: [<0.2499.0>], dictionary: [], trap_exit: false, status: running, heap_size: 376, stack_size: 28, reductions: 193; neighbours:
emqx              | 2025-10-28T23:29:15.059891+08:00 [error] Supervisor: {local,emqx_conf_sup}. Context: start_error. Reason: {{badmatch,{error,{node_not_running,'emqx@177.7.0.12'}}},[{emqx_cluster_rpc,init,1,[{file,"emqx_cluster_rpc.erl"},{line,358}]},{gen_server,init_it,2,[{file,"gen_server.erl"},{line,980}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,935}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,241}]}]}. Offender: id=emqx_cluster_rpc,pid=undefined.
emqx              | 2025-10-28T23:29:15.060246+08:00 [error] crasher: initial call: emqx_cluster_rpc:init/1, pid: <0.11724508.0>, registered_name: [], error: {{badmatch,{error,{node_not_running,'emqx@177.7.0.12'}}},[{emqx_cluster_rpc,init,1,[{file,"emqx_cluster_rpc.erl"},{line,358}]},{gen_server,init_it,2,[{file,"gen_server.erl"},{line,980}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,935}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,241}]}]}, ancestors: [emqx_conf_sup,<0.2482.0>], message_queue_len: 0, messages: [], links: [<0.2499.0>], dictionary: [], trap_exit: false, status: running, heap_size: 376, stack_size: 28, reductions: 192; neighbours:
emqx              | 2025-10-28T23:29:15.060624+08:00 [error] Supervisor: {local,emqx_conf_sup}. Context: start_error. Reason: {{badmatch,{error,{node_not_running,'emqx@177.7.0.12'}}},[{emqx_cluster_rpc,init,1,[{file,"emqx_cluster_rpc.erl"},{line,358}]},{gen_server,init_it,2,[{file,"gen_server.erl"},{line,980}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,935}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,241}]}]}. Offender: id=emqx_cluster_rpc,pid=undefined.
emqx              | 2025-10-28T23:29:15.060914+08:00 [error] crasher: initial call: emqx_cluster_rpc:init/1, pid: <0.11724507.0>, registered_name: [], error: {{badmatch,{error,{node_not_running,'emqx@177.7.0.12'}}},[{emqx_cluster_rpc,init,1,[{file,"emqx_cluster_rpc.erl"},{line,358}]},{gen_server,init_it,2,[{file,"gen_server.erl"},{line,980}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,935}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,241}]}]}, ancestors: [emqx_conf_sup,<0.2482.0>], message_queue_len: 0, messages: [], links: [<0.2499.0>], dictionary: [], trap_exit: false, status: running, heap_size: 376, stack_size: 28, reductions: 196; neighbours:
emqx              | 2025-10-28T23:29:15.061189+08:00 [error] Supervisor: {local,emqx_conf_sup}. Context: start_error. Reason: {{badmatch,{error,{node_not_running,'emqx@177.7.0.12'}}},[{emqx_cluster_rpc,init,1,[{file,"emqx_cluster_rpc.erl"},{line,358}]},{gen_server,init_it,2,[{file,"gen_server.erl"},{line,980}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,935}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,241}]}]}. Offender: id=emqx_cluster_rpc,pid=undefined.
emqx              | 2025-10-28T23:29:15.061391+08:00 [error] crasher: initial call: emqx_cluster_rpc:init/1, pid: <0.11724139.0>, registered_name: [], error: {{badmatch,{error,{node_not_running,'emqx@177.7.0.12'}}},[{emqx_cluster_rpc,init,1,[{file,"emqx_cluster_rpc.erl"},{line,358}]},{gen_server,init_it,2,[{file,"gen_server.erl"},{line,980}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,935}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,241}]}]}, ancestors: [emqx_conf_sup,<0.2482.0>], message_queue_len: 0, messages: [], links: [<0.2499.0>], dictionary: [], trap_exit: false, status: running, heap_size: 376, stack_size: 28, reductions: 207; neighbours:
emqx              | 2025-10-28T23:29:15.061919+08:00 [error] Supervisor: {local,emqx_conf_sup}. Context: start_error. Reason: {{badmatch,{error,{node_not_running,'emqx@177.7.0.12'}}},[{emqx_cluster_rpc,init,1,[{file,"emqx_cluster_rpc.erl"},{line,358}]},{gen_server,init_it,2,[{file,"gen_server.erl"},{line,980}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,935}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,241}]}]}. Offender: id=emqx_cluster_rpc,pid=undefined.
emqx              | 2025-10-28T23:29:15.062150+08:00 [error] crasher: initial call: emqx_cluster_rpc:init/1, pid: <0.11724506.0>, registered_name: [], error: {{badmatch,{error,{node_not_running,'emqx@177.7.0.12'}}},[{emqx_cluster_rpc,init,1,[{file,"emqx_cluster_rpc.erl"},{line,358}]},{gen_server,init_it,2,[{file,"gen_server.erl"},{line,980}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,935}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,241}]}]}, ancestors: [emqx_conf_sup,<0.2482.0>], message_queue_len: 0, messages: [], links: [<0.2499.0>], dictionary: [], trap_exit: false, status: running, heap_size: 376, stack_size: 28, reductions: 208; neighbours:
emqx              | 2025-10-28T23:29:15.062421+08:00 [error] Supervisor: {local,emqx_conf_sup}. Context: start_error. Reason: {{badmatch,{error,{node_not_running,'emqx@177.7.0.12'}}},[{emqx_cluster_rpc,init,1,[{file,"emqx_cluster_rpc.erl"},{line,358}]},{gen_server,init_it,2,[{file,"gen_server.erl"},{line,980}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,935}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,241}]}]}. Offender: id=emqx_cluster_rpc,pid=undefined.
emqx              | 2025-10-28T23:29:15.062596+08:00 [error] crasher: initial call: emqx_cluster_rpc:init/1, pid: <0.11724525.0>, registered_name: [], error: {{badmatch,{error,{node_not_running,'emqx@177.7.0.12'}}},[{emqx_cluster_rpc,init,1,[{file,"emqx_cluster_rpc.erl"},{line,358}]},{gen_server,init_it,2,[{file,"gen_server.erl"},{line,980}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,935}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,241}]}]}, ancestors: [emqx_conf_sup,<0.2482.0>], message_queue_len: 0, messages: [], links: [<0.2499.0>], dictionary: [], trap_exit: false, status: running, heap_size: 376, stack_size: 28, reductions: 208; neighbours:
emqx              | 2025-10-28T23:29:15.062962+08:00 [error] Supervisor: {local,emqx_conf_sup}. Context: start_error. Reason: {{badmatch,{error,{node_not_running,'emqx@177.7.0.12'}}},[{emqx_cluster_rpc,init,1,[{file,"emqx_cluster_rpc.erl"},{line,358}]},{gen_server,init_it,2,[{file,"gen_server.erl"},{line,980}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,935}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,241}]}]}. Offender: id=emqx_cluster_rpc,pid=undefined.
emqx              | 2025-10-28T23:29:15.063193+08:00 [error] crasher: initial call: emqx_cluster_rpc:init/1, pid: <0.11724524.0>, registered_name: [], error: {{badmatch,{error,{node_not_running,'emqx@177.7.0.12'}}},[{emqx_cluster_rpc,init,1,[{file,"emqx_cluster_rpc.erl"},{line,358}]},{gen_server,init_it,2,[{file,"gen_server.erl"},{line,980}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,935}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,241}]}]}, ancestors: [emqx_conf_sup,<0.2482.0>], message_queue_len: 0, messages: [], links: [<0.2499.0>], dictionary: [], trap_exit: false, status: running, heap_size: 233, stack_size: 28, reductions: 225; neighbours:
emqx              | 2025-10-28T23:29:15.063518+08:00 [error] Supervisor: {local,emqx_conf_sup}. Context: start_error. Reason: {{badmatch,{error,{node_not_running,'emqx@177.7.0.12'}}},[{emqx_cluster_rpc,init,1,[{file,"emqx_cluster_rpc.erl"},{line,358}]},{gen_server,init_it,2,[{file,"gen_server.erl"},{line,980}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,935}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,241}]}]}. Offender: id=emqx_cluster_rpc,pid=undefined.
emqx              | 2025-10-28T23:29:15.064185+08:00 [error] Supervisor: {local,emqx_conf_sup}. Context: shutdown. Reason: reached_max_restart_intensity. Offender: id=emqx_cluster_rpc,pid={restarting,<0.2500.0>}.
emqx              | 2025-10-28T23:29:15.104497+08:00 [error] crasher: initial call: emqx_connection:init/4, pid: <0.10992567.0>, registered_name: [], error: {badarg,[{ets,lookup,[emqx_route,<<"/140/202412270409/property/post">>],[{error_info,#{cause => id,module => erl_stdlib_errors}}]},{emqx_router,lookup_route_tab,1,[{file,"emqx_router.erl"},{line,432}]},{emqx_router,match_routes_v2,1,[{file,"emqx_router.erl"},{line,512}]},{emqx_broker,do_publish,1,[{file,"emqx_broker.erl"},{line,295}]},{emqx_channel,do_publish,3,[{file,"emqx_channel.erl"},{line,716}]},{emqx_connection,with_channel,3,[{file,"emqx_connection.erl"},{line,848}]},{emqx_connection,process_msg,2,[{file,"emqx_connection.erl"},{line,495}]},{emqx_connection,handle_recv,3,[{file,"emqx_connection.erl"},{line,446}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,251}]}]}, ancestors: [<0.3614.0>,<0.3613.0>,esockd_sup,<0.2504.0>], message_queue_len: 0, messages: [], links: [<0.3614.0>], dictionary: [{authz_keys_q,{[{#{retain => false,action_type => publish,qos => 1},<<"/140/202412270409/property/post">>}],[]}},{guid,{1761665355104271,150418355633079,29}},{'send_msg.qos1',66},{'$logger_metadata$',#{peername => "39.144.171.122:48293",username => <<"202412270409&140">>,clientid => <<"S&202412270409&140&111">>}},{send_pkt,438},{send_msg,66},{incoming_pubs,3},{rand_seed,{#{type => exsss,next => #Fun<rand.0.65977474>,bits => 58,uniform => #Fun<rand.1.65977474>,uniform_n => #Fun<rand.2.65977474>,jump => #Fun<rand.3.65977474>},[107441659604523527|166111580397646668]}},{recv_pkt,439},{'recv_msg.qos1',28},{incoming_bytes,1559},{authz_cache_size,1},{recv_msg,28},{{#{retain => false,action_type => publish,qos => 1},<<"/140/202412270409/property/post">>},{allow,1761665355104}},{outgoing_pubs,66},{outgoing_bytes,5520}], trap_exit: false, status: running, heap_size: 1598, stack_size: 28, reductions: 560305; neighbours:
emqx              | 2025-10-28T23:29:15.105930+08:00 [error] supervisor: {esockd_connection_sup,<0.10992567.0>}, errorContext: connection_crashed, reason: {badarg,[{ets,lookup,[emqx_route,<<"/140/202412270409/property/post">>],[{error_info,#{cause => id,module => erl_stdlib_errors}}]},{emqx_router,lookup_route_tab,1,[{file,"emqx_router.erl"},{line,432}]},{emqx_router,match_routes_v2,1,[{file,"emqx_router.erl"},{line,512}]},{emqx_broker,do_publish,1,[{file,"emqx_broker.erl"},{line,295}]},{emqx_channel,do_publish,3,[{file,"emqx_channel.erl"},{line,716}]},{emqx_connection,with_channel,3,[{file,"emqx_connection.erl"},{line,848}]},{emqx_connection,process_msg,2,[{file,"emqx_connection.erl"},{line,495}]},{emqx_connection,handle_recv,3,[{file,"emqx_connection.erl"},{line,446}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,251}]}]}, offender: [{pid,<0.10992567.0>},{name,connection},{mfargs,{emqx_connection,start_link,[#{listener => {tcp,default},limiter => #{connection => #{initial => 0,burst => 0,rate => infinity}},enable_authn => true,zone => default}]}}]
emqx              | 2025-10-28T23:29:15.112917+08:00 [error] msg: async_submit_error, reason: {aborted,{node_not_running,'emqx@177.7.0.12'}}, stacktrace: [{mnesia,abort,1,[{file,"mnesia.erl"},{line,363}]},{mnesia_tm,prepare_items,5,[{file,"mnesia_tm.erl"},{line,1289}]},{mnesia_tm,dirty,2,[{file,"mnesia_tm.erl"},{line,1131}]},{emqx_cm,do_unregister_channel,1,[{file,"emqx_cm.erl"},{line,211}]},{emqx_cm,do_clean_down,2,[{file,"emqx_cm.erl"},{line,846}]},{emqx_cm,clean_down,1,[{file,"emqx_cm.erl"},{line,833}]},{emqx_pool,handle_cast,2,[{file,"emqx_pool.erl"},{line,132}]},{gen_server,try_handle_cast,3,[{file,"gen_server.erl"},{line,1121}]},{gen_server,handle_msg,6,[{file,"gen_server.erl"},{line,1183}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,251}]}], exception: exit
emqx              | 2025-10-28T23:29:15.124618+08:00 [error] crasher: initial call: emqx_connection:init/4, pid: <0.10990028.0>, registered_name: [], error: {badarg,[{ets,lookup,[emqx_route,<<"/140/202412270278/property/post">>],[{error_info,#{cause => id,module => erl_stdlib_errors}}]},{emqx_router,lookup_route_tab,1,[{file,"emqx_router.erl"},{line,432}]},{emqx_router,match_routes_v2,1,[{file,"emqx_router.erl"},{line,512}]},{emqx_broker,do_publish,1,[{file,"emqx_broker.erl"},{line,295}]},{emqx_channel,do_publish,3,[{file,"emqx_channel.erl"},{line,716}]},{emqx_connection,with_channel,3,[{file,"emqx_connection.erl"},{line,848}]},{emqx_connection,process_msg,2,[{file,"emqx_connection.erl"},{line,495}]},{emqx_connection,handle_recv,3,[{file,"emqx_connection.erl"},{line,446}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,251}]}]}, ancestors: [<0.3614.0>,<0.3613.0>,esockd_sup,<0.2504.0>], message_queue_len: 0, messages: [], links: [<0.3614.0>], dictionary: [{authz_keys_q,{[{#{retain => false,action_type => publish,qos => 1},<<"/140/202412270278/property/post">>}],[]}},{guid,{1761665355124366,150418355630540,26}},{'send_msg.qos1',65},{'$logger_metadata$',#{peername => "39.144.171.116:65410",username => <<"202412270278&140">>,clientid => <<"S&202412270278&140&111">>}},{send_pkt,434},{send_msg,65},{incoming_pubs,3},{rand_seed,{#{type => exsss,next => #Fun<rand.0.65977474>,bits => 58,uniform => #Fun<rand.1.65977474>,uniform_n => #Fun<rand.2.65977474>,jump => #Fun<rand.3.65977474>},[89110684594921045|133333063518675313]}},{recv_pkt,435},{'recv_msg.qos1',25},{incoming_bytes,1611},{authz_cache_size,1},{recv_msg,25},{{#{retain => false,action_type => publish,qos => 1},<<"/140/202412270278/property/post">>},{allow,1761665355124}},{outgoing_pubs,65},{outgoing_bytes,5555}], trap_exit: false, status: running, heap_size: 1598, stack_size: 28, reductions: 540285; neighbours:
emqx              | 2025-10-28T23:29:15.126047+08:00 [error] msg: async_submit_error, reason: {aborted,{node_not_running,'emqx@177.7.0.12'}}, stacktrace: [{mnesia,abort,1,[{file,"mnesia.erl"},{line,363}]},{mnesia_tm,prepare_items,5,[{file,"mnesia_tm.erl"},{line,1289}]},{mnesia_tm,dirty,2,[{file,"mnesia_tm.erl"},{line,1131}]},{emqx_cm,do_unregister_channel,1,[{file,"emqx_cm.erl"},{line,211}]},{emqx_cm,do_clean_down,2,[{file,"emqx_cm.erl"},{line,846}]},{emqx_cm,clean_down,1,[{file,"emqx_cm.erl"},{line,833}]},{emqx_pool,handle_cast,2,[{file,"emqx_pool.erl"},{line,132}]},{gen_server,try_handle_cast,3,[{file,"gen_server.erl"},{line,1121}]},{gen_server,handle_msg,6,[{file,"gen_server.erl"},{line,1183}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,251}]}], exception: exit
emqx              | 2025-10-28T23:29:15.125958+08:00 [error] supervisor: {esockd_connection_sup,<0.10990028.0>}, errorContext: connection_crashed, reason: {badarg,[{ets,lookup,[emqx_route,<<"/140/202412270278/property/post">>],[{error_info,#{cause => id,module => erl_stdlib_errors}}]},{emqx_router,lookup_route_tab,1,[{file,"emqx_router.erl"},{line,432}]},{emqx_router,match_routes_v2,1,[{file,"emqx_router.erl"},{line,512}]},{emqx_broker,do_publish,1,[{file,"emqx_broker.erl"},{line,295}]},{emqx_channel,do_publish,3,[{file,"emqx_channel.erl"},{line,716}]},{emqx_connection,with_channel,3,[{file,"emqx_connection.erl"},{line,848}]},{emqx_connection,process_msg,2,[{file,"emqx_connection.erl"},{line,495}]},{emqx_connection,handle_recv,3,[{file,"emqx_connection.erl"},{line,446}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,251}]}]}, offender: [{pid,<0.10990028.0>},{name,connection},{mfargs,{emqx_connection,start_link,[#{listener => {tcp,default},limiter => #{connection => #{initial => 0,burst => 0,rate => infinity}},enable_authn => true,zone => default}]}}]
emqx              | 2025-10-28T23:29:15.127146+08:00 [error] Supervisor: {local,emqx_sup}. Context: child_terminated. Reason: shutdown. Offender: id=emqx_broker_sup,pid=<0.2895.0>.
emqx              | 2025-10-28T23:29:15.127328+08:00 [error] Supervisor: {local,emqx_sup}. Context: shutdown. Reason: reached_max_restart_intensity. Offender: id=emqx_broker_sup,pid=<0.2895.0>.
emqx              | 2025-10-28T23:29:15.137929+08:00 [error] crasher: initial call: emqx_connection:init/4, pid: <0.3658743.0>, registered_name: [], error: {badarg,[{ets,lookup,[emqx_route,<<"/140/202412270078/ws/service">>],[{error_info,#{cause => id,module => erl_stdlib_errors}}]},{emqx_router,lookup_route_tab,1,[{file,"emqx_router.erl"},{line,432}]},{emqx_router,match_routes_v2,1,[{file,"emqx_router.erl"},{line,512}]},{emqx_broker,do_publish,1,[{file,"emqx_broker.erl"},{line,295}]},{emqx_channel,do_publish,3,[{file,"emqx_channel.erl"},{line,707}]},{emqx_connection,with_channel,3,[{file,"emqx_connection.erl"},{line,848}]},{emqx_connection,process_msg,2,[{file,"emqx_connection.erl"},{line,495}]},{emqx_connection,handle_recv,3,[{file,"emqx_connection.erl"},{line,446}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,251}]}]}, ancestors: [<0.3614.0>,<0.3613.0>,esockd_sup,<0.2504.0>], message_queue_len: 0, messages: [], links: [<0.3614.0>], dictionary: [{{#{retain => false,action_type => publish,qos => 0},<<"/140/202412270759/ws/service">>},{allow,1761665353980}},{authz_cache_size,32},{{#{retain => false,action_type => publish,qos => 0},<<"/140/202412274158/ws/service">>},{allow,1761665351395}},{{#{retain => false,action_type => publish,qos => 0},<<"/140/202412274288/ws/service">>},{allow,1761665351854}},{{#{retain => false,action_type => publish,qos => 0},<<"/140/202412273899/ws/service">>},{allow,1761665351064}},{{#{retain => false,action_type => publish,qos => 0},<<"/140/202503010699/ws/service">>},{allow,1761665352213}},{guid,{1761665355137562,150418348299255,20356}},{'$logger_metadata$',#{peername => "177.7.0.13:38766",username => <<"fastbee">>,clientid => <<"server-1760840959486">>}},{send_msg,1538639},{incoming_pubs,1},{{#{retain => false,action_type => publish,qos => 0},<<"/140/202412272218/ws/service">>},{allow,1761665354193}},{incoming_bytes,1641},{{#{retain => false,action_type => publish,qos => 0},<<"/140/202412271518/ws/service">>},{allow,1761665354555}},{{#{retain => false,action_type => publish,qos => 0},<<"/140/202412273134/ws/service">>},{allow,1761665352439}},{{#{retain => false,action_type => publish,qos => 0},<<"/140/202412271459/ws/service">>},{allow,1761665353302}},{{#{retain => false,action_type => publish,qos => 0},<<"/140/202503010418/ws/service">>},{allow,1761665353243}},{{#{retain => false,action_type => publish,qos => 0},<<"/140/202412274018/ws/service">>},{allow,1761665352757}},{{#{retain => false,action_type => publish,qos => 0},<<"/140/202412274298/ws/service">>},{allow,1761665351965}},{{#{retain => false,action_type => publish,qos => 0},<<"/140/202503010338/ws/service">>},{allow,1761665354811}},{{#{retain => false,action_type => publish,qos => 0},<<"/140/202504020043/ws/service">>},{allow,1761665351093}},{{#{retain => false,action_type => publish,qos => 0},<<"/140/202503010038/ws/service">>},{allow,1761665351194}},{{#{retain => false,action_type => publish,qos => 0},<<"/140/202412271238/ws/service">>},{allow,1761665353949}},{{#{retain => false,action_type => publish,qos => 0},<<"/140/202412274369/ws/service">>},{allow,1761665353025}},{{#{retain => false,action_type => publish,qos => 0},<<"/140/202503010638/ws/service">>},{allow,1761665353384}},{{#{retain => false,action_type => publish,qos => 0},<<"/140/202412271469/ws/service">>},{allow,1761665354564}},{{#{retain => false,action_type => publish,qos => 0},<<"/140/202412273701/ws/service">>},{allow,1761665355045}},{{#{retain => false,action_type => publish,qos => 0},<<"/140/202412274208/ws/service">>},{allow,1761665351154}},{{#{retain => false,action_type => publish,qos => 0},<<"/140/202412272778/ws/service">>},{allow,1761665353200}},{{#{retain => false,action_type => publish,qos => 0},<<"/140/202503010382/ws/service">>},{allow,1761665352822}},{'send_msg.dropped.queue_full',7825},{{#{retain => false,action_type => publish,qos => 0},<<"/140/202412271614/ws/service">>},{allow,1761665353378}},{authz_keys_q,{[{#{retain => false,action_type => publish,qos => 0},<<"/140/202412270078/ws/service">>},{#{retain => false,action_type => publish,qos => 0},<<"/140/202412273701/ws/service">>},{#{retain => false,action_type => publish,qos => 0},<<"/140/202412271098/ws/service">>},{#{retain => false,action_type => publish,qos => 0},<<"/140/202503010338/ws/service">>},{#{retain => false,action_type => publish,qos => 0},<<"/140/202412273654/ws/service">>},{#{retain => false,action_type => publish,qos => 0},<<"/140/202412271469/ws/service">>},{#{retain => false,action_type => publish,qos => 0},<<"/140/202412271518/ws/service">>},{#{retain => false,action_type => publish,qos => 0},<<"/173/202504010002/ws/service">>},{#{retain => false,action_type => publish,qos => 0},<<"/140/202412272218/ws/service">>},{#{retain => false,action_type => publish,qos => 0},<<"/140/202503010850/ws/service">>},{#{retain => false,action_type => publish,qos => 0},<<"/140/202412270759/ws/service">>},{#{retain => false,action_type => publish,qos => 0},<<"/140/202412271238/ws/service">>},{#{retain => false,action_type => publish,qos => 0},<<"/140/202412273108/ws/service">>},{#{retain => false,action_type => publish,qos => 0},<<"/140/202503010638/ws/service">>},{#{retain => false,action_type => publish,qos => 0},<<"/140/202412271614/ws/service">>},{#{retain => false,action_type => publish,qos => 0},<<"/140/202412271459/ws/service">>}],[{#{retain => false,action_type => publish,qos => 0},<<"/140/202412273899/ws/service">>},{#{retain => false,action_type => publish,qos => 0},<<"/140/202504020043/ws/service">>},{#{retain => false,action_type => publish,qos => 0},<<"/140/202412274208/ws/service">>},{#{retain => false,action_type => publish,qos => 0},<<"/140/202503010038/ws/service">>},{#{retain => false,action_type => publish,qos => 0},<<"/140/202412274158/ws/service">>},{#{retain => false,action_type => publish,qos => 1},<<"/140/202503010128/status/post">>},{#{retain => false,action_type => publish,qos => 0},<<"/140/202412274288/ws/service">>},{#{retain => false,action_type => publish,qos => 0},<<"/140/202412274298/ws/service">>},{#{retain => false,action_type => publish,qos => 0},<<"/140/202503010699/ws/service">>},{#{retain => false,action_type => publish,qos => 0},<<"/140/202412273134/ws/service">>},{#{retain => false,action_type => publish,qos => 0},<<"/140/202412274018/ws/service">>},{#{retain => false,action_type => publish,qos => 0},<<"/140/202503010382/ws/service">>},{#{retain => false,action_type => publish,qos => 0},<<"/140/202412274369/ws/service">>},{#{retain => false,action_type => publish,qos => 0},<<"/140/202412273909/ws/service">>},{#{retain => false,action_type => publish,qos => 0},<<"/140/202412272778/ws/service">>},{#{retain => false,action_type => publish,qos => 0},<<"/140/202503010418/ws/service">>}]}},{'send_msg.dropped',7825},{'send_msg.qos1',1538639},{send_pkt,1962603},{{#{retain => false,action_type => publish,qos => 0},<<"/140/202412273909/ws/service">>},{allow,1761665353162}},{{#{retain => false,action_type => publish,qos => 0},<<"/140/202412273108/ws/service">>},{allow,1761665353865}},{rand_seed,{#{type => exsss,next => #Fun<rand.0.65977474>,bits => 58,uniform => #Fun<rand.1.65977474>,uniform_n => #Fun<rand.2.65977474>,jump => #Fun<rand.3.65977474>},[23534653458926646|79040231421195457]}},{recv_pkt,3394004},{'recv_msg.qos1',423962},{'recv_msg.qos0',1431401},{recv_msg,1855363},{{#{retain => false,action_type => publish,qos => 0},<<"/140/202412273654/ws/service">>},{allow,1761665354770}},{outgoing_pubs,44},{outgoing_bytes,22456},{{#{retain => false,action_type => publish,qos => 1},<<"/140/202503010128/status/post">>},{allow,1761665351628}},{{#{retain => false,action_type => publish,qos => 0},<<"/173/202504010002/ws/service">>},{allow,1761665354446}},{{#{retain => false,action_type => publish,qos => 0},<<"/140/202412270078/ws/service">>},{allow,1761665355137}},{{#{retain => false,action_type => publish,qos => 0},<<"/140/202503010850/ws/service">>},{allow,1761665354083}},{{#{retain => false,action_type => publish,qos => 0},<<"/140/202412271098/ws/service">>},{allow,1761665354917}}], trap_exit: false, status: running, heap_size: 4185, stack_size: 28, reductions: 3874557801; neighbours:
emqx              | 2025-10-28T23:29:15.141970+08:00 [error] supervisor: {esockd_connection_sup,<0.3658743.0>}, errorContext: connection_crashed, reason: {badarg,[{ets,lookup,[emqx_route,<<"/140/202412270078/ws/service">>],[{error_info,#{cause => id,module => erl_stdlib_errors}}]},{emqx_router,lookup_route_tab,1,[{file,"emqx_router.erl"},{line,432}]},{emqx_router,match_routes_v2,1,[{file,"emqx_router.erl"},{line,512}]},{emqx_broker,do_publish,1,[{file,"emqx_broker.erl"},{line,295}]},{emqx_channel,do_publish,3,[{file,"emqx_channel.erl"},{line,707}]},{emqx_connection,with_channel,3,[{file,"emqx_connection.erl"},{line,848}]},{emqx_connection,process_msg,2,[{file,"emqx_connection.erl"},{line,495}]},{emqx_connection,handle_recv,3,[{file,"emqx_connection.erl"},{line,446}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,251}]}]}, offender: [{pid,<0.3658743.0>},{name,connection},{mfargs,{emqx_connection,start_link,[#{listener => {tcp,default},limiter => #{connection => #{initial => 0,burst => 0,rate => infinity}},enable_authn => true,zone => default}]}}]
emqx              | 2025-10-28T23:29:15.156402+08:00 [error] Generic server emqx_router_helper terminating. Reason: {{noproc,{gen_server,call,[mria_membership,{monitor,{membership,<0.2753.0>,false}}]}},[{gen_server,call,2,[{file,"gen_server.erl"},{line,404}]},{gen_server,try_terminate,3,[{file,"gen_server.erl"},{line,1143}]},{gen_server,terminate,10,[{file,"gen_server.erl"},{line,1339}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,251}]}]}. Last message: {'EXIT',<0.2752.0>,shutdown}. State: #{last_membership => ['emqx@177.7.0.12'],tab_node_status => emqx_router_helper,timer_reconcile => #Ref<0.783191341.4216061954.236249>}.
emqx              | 2025-10-28T23:29:15.156716+08:00 [error] crasher: initial call: emqx_router_helper:init/1, pid: <0.2753.0>, registered_name: emqx_router_helper, exit: {{noproc,{gen_server,call,[mria_membership,{monitor,{membership,<0.2753.0>,false}}]}},[{gen_server,call,2,[{file,"gen_server.erl"},{line,404}]},{gen_server,try_terminate,3,[{file,"gen_server.erl"},{line,1143}]},{gen_server,terminate,10,[{file,"gen_server.erl"},{line,1339}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,251}]}]}, ancestors: [emqx_router_sup,emqx_sup,<0.2573.0>], message_queue_len: 0, messages: [], links: [<0.2752.0>], dictionary: [{rand_seed,{#{type => exsss,next => #Fun<rand.0.65977474>,bits => 58,uniform => #Fun<rand.1.65977474>,uniform_n => #Fun<rand.2.65977474>,jump => #Fun<rand.3.65977474>},[191878141646483051|284190730355120272]}}], trap_exit: true, status: running, heap_size: 4185, stack_size: 28, reductions: 670240; neighbours:
emqx              | 2025-10-28T23:29:15.157181+08:00 [error] Supervisor: {local,emqx_router_sup}. Context: shutdown_error. Reason: {noproc,{gen_server,call,[mria_membership,{monitor,{membership,<0.2753.0>,false}}]}}. Offender: id=helper,pid=<0.2753.0>.
emqx              | 2025-10-28T23:29:15.158151+08:00 [error] crasher: initial call: emqx_connection:init/4, pid: <0.10992383.0>, registered_name: [], error: {badarg,[{ets,lookup,[emqx_route,<<"/140/202412272288/property/post">>],[{error_info,#{cause => id,module => erl_stdlib_errors}}]},{emqx_router,lookup_route_tab,1,[{file,"emqx_router.erl"},{line,432}]},{emqx_router,match_routes_v2,1,[{file,"emqx_router.erl"},{line,512}]},{emqx_broker,do_publish,1,[{file,"emqx_broker.erl"},{line,295}]},{emqx_channel,do_publish,3,[{file,"emqx_channel.erl"},{line,716}]},{emqx_connection,with_channel,3,[{file,"emqx_connection.erl"},{line,848}]},{emqx_connection,process_msg,2,[{file,"emqx_connection.erl"},{line,495}]},{emqx_connection,handle_recv,3,[{file,"emqx_connection.erl"},{line,446}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,251}]}]}, ancestors: [<0.3614.0>,<0.3613.0>,esockd_sup,<0.2504.0>], message_queue_len: 0, messages: [], links: [<0.3614.0>], dictionary: [{authz_keys_q,{[{#{retain => false,action_type => publish,qos => 1},<<"/140/202412272288/property/post">>}],[]}},{guid,{1761665355157902,150418355632895,25}},{'send_msg.qos1',64},{'$logger_metadata$',#{peername => "39.144.171.40:43995",username => <<"202412272288&140">>,clientid => <<"S&202412272288&140&111">>}},{send_pkt,432},{send_msg,64},{incoming_pubs,3},{rand_seed,{#{type => exsss,next => #Fun<rand.0.65977474>,bits => 58,uniform => #Fun<rand.1.65977474>,uniform_n => #Fun<rand.2.65977474>,jump => #Fun<rand.3.65977474>},[20033309378510108|237922688711907863]}},{recv_pkt,433},{'recv_msg.qos1',24},{incoming_bytes,1593},{authz_cache_size,1},{recv_msg,24},{{#{retain => false,action_type => publish,qos => 1},<<"/140/202412272288/property/post">>},{allow,1761665355157}},{outgoing_pubs,64},{outgoing_bytes,5427}], trap_exit: false, status: running, heap_size: 1598, stack_size: 28, reductions: 552524; neighbours:
emqx              | 2025-10-28T23:29:15.158799+08:00 [error] supervisor: {esockd_connection_sup,<0.10992383.0>}, errorContext: connection_crashed, reason: {badarg,[{ets,lookup,[emqx_route,<<"/140/202412272288/property/post">>],[{error_info,#{cause => id,module => erl_stdlib_errors}}]},{emqx_router,lookup_route_tab,1,[{file,"emqx_router.erl"},{line,432}]},{emqx_router,match_routes_v2,1,[{file,"emqx_router.erl"},{line,512}]},{emqx_broker,do_publish,1,[{file,"emqx_broker.erl"},{line,295}]},{emqx_channel,do_publish,3,[{file,"emqx_channel.erl"},{line,716}]},{emqx_connection,with_channel,3,[{file,"emqx_connection.erl"},{line,848}]},{emqx_connection,process_msg,2,[{file,"emqx_connection.erl"},{line,495}]},{emqx_connection,handle_recv,3,[{file,"emqx_connection.erl"},{line,446}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,251}]}]}, offender: [{pid,<0.10992383.0>},{name,connection},{mfargs,{emqx_connection,start_link,[#{listener => {tcp,default},limiter => #{connection => #{initial => 0,burst => 0,rate => infinity}},enable_authn => true,zone => default}]}}]
emqx              | 2025-10-28T23:29:15.292971+08:00 [warning] clientid: S&202503010689&140&111, msg: unclean_terminate, peername: 39.144.171.22:58856, username: 202503010689&140, context: badarg, stacktrace: [{ets,lookup,[emqx_hooks,'session.terminated'],[{error_info,#{cause => id,module => erl_stdlib_errors}}]},{emqx_hooks,lookup,1,[{file,"emqx_hooks.erl"},{line,225}]},{emqx_hooks,run,2,[{file,"emqx_hooks.erl"},{line,163}]},{emqx_session,terminate,3,[{file,"emqx_session.erl"},{line,584}]},{emqx_connection,terminate,2,[{file,"emqx_connection.erl"},{line,659}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,251}]}], exception: error
emqx              | Listener tcp:default on 0.0.0.0:1883 stopped.
emqx              | Listener ssl:default on 0.0.0.0:8883 stopped.
emqx              | Listener ws:default on 0.0.0.0:8083 stopped.
emqx              | Listener wss:default on 0.0.0.0:8084 stopped.
emqx              | 2025-10-28T23:29:15.444265+08:00 [error] msg: emqx_alarm_safe_call_exception, reason: {noproc,{gen_server,call,[emqx_alarm,{deactivate_alarm,<<"emqx_authn_http:3">>,no_details,<<>>}]}}, stacktrace: [{gen_server,call,2,[{file,"gen_server.erl"},{line,404}]},{emqx_alarm,safe_call,1,[{file,"emqx_alarm.erl"},{line,524}]},{emqx_resource_manager,stop_resource,1,[{file,"emqx_resource_manager.erl"},{line,1013}]},{emqx_resource_manager,handle_remove_event,3,[{file,"emqx_resource_manager.erl"},{line,866}]},{gen_statem,loop_state_callback,11,[{file,"gen_statem.erl"},{line,1397}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,241}]}]
emqx              | Stop listener http:dashboard on :18083 successfully.
emqx              | 2025-10-28T23:29:15.479511+08:00 [error] msg: emqx_alarm_safe_call_exception, reason: {noproc,{gen_server,call,[emqx_alarm,{deactivate_alarm,<<"action:http:fastbee_hook:connector:http:fastbee_hook">>,no_details,<<>>}]}}, stacktrace: [{gen_server,call,2,[{file,"gen_server.erl"},{line,404}]},{emqx_alarm,safe_call,1,[{file,"emqx_alarm.erl"},{line,524}]},{emqx_resource_manager,handle_remove_channel,3,[{file,"emqx_resource_manager.erl"},{line,1131}]},{gen_statem,loop_state_callback,11,[{file,"gen_statem.erl"},{line,1397}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,241}]}]
emqx              | 2025-10-28T23:29:15.527225+08:00 [error] Generic server emqx_delayed terminating. Reason: {badarg,[{ets,internal_delete_all,[emqx_delayed,undefined],[{error_info,#{cause => id,module => erl_stdlib_errors}}]},{ets,delete_all_objects,1,[{file,"ets.erl"},{line,126}]},{emqx_delayed,do_load_or_unload,2,[{file,"emqx_delayed.erl"},{line,487}]},{gen_server,try_terminate,3,[{file,"gen_server.erl"},{line,1143}]},{gen_server,terminate,10,[{file,"gen_server.erl"},{line,1339}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,251}]}]}. Last message: {'EXIT',<0.3919.0>,shutdown}. State: #{stats_fun => #Fun<emqx_stats.1.23326899>,stats_timer => #Ref<0.783191341.4259577857.92636>,publish_at => 0,publish_timer => undefined}.
emqx              | 2025-10-28T23:29:15.527646+08:00 [error] crasher: initial call: emqx_delayed:init/1, pid: <0.3928.0>, registered_name: emqx_delayed, error: {badarg,[{ets,internal_delete_all,[emqx_delayed,undefined],[{error_info,#{cause => id,module => erl_stdlib_errors}}]},{ets,delete_all_objects,1,[{file,"ets.erl"},{line,126}]},{emqx_delayed,do_load_or_unload,2,[{file,"emqx_delayed.erl"},{line,487}]},{gen_server,try_terminate,3,[{file,"gen_server.erl"},{line,1143}]},{gen_server,terminate,10,[{file,"gen_server.erl"},{line,1339}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,251}]}]}, ancestors: [emqx_modules_sup,<0.3914.0>], message_queue_len: 0, messages: [], links: [<0.3919.0>], dictionary: [], trap_exit: true, status: running, heap_size: 610, stack_size: 28, reductions: 29247694; neighbours:
emqx              | 2025-10-28T23:29:15.528130+08:00 [error] Supervisor: {local,emqx_modules_sup}. Context: shutdown_error. Reason: {badarg,[{ets,internal_delete_all,[emqx_delayed,undefined],[{error_info,#{cause => id,module => erl_stdlib_errors}}]},{ets,delete_all_objects,1,[{file,"ets.erl"},{line,126}]},{emqx_delayed,do_load_or_unload,2,[{file,"emqx_delayed.erl"},{line,487}]},{gen_server,try_terminate,3,[{file,"gen_server.erl"},{line,1143}]},{gen_server,terminate,10,[{file,"gen_server.erl"},{line,1339}]},{proc_lib,wake_up,3,[{file,"proc_lib.erl"},{line,251}]}]}. Offender: id=emqx_delayed,pid=<0.3928.0>.
emqx              | 2025-10-28T23:29:15.579663+08:00 [error] msg: emqx_alarm_safe_call_exception, reason: {noproc,{gen_server,call,[emqx_alarm,{deactivate_alarm,<<"connector:http:fastbee_hook">>,no_details,<<>>}]}}, stacktrace: [{gen_server,call,2,[{file,"gen_server.erl"},{line,404}]},{emqx_alarm,safe_call,1,[{file,"emqx_alarm.erl"},{line,524}]},{emqx_resource_manager,stop_resource,1,[{file,"emqx_resource_manager.erl"},{line,1013}]},{emqx_resource_manager,terminate,3,[{file,"emqx_resource_manager.erl"},{line,646}]},{gen_statem,terminate,7,[{file,"gen_statem.erl"},{line,2571}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,241}]}]
emqx              | Kernel pid terminated (application_controller) ("{application_terminated,emqx,shutdown}")
emqx              | 
emqx              | Crash dump is being written to: /opt/emqx/log/erl_crash.dump...done
emqx              | WARNING: Default (insecure) Erlang cookie is in use.
emqx              | WARNING: Configure node.cookie in /opt/emqx/etc/emqx.conf or override from environment variable EMQX_NODE__COOKIE
emqx              | WARNING: NOTE: Use the same cookie for all nodes in the cluster.
emqx              | EMQX_RPC__PORT_DISCOVERY [rpc.port_discovery]: manual
emqx              | EMQX_NODE__NAME [node.name]: emqx@177.7.0.12
emqx              | 2025-10-29T07:05:12.767388+08:00 [error] Error writing /opt/emqx/data/configs/app.2025.10.29.07.05.11.config: no space left on device
emqx              | 2025-10-29T07:05:12.773905+08:00 [error] Error writing /opt/emqx/data/configs/vm.2025.10.29.07.05.11.args: no space left on device
emqx              | ERROR: call_hocon_failed: -v -t 2025.10.29.07.05.11 -s emqx_conf_schema -c /opt/emqx/etc/base.hocon -c /opt/emqx/data/configs/cluster.hocon -c /opt/emqx/etc/emqx.conf -d /opt/emqx/data/configs generate
[root@Server-i-qrveamuc29 data]# ^C
[root@Server-i-qrveamuc29 data]# ^C
[root@Server-i-qrveamuc29 data]# ^C
[root@Server-i-qrveamuc29 data]# ^C
[root@Server-i-qrveamuc29 data]# 
