环境信息
- emqx版本:开源版 5.8.4
- emqx-operator版本:2.2.25
- 阿里云ack ,k8s版本:1.31.1-aliyun.1
问题描述
想在阿里云k8s的同一个集群的两个不同命名空间下,分别部署emqx-operator,添加了singleNamespace 参数后,再启动emqx-core后就会报错。
先前使用的是emqx-operator默认创建的emqx-operator-system命名空间,没有任何问题。但考虑到emqx-operator可能也会升级,所以想要在不同的命名空间里,为每一个emqx-core分配一个emqx-operator。
helm upgrade --install emqx-operator emqx/emqx-operator
–namespace emqx-debug
–create-namespace
–set emqx/emqx-operator-controller
–set image.tag=2.2.25
–set singleNamespace=true
配置文件及日志
emqx-operator的报错日志如下:
{“level”:“error”,“ts”:“2025-02-26T11:45:14Z”,“msg”:“error received after stop sequence was engaged”,“error”:“failed to wait for rebalance caches to sync: timed out waiting for cache to be synced for Kind *v2beta1.Rebalance”,“stacktrace”:“sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).engageStopProcedure.func1\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.2/pkg/manager/internal.go:490”} {“level”:“error”,“ts”:“2025-02-26T11:45:14Z”,“msg”:“error received after stop sequence was engaged”,“error”:“failed to wait for emqxplugin caches to sync: timed out waiting for cache to be synced for Kind *v1beta4.EmqxPlugin”,“stacktrace”:“sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).engageStopProcedure.func1\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.2/pkg/manager/internal.go:490”} {“level”:“error”,“ts”:“2025-02-26T11:45:14Z”,“msg”:“error received after stop sequence was engaged”,“error”:“failed to wait for emqx caches to sync: timed out waiting for cache to be synced for Kind *v2beta1.EMQX”,“stacktrace”:“sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).engageStopProcedure.func1\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.2/pkg/manager/internal.go:490”} {“level”:“info”,“ts”:“2025-02-26T11:45:14Z”,“msg”:“Stopping and waiting for leader election runnables”} {“level”:“error”,“ts”:“2025-02-26T11:45:14Z”,“msg”:“Could not wait for Cache to sync”,“controller”:“emqxenterprise”,“controllerGroup”:“apps.emqx.io”,“controllerKind”:“EmqxEnterprise”,“error”:“failed to wait for emqxenterprise caches to sync: timed out waiting for cache to be synced for Kind *v1beta4.EmqxEnterprise”,“stacktrace”:“sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.1\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.2/pkg/internal/controller/controller.go:203\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.2/pkg/internal/controller/controller.go:208\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.2/pkg/internal/controller/controller.go:234\nsigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func1\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.2/pkg/manager/runnable_group.go:223”} {“level”:“info”,“ts”:“2025-02-26T11:45:14Z”,“msg”:“Stopping and waiting for caches”} {“level”:“error”,“ts”:“2025-02-26T11:45:14Z”,“msg”:“error received after stop sequence was engaged”,“error”:“failed to wait for emqxenterprise caches to sync: timed out waiting for cache to be synced for Kind *v1beta4.EmqxEnterprise”,“stacktrace”:“sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).engageStopProcedure.func1\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.2/pkg/manager/internal.go:490”} {“level”:“info”,“ts”:“2025-02-26T11:45:14Z”,“msg”:“Stopping and waiting for webhooks”} {“level”:“info”,“ts”:“2025-02-26T11:45:14Z”,“logger”:“controller-runtime.webhook”,“msg”:“Shutting down webhook server with timeout of 1 minute”} {“level”:“info”,“ts”:“2025-02-26T11:45:14Z”,“msg”:“Stopping and waiting for HTTP servers”} {“level”:“info”,“ts”:“2025-02-26T11:45:14Z”,“logger”:“controller-runtime.metrics”,“msg”:“Shutting down metrics server with timeout of 1 minute”} {“level”:“info”,“ts”:“2025-02-26T11:45:14Z”,“msg”:“shutting down server”,“kind”:“health probe”,“addr”:“[::]:8081”} {“level”:“info”,“ts”:“2025-02-26T11:45:14Z”,“msg”:“Wait completed, proceeding to shutdown the manager”} {“level”:“error”,“ts”:“2025-02-26T11:45:14Z”,“logger”:“setup”,“msg”:“problem running manager”,“error”:"failed to wait for emqxbroker caches to sync: timed out wai