Dark Mode

Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

When deploying on a single machine, the controller reports the error: **503: Service Unavailable**. #5554

Open
Open
When deploying on a single machine, the controller reports the error: **503: Service Unavailable**.#5554

Description

After running sudo ansible-playbook -i environments/local openwhisk.yml, an error occurred indicating that the controller was unable to communicate with Kafka.

error when installing:

fatal: [controller0]: FAILED! => {"access_control_allow_headers": "Authorization, Origin, X-Requested-With, Content-Type, Accept, User-Agent", "access_control_allow_methods": "GET, DELETE, POST, PUT, HEAD", "access_control_allow_origin": "*", "changed": false, "connection": "close", "content_length": "141", "content_type": "application/json", "date": "Wed, 15 Oct 2025 14:41:03 GMT", "elapsed": 0, "json": {"code": "xKt7trpnJKaLTtJgWchLNXKM6Gjr8mZJ", "error": "The server is currently unavailable (because it is overloaded or down for maintenance)."}, "msg": "Status code was 503 and not [200]: HTTP Error 503: Service Unavailable", "redirected": false, "server": "akka-http/10.2.4", "status": 503, "url": "https://789c46b1-71f6-4ed5-8c54-816aa4f8c502:abczO3xZCLrMN6v2BKK1dXYFpXlPkccOFqm12CdAsMgRU4VrNZ9lyGVCGuMDGIwP@172.17.0.1:10001/api/v1/namespaces/_/actions/invokerHealthTestAction0?blocking=false&result=false", "x_request_id": "xKt7trpnJKaLTtJgWchLNXKM6Gjr8mZJ"}
...ignoring

Logs for controller0

bash-5.1# grep -i "ERROR" controller0_logs.log
[2025-10-13T08:55:03.952Z] [ERROR] [#tid_fLiYiW3E2rT8f71rW3b8z6tRyaSmGkhN] [ShardingContainerPoolBalancer] failed to schedule activation 52b273eb154b43ceb273eb154b03ced9, action 'whisk.system/invokerHealthTestAction0@0.0.1' (managed), ns 'whisk.system' - invokers to use: Map()
[2025-10-13T08:55:03.952Z] [WARN] [#tid_fLiYiW3E2rT8f71rW3b8z6tRyaSmGkhN] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:215:77]
[2025-10-13T08:55:03.953Z] [WARN] [#tid_fLiYiW3E2rT8f71rW3b8z6tRyaSmGkhN] [ActionsApi] No invokers available [marker:controller_activation_error:215:78]
[2025-10-13T08:55:03.953Z] [ERROR] [#tid_fLiYiW3E2rT8f71rW3b8z6tRyaSmGkhN] [ActionsApi] [POST] failed in loadbalancer: No invokers available
[2025-10-13T12:25:16.312Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit cacheInvalidation consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T12:25:16.413Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit activeack consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T12:25:16.619Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit ping consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T12:25:39.076Z] [ERROR] [#tid_OFhG5xFk0XbrDBvRaWu8tixEFuHNFPfy] [ShardingContainerPoolBalancer] failed to schedule activation 9f8a3fe90f7748078a3fe90f77f80738, action 'whisk.system/invokerHealthTestAction0@0.0.1' (managed), ns 'whisk.system' - invokers to use: Map()
[2025-10-13T12:25:39.077Z] [WARN] [#tid_OFhG5xFk0XbrDBvRaWu8tixEFuHNFPfy] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:193:65]
[2025-10-13T12:25:39.077Z] [WARN] [#tid_OFhG5xFk0XbrDBvRaWu8tixEFuHNFPfy] [ActionsApi] No invokers available [marker:controller_activation_error:193:65]
[2025-10-13T12:25:39.077Z] [ERROR] [#tid_OFhG5xFk0XbrDBvRaWu8tixEFuHNFPfy] [ActionsApi] [POST] failed in loadbalancer: No invokers available
[2025-10-13T12:54:48.356Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit cacheInvalidation consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T12:54:48.356Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit ping consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T12:54:48.356Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit activeack consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T12:55:10.268Z] [ERROR] [#tid_kOFS0gnVuGyGFPtQSb9jjYdBxWNX7M8r] [ShardingContainerPoolBalancer] failed to schedule activation a816a41eac5141c596a41eac5131c5ac, action 'whisk.system/invokerHealthTestAction0@0.0.1' (managed), ns 'whisk.system' - invokers to use: Map()
[2025-10-13T12:55:10.268Z] [WARN] [#tid_kOFS0gnVuGyGFPtQSb9jjYdBxWNX7M8r] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:190:62]
[2025-10-13T12:55:10.269Z] [WARN] [#tid_kOFS0gnVuGyGFPtQSb9jjYdBxWNX7M8r] [ActionsApi] No invokers available [marker:controller_activation_error:191:63]
[2025-10-13T12:55:10.269Z] [ERROR] [#tid_kOFS0gnVuGyGFPtQSb9jjYdBxWNX7M8r] [ActionsApi] [POST] failed in loadbalancer: No invokers available
[2025-10-13T13:50:50.917Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit cacheInvalidation consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T13:50:50.917Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit ping consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T13:50:50.918Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit activeack consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T13:51:13.616Z] [ERROR] [#tid_eIpz7abhXYRyWgPcl8jaw4KghgSCQLAT] [ShardingContainerPoolBalancer] failed to schedule activation 0f69a5547f084b47a9a5547f08fb47ba, action 'whisk.system/invokerHealthTestAction0@0.0.1' (managed), ns 'whisk.system' - invokers to use: Map()
[2025-10-13T13:51:13.617Z] [WARN] [#tid_eIpz7abhXYRyWgPcl8jaw4KghgSCQLAT] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:176:66]
[2025-10-13T13:51:13.617Z] [WARN] [#tid_eIpz7abhXYRyWgPcl8jaw4KghgSCQLAT] [ActionsApi] No invokers available [marker:controller_activation_error:177:67]
[2025-10-13T13:51:13.617Z] [ERROR] [#tid_eIpz7abhXYRyWgPcl8jaw4KghgSCQLAT] [ActionsApi] [POST] failed in loadbalancer: No invokers available
[2025-10-13T14:05:11.175Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit cacheInvalidation consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T14:05:11.175Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit activeack consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T14:05:11.176Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit ping consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T14:05:31.893Z] [ERROR] [#tid_xqUuunFLYIeq5b7jmZDunenZ316Vs3tG] [ShardingContainerPoolBalancer] failed to schedule activation 7697b2e8847e4b8b97b2e8847e5b8b61, action 'whisk.system/invokerHealthTestAction0@0.0.1' (managed), ns 'whisk.system' - invokers to use: Map()
[2025-10-13T14:05:31.894Z] [WARN] [#tid_xqUuunFLYIeq5b7jmZDunenZ316Vs3tG] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:182:65]
[2025-10-13T14:05:31.894Z] [WARN] [#tid_xqUuunFLYIeq5b7jmZDunenZ316Vs3tG] [ActionsApi] No invokers available [marker:controller_activation_error:182:65]
[2025-10-13T14:05:31.894Z] [ERROR] [#tid_xqUuunFLYIeq5b7jmZDunenZ316Vs3tG] [ActionsApi] [POST] failed in loadbalancer: No invokers available
[2025-10-13T14:47:41.646Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit ping consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T14:47:41.647Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit cacheInvalidation consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T14:47:41.647Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit activeack consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T14:47:58.220Z] [ERROR] [#tid_rBQ3X6P4hC79aFrH6BPZdnYbDZULV5gf] [ShardingContainerPoolBalancer] failed to schedule activation 1076de7831b348afb6de7831b348afc3, action 'whisk.system/invokerHealthTestAction0@0.0.1' (managed), ns 'whisk.system' - invokers to use: Map(Unhealthy -> 1)
[2025-10-13T14:47:58.221Z] [WARN] [#tid_rBQ3X6P4hC79aFrH6BPZdnYbDZULV5gf] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:211:88]
[2025-10-13T14:47:58.221Z] [WARN] [#tid_rBQ3X6P4hC79aFrH6BPZdnYbDZULV5gf] [ActionsApi] No invokers available [marker:controller_activation_error:211:89]
[2025-10-13T14:47:58.221Z] [ERROR] [#tid_rBQ3X6P4hC79aFrH6BPZdnYbDZULV5gf] [ActionsApi] [POST] failed in loadbalancer: No invokers available
[2025-10-13T14:48:50.143Z] [ERROR] [#tid_sid_invokerHealth] [KafkaProducerConnector] sending message on topic 'invoker0' failed: Topic invoker0 not present in metadata after 60000 ms.
[2025-10-13T14:48:50.157Z] [ERROR] [#tid_sid_invokerHealth] [KafkaProducerConnector] sending message on topic 'invoker0' failed: Cannot perform operation after producer has been closed
[2025-10-13T14:48:50.208Z] [WARN] [#tid_sid_invokerHealth] [ShardingContainerPoolBalancer] error on posting to topic invoker0 [marker:controller_kafka_error:61716:52]
[2025-10-13T14:48:50.208Z] [WARN] [#tid_sid_invokerHealth] [ShardingContainerPoolBalancer] error on posting to topic invoker0 [marker:controller_kafka_error:61716:60069]
[2025-10-13T14:48:50.209Z] [WARN] unhandled event Failure(org.apache.kafka.common.errors.TimeoutException: Topic invoker0 not present in metadata after 60000 ms.) in state Unhealthy
[2025-10-13T14:59:29.834Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit activeack consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T14:59:30.338Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit ping consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T14:59:31.969Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit cacheInvalidation consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T14:59:50.604Z] [ERROR] [#tid_gziDmjzOIPPec3BLkvmb4NKZFauQHYiz] [ShardingContainerPoolBalancer] failed to schedule activation 40e6f41c137042efa6f41c137052efde, action 'whisk.system/invokerHealthTestAction0@0.0.1' (managed), ns 'whisk.system' - invokers to use: Map()
[2025-10-13T14:59:50.605Z] [WARN] [#tid_gziDmjzOIPPec3BLkvmb4NKZFauQHYiz] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:178:69]
[2025-10-13T14:59:50.605Z] [WARN] [#tid_gziDmjzOIPPec3BLkvmb4NKZFauQHYiz] [ActionsApi] No invokers available [marker:controller_activation_error:178:69]
[2025-10-13T14:59:50.605Z] [ERROR] [#tid_gziDmjzOIPPec3BLkvmb4NKZFauQHYiz] [ActionsApi] [POST] failed in loadbalancer: No invokers available
[2025-10-13T15:16:20.236Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit activeack consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T15:16:20.642Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit ping consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T15:16:22.380Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit cacheInvalidation consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T15:16:40.829Z] [ERROR] [#tid_k6VrzBdL602daEtkyZqOxtrjk84XMBD3] [ShardingContainerPoolBalancer] failed to schedule activation 5f2d2d21d55749d2ad2d21d55779d2a6, action 'whisk.system/invokerHealthTestAction0@0.0.1' (managed), ns 'whisk.system' - invokers to use: Map()
[2025-10-13T15:16:40.829Z] [WARN] [#tid_k6VrzBdL602daEtkyZqOxtrjk84XMBD3] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:205:83]
[2025-10-13T15:16:40.829Z] [WARN] [#tid_k6VrzBdL602daEtkyZqOxtrjk84XMBD3] [ActionsApi] No invokers available [marker:controller_activation_error:205:83]
[2025-10-13T15:16:40.830Z] [ERROR] [#tid_k6VrzBdL602daEtkyZqOxtrjk84XMBD3] [ActionsApi] [POST] failed in loadbalancer: No invokers available
[2025-10-13T16:03:10.646Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit activeack consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T16:03:11.046Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit ping consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T16:03:12.867Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit cacheInvalidation consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T16:03:30.268Z] [ERROR] [#tid_apyUwJFY3qBmV68pSBZgAjuZINrmx8Dg] [ShardingContainerPoolBalancer] failed to schedule activation e59483f139144a559483f139144a555b, action 'whisk.system/invokerHealthTestAction0@0.0.1' (managed), ns 'whisk.system' - invokers to use: Map()
[2025-10-13T16:03:30.269Z] [WARN] [#tid_apyUwJFY3qBmV68pSBZgAjuZINrmx8Dg] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:203:69]
[2025-10-13T16:03:30.269Z] [WARN] [#tid_apyUwJFY3qBmV68pSBZgAjuZINrmx8Dg] [ActionsApi] No invokers available [marker:controller_activation_error:203:69]
[2025-10-13T16:03:30.269Z] [ERROR] [#tid_apyUwJFY3qBmV68pSBZgAjuZINrmx8Dg] [ActionsApi] [POST] failed in loadbalancer: No invokers available
[2025-10-13T16:08:31.007Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit activeack consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T16:08:31.415Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit ping consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T16:08:33.243Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit cacheInvalidation consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-13T16:08:50.952Z] [ERROR] [#tid_Lsak05H6yGift4jzypAFWOUMLQGj7jAf] [ShardingContainerPoolBalancer] failed to schedule activation ec2af18c06514e41aaf18c06516e41a0, action 'whisk.system/invokerHealthTestAction0@0.0.1' (managed), ns 'whisk.system' - invokers to use: Map()
[2025-10-13T16:08:50.953Z] [WARN] [#tid_Lsak05H6yGift4jzypAFWOUMLQGj7jAf] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:192:78]
[2025-10-13T16:08:50.953Z] [WARN] [#tid_Lsak05H6yGift4jzypAFWOUMLQGj7jAf] [ActionsApi] No invokers available [marker:controller_activation_error:192:78]
[2025-10-13T16:08:50.953Z] [ERROR] [#tid_Lsak05H6yGift4jzypAFWOUMLQGj7jAf] [ActionsApi] [POST] failed in loadbalancer: No invokers available
[2025-10-14T02:41:52.656Z] [ERROR] [#tid_sid_unknown] [KafkaConsumerConnector] org.apache.kafka.common.errors.TimeoutException: Timeout of 60000ms expired before successfully committing offsets {cacheInvalidation-0=OffsetAndMetadata{offset=0, leaderEpoch=null, metadata=''}}: retrying 3 more times
[2025-10-14T02:41:52.904Z] [ERROR] [#tid_sid_unknown] [KafkaConsumerConnector] org.apache.kafka.common.errors.TimeoutException: Timeout of 60000ms expired before successfully committing offsets {health-0=OffsetAndMetadata{offset=37186, leaderEpoch=0, metadata=''}}: retrying 3 more times
[2025-10-14T02:41:53.000Z] [ERROR] [#tid_sid_unknown] [KafkaConsumerConnector] org.apache.kafka.common.errors.TimeoutException: Timeout of 60000ms expired before successfully committing offsets {completed0-0=OffsetAndMetadata{offset=6, leaderEpoch=0, metadata=''}}: retrying 3 more times
[2025-10-14T02:42:22.905Z] [INFO] [#tid_sid_unknown] [KafkaConsumerConnector] lag metric reporting failed for topic 'health': org.apache.kafka.common.errors.TimeoutException: Failed to get offsets by times in 30000ms
[2025-10-14T02:42:22.999Z] [INFO] [#tid_sid_unknown] [KafkaConsumerConnector] lag metric reporting failed for topic 'completed0': org.apache.kafka.common.errors.TimeoutException: Failed to get offsets by times in 30000ms
[2025-10-14T02:56:46.717Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit cacheInvalidation consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-14T02:56:46.814Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit activeack consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-14T02:56:47.430Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit ping consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-14T02:57:08.733Z] [ERROR] [#tid_cTsHt0n3iq7ZZGe8qHe3FE6Ihd771TNn] [ShardingContainerPoolBalancer] failed to schedule activation dbb1bdb7cc3d4aa7b1bdb7cc3d8aa74f, action 'whisk.system/invokerHealthTestAction0@0.0.1' (managed), ns 'whisk.system' - invokers to use: Map(Unhealthy -> 1)
[2025-10-14T02:57:08.734Z] [WARN] [#tid_cTsHt0n3iq7ZZGe8qHe3FE6Ihd771TNn] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:212:67]
[2025-10-14T02:57:08.734Z] [WARN] [#tid_cTsHt0n3iq7ZZGe8qHe3FE6Ihd771TNn] [ActionsApi] No invokers available [marker:controller_activation_error:212:67]
[2025-10-14T02:57:08.734Z] [ERROR] [#tid_cTsHt0n3iq7ZZGe8qHe3FE6Ihd771TNn] [ActionsApi] [POST] failed in loadbalancer: No invokers available
[2025-10-14T03:00:17.008Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit cacheInvalidation consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-14T03:00:20.357Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit activeack consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-14T03:00:20.757Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit ping consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-14T03:00:36.199Z] [ERROR] [#tid_AuJDmHZ4EFSNkmsDFsojXEpckTvBLJYM] [ShardingContainerPoolBalancer] failed to schedule activation 5d1428217a634d709428217a632d7047, action 'whisk.system/invokerHealthTestAction0@0.0.1' (managed), ns 'whisk.system' - invokers to use: Map()
[2025-10-14T03:00:36.200Z] [WARN] [#tid_AuJDmHZ4EFSNkmsDFsojXEpckTvBLJYM] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:205:86]
[2025-10-14T03:00:36.200Z] [WARN] [#tid_AuJDmHZ4EFSNkmsDFsojXEpckTvBLJYM] [ActionsApi] No invokers available [marker:controller_activation_error:205:86]
[2025-10-14T03:00:36.200Z] [ERROR] [#tid_AuJDmHZ4EFSNkmsDFsojXEpckTvBLJYM] [ActionsApi] [POST] failed in loadbalancer: No invokers available
[2025-10-14T03:39:38.981Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit cacheInvalidation consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-14T03:39:40.824Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit activeack consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-14T03:39:41.127Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit ping consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-14T03:40:02.138Z] [ERROR] [#tid_amZBrip4bOoGFAiNSuXsCQoz345z3wNi] [ShardingContainerPoolBalancer] failed to schedule activation ab774711269e4415b74711269ed415a8, action 'whisk.system/invokerHealthTestAction0@0.0.1' (managed), ns 'whisk.system' - invokers to use: Map(Unhealthy -> 1)
[2025-10-14T03:40:02.138Z] [WARN] [#tid_amZBrip4bOoGFAiNSuXsCQoz345z3wNi] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:215:63]
[2025-10-14T03:40:02.139Z] [WARN] [#tid_amZBrip4bOoGFAiNSuXsCQoz345z3wNi] [ActionsApi] No invokers available [marker:controller_activation_error:215:64]
[2025-10-14T03:40:02.139Z] [ERROR] [#tid_amZBrip4bOoGFAiNSuXsCQoz345z3wNi] [ActionsApi] [POST] failed in loadbalancer: No invokers available
[2025-10-14T03:40:54.035Z] [ERROR] [#tid_sid_invokerHealth] [KafkaProducerConnector] sending message on topic 'invoker0' failed: Topic invoker0 not present in metadata after 60000 ms.
[2025-10-14T03:40:54.049Z] [ERROR] [#tid_sid_invokerHealth] [KafkaProducerConnector] sending message on topic 'invoker0' failed: Cannot perform operation after producer has been closed
[2025-10-14T03:40:54.112Z] [WARN] [#tid_sid_invokerHealth] [ShardingContainerPoolBalancer] error on posting to topic invoker0 [marker:controller_kafka_error:61719:63]
[2025-10-14T03:40:54.113Z] [WARN] [#tid_sid_invokerHealth] [ShardingContainerPoolBalancer] error on posting to topic invoker0 [marker:controller_kafka_error:61721:60080]
[2025-10-14T03:40:54.113Z] [WARN] unhandled event Failure(org.apache.kafka.common.errors.TimeoutException: Topic invoker0 not present in metadata after 60000 ms.) in state Unhealthy
[2025-10-15T03:00:42.155Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit ping consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-15T03:00:42.658Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit cacheInvalidation consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-15T03:00:42.759Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit activeack consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-15T03:01:02.873Z] [ERROR] [#tid_I10PxYArc69pZMc7ObLKHmLoiWnzkUDQ] [ShardingContainerPoolBalancer] failed to schedule activation 4cd5d972e77d4f0b95d972e77d7f0bd8, action 'whisk.system/invokerHealthTestAction0@0.0.1' (managed), ns 'whisk.system' - invokers to use: Map()
[2025-10-15T03:01:02.873Z] [WARN] [#tid_I10PxYArc69pZMc7ObLKHmLoiWnzkUDQ] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:175:74]
[2025-10-15T03:01:02.873Z] [WARN] [#tid_I10PxYArc69pZMc7ObLKHmLoiWnzkUDQ] [ActionsApi] No invokers available [marker:controller_activation_error:175:74]
[2025-10-15T03:01:02.874Z] [ERROR] [#tid_I10PxYArc69pZMc7ObLKHmLoiWnzkUDQ] [ActionsApi] [POST] failed in loadbalancer: No invokers available
[2025-10-15T14:04:00.484Z] [ERROR] [#tid_y2HCC8CR5pMRIBvCOU4mGDdeuXnW1M6s] [ShardingContainerPoolBalancer] failed to schedule activation 677d63634a364e63bd63634a363e63a9, action 'whisk.system/invokerHealthTestAction0@0.0.1' (managed), ns 'whisk.system' - invokers to use: Map()
[2025-10-15T14:04:00.485Z] [WARN] [#tid_y2HCC8CR5pMRIBvCOU4mGDdeuXnW1M6s] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:214:80]
[2025-10-15T14:04:00.485Z] [WARN] [#tid_y2HCC8CR5pMRIBvCOU4mGDdeuXnW1M6s] [ActionsApi] No invokers available [marker:controller_activation_error:215:81]
[2025-10-15T14:04:00.485Z] [ERROR] [#tid_y2HCC8CR5pMRIBvCOU4mGDdeuXnW1M6s] [ActionsApi] [POST] failed in loadbalancer: No invokers available
[2025-10-15T14:08:22.459Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit cacheInvalidation consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-15T14:08:22.459Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit activeack consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-15T14:08:22.662Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit ping consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-15T14:08:40.359Z] [ERROR] [#tid_hQF6mZnlZ22X0yRV8QaMuIvVBlF8zCVJ] [ShardingContainerPoolBalancer] failed to schedule activation ef2be4b1891742ababe4b1891712ab48, action 'whisk.system/invokerHealthTestAction0@0.0.1' (managed), ns 'whisk.system' - invokers to use: Map()
[2025-10-15T14:08:40.359Z] [WARN] [#tid_hQF6mZnlZ22X0yRV8QaMuIvVBlF8zCVJ] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:201:66]
[2025-10-15T14:08:40.359Z] [WARN] [#tid_hQF6mZnlZ22X0yRV8QaMuIvVBlF8zCVJ] [ActionsApi] No invokers available [marker:controller_activation_error:201:66]
[2025-10-15T14:08:40.360Z] [ERROR] [#tid_hQF6mZnlZ22X0yRV8QaMuIvVBlF8zCVJ] [ActionsApi] [POST] failed in loadbalancer: No invokers available
[2025-10-15T14:40:42.855Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit activeack consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-15T14:40:42.856Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit cacheInvalidation consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-15T14:40:43.059Z] [ERROR] [#tid_sid_dispatcher] [MessageFeed] failed to commit ping consumer offset: org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
[2025-10-15T14:41:03.892Z] [ERROR] [#tid_xKt7trpnJKaLTtJgWchLNXKM6Gjr8mZJ] [ShardingContainerPoolBalancer] failed to schedule activation 392a6e72795a4d7faa6e72795a4d7f9e, action 'whisk.system/invokerHealthTestAction0@0.0.1' (managed), ns 'whisk.system' - invokers to use: Map(Unhealthy -> 1)
[2025-10-15T14:41:03.893Z] [WARN] [#tid_xKt7trpnJKaLTtJgWchLNXKM6Gjr8mZJ] [ActionsApi] No invokers available [marker:controller_loadbalancer_error:190:62]
[2025-10-15T14:41:03.893Z] [WARN] [#tid_xKt7trpnJKaLTtJgWchLNXKM6Gjr8mZJ] [ActionsApi] No invokers available [marker:controller_activation_error:190:62]
[2025-10-15T14:41:03.893Z] [ERROR] [#tid_xKt7trpnJKaLTtJgWchLNXKM6Gjr8mZJ] [ActionsApi] [POST] failed in loadbalancer: No invokers available
bash-5.1#

Zhi Xing Guo Cheng Zhong De Bao Cuo :
PLAY [controllers] ***********************************************************************************************************************************

TASK [Gathering Facts] *******************************************************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:47 +0800 (0:00:00.037) 0:00:47.268 ****************
ok: [controller0]

TASK [controller : docker login] *********************************************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:47 +0800 (0:00:00.784) 0:00:48.052 ****************
skipping: [controller0]

TASK [controller : get controller name and index] ****************************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:48 +0800 (0:00:00.013) 0:00:48.065 ****************
ok: [controller0]

TASK [controller : pull the latest image of controller] **********************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:48 +0800 (0:00:00.018) 0:00:48.084 ****************
skipping: [controller0]

TASK [controller : ensure controller log directory is created with permissions] **********************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:48 +0800 (0:00:00.010) 0:00:48.095 ****************
ok: [controller0]

TASK [controller : ensure controller log file is created with permissions] ***************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:48 +0800 (0:00:00.105) 0:00:48.200 ****************
skipping: [controller0]

TASK [controller : ensure controller config directory is created with permissions] *******************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:48 +0800 (0:00:00.019) 0:00:48.219 ****************
ok: [controller0]

TASK [controller : copy jmxremote password file] *****************************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:48 +0800 (0:00:00.171) 0:00:48.391 ****************
changed: [controller0]

TASK [controller : copy jmxremote access file] *******************************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:48 +0800 (0:00:00.295) 0:00:48.687 ****************
changed: [controller0]

TASK [controller : copy kafka truststore/keystore] ***************************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:48 +0800 (0:00:00.189) 0:00:48.876 ****************
skipping: [controller0]

TASK [controller : copy nginx certificate keystore] **************************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:48 +0800 (0:00:00.014) 0:00:48.890 ****************
changed: [controller0]

TASK [controller : copy certificates] ****************************************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:49 +0800 (0:00:00.337) 0:00:49.227 ****************
changed: [controller0] => (item=controller-openwhisk-server-cert.pem)
changed: [controller0] => (item=controller-openwhisk-server-key.pem)

TASK [controller : check, that required databases exist] *********************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:49 +0800 (0:00:00.637) 0:00:49.865 ****************
included: /home/djc/Desktop/InstaInfer-SoCC24/ansible/tasks/db/checkDb .yml for controller0 => (item=whisk_local_whisks)
included: /home/djc/Desktop/InstaInfer-SoCC24/ansible/tasks/db/checkDb .yml for controller0 => (item=whisk_local_subjects)
included: /home/djc/Desktop/InstaInfer-SoCC24/ansible/tasks/db/checkDb .yml for controller0 => (item=whisk_local_activations)

TASK [controller : check if whisk_local_whisks with CouchDB exists] **********************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:49 +0800 (0:00:00.112) 0:00:49.977 ****************
[WARNING]: Module did not set no_log for password
ok: [controller0]

TASK [controller : check if whisk_local_subjects with CouchDB exists] ********************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:50 +0800 (0:00:00.279) 0:00:50.257 ****************
ok: [controller0]

TASK [controller : check if whisk_local_activations with CouchDB exists] *****************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:50 +0800 (0:00:00.272) 0:00:50.529 ****************
ok: [controller0]

TASK [controller : prepare controller port] **********************************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:50 +0800 (0:00:00.261) 0:00:50.791 ****************
ok: [controller0]

TASK [controller : expose additional ports if jmxremote is enabled] **********************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:50 +0800 (0:00:00.057) 0:00:50.848 ****************
ok: [controller0]

TASK [controller : Load config from template] ********************************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:50 +0800 (0:00:00.040) 0:00:50.889 ****************
ok: [controller0]

TASK [controller : populate environment variables for controller] ************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:50 +0800 (0:00:00.021) 0:00:50.911 ****************
ok: [controller0]

TASK [controller : merge extra env variables] ********************************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:51 +0800 (0:00:00.580) 0:00:51.491 ****************
ok: [controller0]

TASK [controller : setup elasticsearch activation store env] *****************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:51 +0800 (0:00:00.034) 0:00:51.526 ****************
skipping: [controller0]

TASK [controller : merge elasticsearch activation store env] *****************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:51 +0800 (0:00:00.032) 0:00:51.558 ****************
skipping: [controller0]

TASK [controller : setup mongodb artifact store env] *************************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:51 +0800 (0:00:00.031) 0:00:51.589 ****************
skipping: [controller0]

TASK [controller : merge mongodb artifact store env] *************************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:51 +0800 (0:00:00.032) 0:00:51.622 ****************
skipping: [controller0]

TASK [controller : setup scheduler env] **************************************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:51 +0800 (0:00:00.032) 0:00:51.654 ****************
ok: [controller0]

TASK [controller : merge scheduler env] **************************************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:51 +0800 (0:00:00.066) 0:00:51.720 ****************
ok: [controller0]

TASK [controller : populate volumes for controller] **************************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:51 +0800 (0:00:00.019) 0:00:51.740 ****************
ok: [controller0]

TASK [controller : check if coverage collection is enabled] ******************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:51 +0800 (0:00:00.037) 0:00:51.778 ****************
skipping: [controller0]

TASK [controller : ensure controller coverage directory is created with permissions] *****************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:51 +0800 (0:00:00.012) 0:00:51.790 ****************
skipping: [controller0] => (item=controller)
skipping: [controller0] => (item=common)

TASK [controller : extend controller volume for coverage] ********************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:51 +0800 (0:00:00.020) 0:00:51.811 ****************
skipping: [controller0]

TASK [controller : include plugins] ******************************************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:51 +0800 (0:00:00.017) 0:00:51.828 ****************
included: /home/djc/Desktop/InstaInfer-SoCC24/ansible/roles/controller /tasks/join_akka_cluster.yml for controller0 => (item=join_akka_cluster)

TASK [controller : add akka port to ports_to_expose] *************************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:51 +0800 (0:00:00.026) 0:00:51.854 ****************
ok: [controller0]

TASK [controller : add seed nodes to controller environment] *****************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:51 +0800 (0:00:00.033) 0:00:51.888 ****************
ok: [controller0] => (item=[0, '172.17.0.1'])

TASK [controller : Add akka environment to controller environment] ***********************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:51 +0800 (0:00:00.057) 0:00:51.945 ****************
ok: [controller0]

TASK [controller : lean controller setup] ************************************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:51 +0800 (0:00:00.105) 0:00:52.051 ****************
skipping: [controller0]

TASK [controller : remove the controller from nginx's upstream configuration] ************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:52 +0800 (0:00:00.016) 0:00:52.068 ****************
skipping: [controller0] => (item=172.17.0.1)

TASK [controller : wait some time for controllers fire all existing triggers] ************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:52 +0800 (0:00:00.012) 0:00:52.081 ****************
skipping: [controller0]

TASK [controller : wait until controller0 executes all existing activations] *************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:52 +0800 (0:00:00.012) 0:00:52.093 ****************
skipping: [controller0]

TASK [controller : Disable controller0 before remove controller] *************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:52 +0800 (0:00:00.012) 0:00:52.105 ****************
skipping: [controller0]

TASK [controller : wait some time for controller to gracefully shutdown the consumer for activation ack] *********************************************
Xing Qi San 15 Shi Yue 2025 22:40:52 +0800 (0:00:00.011) 0:00:52.117 ****************
skipping: [controller0]

TASK [controller : (re)start controller] *************************************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:52 +0800 (0:00:00.014) 0:00:52.131 ****************
changed: [controller0]

TASK [controller : wait until the Controller in this host is up and running] *************************************************************************
Xing Qi San 15 Shi Yue 2025 22:40:52 +0800 (0:00:00.874) 0:00:53.005 ****************
FAILED - RETRYING: wait until the Controller in this host is up and running (12 retries left).
ok: [controller0]

TASK [controller : warm up activation path] **********************************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:41:03 +0800 (0:00:10.517) 0:01:03.523 ****************
fatal: [controller0]: FAILED! => {"access_control_allow_headers": "Authorization, Origin, X-Requested-With, Content-Type, Accept, User-Agent", "access_control_allow_methods": "GET, DELETE, POST, PUT, HEAD", "access_control_allow_origin": "*", "changed": false, "connection": "close", "content_length": "141", "content_type": "application/json", "date": "Wed, 15 Oct 2025 14:41:03 GMT", "elapsed": 0, "json": {"code": "xKt7trpnJKaLTtJgWchLNXKM6Gjr8mZJ", "error": "The server is currently unavailable (because it is overloaded or down for maintenance)."}, "msg": "Status code was 503 and not [200]: HTTP Error 503: Service Unavailable", "redirected": false, "server": "akka-http/10.2.4", "status": 503, "url": "https://789c46b1-71f6-4ed5-8c54-816aa4f8c502:abczO3xZCLrMN6v2BKK1dXYFpXlPkccOFqm12CdAsMgRU4VrNZ9lyGVCGuMDGIwP@172.17.0.1:10001/api/v1/namespaces/_/actions/invokerHealthTestAction0?blocking=false&result=false", "x_request_id": "xKt7trpnJKaLTtJgWchLNXKM6Gjr8mZJ"}
...ignoring

Status code was 503 and not [200]: HTTP Error 503: Service Unavailable

TASK [controller : wait for all invokers in controller0 to become up] ********************************************************************************
Xing Qi San 15 Shi Yue 2025 22:41:03 +0800 (0:00:00.449) 0:01:03.973 ****************
skipping: [controller0]

TASK [controller : Add the controller back to nginx's upstream configuration when there exist at least one healthy invoker] **************************
Xing Qi San 15 Shi Yue 2025 22:41:03 +0800 (0:00:00.021) 0:01:03.994 ****************
skipping: [controller0] => (item=172.17.0.1)

TASK [controller : get controller name] **************************************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:41:03 +0800 (0:00:00.017) 0:01:04.011 ****************
skipping: [controller0]

TASK [controller : remove controller] ****************************************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:41:03 +0800 (0:00:00.015) 0:01:04.027 ****************
skipping: [controller0]

TASK [controller : remove controller log directory] **************************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:41:03 +0800 (0:00:00.011) 0:01:04.039 ****************
skipping: [controller0]

TASK [controller : remove controller conf directory] *************************************************************************************************
Xing Qi San 15 Shi Yue 2025 22:41:03 +0800 (0:00:00.011) 0:01:04.050 ****************
skipping: [controller0]

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions