Log: /mnt/jenkins/workspace/cloud-pxc-operator_PR-2525/e2e-tests/logs/smart-update2-8-0.log Warning: version difference between client (1.36) and server (1.33) exceeds the supported minor version skew of +/-1 Warning: version difference between client (1.36) and server (1.33) exceeds the supported minor version skew of +/-1 No resources found No resources found No resources found error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces pxc-operator ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified namespace "pxc-operator" deleted waiting for namespace/pxc-operator to be deletedError from server (NotFound): namespaces "pxc-operator" not found ----------------------------------------------------------------------------------- create namespace pxc-operator ----------------------------------------------------------------------------------- namespace/pxc-operator created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2525-c81e47f0-4-cluster8" modified. ----------------------------------------------------------------------------------- start PXC operator ----------------------------------------------------------------------------------- customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterbackups.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterrestores.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusters.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusters.pxc.percona.com condition met E0806 04:09:46.791378 1291347 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/apis/apiextensions.k8s.io/v1/customresourcedefinitions?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dperconaxtradbclusters.pxc.percona.com&resourceVersion=1785989382349163000&timeoutSeconds=317&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterbackups.pxc.percona.com condition met E0806 04:09:50.651749 1291823 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/apis/apiextensions.k8s.io/v1/customresourcedefinitions?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dperconaxtradbclusterbackups.pxc.percona.com&resourceVersion=1785989387349334000&timeoutSeconds=409&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterrestores.pxc.percona.com condition met E0806 04:09:54.204768 1292330 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/apis/apiextensions.k8s.io/v1/customresourcedefinitions?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dperconaxtradbclusterrestores.pxc.percona.com&resourceVersion=1785989392349395000&timeoutSeconds=461&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" clusterrole.rbac.authorization.k8s.io/percona-xtradb-cluster-operator unchanged serviceaccount/percona-xtradb-cluster-operator created clusterrolebinding.rbac.authorization.k8s.io/service-account-percona-xtradb-cluster-operator unchanged deployment.apps/percona-xtradb-cluster-operator created service/percona-xtradb-cluster-operator created pod/percona-xtradb-cluster-operator-6699755d74-tpprb condition met E0806 04:10:24.391366 1296184 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/pxc-operator/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpercona-xtradb-cluster-operator-6699755d74-tpprb&resourceVersion=1785989424030963000&timeoutSeconds=303&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" pod/percona-xtradb-cluster-operator-6699755d74-tpprb condition met E0806 04:10:35.058341 1297675 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/pxc-operator/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpercona-xtradb-cluster-operator-6699755d74-tpprb&resourceVersion=1785989431438575000&timeoutSeconds=471&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/percona-xtradb-cluster-operator-6699755d74-tpprb to become Ready.Ok error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces smart-update2-10837 ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified Error from server (NotFound): namespaces "smart-update2-10837" not found waiting for namespace/smart-update2-10837 to be deletedError from server (NotFound): namespaces "smart-update2-10837" not found ----------------------------------------------------------------------------------- create namespace smart-update2-10837 ----------------------------------------------------------------------------------- namespace/smart-update2-10837 created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2525-c81e47f0-4-cluster8" modified. ----------------------------------------------------------------------------------- create secrets for cloud storages ----------------------------------------------------------------------------------- secret/minio-secret created secret/aws-s3-secret created secret/do-spaces-secret created secret/gcp-cs-secret created secret/azure-secret created ----------------------------------------------------------------------------------- install version service ----------------------------------------------------------------------------------- configmap/versions created deployment.apps/version-service created service/version-service created ----------------------------------------------------------------------------------- deploy cert manager ----------------------------------------------------------------------------------- namespace/cert-manager created namespace/cert-manager labeled namespace/cert-manager configured customresourcedefinition.apiextensions.k8s.io/challenges.acme.cert-manager.io created customresourcedefinition.apiextensions.k8s.io/orders.acme.cert-manager.io created customresourcedefinition.apiextensions.k8s.io/certificaterequests.cert-manager.io created customresourcedefinition.apiextensions.k8s.io/certificates.cert-manager.io created customresourcedefinition.apiextensions.k8s.io/clusterissuers.cert-manager.io created customresourcedefinition.apiextensions.k8s.io/issuers.cert-manager.io created serviceaccount/cert-manager-cainjector created serviceaccount/cert-manager created serviceaccount/cert-manager-webhook created clusterrole.rbac.authorization.k8s.io/cert-manager-cainjector created clusterrole.rbac.authorization.k8s.io/cert-manager-controller-issuers created clusterrole.rbac.authorization.k8s.io/cert-manager-controller-clusterissuers created clusterrole.rbac.authorization.k8s.io/cert-manager-controller-certificates created clusterrole.rbac.authorization.k8s.io/cert-manager-controller-orders created clusterrole.rbac.authorization.k8s.io/cert-manager-controller-challenges created clusterrole.rbac.authorization.k8s.io/cert-manager-controller-ingress-shim created clusterrole.rbac.authorization.k8s.io/cert-manager-cluster-view created clusterrole.rbac.authorization.k8s.io/cert-manager-view created clusterrole.rbac.authorization.k8s.io/cert-manager-edit created clusterrole.rbac.authorization.k8s.io/cert-manager-controller-approve:cert-manager-io created clusterrole.rbac.authorization.k8s.io/cert-manager-controller-certificatesigningrequests created clusterrole.rbac.authorization.k8s.io/cert-manager-webhook:subjectaccessreviews created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-cainjector created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-controller-issuers created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-controller-clusterissuers created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-controller-certificates created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-controller-orders created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-controller-challenges created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-controller-ingress-shim created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-controller-approve:cert-manager-io created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-controller-certificatesigningrequests created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-webhook:subjectaccessreviews created role.rbac.authorization.k8s.io/cert-manager-cainjector:leaderelection created role.rbac.authorization.k8s.io/cert-manager:leaderelection created role.rbac.authorization.k8s.io/cert-manager-tokenrequest created role.rbac.authorization.k8s.io/cert-manager-webhook:dynamic-serving created rolebinding.rbac.authorization.k8s.io/cert-manager-cainjector:leaderelection created rolebinding.rbac.authorization.k8s.io/cert-manager:leaderelection created rolebinding.rbac.authorization.k8s.io/cert-manager-tokenrequest created rolebinding.rbac.authorization.k8s.io/cert-manager-webhook:dynamic-serving created service/cert-manager-cainjector created service/cert-manager created service/cert-manager-webhook created deployment.apps/cert-manager-cainjector created deployment.apps/cert-manager created deployment.apps/cert-manager-webhook created mutatingwebhookconfiguration.admissionregistration.k8s.io/cert-manager-webhook created validatingwebhookconfiguration.admissionregistration.k8s.io/cert-manager-webhook created Warning: resource namespaces/cert-manager is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. deployment "cert-manager" successfully rolled out deployment "cert-manager-cainjector" successfully rolled out deployment "cert-manager-webhook" successfully rolled out [2026-08-06T04:12:30+0000] waiting for cert-manager webhook caBundle to be injected [2026-08-06T04:12:33+0000] probing cert-manager webhook Unable to use a TTY - input is not a terminal or the right kind of file customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusters.pxc.percona.com patched deployment.apps/percona-xtradb-cluster-operator env updated ----------------------------------------------------------------------------------- Starting telemetry testing ----------------------------------------------------------------------------------- deployment.apps/version-service-cr created service/version-service-cr created pod "version-service-559c4df55c-65wnf" deleted from smart-update2-10837 namespace ----------------------------------------------------------------------------------- Enable telemetry on operator level ----------------------------------------------------------------------------------- deployment.apps/percona-xtradb-cluster-operator configured pod/percona-xtradb-cluster-operator-67b44ffdc8-8w4cb condition met E0806 04:13:48.395784 1322226 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/pxc-operator/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpercona-xtradb-cluster-operator-67b44ffdc8-8w4cb&resourceVersion=1785989624767755000&timeoutSeconds=362&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/percona-xtradb-cluster-operator-67b44ffdc8-8w4cb to become Ready.Ok ----------------------------------------------------------------------------------- create PXC minimal cluster ----------------------------------------------------------------------------------- deployment.apps/pxc-client created secret/minimal-cluster created secret/some-name-ssl created secret/some-name-ssl-internal created perconaxtradbcluster.pxc.percona.com/minimal-cluster created ----------------------------------------------------------------------------------- check if Pod is started ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- Waiting for 1 running pods for minimal-cluster-pxc ----------------------------------------------------------------------------------- pod/minimal-cluster-pxc-0 condition met waiting for pod/minimal-cluster-pxc-0 to become Ready.Ok ----------------------------------------------------------------------------------- Waiting for 1 running pods for minimal-cluster-haproxy ----------------------------------------------------------------------------------- pod/minimal-cluster-haproxy-0 condition met E0806 04:16:18.832573 1341550 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dminimal-cluster-haproxy-0&resourceVersion=1785989774050275000&timeoutSeconds=527&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/minimal-cluster-haproxy-0 to become Ready.Ok ----------------------------------------------------------------------------------- write data ----------------------------------------------------------------------------------- pod/pxc-client-67fc4995bb-g28gn condition met E0806 04:16:36.853947 1343844 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-g28gn&resourceVersion=1785989793587160000&timeoutSeconds=321&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-g28gn to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok [ERROR] mysql: option '-P' requires an argument. command terminated with exit code 5 pod/pxc-client-67fc4995bb-g28gn condition met E0806 04:16:53.666517 1345919 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-g28gn&resourceVersion=1785989810285036000&timeoutSeconds=434&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-g28gn to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok [ERROR] mysql: option '-P' requires an argument. command terminated with exit code 5 ----------------------------------------------------------------------------------- telemetry was disabled in CR but in operator not ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- operator fallback VS should have telemetry ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- CR VS should not have telemetry ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- telemetry was disabled in operator but not in CR ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- telemetry was disabled in CR as well as in operator ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/minimal-cluster patched pod "percona-xtradb-cluster-operator-67b44ffdc8-8w4cb" deleted from pxc-operator namespace perconaxtradbcluster.pxc.percona.com "minimal-cluster" deleted from smart-update2-10837 namespace deployment.apps "pxc-client" deleted from smart-update2-10837 namespace ----------------------------------------------------------------------------------- Disabling telemetry on the operator level ----------------------------------------------------------------------------------- pod "version-service-cr-76d4659869-8q82f" deleted from smart-update2-10837 namespace pod "version-service-559c4df55c-wjfbx" deleted from smart-update2-10837 namespace deployment.apps/percona-xtradb-cluster-operator configured pod/percona-xtradb-cluster-operator-d749d586c-g5jtb condition met E0806 04:19:09.696679 1362632 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/pxc-operator/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpercona-xtradb-cluster-operator-d749d586c-g5jtb&resourceVersion=1785989947659937000&timeoutSeconds=313&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/percona-xtradb-cluster-operator-d749d586c-g5jtb to become Ready.Ok ----------------------------------------------------------------------------------- create PXC minimal cluster ----------------------------------------------------------------------------------- deployment.apps/pxc-client created secret/minimal-cluster unchanged secret/some-name-ssl unchanged secret/some-name-ssl-internal unchanged perconaxtradbcluster.pxc.percona.com/minimal-cluster created ----------------------------------------------------------------------------------- check if Pod is started ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- Waiting for 1 running pods for minimal-cluster-pxc ----------------------------------------------------------------------------------- pod/minimal-cluster-pxc-0 condition met waiting for pod/minimal-cluster-pxc-0 to become Ready.Ok ----------------------------------------------------------------------------------- Waiting for 1 running pods for minimal-cluster-haproxy ----------------------------------------------------------------------------------- pod/minimal-cluster-haproxy-0 condition met E0806 04:21:30.276770 1380551 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dminimal-cluster-haproxy-0&resourceVersion=1785990086650204000&timeoutSeconds=598&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/minimal-cluster-haproxy-0 to become Ready.Ok ----------------------------------------------------------------------------------- write data ----------------------------------------------------------------------------------- pod/pxc-client-67fc4995bb-j6txg condition met E0806 04:21:46.009397 1382701 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-j6txg&resourceVersion=1785990103431301000&timeoutSeconds=491&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-j6txg to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok [ERROR] mysql: option '-P' requires an argument. command terminated with exit code 5 pod/pxc-client-67fc4995bb-j6txg condition met E0806 04:21:56.417441 1384058 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-j6txg&resourceVersion=1785990114101339000&timeoutSeconds=396&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-j6txg to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok [ERROR] mysql: option '-P' requires an argument. command terminated with exit code 5 ----------------------------------------------------------------------------------- telemetry was disabled in CR but in operator not ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- telemetry was disabled in operator but not in CR ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cr VS should have telemetry ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- operator VS should not have telemetry ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- telemetry was disabled in CR as well as in operator ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/minimal-cluster patched pod "percona-xtradb-cluster-operator-d749d586c-g5jtb" deleted from pxc-operator namespace perconaxtradbcluster.pxc.percona.com "minimal-cluster" deleted from smart-update2-10837 namespace deployment.apps "pxc-client" deleted from smart-update2-10837 namespace pod "version-service-cr-76d4659869-2v9vs" deleted from smart-update2-10837 namespace pod "version-service-559c4df55c-q2pcx" deleted from smart-update2-10837 namespace ----------------------------------------------------------------------------------- create PXC minimal cluster ----------------------------------------------------------------------------------- deployment.apps/pxc-client created secret/minimal-cluster unchanged secret/some-name-ssl unchanged secret/some-name-ssl-internal unchanged perconaxtradbcluster.pxc.percona.com/minimal-cluster created ----------------------------------------------------------------------------------- check if Pod is started ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- Waiting for 1 running pods for minimal-cluster-pxc ----------------------------------------------------------------------------------- pod/minimal-cluster-pxc-0 condition met waiting for pod/minimal-cluster-pxc-0 to become Ready.Ok ----------------------------------------------------------------------------------- Waiting for 1 running pods for minimal-cluster-haproxy ----------------------------------------------------------------------------------- pod/minimal-cluster-haproxy-0 condition met E0806 04:25:31.896188 1411909 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dminimal-cluster-haproxy-0&resourceVersion=1785990329210545000&timeoutSeconds=388&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/minimal-cluster-haproxy-0 to become Ready.Ok ----------------------------------------------------------------------------------- write data ----------------------------------------------------------------------------------- pod/pxc-client-67fc4995bb-n7sms condition met E0806 04:25:44.090657 1413674 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-n7sms&resourceVersion=1785990342965338000&timeoutSeconds=319&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-n7sms to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok [ERROR] mysql: option '-P' requires an argument. command terminated with exit code 5 pod/pxc-client-67fc4995bb-n7sms condition met E0806 04:25:58.963569 1415422 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-n7sms&resourceVersion=1785990355873245000&timeoutSeconds=423&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-n7sms to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok [ERROR] mysql: option '-P' requires an argument. command terminated with exit code 5 ----------------------------------------------------------------------------------- telemetry was disabled in CR but in operator not ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- telemetry was disabled in operator but not in CR ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- telemetry was disabled in CR as well as in operator ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- CR VS should not have telemetry ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- operator VS should not have telemetry ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/minimal-cluster patched pod "percona-xtradb-cluster-operator-d749d586c-92cnt" deleted from pxc-operator namespace perconaxtradbcluster.pxc.percona.com "minimal-cluster" deleted from smart-update2-10837 namespace deployment.apps "pxc-client" deleted from smart-update2-10837 namespace deployment.apps "version-service-cr" deleted from smart-update2-10837 namespace ----------------------------------------------------------------------------------- Telemetry testing finished ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- PXC cluster with version service offline ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- create first PXC cluster ----------------------------------------------------------------------------------- secret/my-cluster-secrets created secret/some-name-ssl unchanged secret/some-name-ssl-internal unchanged deployment.apps/pxc-client created perconaxtradbcluster.pxc.percona.com/smart-update created ----------------------------------------------------------------------------------- waiting pods to be running for smart-update ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- Waiting for 3 running pods for smart-update-pxc ----------------------------------------------------------------------------------- Error from server (NotFound): pods "smart-update-pxc-0" not found waiting for pod/smart-update-pxc-0 to become Ready...............................Ok pod/smart-update-pxc-1 condition met waiting for pod/smart-update-pxc-1 to become Ready.Ok error: timed out waiting for the condition on pods/smart-update-pxc-2 waiting for pod/smart-update-pxc-2 to become Ready...........Ok ----------------------------------------------------------------------------------- Waiting for 2 running pods for smart-update-haproxy ----------------------------------------------------------------------------------- pod/smart-update-haproxy-0 condition met E0806 04:39:04.040231 1517092 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dsmart-update-haproxy-0&resourceVersion=1785991142185016000&timeoutSeconds=402&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/smart-update-haproxy-0 to become Ready.Ok pod/smart-update-haproxy-1 condition met E0806 04:39:11.849067 1518161 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dsmart-update-haproxy-1&resourceVersion=1785991147185332000&timeoutSeconds=544&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/smart-update-haproxy-1 to become Ready.Ok ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/smart-update to be ready ----------------------------------------------------------------------------------- write data ----------------------------------------------------------------------------------- pod/pxc-client-6666d5df5c-g75h2 condition met E0806 04:39:49.665356 1523343 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6666d5df5c-g75h2&resourceVersion=1785991187345411000&timeoutSeconds=404&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6666d5df5c-g75h2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-6666d5df5c-g75h2 condition met E0806 04:40:05.651439 1525455 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6666d5df5c-g75h2&resourceVersion=1785991202947538000&timeoutSeconds=339&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6666d5df5c-g75h2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- compare initial data ----------------------------------------------------------------------------------- pod/pxc-client-6666d5df5c-g75h2 condition met E0806 04:41:02.074419 1532737 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6666d5df5c-g75h2&resourceVersion=1785991258226837000&timeoutSeconds=499&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6666d5df5c-g75h2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-6666d5df5c-g75h2 condition met E0806 04:41:17.393097 1534804 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6666d5df5c-g75h2&resourceVersion=1785991273724654000&timeoutSeconds=385&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6666d5df5c-g75h2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-6666d5df5c-g75h2 condition met E0806 04:41:34.477757 1537003 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6666d5df5c-g75h2&resourceVersion=1785991291223865000&timeoutSeconds=531&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6666d5df5c-g75h2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/smart-update to be ready ----------------------------------------------------------------------------------- PXC cluster update with recommended image by version service ----------------------------------------------------------------------------------- pod/pxc-client-6666d5df5c-g75h2 condition met E0806 04:42:16.296972 1542599 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6666d5df5c-g75h2&resourceVersion=1785991333695648000&timeoutSeconds=483&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6666d5df5c-g75h2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok perconaxtradbcluster.pxc.percona.com/smart-update patched Waiting for the last pod to update+ wait_cluster_consistency smart-update 3 2 + local cluster_name=smart-update + local pxc_size=3 + local proxy_size=2 + desc 'wait cluster consistency' + set +o xtrace ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/smart-update to be ready pod/pxc-client-6666d5df5c-g75h2 condition met E0806 04:43:44.503793 1554731 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6666d5df5c-g75h2&resourceVersion=1785991422623168000&timeoutSeconds=310&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6666d5df5c-g75h2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-6666d5df5c-g75h2 condition met E0806 04:43:56.059753 1556212 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6666d5df5c-g75h2&resourceVersion=1785991433546983000&timeoutSeconds=513&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6666d5df5c-g75h2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-6666d5df5c-g75h2 condition met E0806 04:44:06.543772 1557734 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6666d5df5c-g75h2&resourceVersion=1785991444691172000&timeoutSeconds=563&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6666d5df5c-g75h2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok perconaxtradbcluster.pxc.percona.com "smart-update" deleted from smart-update2-10837 namespace persistentvolumeclaim "datadir-smart-update-pxc-0" deleted from smart-update2-10837 namespace persistentvolumeclaim "datadir-smart-update-pxc-1" deleted from smart-update2-10837 namespace persistentvolumeclaim "datadir-smart-update-pxc-2" deleted from smart-update2-10837 namespace ----------------------------------------------------------------------------------- PXC cluster update with the latest image by version service ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- create first PXC cluster ----------------------------------------------------------------------------------- secret/my-cluster-secrets unchanged secret/some-name-ssl unchanged secret/some-name-ssl-internal unchanged deployment.apps/pxc-client unchanged perconaxtradbcluster.pxc.percona.com/smart-update created ----------------------------------------------------------------------------------- waiting pods to be running for smart-update ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- Waiting for 3 running pods for smart-update-pxc ----------------------------------------------------------------------------------- pod/smart-update-pxc-0 condition met waiting for pod/smart-update-pxc-0 to become Ready.Ok pod/smart-update-pxc-1 condition met waiting for pod/smart-update-pxc-1 to become Ready.Ok pod/smart-update-pxc-2 condition met waiting for pod/smart-update-pxc-2 to become Ready.Ok ----------------------------------------------------------------------------------- Waiting for 2 running pods for smart-update-haproxy ----------------------------------------------------------------------------------- pod/smart-update-haproxy-0 condition met E0806 04:49:30.267225 1600332 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dsmart-update-haproxy-0&resourceVersion=1785991768755093000&timeoutSeconds=554&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/smart-update-haproxy-0 to become Ready.Ok pod/smart-update-haproxy-1 condition met E0806 04:49:37.928906 1601419 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dsmart-update-haproxy-1&resourceVersion=1785991773755144000&timeoutSeconds=369&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/smart-update-haproxy-1 to become Ready.Ok ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/smart-update to be ready ----------------------------------------------------------------------------------- write data ----------------------------------------------------------------------------------- pod/pxc-client-6666d5df5c-g75h2 condition met E0806 04:50:24.853347 1607606 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6666d5df5c-g75h2&resourceVersion=1785991821833214000&timeoutSeconds=560&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6666d5df5c-g75h2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-6666d5df5c-g75h2 condition met E0806 04:50:51.348031 1610992 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6666d5df5c-g75h2&resourceVersion=1785991848109365000&timeoutSeconds=555&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6666d5df5c-g75h2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- compare initial data ----------------------------------------------------------------------------------- pod/pxc-client-6666d5df5c-g75h2 condition met E0806 04:51:42.770157 1617910 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6666d5df5c-g75h2&resourceVersion=1785991899700181000&timeoutSeconds=336&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6666d5df5c-g75h2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-6666d5df5c-g75h2 condition met E0806 04:51:55.559300 1619620 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6666d5df5c-g75h2&resourceVersion=1785991912761787000&timeoutSeconds=483&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6666d5df5c-g75h2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-6666d5df5c-g75h2 condition met E0806 04:52:05.870897 1621333 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6666d5df5c-g75h2&resourceVersion=1785991924886170000&timeoutSeconds=552&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6666d5df5c-g75h2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-6666d5df5c-g75h2 condition met E0806 04:52:21.653259 1623225 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6666d5df5c-g75h2&resourceVersion=1785991939618460000&timeoutSeconds=395&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6666d5df5c-g75h2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok perconaxtradbcluster.pxc.percona.com/smart-update patched Waiting for the last pod to update+ wait_cluster_consistency smart-update 3 2 + local cluster_name=smart-update + local pxc_size=3 + local proxy_size=2 + desc 'wait cluster consistency' + set +o xtrace ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/smart-update to be ready pod/pxc-client-6666d5df5c-g75h2 condition met E0806 04:53:45.835650 1633071 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6666d5df5c-g75h2&resourceVersion=1785992024421696000&timeoutSeconds=397&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6666d5df5c-g75h2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-6666d5df5c-g75h2 condition met E0806 04:53:55.726552 1634285 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6666d5df5c-g75h2&resourceVersion=1785992033182132000&timeoutSeconds=590&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6666d5df5c-g75h2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-6666d5df5c-g75h2 condition met E0806 04:54:03.972900 1635325 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6666d5df5c-g75h2&resourceVersion=1785992041477054000&timeoutSeconds=540&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6666d5df5c-g75h2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok perconaxtradbcluster.pxc.percona.com "smart-update" deleted from smart-update2-10837 namespace persistentvolumeclaim "datadir-smart-update-pxc-0" deleted from smart-update2-10837 namespace persistentvolumeclaim "datadir-smart-update-pxc-1" deleted from smart-update2-10837 namespace persistentvolumeclaim "datadir-smart-update-pxc-2" deleted from smart-update2-10837 namespace ----------------------------------------------------------------------------------- PXC cluster update with explicitly specified image inside version service ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- create first PXC cluster ----------------------------------------------------------------------------------- secret/my-cluster-secrets unchanged secret/some-name-ssl unchanged secret/some-name-ssl-internal unchanged deployment.apps/pxc-client unchanged perconaxtradbcluster.pxc.percona.com/smart-update created ----------------------------------------------------------------------------------- waiting pods to be running for smart-update ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- Waiting for 3 running pods for smart-update-pxc ----------------------------------------------------------------------------------- pod/smart-update-pxc-0 condition met waiting for pod/smart-update-pxc-0 to become Ready.Ok pod/smart-update-pxc-1 condition met waiting for pod/smart-update-pxc-1 to become Ready.Ok pod/smart-update-pxc-2 condition met waiting for pod/smart-update-pxc-2 to become Ready.Ok ----------------------------------------------------------------------------------- Waiting for 2 running pods for smart-update-haproxy ----------------------------------------------------------------------------------- pod/smart-update-haproxy-0 condition met E0806 04:59:17.596440 1669567 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dsmart-update-haproxy-0&resourceVersion=1785992354900040000&timeoutSeconds=572&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/smart-update-haproxy-0 to become Ready.Ok pod/smart-update-haproxy-1 condition met E0806 04:59:27.164188 1670808 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dsmart-update-haproxy-1&resourceVersion=1785992364901180000&timeoutSeconds=356&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/smart-update-haproxy-1 to become Ready.Ok ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/smart-update to be ready ----------------------------------------------------------------------------------- write data ----------------------------------------------------------------------------------- pod/pxc-client-6666d5df5c-g75h2 condition met E0806 05:00:07.261908 1675961 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6666d5df5c-g75h2&resourceVersion=1785992404999431000&timeoutSeconds=351&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6666d5df5c-g75h2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-6666d5df5c-g75h2 condition met E0806 05:00:38.569083 1679802 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6666d5df5c-g75h2&resourceVersion=1785992434128442000&timeoutSeconds=479&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6666d5df5c-g75h2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- compare initial data ----------------------------------------------------------------------------------- pod/pxc-client-6666d5df5c-g75h2 condition met E0806 05:01:31.028990 1686763 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6666d5df5c-g75h2&resourceVersion=1785992488456529000&timeoutSeconds=549&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6666d5df5c-g75h2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-6666d5df5c-g75h2 condition met E0806 05:01:46.476893 1688600 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6666d5df5c-g75h2&resourceVersion=1785992502917195000&timeoutSeconds=594&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6666d5df5c-g75h2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-6666d5df5c-g75h2 condition met E0806 05:02:02.843172 1690778 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6666d5df5c-g75h2&resourceVersion=1785992519828587000&timeoutSeconds=533&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6666d5df5c-g75h2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok Unable to use a TTY - input is not a terminal or the right kind of file pod/pxc-client-6666d5df5c-g75h2 condition met E0806 05:02:26.532387 1693926 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6666d5df5c-g75h2&resourceVersion=1785992544105540000&timeoutSeconds=306&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6666d5df5c-g75h2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok perconaxtradbcluster.pxc.percona.com/smart-update patched Waiting for the last pod to update+ wait_cluster_consistency smart-update 3 2 + local cluster_name=smart-update + local pxc_size=3 + local proxy_size=2 + desc 'wait cluster consistency' + set +o xtrace ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/smart-update to be ready pod/pxc-client-6666d5df5c-g75h2 condition met E0806 05:03:53.234501 1705129 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6666d5df5c-g75h2&resourceVersion=1785992632230103000&timeoutSeconds=388&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6666d5df5c-g75h2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-6666d5df5c-g75h2 condition met E0806 05:04:04.044418 1706368 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6666d5df5c-g75h2&resourceVersion=1785992641765447000&timeoutSeconds=382&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6666d5df5c-g75h2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-6666d5df5c-g75h2 condition met E0806 05:04:16.208879 1708064 reflector.go:227] "Failed to watch" err="Get \"https://136.64.130.253/api/v1/namespaces/smart-update2-10837/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6666d5df5c-g75h2&resourceVersion=1785992654228820000&timeoutSeconds=462&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6666d5df5c-g75h2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok perconaxtradbcluster.pxc.percona.com "smart-update" deleted from smart-update2-10837 namespace persistentvolumeclaim "datadir-smart-update-pxc-0" deleted from smart-update2-10837 namespace persistentvolumeclaim "datadir-smart-update-pxc-1" deleted from smart-update2-10837 namespace persistentvolumeclaim "datadir-smart-update-pxc-2" deleted from smart-update2-10837 namespace ----------------------------------------------------------------------------------- cleanup ----------------------------------------------------------------------------------- deployment.apps "version-service" deleted from smart-update2-10837 namespace service "version-service" deleted from smart-update2-10837 namespace ----------------------------------------------------------------------------------- destroy cluster/operator and all other resources ----------------------------------------------------------------------------------- No resources found validatingwebhookconfiguration.admissionregistration.k8s.io "percona-xtradbcluster-webhook" deleted namespace "cert-manager" deleted customresourcedefinition.apiextensions.k8s.io "challenges.acme.cert-manager.io" deleted customresourcedefinition.apiextensions.k8s.io "orders.acme.cert-manager.io" deleted customresourcedefinition.apiextensions.k8s.io "certificaterequests.cert-manager.io" deleted customresourcedefinition.apiextensions.k8s.io "certificates.cert-manager.io" deleted customresourcedefinition.apiextensions.k8s.io "clusterissuers.cert-manager.io" deleted customresourcedefinition.apiextensions.k8s.io "issuers.cert-manager.io" deleted serviceaccount "cert-manager-cainjector" deleted from cert-manager namespace serviceaccount "cert-manager" deleted from cert-manager namespace serviceaccount "cert-manager-webhook" deleted from cert-manager namespace clusterrole.rbac.authorization.k8s.io "cert-manager-cainjector" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-issuers" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-clusterissuers" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-certificates" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-orders" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-challenges" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-ingress-shim" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-cluster-view" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-view" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-edit" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-approve:cert-manager-io" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-certificatesigningrequests" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-webhook:subjectaccessreviews" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-cainjector" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-issuers" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-clusterissuers" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-certificates" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-orders" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-challenges" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-ingress-shim" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-approve:cert-manager-io" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-certificatesigningrequests" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-webhook:subjectaccessreviews" deleted role.rbac.authorization.k8s.io "cert-manager-cainjector:leaderelection" deleted from kube-system namespace role.rbac.authorization.k8s.io "cert-manager:leaderelection" deleted from kube-system namespace role.rbac.authorization.k8s.io "cert-manager-tokenrequest" deleted from cert-manager namespace role.rbac.authorization.k8s.io "cert-manager-webhook:dynamic-serving" deleted from cert-manager namespace rolebinding.rbac.authorization.k8s.io "cert-manager-cainjector:leaderelection" deleted from kube-system namespace rolebinding.rbac.authorization.k8s.io "cert-manager:leaderelection" deleted from kube-system namespace rolebinding.rbac.authorization.k8s.io "cert-manager-tokenrequest" deleted from cert-manager namespace rolebinding.rbac.authorization.k8s.io "cert-manager-webhook:dynamic-serving" deleted from cert-manager namespace service "cert-manager-cainjector" deleted from cert-manager namespace service "cert-manager" deleted from cert-manager namespace service "cert-manager-webhook" deleted from cert-manager namespace deployment.apps "cert-manager-cainjector" deleted from cert-manager namespace deployment.apps "cert-manager" deleted from cert-manager namespace deployment.apps "cert-manager-webhook" deleted from cert-manager namespace mutatingwebhookconfiguration.admissionregistration.k8s.io "cert-manager-webhook" deleted validatingwebhookconfiguration.admissionregistration.k8s.io "cert-manager-webhook" deleted namespace "pxc-operator" force deleted Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. namespace "smart-update2-10837" force deleted Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. ----------------------------------------------------------------------------------- test passed -----------------------------------------------------------------------------------