Log: /mnt/jenkins/workspace/cloud-pxc-operator_PR-2521/e2e-tests/logs/upgrade-proxysql-5-7.log Warning: version difference between client (1.36) and server (1.33) exceeds the supported minor version skew of +/-1 Warning: version difference between client (1.36) and server (1.33) exceeds the supported minor version skew of +/-1 ----------------------------------------------------------------------------------- deploy cert manager ----------------------------------------------------------------------------------- namespace/cert-manager created namespace/cert-manager labeled namespace/cert-manager configured customresourcedefinition.apiextensions.k8s.io/challenges.acme.cert-manager.io created customresourcedefinition.apiextensions.k8s.io/orders.acme.cert-manager.io created customresourcedefinition.apiextensions.k8s.io/certificaterequests.cert-manager.io created customresourcedefinition.apiextensions.k8s.io/certificates.cert-manager.io created customresourcedefinition.apiextensions.k8s.io/clusterissuers.cert-manager.io created customresourcedefinition.apiextensions.k8s.io/issuers.cert-manager.io created serviceaccount/cert-manager-cainjector created serviceaccount/cert-manager created serviceaccount/cert-manager-webhook created clusterrole.rbac.authorization.k8s.io/cert-manager-cainjector created clusterrole.rbac.authorization.k8s.io/cert-manager-controller-issuers created clusterrole.rbac.authorization.k8s.io/cert-manager-controller-clusterissuers created clusterrole.rbac.authorization.k8s.io/cert-manager-controller-certificates created clusterrole.rbac.authorization.k8s.io/cert-manager-controller-orders created clusterrole.rbac.authorization.k8s.io/cert-manager-controller-challenges created clusterrole.rbac.authorization.k8s.io/cert-manager-controller-ingress-shim created clusterrole.rbac.authorization.k8s.io/cert-manager-cluster-view created clusterrole.rbac.authorization.k8s.io/cert-manager-view created clusterrole.rbac.authorization.k8s.io/cert-manager-edit created clusterrole.rbac.authorization.k8s.io/cert-manager-controller-approve:cert-manager-io created clusterrole.rbac.authorization.k8s.io/cert-manager-controller-certificatesigningrequests created clusterrole.rbac.authorization.k8s.io/cert-manager-webhook:subjectaccessreviews created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-cainjector created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-controller-issuers created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-controller-clusterissuers created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-controller-certificates created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-controller-orders created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-controller-challenges created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-controller-ingress-shim created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-controller-approve:cert-manager-io created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-controller-certificatesigningrequests created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-webhook:subjectaccessreviews created role.rbac.authorization.k8s.io/cert-manager-cainjector:leaderelection created role.rbac.authorization.k8s.io/cert-manager:leaderelection created role.rbac.authorization.k8s.io/cert-manager-tokenrequest created role.rbac.authorization.k8s.io/cert-manager-webhook:dynamic-serving created rolebinding.rbac.authorization.k8s.io/cert-manager-cainjector:leaderelection created rolebinding.rbac.authorization.k8s.io/cert-manager:leaderelection created rolebinding.rbac.authorization.k8s.io/cert-manager-tokenrequest created rolebinding.rbac.authorization.k8s.io/cert-manager-webhook:dynamic-serving created service/cert-manager-cainjector created service/cert-manager created service/cert-manager-webhook created deployment.apps/cert-manager-cainjector created deployment.apps/cert-manager created deployment.apps/cert-manager-webhook created mutatingwebhookconfiguration.admissionregistration.k8s.io/cert-manager-webhook created validatingwebhookconfiguration.admissionregistration.k8s.io/cert-manager-webhook created Warning: resource namespaces/cert-manager is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. deployment "cert-manager" successfully rolled out deployment "cert-manager-cainjector" successfully rolled out deployment "cert-manager-webhook" successfully rolled out [2026-06-11T04:33:08+0000] waiting for cert-manager webhook caBundle to be injected [2026-06-11T04:33:11+0000] probing cert-manager webhook error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces pxc-operator ----------------------------------------------------------------------------------- namespace "cert-manager" deleted namespace "pxc-operator" deleted waiting for namespace/pxc-operator to be deletedError from server (NotFound): namespaces "pxc-operator" not found ----------------------------------------------------------------------------------- create namespace pxc-operator ----------------------------------------------------------------------------------- namespace/pxc-operator created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2521-bb594380-1-cluster8" modified. ----------------------------------------------------------------------------------- start PXC operator ----------------------------------------------------------------------------------- clusterrole.rbac.authorization.k8s.io/percona-xtradb-cluster-operator unchanged serviceaccount/percona-xtradb-cluster-operator created clusterrolebinding.rbac.authorization.k8s.io/service-account-percona-xtradb-cluster-operator unchanged deployment.apps/percona-xtradb-cluster-operator created service/percona-xtradb-cluster-operator created pod/percona-xtradb-cluster-operator-774b5698c6-96pln condition met E0611 04:34:35.616377 5271 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/pxc-operator/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpercona-xtradb-cluster-operator-774b5698c6-96pln&resourceVersion=1781152472046600000&timeoutSeconds=302&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/percona-xtradb-cluster-operator-774b5698c6-96pln to become Ready.Ok error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces upgrade-proxysql-3770 ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified Error from server (NotFound): namespaces "upgrade-proxysql-3770" not found waiting for namespace/upgrade-proxysql-3770 to be deletedError from server (NotFound): namespaces "upgrade-proxysql-3770" not found ----------------------------------------------------------------------------------- create namespace upgrade-proxysql-3770 ----------------------------------------------------------------------------------- namespace/upgrade-proxysql-3770 created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2521-bb594380-1-cluster8" modified. ----------------------------------------------------------------------------------- create secrets for cloud storages ----------------------------------------------------------------------------------- secret/minio-secret created secret/aws-s3-secret created secret/do-spaces-secret created secret/gcp-cs-secret created secret/azure-secret created ----------------------------------------------------------------------------------- create first PXC cluster ----------------------------------------------------------------------------------- secret/my-cluster-secrets created deployment.apps/pxc-client created perconaxtradbcluster.pxc.percona.com/upgrade-proxysql created ----------------------------------------------------------------------------------- waiting pods to be running for upgrade-proxysql ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- Waiting for 3 running pods for upgrade-proxysql-pxc ----------------------------------------------------------------------------------- pod/upgrade-proxysql-pxc-0 condition met waiting for pod/upgrade-proxysql-pxc-0 to become Ready.Ok pod/upgrade-proxysql-pxc-1 condition met waiting for pod/upgrade-proxysql-pxc-1 to become Ready.Ok pod/upgrade-proxysql-pxc-2 condition met waiting for pod/upgrade-proxysql-pxc-2 to become Ready.Ok ----------------------------------------------------------------------------------- Waiting for 3 running pods for upgrade-proxysql-proxysql ----------------------------------------------------------------------------------- pod/upgrade-proxysql-proxysql-0 condition met E0611 04:39:47.286443 21056 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/upgrade-proxysql-3770/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dupgrade-proxysql-proxysql-0&resourceVersion=1781152783560179000&timeoutSeconds=592&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/upgrade-proxysql-proxysql-0 to become Ready.Ok pod/upgrade-proxysql-proxysql-1 condition met E0611 04:39:57.555407 22813 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/upgrade-proxysql-3770/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dupgrade-proxysql-proxysql-1&resourceVersion=1781152793560253000&timeoutSeconds=420&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/upgrade-proxysql-proxysql-1 to become Ready.Ok pod/upgrade-proxysql-proxysql-2 condition met E0611 04:40:07.602568 24315 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/upgrade-proxysql-3770/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dupgrade-proxysql-proxysql-2&resourceVersion=1781152803563005000&timeoutSeconds=529&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/upgrade-proxysql-proxysql-2 to become Ready.Ok ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/upgrade-proxysql to be ready ----------------------------------------------------------------------------------- write data ----------------------------------------------------------------------------------- pod/pxc-client-6c975684f9-n2dt4 condition met E0611 04:41:19.010984 2818 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/upgrade-proxysql-3770/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6c975684f9-n2dt4&resourceVersion=1781152876521218000&timeoutSeconds=310&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6c975684f9-n2dt4 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-6c975684f9-n2dt4 condition met E0611 04:41:43.532435 6687 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/upgrade-proxysql-3770/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6c975684f9-n2dt4&resourceVersion=1781152901765395000&timeoutSeconds=573&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6c975684f9-n2dt4 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- compare initial data ----------------------------------------------------------------------------------- pod/pxc-client-6c975684f9-n2dt4 condition met E0611 04:42:36.928421 14673 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/upgrade-proxysql-3770/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6c975684f9-n2dt4&resourceVersion=1781152953463273000&timeoutSeconds=462&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6c975684f9-n2dt4 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-6c975684f9-n2dt4 condition met E0611 04:42:51.184945 16954 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/upgrade-proxysql-3770/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6c975684f9-n2dt4&resourceVersion=1781152968370282000&timeoutSeconds=353&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6c975684f9-n2dt4 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-6c975684f9-n2dt4 condition met E0611 04:43:04.189295 18957 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/upgrade-proxysql-3770/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6c975684f9-n2dt4&resourceVersion=1781152981653510000&timeoutSeconds=334&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6c975684f9-n2dt4 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- upgrade operator ----------------------------------------------------------------------------------- customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterbackups.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterrestores.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusters.pxc.percona.com serverside-applied clusterrole.rbac.authorization.k8s.io/percona-xtradb-cluster-operator unchanged serviceaccount/percona-xtradb-cluster-operator created clusterrolebinding.rbac.authorization.k8s.io/service-account-percona-xtradb-cluster-operator unchanged deployment.apps/percona-xtradb-cluster-operator patched deployment "percona-xtradb-cluster-operator" successfully rolled out ----------------------------------------------------------------------------------- wait for operator upgrade ----------------------------------------------------------------------------------- Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2521-bb594380-1-cluster8" modified. pod/percona-xtradb-cluster-operator-57b4c7d59b-rjpn8 condition met E0611 04:44:03.648675 27674 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/pxc-operator/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpercona-xtradb-cluster-operator-57b4c7d59b-rjpn8&resourceVersion=1781153039533847000&timeoutSeconds=534&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/percona-xtradb-cluster-operator-57b4c7d59b-rjpn8 to become Ready.Ok Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2521-bb594380-1-cluster8" modified. ----------------------------------------------------------------------------------- check images and generation after operator upgrade ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/upgrade-proxysql to be ready ----------------------------------------------------------------------------------- Waiting for 3 running pods for upgrade-proxysql-pxc ----------------------------------------------------------------------------------- pod/upgrade-proxysql-pxc-0 condition met E0611 04:44:48.319232 1579 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/upgrade-proxysql-3770/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dupgrade-proxysql-pxc-0&resourceVersion=1781153084535558000&timeoutSeconds=376&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/upgrade-proxysql-pxc-0 to become Ready.Ok pod/upgrade-proxysql-pxc-1 condition met E0611 04:44:58.530707 3155 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/upgrade-proxysql-3770/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dupgrade-proxysql-pxc-1&resourceVersion=1781153094536825000&timeoutSeconds=381&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/upgrade-proxysql-pxc-1 to become Ready.Ok pod/upgrade-proxysql-pxc-2 condition met E0611 04:45:07.044506 4605 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/upgrade-proxysql-3770/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dupgrade-proxysql-pxc-2&resourceVersion=1781153104540413000&timeoutSeconds=568&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/upgrade-proxysql-pxc-2 to become Ready.Ok pod/pxc-client-6c975684f9-n2dt4 condition met E0611 04:45:19.388780 6354 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/upgrade-proxysql-3770/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6c975684f9-n2dt4&resourceVersion=1781153116347002000&timeoutSeconds=386&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6c975684f9-n2dt4 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-6c975684f9-n2dt4 condition met E0611 04:45:35.015651 8623 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/upgrade-proxysql-3770/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6c975684f9-n2dt4&resourceVersion=1781153132299101000&timeoutSeconds=383&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6c975684f9-n2dt4 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-6c975684f9-n2dt4 condition met E0611 04:45:47.914958 10671 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/upgrade-proxysql-3770/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6c975684f9-n2dt4&resourceVersion=1781153146868585000&timeoutSeconds=454&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6c975684f9-n2dt4 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- patch pxc images and upgrade ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/upgrade-proxysql patched ----------------------------------------------------------------------------------- check images and generation after full upgrade ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/upgrade-proxysql to be ready............. ----------------------------------------------------------------------------------- Waiting for 3 running pods for upgrade-proxysql-pxc ----------------------------------------------------------------------------------- pod/upgrade-proxysql-pxc-0 condition met E0611 04:50:14.155749 15972 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/upgrade-proxysql-3770/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dupgrade-proxysql-pxc-0&resourceVersion=1781153411755970000&timeoutSeconds=488&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/upgrade-proxysql-pxc-0 to become Ready.Ok pod/upgrade-proxysql-pxc-1 condition met E0611 04:50:21.829223 17174 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/upgrade-proxysql-3770/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dupgrade-proxysql-pxc-1&resourceVersion=1781153416756097000&timeoutSeconds=314&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/upgrade-proxysql-pxc-1 to become Ready.Ok pod/upgrade-proxysql-pxc-2 condition met E0611 04:50:27.686615 18008 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/upgrade-proxysql-3770/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dupgrade-proxysql-pxc-2&resourceVersion=1781153426756191000&timeoutSeconds=433&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/upgrade-proxysql-pxc-2 to become Ready.Ok pod/pxc-client-6c975684f9-n2dt4 condition met E0611 04:50:35.522307 19073 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/upgrade-proxysql-3770/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6c975684f9-n2dt4&resourceVersion=1781153433475634000&timeoutSeconds=475&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6c975684f9-n2dt4 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-6c975684f9-n2dt4 condition met E0611 04:50:45.922588 20612 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/upgrade-proxysql-3770/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6c975684f9-n2dt4&resourceVersion=1781153443446263000&timeoutSeconds=581&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6c975684f9-n2dt4 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-6c975684f9-n2dt4 condition met E0611 04:50:57.623597 22664 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/upgrade-proxysql-3770/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-6c975684f9-n2dt4&resourceVersion=1781153456580000000&timeoutSeconds=402&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-6c975684f9-n2dt4 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- compare statefulset/upgrade-proxysql-pxc- ----------------------------------------------------------------------------------- [2026-06-11T04:51:24+0000] compare_kubectl: statefulset/upgrade-proxysql-pxc OK ----------------------------------------------------------------------------------- compare statefulset/upgrade-proxysql-proxysql- ----------------------------------------------------------------------------------- [2026-06-11T04:51:26+0000] compare_kubectl: statefulset/upgrade-proxysql-proxysql OK ----------------------------------------------------------------------------------- cleanup ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- destroy cluster/operator and all other resources ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/upgrade-proxysql patched perconaxtradbcluster.pxc.percona.com "upgrade-proxysql" deleted from upgrade-proxysql-3770 namespace No resources found validatingwebhookconfiguration.admissionregistration.k8s.io "percona-xtradbcluster-webhook" deleted customresourcedefinition.apiextensions.k8s.io "challenges.acme.cert-manager.io" deleted customresourcedefinition.apiextensions.k8s.io "orders.acme.cert-manager.io" deleted customresourcedefinition.apiextensions.k8s.io "certificaterequests.cert-manager.io" deleted customresourcedefinition.apiextensions.k8s.io "certificates.cert-manager.io" deleted customresourcedefinition.apiextensions.k8s.io "clusterissuers.cert-manager.io" deleted customresourcedefinition.apiextensions.k8s.io "issuers.cert-manager.io" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-cainjector" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-issuers" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-clusterissuers" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-certificates" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-orders" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-challenges" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-ingress-shim" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-cluster-view" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-view" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-edit" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-approve:cert-manager-io" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-certificatesigningrequests" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-webhook:subjectaccessreviews" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-cainjector" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-issuers" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-clusterissuers" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-certificates" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-orders" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-challenges" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-ingress-shim" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-approve:cert-manager-io" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-certificatesigningrequests" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-webhook:subjectaccessreviews" deleted role.rbac.authorization.k8s.io "cert-manager-cainjector:leaderelection" deleted from kube-system namespace role.rbac.authorization.k8s.io "cert-manager:leaderelection" deleted from kube-system namespace rolebinding.rbac.authorization.k8s.io "cert-manager-cainjector:leaderelection" deleted from kube-system namespace rolebinding.rbac.authorization.k8s.io "cert-manager:leaderelection" deleted from kube-system namespace mutatingwebhookconfiguration.admissionregistration.k8s.io "cert-manager-webhook" deleted validatingwebhookconfiguration.admissionregistration.k8s.io "cert-manager-webhook" deleted namespace "pxc-operator" force deleted Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. namespace "upgrade-proxysql-3770" force deleted Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. customresourcedefinition.apiextensions.k8s.io "perconaxtradbclusterbackups.pxc.percona.com" deleted customresourcedefinition.apiextensions.k8s.io "perconaxtradbclusterrestores.pxc.percona.com" deleted customresourcedefinition.apiextensions.k8s.io "perconaxtradbclusters.pxc.percona.com" deleted ----------------------------------------------------------------------------------- test passed -----------------------------------------------------------------------------------