Log: /mnt/jenkins/workspace/cloud-pxc-operator_PR-2476/e2e-tests/logs/upgrade-consistency-8-0.log Warning: version difference between client (1.36) and server (1.33) exceeds the supported minor version skew of +/-1 Warning: version difference between client (1.36) and server (1.33) exceeds the supported minor version skew of +/-1 + kubectl patch pxc -n pitr-gap-errors-29237 pitr-gap-errors --type=merge -p '{"metadata":{"finalizers":[]}}' perconaxtradbcluster.pxc.percona.com/pitr-gap-errors patched perconaxtradbcluster.pxc.percona.com "pitr-gap-errors" deleted from pitr-gap-errors-29237 namespace perconaxtradbclusterbackup.pxc.percona.com "on-pitr-minio" deleted from pitr-gap-errors-29237 namespace perconaxtradbclusterbackup.pxc.percona.com "on-pitr-minio-gap" deleted from pitr-gap-errors-29237 namespace perconaxtradbclusterbackup.pxc.percona.com "on-pitr-minio1" deleted from pitr-gap-errors-29237 namespace perconaxtradbclusterrestore.pxc.percona.com "restore-on-pitr-minio" deleted from pitr-gap-errors-29237 namespace perconaxtradbclusterrestore.pxc.percona.com "restore-on-pitr-minio-gap-no-pitr" deleted from pitr-gap-errors-29237 namespace perconaxtradbclusterrestore.pxc.percona.com "restore-on-pitr-minio-invalid" deleted from pitr-gap-errors-29237 namespace error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces pxc-operator ----------------------------------------------------------------------------------- namespace "cert-manager" deleted namespace "pitr-gap-errors-29237" deleted namespace "pxc-operator" deleted waiting for namespace/pxc-operator to be deletedError from server (NotFound): namespaces "pxc-operator" not found ----------------------------------------------------------------------------------- create namespace pxc-operator ----------------------------------------------------------------------------------- namespace/pxc-operator created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2476-a8b01a39-5-cluster1" modified. ----------------------------------------------------------------------------------- start PXC operator ----------------------------------------------------------------------------------- customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterbackups.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterrestores.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusters.pxc.percona.com serverside-applied clusterrole.rbac.authorization.k8s.io/percona-xtradb-cluster-operator unchanged serviceaccount/percona-xtradb-cluster-operator created clusterrolebinding.rbac.authorization.k8s.io/service-account-percona-xtradb-cluster-operator unchanged deployment.apps/percona-xtradb-cluster-operator created service/percona-xtradb-cluster-operator created pod/percona-xtradb-cluster-operator-8548fd5788-wrm6k condition met E0516 21:29:47.769947 22249 reflector.go:227] "Failed to watch" err="Get \"https://35.254.186.129/api/v1/namespaces/pxc-operator/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpercona-xtradb-cluster-operator-8548fd5788-wrm6k&resourceVersion=1778966987403423000&timeoutSeconds=454&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" pod/percona-xtradb-cluster-operator-8548fd5788-wrm6k condition met E0516 21:29:53.966997 23285 reflector.go:227] "Failed to watch" err="Get \"https://35.254.186.129/api/v1/namespaces/pxc-operator/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpercona-xtradb-cluster-operator-8548fd5788-wrm6k&resourceVersion=1778966991405218000&timeoutSeconds=530&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/percona-xtradb-cluster-operator-8548fd5788-wrm6k to become Ready.Ok error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces upgrade-consistency-8946 ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified Error from server (NotFound): namespaces "upgrade-consistency-8946" not found waiting for namespace/upgrade-consistency-8946 to be deletedError from server (NotFound): namespaces "upgrade-consistency-8946" not found ----------------------------------------------------------------------------------- create namespace upgrade-consistency-8946 ----------------------------------------------------------------------------------- namespace/upgrade-consistency-8946 created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2476-a8b01a39-5-cluster1" modified. ----------------------------------------------------------------------------------- create secrets for cloud storages ----------------------------------------------------------------------------------- secret/minio-secret created secret/aws-s3-secret created secret/do-spaces-secret created secret/gcp-cs-secret created secret/azure-secret created deployment.apps/pxc-client created secret/my-cluster-secrets created perconaxtradbcluster.pxc.percona.com/some-name created ----------------------------------------------------------------------------------- test 1.18.0 ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/some-name patched (no change) ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready.............................................................. Waiting for statefulset readyness + desc 'compare k8s objects' + set +o xtrace ----------------------------------------------------------------------------------- compare k8s objects ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- compare service/some-name-pxc--1180 ----------------------------------------------------------------------------------- [2026-05-16T21:37:34+0000] compare_kubectl: service/some-name-pxc OK ----------------------------------------------------------------------------------- compare service/some-name-proxysql--1180 ----------------------------------------------------------------------------------- [2026-05-16T21:37:35+0000] compare_kubectl: service/some-name-proxysql OK ----------------------------------------------------------------------------------- compare statefulset/some-name-pxc--1180 ----------------------------------------------------------------------------------- [2026-05-16T21:37:36+0000] compare_kubectl: statefulset/some-name-pxc OK ----------------------------------------------------------------------------------- compare statefulset/some-name-proxysql--1180 ----------------------------------------------------------------------------------- [2026-05-16T21:37:38+0000] compare_kubectl: statefulset/some-name-proxysql OK ----------------------------------------------------------------------------------- test 1.19.0 ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/some-name patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready.......................... Waiting for statefulset readyness + desc 'compare k8s objects' + set +o xtrace ----------------------------------------------------------------------------------- compare k8s objects ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- compare service/some-name-pxc--1190 ----------------------------------------------------------------------------------- [2026-05-16T21:40:41+0000] compare_kubectl: service/some-name-pxc OK ----------------------------------------------------------------------------------- compare service/some-name-proxysql--1190 ----------------------------------------------------------------------------------- [2026-05-16T21:40:43+0000] compare_kubectl: service/some-name-proxysql OK ----------------------------------------------------------------------------------- compare statefulset/some-name-pxc--1190 ----------------------------------------------------------------------------------- [2026-05-16T21:40:44+0000] compare_kubectl: statefulset/some-name-pxc OK ----------------------------------------------------------------------------------- compare statefulset/some-name-proxysql--1190 ----------------------------------------------------------------------------------- [2026-05-16T21:40:45+0000] compare_kubectl: statefulset/some-name-proxysql OK ----------------------------------------------------------------------------------- test 1.20.0 ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/some-name patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready............................ Waiting for statefulset readyness + desc 'compare k8s objects' + set +o xtrace ----------------------------------------------------------------------------------- compare k8s objects ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- compare service/some-name-pxc--1200 ----------------------------------------------------------------------------------- [2026-05-16T21:43:50+0000] compare_kubectl: service/some-name-pxc OK ----------------------------------------------------------------------------------- compare service/some-name-proxysql--1200 ----------------------------------------------------------------------------------- [2026-05-16T21:43:50+0000] compare_kubectl: service/some-name-proxysql OK ----------------------------------------------------------------------------------- compare statefulset/some-name-pxc--1200 ----------------------------------------------------------------------------------- [2026-05-16T21:43:51+0000] compare_kubectl: statefulset/some-name-pxc OK ----------------------------------------------------------------------------------- compare statefulset/some-name-proxysql--1200 ----------------------------------------------------------------------------------- [2026-05-16T21:43:52+0000] compare_kubectl: statefulset/some-name-proxysql OK ----------------------------------------------------------------------------------- destroy cluster/operator and all other resources ----------------------------------------------------------------------------------- + kubectl patch pxc -n upgrade-consistency-8946 some-name --type=merge -p '{"metadata":{"finalizers":[]}}' perconaxtradbcluster.pxc.percona.com/some-name patched perconaxtradbcluster.pxc.percona.com "some-name" deleted from upgrade-consistency-8946 namespace No resources found No resources found validatingwebhookconfiguration.admissionregistration.k8s.io "percona-xtradbcluster-webhook" deleted customresourcedefinition.apiextensions.k8s.io "challenges.acme.cert-manager.io" deleted customresourcedefinition.apiextensions.k8s.io "orders.acme.cert-manager.io" deleted customresourcedefinition.apiextensions.k8s.io "certificaterequests.cert-manager.io" deleted customresourcedefinition.apiextensions.k8s.io "certificates.cert-manager.io" deleted customresourcedefinition.apiextensions.k8s.io "clusterissuers.cert-manager.io" deleted customresourcedefinition.apiextensions.k8s.io "issuers.cert-manager.io" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-cainjector" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-issuers" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-clusterissuers" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-certificates" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-orders" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-challenges" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-ingress-shim" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-cluster-view" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-view" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-edit" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-approve:cert-manager-io" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-certificatesigningrequests" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-webhook:subjectaccessreviews" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-cainjector" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-issuers" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-clusterissuers" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-certificates" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-orders" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-challenges" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-ingress-shim" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-approve:cert-manager-io" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-certificatesigningrequests" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-webhook:subjectaccessreviews" deleted role.rbac.authorization.k8s.io "cert-manager-cainjector:leaderelection" deleted from kube-system namespace role.rbac.authorization.k8s.io "cert-manager:leaderelection" deleted from kube-system namespace rolebinding.rbac.authorization.k8s.io "cert-manager-cainjector:leaderelection" deleted from kube-system namespace rolebinding.rbac.authorization.k8s.io "cert-manager:leaderelection" deleted from kube-system namespace mutatingwebhookconfiguration.admissionregistration.k8s.io "cert-manager-webhook" deleted validatingwebhookconfiguration.admissionregistration.k8s.io "cert-manager-webhook" deleted ----------------------------------------------------------------------------------- test passed -----------------------------------------------------------------------------------