Log: /mnt/jenkins/workspace/cloud-pxc-operator_PR-2476/e2e-tests/logs/scaling-8-0.log Warning: version difference between client (1.36) and server (1.33) exceeds the supported minor version skew of +/-1 Warning: version difference between client (1.36) and server (1.33) exceeds the supported minor version skew of +/-1 No resources found + kubectl patch pxc -n sh --type=merge -p '{"metadata":{"finalizers":[]}}' error: resource(s) were provided, but no name was specified No resources found No resources found No resources found error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces pxc-operator ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified namespace "pxc-operator" deleted waiting for namespace/pxc-operator to be deletedError from server (NotFound): namespaces "pxc-operator" not found ----------------------------------------------------------------------------------- create namespace pxc-operator ----------------------------------------------------------------------------------- namespace/pxc-operator created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2476-a8b01a39-5-cluster8" modified. ----------------------------------------------------------------------------------- start PXC operator ----------------------------------------------------------------------------------- customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterbackups.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterrestores.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusters.pxc.percona.com serverside-applied clusterrole.rbac.authorization.k8s.io/percona-xtradb-cluster-operator unchanged serviceaccount/percona-xtradb-cluster-operator created clusterrolebinding.rbac.authorization.k8s.io/service-account-percona-xtradb-cluster-operator unchanged deployment.apps/percona-xtradb-cluster-operator created service/percona-xtradb-cluster-operator created pod/percona-xtradb-cluster-operator-8548fd5788-mm284 condition met E0516 20:30:06.194613 13548 reflector.go:227] "Failed to watch" err="Get \"https://35.192.233.86/api/v1/namespaces/pxc-operator/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpercona-xtradb-cluster-operator-8548fd5788-mm284&resourceVersion=1778963405831497000&timeoutSeconds=523&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" pod/percona-xtradb-cluster-operator-8548fd5788-mm284 condition met E0516 20:30:12.495644 14454 reflector.go:227] "Failed to watch" err="Get \"https://35.192.233.86/api/v1/namespaces/pxc-operator/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpercona-xtradb-cluster-operator-8548fd5788-mm284&resourceVersion=1778963410199756000&timeoutSeconds=327&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/percona-xtradb-cluster-operator-8548fd5788-mm284 to become Ready.Ok error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces scaling-7306 ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified Error from server (NotFound): namespaces "scaling-7306" not found waiting for namespace/scaling-7306 to be deletedError from server (NotFound): namespaces "scaling-7306" not found ----------------------------------------------------------------------------------- create namespace scaling-7306 ----------------------------------------------------------------------------------- namespace/scaling-7306 created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2476-a8b01a39-5-cluster8" modified. ----------------------------------------------------------------------------------- create secrets for cloud storages ----------------------------------------------------------------------------------- secret/minio-secret created secret/aws-s3-secret created secret/do-spaces-secret created secret/gcp-cs-secret created secret/azure-secret created ----------------------------------------------------------------------------------- create first PXC cluster ----------------------------------------------------------------------------------- secret/my-cluster-secrets created secret/some-name-ssl created secret/some-name-ssl-internal created deployment.apps/pxc-client created perconaxtradbcluster.pxc.percona.com/scaling created ----------------------------------------------------------------------------------- check if all 3 Pods started ----------------------------------------------------------------------------------- error: no matching resources found ----------------------------------------------------------------------------------- wait for running cluster ----------------------------------------------------------------------------------- pod/scaling-proxysql-0 condition met waiting for pod/scaling-proxysql-0 to become Ready.Ok ----------------------------------------------------------------------------------- wait for running cluster ----------------------------------------------------------------------------------- pod/scaling-pxc-0 condition met waiting for pod/scaling-pxc-0 to become Ready.Ok pod/scaling-pxc-1 condition met waiting for pod/scaling-pxc-1 to become Ready.Ok pod/scaling-pxc-2 condition met waiting for pod/scaling-pxc-2 to become Ready.Ok ----------------------------------------------------------------------------------- write data ----------------------------------------------------------------------------------- pod/pxc-client-67fc4995bb-m64k8 condition met E0516 20:35:29.609521 22639 reflector.go:227] "Failed to watch" err="Get \"https://35.192.233.86/api/v1/namespaces/scaling-7306/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-m64k8&resourceVersion=1778963727073133000&timeoutSeconds=419&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-m64k8 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-m64k8 condition met E0516 20:35:42.251728 24513 reflector.go:227] "Failed to watch" err="Get \"https://35.192.233.86/api/v1/namespaces/scaling-7306/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-m64k8&resourceVersion=1778963740368665000&timeoutSeconds=499&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-m64k8 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-m64k8 condition met E0516 20:36:20.050093 28296 reflector.go:227] "Failed to watch" err="Get \"https://35.192.233.86/api/v1/namespaces/scaling-7306/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-m64k8&resourceVersion=1778963778542858000&timeoutSeconds=474&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-m64k8 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-m64k8 condition met E0516 20:36:26.857821 29321 reflector.go:227] "Failed to watch" err="Get \"https://35.192.233.86/api/v1/namespaces/scaling-7306/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-m64k8&resourceVersion=1778963786104490000&timeoutSeconds=516&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-m64k8 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-m64k8 condition met E0516 20:36:33.258295 30211 reflector.go:227] "Failed to watch" err="Get \"https://35.192.233.86/api/v1/namespaces/scaling-7306/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-m64k8&resourceVersion=1778963792474770000&timeoutSeconds=422&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-m64k8 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- scale up from 3 to 5 ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/scaling configured ----------------------------------------------------------------------------------- check if all 5 Pods started ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- wait for running cluster ----------------------------------------------------------------------------------- pod/scaling-pxc-0 condition met E0516 20:36:48.998217 32242 reflector.go:227] "Failed to watch" err="Get \"https://35.192.233.86/api/v1/namespaces/scaling-7306/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dscaling-pxc-0&resourceVersion=1778963808098063007&timeoutSeconds=354&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/scaling-pxc-0 to become Ready.Ok pod/scaling-pxc-1 condition met E0516 20:36:55.196850 715 reflector.go:227] "Failed to watch" err="Get \"https://35.192.233.86/api/v1/namespaces/scaling-7306/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dscaling-pxc-1&resourceVersion=1778963812253887007&timeoutSeconds=504&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/scaling-pxc-1 to become Ready.Ok pod/scaling-pxc-2 condition met E0516 20:37:01.669997 1593 reflector.go:227] "Failed to watch" err="Get \"https://35.192.233.86/api/v1/namespaces/scaling-7306/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dscaling-pxc-2&resourceVersion=1778963817255030000&timeoutSeconds=336&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/scaling-pxc-2 to become Ready.Ok pod/scaling-pxc-3 condition met waiting for pod/scaling-pxc-3 to become Ready.Ok pod/scaling-pxc-4 condition met waiting for pod/scaling-pxc-4 to become Ready.Ok ----------------------------------------------------------------------------------- check if PVC created ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- compare pvc/datadir-scaling-pxc-3- ----------------------------------------------------------------------------------- [2026-05-16T20:39:45+0000] compare_kubectl: pvc/datadir-scaling-pxc-3 OK ----------------------------------------------------------------------------------- compare pvc/datadir-scaling-pxc-4- ----------------------------------------------------------------------------------- [2026-05-16T20:39:46+0000] compare_kubectl: pvc/datadir-scaling-pxc-4 OK ----------------------------------------------------------------------------------- check data consistency for new Pods ----------------------------------------------------------------------------------- pod/pxc-client-67fc4995bb-m64k8 condition met E0516 20:39:48.538653 19852 reflector.go:227] "Failed to watch" err="Get \"https://35.192.233.86/api/v1/namespaces/scaling-7306/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-m64k8&resourceVersion=1778963986613038000&timeoutSeconds=432&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-m64k8 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-m64k8 condition met E0516 20:39:56.535312 20941 reflector.go:227] "Failed to watch" err="Get \"https://35.192.233.86/api/v1/namespaces/scaling-7306/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-m64k8&resourceVersion=1778963995072925000&timeoutSeconds=411&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-m64k8 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- check new Pods exists in ProxySQL ----------------------------------------------------------------------------------- scaling-pxc-3.scaling-pxc.scaling-7306.svc.cluster.local scaling-pxc-3.scaling-pxc.scaling-7306.svc.cluster.local scaling-pxc-4.scaling-pxc.scaling-7306.svc.cluster.local scaling-pxc-4.scaling-pxc.scaling-7306.svc.cluster.local ----------------------------------------------------------------------------------- scale down from 5 to 3 ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/scaling configured ----------------------------------------------------------------------------------- check if Pod deleted ----------------------------------------------------------------------------------- waiting for pod/scaling-pxc-3 to be deleted..Error from server (NotFound): pods "scaling-pxc-3" not found waiting for pod/scaling-pxc-4 to be deletedError from server (NotFound): pods "scaling-pxc-4" not found ----------------------------------------------------------------------------------- check if PVC not deleted ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- compare pvc/datadir-scaling-pxc-3- ----------------------------------------------------------------------------------- [2026-05-16T20:40:54+0000] compare_kubectl: pvc/datadir-scaling-pxc-3 OK ----------------------------------------------------------------------------------- compare pvc/datadir-scaling-pxc-4- ----------------------------------------------------------------------------------- [2026-05-16T20:40:55+0000] compare_kubectl: pvc/datadir-scaling-pxc-4 OK ----------------------------------------------------------------------------------- check if Pod deleted from ProxySQL ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- destroy cluster/operator and all other resources ----------------------------------------------------------------------------------- + kubectl patch pxc -n scaling-7306 scaling --type=merge -p '{"metadata":{"finalizers":[]}}' perconaxtradbcluster.pxc.percona.com/scaling patched (no change) perconaxtradbcluster.pxc.percona.com "scaling" deleted from scaling-7306 namespace No resources found No resources found validatingwebhookconfiguration.admissionregistration.k8s.io "percona-xtradbcluster-webhook" deleted ----------------------------------------------------------------------------------- test passed -----------------------------------------------------------------------------------