Log: /mnt/jenkins/workspace/cloud-pxc-operator_PR-2546/e2e-tests/logs/proxysql-scheduler-8-0.log Warning: version difference between client (1.37) and server (1.34) exceeds the supported minor version skew of +/-1 Warning: version difference between client (1.37) and server (1.34) exceeds the supported minor version skew of +/-1 No resources found No resources found No resources found error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces pxc-operator ----------------------------------------------------------------------------------- Error from server (NotFound): namespaces "pxc-operator" not found waiting for namespace/pxc-operator to be deletederror: resource(s) were provided, but no name was specified Error from server (NotFound): namespaces "pxc-operator" not found ----------------------------------------------------------------------------------- create namespace pxc-operator ----------------------------------------------------------------------------------- namespace/pxc-operator created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2546-caf25420-2-cluster1" modified. ----------------------------------------------------------------------------------- start PXC operator ----------------------------------------------------------------------------------- customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterbackups.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterrestores.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusters.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusters.pxc.percona.com condition met customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterbackups.pxc.percona.com condition met customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterrestores.pxc.percona.com condition met clusterrole.rbac.authorization.k8s.io/percona-xtradb-cluster-operator unchanged serviceaccount/percona-xtradb-cluster-operator created clusterrolebinding.rbac.authorization.k8s.io/service-account-percona-xtradb-cluster-operator unchanged deployment.apps/percona-xtradb-cluster-operator created service/percona-xtradb-cluster-operator created pod/percona-xtradb-cluster-operator-658fcf4b98-6fnqv condition met pod/percona-xtradb-cluster-operator-658fcf4b98-6fnqv condition met waiting for pod/percona-xtradb-cluster-operator-658fcf4b98-6fnqv to become Ready.Ok error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces proxysql-scheduler-17570 ----------------------------------------------------------------------------------- Error from server (NotFound): namespaces "proxysql-scheduler-17570" not found waiting for namespace/proxysql-scheduler-17570 to be deletederror: resource(s) were provided, but no name was specified Error from server (NotFound): namespaces "proxysql-scheduler-17570" not found ----------------------------------------------------------------------------------- create namespace proxysql-scheduler-17570 ----------------------------------------------------------------------------------- namespace/proxysql-scheduler-17570 created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2546-caf25420-2-cluster1" modified. ----------------------------------------------------------------------------------- create secrets for cloud storages ----------------------------------------------------------------------------------- secret/minio-secret created secret/aws-s3-secret created secret/do-spaces-secret created secret/gcp-cs-secret created secret/azure-secret created ----------------------------------------------------------------------------------- create PXC cluster: some-name ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- create first PXC cluster ----------------------------------------------------------------------------------- secret/my-cluster-secrets created secret/some-name-ssl created secret/some-name-ssl-internal created deployment.apps/pxc-client created perconaxtradbcluster.pxc.percona.com/some-name created ----------------------------------------------------------------------------------- waiting pods to be running for some-name ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- Waiting for 3 running pods for some-name-pxc ----------------------------------------------------------------------------------- pod/some-name-pxc-0 condition met waiting for pod/some-name-pxc-0 to become Ready.Ok pod/some-name-pxc-1 condition met waiting for pod/some-name-pxc-1 to become Ready.Ok pod/some-name-pxc-2 condition met waiting for pod/some-name-pxc-2 to become Ready.Ok ----------------------------------------------------------------------------------- Waiting for 2 running pods for some-name-proxysql ----------------------------------------------------------------------------------- pod/some-name-proxysql-0 condition met waiting for pod/some-name-proxysql-0 to become Ready.Ok pod/some-name-proxysql-1 condition met waiting for pod/some-name-proxysql-1 to become Ready.Ok ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready ----------------------------------------------------------------------------------- write data ----------------------------------------------------------------------------------- pod/pxc-client-6fc75f888d-8z9z8 condition met waiting for pod/pxc-client-6fc75f888d-8z9z8 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-6fc75f888d-8z9z8 condition met waiting for pod/pxc-client-6fc75f888d-8z9z8 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- compare initial data ----------------------------------------------------------------------------------- pod/pxc-client-6fc75f888d-8z9z8 condition met waiting for pod/pxc-client-6fc75f888d-8z9z8 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-6fc75f888d-8z9z8 condition met waiting for pod/pxc-client-6fc75f888d-8z9z8 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-6fc75f888d-8z9z8 condition met waiting for pod/pxc-client-6fc75f888d-8z9z8 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready ----------------------------------------------------------------------------------- check proxysql custom config ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- check if service and statefulset created with expected config ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- compare statefulset/some-name-pxc- ----------------------------------------------------------------------------------- [2026-10-05T13:17:13+0000] compare_kubectl: statefulset/some-name-pxc OK ----------------------------------------------------------------------------------- compare statefulset/some-name-proxysql- ----------------------------------------------------------------------------------- [2026-10-05T13:17:14+0000] compare_kubectl: statefulset/some-name-proxysql OK ----------------------------------------------------------------------------------- compare service/some-name-pxc- ----------------------------------------------------------------------------------- [2026-10-05T13:17:15+0000] compare_kubectl: service/some-name-pxc OK ----------------------------------------------------------------------------------- compare service/some-name-proxysql- ----------------------------------------------------------------------------------- [2026-10-05T13:17:15+0000] compare_kubectl: service/some-name-proxysql OK ----------------------------------------------------------------------------------- compare service/some-name-proxysql-unready- ----------------------------------------------------------------------------------- [2026-10-05T13:17:17+0000] compare_kubectl: service/some-name-proxysql-unready OK ----------------------------------------------------------------------------------- check if scheduler is enabled in all ProxySQL servers ----------------------------------------------------------------------------------- [2026-10-05T13:19:19+0000] scheduler is enabled in some-name-proxysql-0: OK [2026-10-05T13:19:20+0000] scheduler is enabled in some-name-proxysql-1: OK ----------------------------------------------------------------------------------- check if scheduler is doing its job in all ProxySQL servers ----------------------------------------------------------------------------------- check runtime_mysql_servers in some-name-proxysql-0 [2026-10-05T13:19:22+0000] mysql_servers are configured in some-name-proxysql-0: OK check runtime_mysql_servers in some-name-proxysql-1 [2026-10-05T13:19:24+0000] mysql_servers are configured in some-name-proxysql-1: OK ----------------------------------------------------------------------------------- check disabling scheduler ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/some-name patched [2026-10-05T13:19:26+0000] sleeping for 90 seconds ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready [2026-10-05T13:21:31+0000] scheduler is disabled in some-name-proxysql-0: OK [2026-10-05T13:21:54+0000] scheduler is disabled in some-name-proxysql-1: OK NAME READY STATUS RESTARTS AGE pxc-client-6fc75f888d-8z9z8 2/2 Running 0 10m some-name-proxysql-0 3/3 Running 1 (89s ago) 2m2s some-name-proxysql-1 3/3 Running 0 2m28s some-name-pxc-0 1/1 Running 0 10m some-name-pxc-1 1/1 Running 0 9m20s some-name-pxc-2 1/1 Running 0 8m2s NAME ENDPOINT STATUS PXC PROXYSQL HAPROXY AGE some-name some-name-proxysql.proxysql-scheduler-17570 ready 3 2 10m ----------------------------------------------------------------------------------- check enabling scheduler ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/some-name patched [2026-10-05T13:21:59+0000] sleeping for 90 seconds ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready [2026-10-05T13:23:43+0000] scheduler is enabled in some-name-proxysql-0: OK [2026-10-05T13:23:46+0000] scheduler is enabled in some-name-proxysql-1: OK ----------------------------------------------------------------------------------- check PXC pod 1 is promoted to writer when pod-0 is down ----------------------------------------------------------------------------------- LOOP_PID=690354 pod "some-name-pxc-0" deleted from proxysql-scheduler-17570 namespace [2026-10-05T13:23:56+0000] waiting for pod0 to be removed from proxysql check runtime_mysql_servers in some-name-proxysql-0 [2026-10-05T13:23:57+0000] mysql_servers are configured in some-name-proxysql-0 when pxc-0 is down: OK check runtime_mysql_servers in some-name-proxysql-1 [2026-10-05T13:23:59+0000] mysql_servers are configured in some-name-proxysql-1 when pxc-0 is down: OK ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready.... ----------------------------------------------------------------------------------- check scaling PXC up to 5 replicas ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/some-name patched pod/some-name-pxc-3 condition met waiting for pod/some-name-pxc-3 to become Ready.Ok pod/some-name-pxc-4 condition met waiting for pod/some-name-pxc-4 to become Ready.Ok check runtime_mysql_servers in some-name-proxysql-0 [2026-10-05T13:29:47+0000] new mysql_servers are configured in some-name-proxysql-0: OK check runtime_mysql_servers in some-name-proxysql-1 [2026-10-05T13:29:50+0000] new mysql_servers are configured in some-name-proxysql-1: OK ----------------------------------------------------------------------------------- check scaling ProxySQL up ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/some-name patched pod/some-name-proxysql-2 condition met waiting for pod/some-name-proxysql-2 to become Ready.Ok [2026-10-05T13:32:18+0000] scheduler is enabled in some-name-proxysql-2: OK check runtime_mysql_servers in some-name-proxysql-2 [2026-10-05T13:32:20+0000] mysql_servers are configured in some-name-proxysql-2: OK ----------------------------------------------------------------------------------- check writerIsAlsoReader = false ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/some-name patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready.... check runtime_mysql_servers in some-name-proxysql-0 [2026-10-05T13:34:24+0000] new mysql_servers are configured in some-name-proxysql-0: OK check runtime_mysql_servers in some-name-proxysql-1 [2026-10-05T13:34:26+0000] new mysql_servers are configured in some-name-proxysql-1: OK check runtime_mysql_servers in some-name-proxysql-2 [2026-10-05T13:34:28+0000] mysql_servers are configured in some-name-proxysql-2: OK ----------------------------------------------------------------------------------- check scaling PXC down to 3 replicas ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/some-name patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready... check runtime_mysql_servers in some-name-proxysql-0 [2026-10-05T13:36:20+0000] mysql_servers are configured in some-name-proxysql-0: OK check runtime_mysql_servers in some-name-proxysql-1 [2026-10-05T13:36:22+0000] mysql_servers are configured in some-name-proxysql-1: OK check runtime_mysql_servers in some-name-proxysql-2 [2026-10-05T13:36:23+0000] mysql_servers are configured in some-name-proxysql-2: OK ----------------------------------------------------------------------------------- check PXC pod 0 is reader and writer when pods 1 and 2 are down ----------------------------------------------------------------------------------- [2026-10-05T13:36:23+0000] scaling PXC down to 1 replica statefulset.apps/some-name-pxc scaled check runtime_mysql_servers in some-name-proxysql-0.. [2026-10-05T13:37:10+0000] mysql_servers are configured in some-name-proxysql-0 when 2 pods are down: OK check runtime_mysql_servers in some-name-proxysql-1 [2026-10-05T13:37:11+0000] mysql_servers are configured in some-name-proxysql-1 when 2 pods are down: OK check runtime_mysql_servers in some-name-proxysql-2 [2026-10-05T13:37:13+0000] mysql_servers are configured in some-name-proxysql-2 when 2 pods are down: OK ----------------------------------------------------------------------------------- test passed ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- destroy cluster/operator and all other resources ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/some-name patched perconaxtradbcluster.pxc.percona.com "some-name" deleted from proxysql-scheduler-17570 namespace No resources found validatingwebhookconfiguration.admissionregistration.k8s.io "percona-xtradbcluster-webhook" deleted namespace "proxysql-scheduler-17570" force deleted Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.