Log: /mnt/jenkins/workspace/cloud-pxc-operator_PR-2207/e2e-tests/logs/scaling-8-0.log Warning: version difference between client (1.34) and server (1.31) exceeds the supported minor version skew of +/-1 Warning: version difference between client (1.34) and server (1.31) exceeds the supported minor version skew of +/-1 + kubectl patch pxc -n demand-backup-flow-control-25596 some-name --type=merge -p '{"metadata":{"finalizers":[]}}' Error from server (InternalError): Internal error occurred: failed calling webhook "validationwebhook.pxc.percona.com": failed to call webhook: Post "https://percona-xtradb-cluster-operator.pxc-operator.svc:443/validate-percona-xtradbcluster?timeout=10s": no endpoints available for service "percona-xtradb-cluster-operator" perconaxtradbcluster.pxc.percona.com "some-name" deleted from demand-backup-flow-control-25596 namespace error: the server doesn't have a resource type "pxc-backup" error: the server doesn't have a resource type "pxc-restore" error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces pxc-operator ----------------------------------------------------------------------------------- namespace "demand-backup-flow-control-25596" deleted namespace "pxc-operator" deleted waiting for namespace/pxc-operator to be deletedError from server (NotFound): namespaces "pxc-operator" not found ----------------------------------------------------------------------------------- create namespace pxc-operator ----------------------------------------------------------------------------------- namespace/pxc-operator created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2207-f8e092d7-9-cluster8" modified. ----------------------------------------------------------------------------------- start PXC operator ----------------------------------------------------------------------------------- customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusters.pxc.percona.com serverside-applied clusterrole.rbac.authorization.k8s.io/percona-xtradb-cluster-operator unchanged serviceaccount/percona-xtradb-cluster-operator created clusterrolebinding.rbac.authorization.k8s.io/service-account-percona-xtradb-cluster-operator unchanged deployment.apps/percona-xtradb-cluster-operator created service/percona-xtradb-cluster-operator created pod/percona-xtradb-cluster-operator-859595f865-96n45 condition met pod/percona-xtradb-cluster-operator-859595f865-96n45 condition met waiting for pod/percona-xtradb-cluster-operator-859595f865-96n45 to become Ready.Ok error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces scaling-30714 ----------------------------------------------------------------------------------- Error from server (NotFound): namespaces "scaling-30714" not found waiting for namespace/scaling-30714 to be deletederror: resource(s) were provided, but no name was specified Error from server (NotFound): namespaces "scaling-30714" not found ----------------------------------------------------------------------------------- create namespace scaling-30714 ----------------------------------------------------------------------------------- namespace/scaling-30714 created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2207-f8e092d7-9-cluster8" modified. ----------------------------------------------------------------------------------- create secrets for cloud storages ----------------------------------------------------------------------------------- secret/minio-secret created secret/aws-s3-secret created secret/gcp-cs-secret created secret/azure-secret created ----------------------------------------------------------------------------------- create first PXC cluster ----------------------------------------------------------------------------------- secret/my-cluster-secrets created secret/some-name-ssl created secret/some-name-ssl-internal created deployment.apps/pxc-client created perconaxtradbcluster.pxc.percona.com/scaling created ----------------------------------------------------------------------------------- check if all 3 Pods started ----------------------------------------------------------------------------------- error: no matching resources found ----------------------------------------------------------------------------------- wait for running cluster ----------------------------------------------------------------------------------- pod/scaling-proxysql-0 condition met waiting for pod/scaling-proxysql-0 to become Ready.Ok ----------------------------------------------------------------------------------- wait for running cluster ----------------------------------------------------------------------------------- pod/scaling-pxc-0 condition met waiting for pod/scaling-pxc-0 to become Ready.Ok pod/scaling-pxc-1 condition met waiting for pod/scaling-pxc-1 to become Ready.Ok pod/scaling-pxc-2 condition met waiting for pod/scaling-pxc-2 to become Ready.Ok ----------------------------------------------------------------------------------- write data ----------------------------------------------------------------------------------- pod/pxc-client-59944c5bbf-86mtw condition met waiting for pod/pxc-client-59944c5bbf-86mtw to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-59944c5bbf-86mtw condition met waiting for pod/pxc-client-59944c5bbf-86mtw to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-59944c5bbf-86mtw condition met waiting for pod/pxc-client-59944c5bbf-86mtw to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-59944c5bbf-86mtw condition met waiting for pod/pxc-client-59944c5bbf-86mtw to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-59944c5bbf-86mtw condition met waiting for pod/pxc-client-59944c5bbf-86mtw to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok Unable to use a TTY - input is not a terminal or the right kind of file ----------------------------------------------------------------------------------- scale up from 3 to 5 ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/scaling configured ----------------------------------------------------------------------------------- check if all 5 Pods started ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- wait for running cluster ----------------------------------------------------------------------------------- pod/scaling-pxc-0 condition met waiting for pod/scaling-pxc-0 to become Ready.Ok pod/scaling-pxc-1 condition met waiting for pod/scaling-pxc-1 to become Ready.Ok pod/scaling-pxc-2 condition met waiting for pod/scaling-pxc-2 to become Ready.Ok pod/scaling-pxc-3 condition met waiting for pod/scaling-pxc-3 to become Ready.Ok pod/scaling-pxc-4 condition met waiting for pod/scaling-pxc-4 to become Ready.Ok ----------------------------------------------------------------------------------- check if PVC created ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- compare pvc/datadir-scaling-pxc-3- ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- return true if kubernetes version equal or greater than desired ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- return true if kubernetes version equal or greater than desired ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- return true if kubernetes version equal or greater than desired ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- return true if kubernetes version equal or greater than desired ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- return true if kubernetes version equal or greater than desired ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- return true if kubernetes version equal or greater than desired ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- return true if kubernetes version equal or greater than desired ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- compare pvc/datadir-scaling-pxc-4- ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- return true if kubernetes version equal or greater than desired ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- return true if kubernetes version equal or greater than desired ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- return true if kubernetes version equal or greater than desired ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- return true if kubernetes version equal or greater than desired ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- return true if kubernetes version equal or greater than desired ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- return true if kubernetes version equal or greater than desired ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- return true if kubernetes version equal or greater than desired ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- check data consistency for new Pods ----------------------------------------------------------------------------------- pod/pxc-client-59944c5bbf-86mtw condition met waiting for pod/pxc-client-59944c5bbf-86mtw to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-59944c5bbf-86mtw condition met waiting for pod/pxc-client-59944c5bbf-86mtw to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- check new Pods exists in ProxySQL ----------------------------------------------------------------------------------- scaling-pxc-3.scaling-pxc.scaling-30714.svc.cluster.local scaling-pxc-3.scaling-pxc.scaling-30714.svc.cluster.local scaling-pxc-4.scaling-pxc.scaling-30714.svc.cluster.local scaling-pxc-4.scaling-pxc.scaling-30714.svc.cluster.local ----------------------------------------------------------------------------------- scale down from 5 to 3 ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/scaling configured ----------------------------------------------------------------------------------- check if Pod deleted ----------------------------------------------------------------------------------- waiting for pod/scaling-pxc-3 to be deleted...Error from server (NotFound): pods "scaling-pxc-3" not found waiting for pod/scaling-pxc-4 to be deletedError from server (NotFound): pods "scaling-pxc-4" not found ----------------------------------------------------------------------------------- check if PVC not deleted ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- compare pvc/datadir-scaling-pxc-3- ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- return true if kubernetes version equal or greater than desired ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- return true if kubernetes version equal or greater than desired ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- return true if kubernetes version equal or greater than desired ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- return true if kubernetes version equal or greater than desired ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- return true if kubernetes version equal or greater than desired ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- return true if kubernetes version equal or greater than desired ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- return true if kubernetes version equal or greater than desired ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- compare pvc/datadir-scaling-pxc-4- ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- return true if kubernetes version equal or greater than desired ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- return true if kubernetes version equal or greater than desired ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- return true if kubernetes version equal or greater than desired ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- return true if kubernetes version equal or greater than desired ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- return true if kubernetes version equal or greater than desired ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- return true if kubernetes version equal or greater than desired ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- return true if kubernetes version equal or greater than desired ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- check if Pod deleted from ProxySQL ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- destroy cluster/operator and all other resources ----------------------------------------------------------------------------------- + kubectl patch pxc -n scaling-30714 scaling --type=merge -p '{"metadata":{"finalizers":[]}}' perconaxtradbcluster.pxc.percona.com/scaling patched (no change) perconaxtradbcluster.pxc.percona.com "scaling" deleted from scaling-30714 namespace error: the server doesn't have a resource type "pxc-backup" error: the server doesn't have a resource type "pxc-restore" validatingwebhookconfiguration.admissionregistration.k8s.io "percona-xtradbcluster-webhook" deleted ----------------------------------------------------------------------------------- test passed -----------------------------------------------------------------------------------