Log: /mnt/jenkins/workspace/cloud-pxc-operator_PR-2538/e2e-tests/logs/pvc-resize-8-0.log Warning: version difference between client (1.36) and server (1.33) exceeds the supported minor version skew of +/-1 Warning: version difference between client (1.36) and server (1.33) exceeds the supported minor version skew of +/-1 Size unit: Gi Checking if default storageclass standard-rwo allows volume expansion No resources found No resources found No resources found error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces pxc-operator ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified namespace "pxc-operator" deleted waiting for namespace/pxc-operator to be deletedError from server (NotFound): namespaces "pxc-operator" not found ----------------------------------------------------------------------------------- create namespace pxc-operator ----------------------------------------------------------------------------------- namespace/pxc-operator created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2538-70c04858-1-cluster5" modified. ----------------------------------------------------------------------------------- start PXC operator ----------------------------------------------------------------------------------- customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterbackups.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterrestores.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusters.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusters.pxc.percona.com condition met E0702 02:56:42.251663 23181 reflector.go:227] "Failed to watch" err="Get \"https://136.119.17.40/apis/apiextensions.k8s.io/v1/customresourcedefinitions?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dperconaxtradbclusters.pxc.percona.com&resourceVersion=1782960998365121000&timeoutSeconds=429&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterbackups.pxc.percona.com condition met E0702 02:56:43.980682 23532 reflector.go:227] "Failed to watch" err="Get \"https://136.119.17.40/apis/apiextensions.k8s.io/v1/customresourcedefinitions?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dperconaxtradbclusterbackups.pxc.percona.com&resourceVersion=1782961003365130000&timeoutSeconds=506&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterrestores.pxc.percona.com condition met E0702 02:56:45.971389 23838 reflector.go:227] "Failed to watch" err="Get \"https://136.119.17.40/apis/apiextensions.k8s.io/v1/customresourcedefinitions?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dperconaxtradbclusterrestores.pxc.percona.com&resourceVersion=1782961003365130000&timeoutSeconds=594&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" clusterrole.rbac.authorization.k8s.io/percona-xtradb-cluster-operator unchanged serviceaccount/percona-xtradb-cluster-operator created clusterrolebinding.rbac.authorization.k8s.io/service-account-percona-xtradb-cluster-operator unchanged deployment.apps/percona-xtradb-cluster-operator created service/percona-xtradb-cluster-operator created pod/percona-xtradb-cluster-operator-59848dbdcc-85n2q condition met E0702 02:57:08.580478 27038 reflector.go:227] "Failed to watch" err="Get \"https://136.119.17.40/api/v1/namespaces/pxc-operator/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpercona-xtradb-cluster-operator-59848dbdcc-85n2q&resourceVersion=1782961028219961000&timeoutSeconds=574&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" pod/percona-xtradb-cluster-operator-59848dbdcc-85n2q condition met E0702 02:57:16.790958 28395 reflector.go:227] "Failed to watch" err="Get \"https://136.119.17.40/api/v1/namespaces/pxc-operator/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpercona-xtradb-cluster-operator-59848dbdcc-85n2q&resourceVersion=1782961033967449000&timeoutSeconds=433&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/percona-xtradb-cluster-operator-59848dbdcc-85n2q to become Ready.Ok error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces pvc-resize-4223 ----------------------------------------------------------------------------------- Error from server (NotFound): namespaces "pvc-resize-4223" not found waiting for namespace/pvc-resize-4223 to be deletederror: resource(s) were provided, but no name was specified Error from server (NotFound): namespaces "pvc-resize-4223" not found ----------------------------------------------------------------------------------- create namespace pvc-resize-4223 ----------------------------------------------------------------------------------- namespace/pvc-resize-4223 created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2538-70c04858-1-cluster5" modified. ----------------------------------------------------------------------------------- create secrets for cloud storages ----------------------------------------------------------------------------------- secret/minio-secret created secret/aws-s3-secret created secret/do-spaces-secret created secret/gcp-cs-secret created secret/azure-secret created ----------------------------------------------------------------------------------- create first PXC cluster ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- create first PXC cluster ----------------------------------------------------------------------------------- secret/my-cluster-secrets created secret/some-name-ssl created secret/some-name-ssl-internal created deployment.apps/pxc-client created perconaxtradbcluster.pxc.percona.com/some-name created ----------------------------------------------------------------------------------- waiting pods to be running for some-name ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- Waiting for 3 running pods for some-name-pxc ----------------------------------------------------------------------------------- pod/some-name-pxc-0 condition met waiting for pod/some-name-pxc-0 to become Ready.Ok pod/some-name-pxc-1 condition met waiting for pod/some-name-pxc-1 to become Ready.Ok pod/some-name-pxc-2 condition met waiting for pod/some-name-pxc-2 to become Ready.Ok ----------------------------------------------------------------------------------- Waiting for 2 running pods for some-name-haproxy ----------------------------------------------------------------------------------- pod/some-name-haproxy-0 condition met E0702 03:02:17.329884 8442 reflector.go:227] "Failed to watch" err="Get \"https://136.119.17.40/api/v1/namespaces/pvc-resize-4223/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dsome-name-haproxy-0&resourceVersion=1782961335760077000&timeoutSeconds=400&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/some-name-haproxy-0 to become Ready.Ok pod/some-name-haproxy-1 condition met E0702 03:02:28.905793 10174 reflector.go:227] "Failed to watch" err="Get \"https://136.119.17.40/api/v1/namespaces/pvc-resize-4223/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dsome-name-haproxy-1&resourceVersion=1782961345760160000&timeoutSeconds=570&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/some-name-haproxy-1 to become Ready.Ok ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready ----------------------------------------------------------------------------------- write data ----------------------------------------------------------------------------------- pod/pxc-client-67fc4995bb-x2h2j condition met E0702 03:03:27.084995 18751 reflector.go:227] "Failed to watch" err="Get \"https://136.119.17.40/api/v1/namespaces/pvc-resize-4223/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-x2h2j&resourceVersion=1782961403870473000&timeoutSeconds=435&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-x2h2j to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-x2h2j condition met E0702 03:03:57.606594 23072 reflector.go:227] "Failed to watch" err="Get \"https://136.119.17.40/api/v1/namespaces/pvc-resize-4223/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-x2h2j&resourceVersion=1782961433827361000&timeoutSeconds=469&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-x2h2j to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- compare initial data ----------------------------------------------------------------------------------- pod/pxc-client-67fc4995bb-x2h2j condition met E0702 03:05:00.508828 32682 reflector.go:227] "Failed to watch" err="Get \"https://136.119.17.40/api/v1/namespaces/pvc-resize-4223/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-x2h2j&resourceVersion=1782961498145266000&timeoutSeconds=369&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-x2h2j to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-x2h2j condition met E0702 03:05:17.830800 2780 reflector.go:227] "Failed to watch" err="Get \"https://136.119.17.40/api/v1/namespaces/pvc-resize-4223/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-x2h2j&resourceVersion=1782961515049998000&timeoutSeconds=515&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-x2h2j to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-x2h2j condition met E0702 03:05:32.695528 5219 reflector.go:227] "Failed to watch" err="Get \"https://136.119.17.40/api/v1/namespaces/pvc-resize-4223/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-x2h2j&resourceVersion=1782961530620802000&timeoutSeconds=491&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-x2h2j to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- test scaling ----------------------------------------------------------------------------------- Patching PVC request to 3G in some-name perconaxtradbcluster.pxc.percona.com/some-name patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready Waiting for persistentvolumeclaim/datadir-some-name-pxc-0 to be resized ........................................................................................................................ persistentvolumeclaim/datadir-some-name-pxc-0 was not resized, max retries exceeded Enabling PVC resize perconaxtradbcluster.pxc.percona.com/some-name patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready.. Waiting for persistentvolumeclaim/datadir-some-name-pxc-0 to be resized persistentvolumeclaim/datadir-some-name-pxc-0 was resized Waiting for persistentvolumeclaim/datadir-some-name-pxc-1 to be resized persistentvolumeclaim/datadir-some-name-pxc-1 was resized Waiting for persistentvolumeclaim/datadir-some-name-pxc-2 to be resized persistentvolumeclaim/datadir-some-name-pxc-2 was resized ----------------------------------------------------------------------------------- create 1st insufficient resourcequota ----------------------------------------------------------------------------------- Applying resourcequota for default storageclass standard-rwo with quota 10Gi resourcequota/default-storage-quota created Patching PVC request to 4G in some-name perconaxtradbcluster.pxc.percona.com/some-name patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready. Waiting for any of pvces to be resized Waiting for any of pvces to be resized PVC was resized datadir-some-name-pxc-0 was resized Waiting for pxc/some-name status to be ready pxc/some-name status is ready ----------------------------------------------------------------------------------- update insufficient resourcequota ----------------------------------------------------------------------------------- Applying resourcequota for default storageclass standard-rwo with quota 11Gi resourcequota/default-storage-quota configured Patching PVC request to 4Gi in some-name perconaxtradbcluster.pxc.percona.com/some-name patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready... Waiting for any of pvces to be resized Waiting for any of pvces to be resized PVC was resized datadir-some-name-pxc-0 datadir-some-name-pxc-1 was resized Waiting for pxc/some-name status to be ready pxc/some-name status is ready ----------------------------------------------------------------------------------- update resourcequota to be sufficient ----------------------------------------------------------------------------------- Applying resourcequota for default storageclass standard-rwo with quota 12Gi resourcequota/default-storage-quota configured Patching PVC request to 4G in some-name perconaxtradbcluster.pxc.percona.com/some-name patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready... Waiting for persistentvolumeclaim/datadir-some-name-pxc-0 to be resized persistentvolumeclaim/datadir-some-name-pxc-0 was resized Waiting for persistentvolumeclaim/datadir-some-name-pxc-1 to be resized persistentvolumeclaim/datadir-some-name-pxc-1 was resized Waiting for persistentvolumeclaim/datadir-some-name-pxc-2 to be resized persistentvolumeclaim/datadir-some-name-pxc-2 was resized Waiting for pxc/some-name status to be ready pxc/some-name status is ready ----------------------------------------------------------------------------------- test downscale ----------------------------------------------------------------------------------- Patching PVC request to 1G in some-name perconaxtradbcluster.pxc.percona.com/some-name patched Waiting for persistentvolumeclaim/datadir-some-name-pxc-0 to be resized persistentvolumeclaim/datadir-some-name-pxc-0 was resized Waiting for persistentvolumeclaim/datadir-some-name-pxc-1 to be resized persistentvolumeclaim/datadir-some-name-pxc-1 was resized Waiting for persistentvolumeclaim/datadir-some-name-pxc-2 to be resized persistentvolumeclaim/datadir-some-name-pxc-2 was resized Waiting for pxc/some-name status to be ready pxc/some-name status is ready ----------------------------------------------------------------------------------- destroy cluster/operator and all other resources ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/some-name patched perconaxtradbcluster.pxc.percona.com "some-name" deleted from pvc-resize-4223 namespace No resources found validatingwebhookconfiguration.admissionregistration.k8s.io "percona-xtradbcluster-webhook" deleted namespace "pxc-operator" force deleted Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. namespace "pvc-resize-4223" force deleted Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. ----------------------------------------------------------------------------------- test passed -----------------------------------------------------------------------------------