Log: /mnt/jenkins/workspace/cloud-pxc-operator_PR-2521/e2e-tests/logs/custom-users-8-0.log Warning: version difference between client (1.36) and server (1.33) exceeds the supported minor version skew of +/-1 Warning: version difference between client (1.36) and server (1.33) exceeds the supported minor version skew of +/-1 error: the server doesn't have a resource type "pxc" error: the server doesn't have a resource type "pxc-backup" error: the server doesn't have a resource type "pxc-restore" error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces pxc-operator ----------------------------------------------------------------------------------- Error from server (NotFound): namespaces "pxc-operator" not found waiting for namespace/pxc-operator to be deletederror: resource(s) were provided, but no name was specified Error from server (NotFound): namespaces "pxc-operator" not found ----------------------------------------------------------------------------------- create namespace pxc-operator ----------------------------------------------------------------------------------- namespace/pxc-operator created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2521-bb594380-1-cluster8" modified. ----------------------------------------------------------------------------------- start PXC operator ----------------------------------------------------------------------------------- customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterbackups.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterrestores.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusters.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusters.pxc.percona.com condition met E0611 01:27:57.648402 7744 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/apis/apiextensions.k8s.io/v1/customresourcedefinitions?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dperconaxtradbclusters.pxc.percona.com&resourceVersion=1781141276038399007&timeoutSeconds=334&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterbackups.pxc.percona.com condition met E0611 01:28:00.566166 8195 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/apis/apiextensions.k8s.io/v1/customresourcedefinitions?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dperconaxtradbclusterbackups.pxc.percona.com&resourceVersion=1781141276038399007&timeoutSeconds=305&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterrestores.pxc.percona.com condition met E0611 01:28:01.709299 8627 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/apis/apiextensions.k8s.io/v1/customresourcedefinitions?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dperconaxtradbclusterrestores.pxc.percona.com&resourceVersion=1781141281040104000&timeoutSeconds=579&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" clusterrole.rbac.authorization.k8s.io/percona-xtradb-cluster-operator created serviceaccount/percona-xtradb-cluster-operator created clusterrolebinding.rbac.authorization.k8s.io/service-account-percona-xtradb-cluster-operator created deployment.apps/percona-xtradb-cluster-operator created service/percona-xtradb-cluster-operator created pod/percona-xtradb-cluster-operator-774dd4b69-pvszr condition met E0611 01:28:29.694150 12405 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/pxc-operator/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpercona-xtradb-cluster-operator-774dd4b69-pvszr&resourceVersion=1781141309333509000&timeoutSeconds=524&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" pod/percona-xtradb-cluster-operator-774dd4b69-pvszr condition met E0611 01:28:39.214917 13800 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/pxc-operator/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpercona-xtradb-cluster-operator-774dd4b69-pvszr&resourceVersion=1781141315672768000&timeoutSeconds=324&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/percona-xtradb-cluster-operator-774dd4b69-pvszr to become Ready.Ok error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces custom-users-5956 ----------------------------------------------------------------------------------- Error from server (NotFound): namespaces "custom-users-5956" not found waiting for namespace/custom-users-5956 to be deletederror: resource(s) were provided, but no name was specified Error from server (NotFound): namespaces "custom-users-5956" not found ----------------------------------------------------------------------------------- create namespace custom-users-5956 ----------------------------------------------------------------------------------- namespace/custom-users-5956 created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2521-bb594380-1-cluster8" modified. ----------------------------------------------------------------------------------- create secrets for cloud storages ----------------------------------------------------------------------------------- secret/minio-secret created secret/aws-s3-secret created secret/do-spaces-secret created secret/gcp-cs-secret created secret/azure-secret created ----------------------------------------------------------------------------------- create PXC cluster ----------------------------------------------------------------------------------- secret/user-secrets created ----------------------------------------------------------------------------------- create first PXC cluster ----------------------------------------------------------------------------------- secret/my-cluster-secrets created secret/some-name-ssl created secret/some-name-ssl-internal created deployment.apps/pxc-client created perconaxtradbcluster.pxc.percona.com/some-name created ----------------------------------------------------------------------------------- waiting pods to be running for some-name ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- Waiting for 3 running pods for some-name-pxc ----------------------------------------------------------------------------------- pod/some-name-pxc-0 condition met waiting for pod/some-name-pxc-0 to become Ready.Ok pod/some-name-pxc-1 condition met waiting for pod/some-name-pxc-1 to become Ready.Ok pod/some-name-pxc-2 condition met waiting for pod/some-name-pxc-2 to become Ready.Ok ----------------------------------------------------------------------------------- Waiting for 3 running pods for some-name-haproxy ----------------------------------------------------------------------------------- pod/some-name-haproxy-0 condition met E0611 01:34:02.193305 10588 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/custom-users-5956/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dsome-name-haproxy-0&resourceVersion=1781141638050075000&timeoutSeconds=597&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/some-name-haproxy-0 to become Ready.Ok pod/some-name-haproxy-1 condition met E0611 01:34:11.621864 11800 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/custom-users-5956/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dsome-name-haproxy-1&resourceVersion=1781141648050273000&timeoutSeconds=357&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/some-name-haproxy-1 to become Ready.Ok pod/some-name-haproxy-2 condition met E0611 01:34:23.818856 13623 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/custom-users-5956/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dsome-name-haproxy-2&resourceVersion=1781141663050588000&timeoutSeconds=368&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/some-name-haproxy-2 to become Ready.Ok ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready ----------------------------------------------------------------------------------- write data ----------------------------------------------------------------------------------- pod/pxc-client-67fc4995bb-v64v6 condition met E0611 01:35:19.738580 22235 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/custom-users-5956/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-v64v6&resourceVersion=1781141715931986000&timeoutSeconds=510&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-v64v6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-v64v6 condition met E0611 01:35:52.260551 27203 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/custom-users-5956/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-v64v6&resourceVersion=1781141748437730000&timeoutSeconds=448&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-v64v6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- compare initial data ----------------------------------------------------------------------------------- pod/pxc-client-67fc4995bb-v64v6 condition met E0611 01:36:54.408355 4228 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/custom-users-5956/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-v64v6&resourceVersion=1781141809453966000&timeoutSeconds=410&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-v64v6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-v64v6 condition met E0611 01:37:12.038349 6866 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/custom-users-5956/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-v64v6&resourceVersion=1781141827658981000&timeoutSeconds=495&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-v64v6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-v64v6 condition met E0611 01:37:32.881713 10196 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/custom-users-5956/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-v64v6&resourceVersion=1781141849207655000&timeoutSeconds=366&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-v64v6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- check users created on cluster creation ----------------------------------------------------------------------------------- pod/pxc-client-67fc4995bb-v64v6 condition met E0611 01:38:00.517214 14356 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/custom-users-5956/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-v64v6&resourceVersion=1781141876121612000&timeoutSeconds=300&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-v64v6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-v64v6 condition met E0611 01:38:23.529206 18267 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/custom-users-5956/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-v64v6&resourceVersion=1781141899882498000&timeoutSeconds=323&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-v64v6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-v64v6 condition met E0611 01:38:44.459026 21490 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/custom-users-5956/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-v64v6&resourceVersion=1781141921945003000&timeoutSeconds=578&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-v64v6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-v64v6 condition met E0611 01:39:00.889444 23798 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/custom-users-5956/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-v64v6&resourceVersion=1781141936868261000&timeoutSeconds=423&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-v64v6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-v64v6 condition met E0611 01:39:22.311488 27149 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/custom-users-5956/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-v64v6&resourceVersion=1781141959382345000&timeoutSeconds=312&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-v64v6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-v64v6 condition met E0611 01:39:44.927706 30545 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/custom-users-5956/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-v64v6&resourceVersion=1781141980806836000&timeoutSeconds=563&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-v64v6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-v64v6 condition met E0611 01:40:02.993073 1018 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/custom-users-5956/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-v64v6&resourceVersion=1781142000140326000&timeoutSeconds=496&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-v64v6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- check password change ----------------------------------------------------------------------------------- secret/user-secrets patched pod/pxc-client-67fc4995bb-v64v6 condition met E0611 01:40:41.466255 6856 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/custom-users-5956/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-v64v6&resourceVersion=1781142037410432000&timeoutSeconds=515&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-v64v6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-v64v6 condition met E0611 01:41:05.357555 10443 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/custom-users-5956/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-v64v6&resourceVersion=1781142060249212000&timeoutSeconds=573&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-v64v6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-v64v6 condition met E0611 01:41:27.574098 14081 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/custom-users-5956/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-v64v6&resourceVersion=1781142084498444000&timeoutSeconds=479&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-v64v6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- check removing secretPasswordRef from user generates user password stored in generated custom-user-secret ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/some-name patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready pod/pxc-client-67fc4995bb-v64v6 condition met E0611 01:42:10.552056 20678 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/custom-users-5956/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-v64v6&resourceVersion=1781142126884386000&timeoutSeconds=528&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-v64v6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- delete initial users from CR and create a new one ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/some-name patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready pod/pxc-client-67fc4995bb-v64v6 condition met E0611 01:42:57.174486 27742 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/custom-users-5956/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-v64v6&resourceVersion=1781142173426695000&timeoutSeconds=546&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-v64v6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-v64v6 condition met E0611 01:43:16.604504 30833 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/custom-users-5956/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-v64v6&resourceVersion=1781142193517795000&timeoutSeconds=512&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-v64v6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-v64v6 condition met E0611 01:43:30.927142 869 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/custom-users-5956/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-v64v6&resourceVersion=1781142209912038000&timeoutSeconds=366&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-v64v6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-v64v6 condition met E0611 01:43:48.125869 3455 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/custom-users-5956/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-v64v6&resourceVersion=1781142227064806000&timeoutSeconds=549&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-v64v6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- check user DBs updated ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/some-name patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready pod/pxc-client-67fc4995bb-v64v6 condition met E0611 01:44:28.096728 9074 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/custom-users-5956/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-v64v6&resourceVersion=1781142264053975000&timeoutSeconds=353&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-v64v6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- check user grants updated ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/some-name patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready pod/pxc-client-67fc4995bb-v64v6 condition met E0611 01:45:08.987605 15546 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/custom-users-5956/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-v64v6&resourceVersion=1781142306130943000&timeoutSeconds=321&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-v64v6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- check user recreated after deleted from DB ----------------------------------------------------------------------------------- pod/pxc-client-67fc4995bb-v64v6 condition met E0611 01:45:29.012425 18530 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/custom-users-5956/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-v64v6&resourceVersion=1781142325720043000&timeoutSeconds=447&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-v64v6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-v64v6 condition met E0611 01:45:57.977028 23209 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/custom-users-5956/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-v64v6&resourceVersion=1781142356064149000&timeoutSeconds=461&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-v64v6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-v64v6 condition met E0611 01:46:08.744562 24803 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/custom-users-5956/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-v64v6&resourceVersion=1781142366299269000&timeoutSeconds=558&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-v64v6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- check user update from DB ----------------------------------------------------------------------------------- pod/pxc-client-67fc4995bb-v64v6 condition met E0611 01:46:19.010178 26470 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/custom-users-5956/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-v64v6&resourceVersion=1781142376942464000&timeoutSeconds=546&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-v64v6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-v64v6 condition met E0611 01:46:48.363776 31070 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/custom-users-5956/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-v64v6&resourceVersion=1781142405552084000&timeoutSeconds=504&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-v64v6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-v64v6 condition met E0611 01:47:07.113923 1346 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/custom-users-5956/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-v64v6&resourceVersion=1781142423208558000&timeoutSeconds=485&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-v64v6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- check new user created after updated user name via CR ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/some-name patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready pod/pxc-client-67fc4995bb-v64v6 condition met E0611 01:48:03.168081 9663 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/custom-users-5956/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-v64v6&resourceVersion=1781142479271253000&timeoutSeconds=513&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-v64v6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-v64v6 condition met E0611 01:48:24.082046 12941 reflector.go:227] "Failed to watch" err="Get \"https://34.121.67.239/api/v1/namespaces/custom-users-5956/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-v64v6&resourceVersion=1781142501477895000&timeoutSeconds=560&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-v64v6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- destroy cluster/operator and all other resources ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/some-name patched perconaxtradbcluster.pxc.percona.com "some-name" deleted from custom-users-5956 namespace No resources found validatingwebhookconfiguration.admissionregistration.k8s.io "percona-xtradbcluster-webhook" deleted namespace "custom-users-5956" force deleted Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. ----------------------------------------------------------------------------------- test passed -----------------------------------------------------------------------------------