Log: /mnt/jenkins/workspace/cloud-pxc-operator_PR-2539/e2e-tests/logs/custom-users-8-0.log Warning: version difference between client (1.36) and server (1.33) exceeds the supported minor version skew of +/-1 Warning: version difference between client (1.36) and server (1.33) exceeds the supported minor version skew of +/-1 error: the server doesn't have a resource type "pxc" error: the server doesn't have a resource type "pxc-backup" error: the server doesn't have a resource type "pxc-restore" error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces pxc-operator ----------------------------------------------------------------------------------- Error from server (NotFound): namespaces "pxc-operator" not found waiting for namespace/pxc-operator to be deletederror: resource(s) were provided, but no name was specified Error from server (NotFound): namespaces "pxc-operator" not found ----------------------------------------------------------------------------------- create namespace pxc-operator ----------------------------------------------------------------------------------- namespace/pxc-operator created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2539-dcdf1e8a-1-cluster8" modified. ----------------------------------------------------------------------------------- start PXC operator ----------------------------------------------------------------------------------- customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterbackups.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterrestores.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusters.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusters.pxc.percona.com condition met E0702 01:30:57.806553 9577 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/apis/apiextensions.k8s.io/v1/customresourcedefinitions?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dperconaxtradbclusters.pxc.percona.com&resourceVersion=1782955856776079007&timeoutSeconds=392&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterbackups.pxc.percona.com condition met E0702 01:30:59.729575 9965 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/apis/apiextensions.k8s.io/v1/customresourcedefinitions?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dperconaxtradbclusterbackups.pxc.percona.com&resourceVersion=1782955856776079007&timeoutSeconds=569&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterrestores.pxc.percona.com condition met E0702 01:31:01.398232 10213 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/apis/apiextensions.k8s.io/v1/customresourcedefinitions?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dperconaxtradbclusterrestores.pxc.percona.com&resourceVersion=1782955856776079007&timeoutSeconds=499&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" clusterrole.rbac.authorization.k8s.io/percona-xtradb-cluster-operator created serviceaccount/percona-xtradb-cluster-operator created clusterrolebinding.rbac.authorization.k8s.io/service-account-percona-xtradb-cluster-operator created deployment.apps/percona-xtradb-cluster-operator created service/percona-xtradb-cluster-operator created pod/percona-xtradb-cluster-operator-65b5d85575-rxmzp condition met E0702 01:31:21.221531 12883 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/pxc-operator/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpercona-xtradb-cluster-operator-65b5d85575-rxmzp&resourceVersion=1782955880859499000&timeoutSeconds=424&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" pod/percona-xtradb-cluster-operator-65b5d85575-rxmzp condition met E0702 01:31:25.358714 13727 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/pxc-operator/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpercona-xtradb-cluster-operator-65b5d85575-rxmzp&resourceVersion=1782955884387149000&timeoutSeconds=520&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/percona-xtradb-cluster-operator-65b5d85575-rxmzp to become Ready.Ok error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces custom-users-32039 ----------------------------------------------------------------------------------- Error from server (NotFound): namespaces "custom-users-32039" not found waiting for namespace/custom-users-32039 to be deletederror: resource(s) were provided, but no name was specified Error from server (NotFound): namespaces "custom-users-32039" not found ----------------------------------------------------------------------------------- create namespace custom-users-32039 ----------------------------------------------------------------------------------- namespace/custom-users-32039 created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2539-dcdf1e8a-1-cluster8" modified. ----------------------------------------------------------------------------------- create secrets for cloud storages ----------------------------------------------------------------------------------- secret/minio-secret created secret/aws-s3-secret created secret/do-spaces-secret created secret/gcp-cs-secret created secret/azure-secret created ----------------------------------------------------------------------------------- create PXC cluster ----------------------------------------------------------------------------------- secret/user-secrets created ----------------------------------------------------------------------------------- create first PXC cluster ----------------------------------------------------------------------------------- secret/my-cluster-secrets created secret/some-name-ssl created secret/some-name-ssl-internal created deployment.apps/pxc-client created perconaxtradbcluster.pxc.percona.com/some-name created ----------------------------------------------------------------------------------- waiting pods to be running for some-name ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- Waiting for 3 running pods for some-name-pxc ----------------------------------------------------------------------------------- pod/some-name-pxc-0 condition met waiting for pod/some-name-pxc-0 to become Ready.Ok pod/some-name-pxc-1 condition met waiting for pod/some-name-pxc-1 to become Ready.Ok pod/some-name-pxc-2 condition met waiting for pod/some-name-pxc-2 to become Ready.Ok ----------------------------------------------------------------------------------- Waiting for 3 running pods for some-name-haproxy ----------------------------------------------------------------------------------- pod/some-name-haproxy-0 condition met E0702 01:37:43.182581 17889 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/custom-users-32039/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dsome-name-haproxy-0&resourceVersion=1782956261920125000&timeoutSeconds=304&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/some-name-haproxy-0 to become Ready.Ok pod/some-name-haproxy-1 condition met E0702 01:37:55.124118 19711 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/custom-users-32039/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dsome-name-haproxy-1&resourceVersion=1782956271920250000&timeoutSeconds=599&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/some-name-haproxy-1 to become Ready.Ok pod/some-name-haproxy-2 condition met E0702 01:38:06.643906 21563 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/custom-users-32039/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dsome-name-haproxy-2&resourceVersion=1782956281920285000&timeoutSeconds=527&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/some-name-haproxy-2 to become Ready.Ok ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready ----------------------------------------------------------------------------------- write data ----------------------------------------------------------------------------------- pod/pxc-client-67fc4995bb-czfgd condition met E0702 01:38:53.639428 28717 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/custom-users-32039/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-czfgd&resourceVersion=1782956330264814000&timeoutSeconds=334&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-czfgd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-czfgd condition met E0702 01:39:16.365897 32196 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/custom-users-32039/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-czfgd&resourceVersion=1782956353719914000&timeoutSeconds=522&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-czfgd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- compare initial data ----------------------------------------------------------------------------------- pod/pxc-client-67fc4995bb-czfgd condition met E0702 01:40:12.876831 8517 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/custom-users-32039/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-czfgd&resourceVersion=1782956409484097000&timeoutSeconds=513&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-czfgd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-czfgd condition met E0702 01:40:27.239875 11390 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/custom-users-32039/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-czfgd&resourceVersion=1782956426136708000&timeoutSeconds=378&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-czfgd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-czfgd condition met E0702 01:40:42.851473 13315 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/custom-users-32039/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-czfgd&resourceVersion=1782956439628666000&timeoutSeconds=565&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-czfgd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- check users created on cluster creation ----------------------------------------------------------------------------------- pod/pxc-client-67fc4995bb-czfgd condition met E0702 01:41:01.633276 16265 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/custom-users-32039/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-czfgd&resourceVersion=1782956458948040000&timeoutSeconds=379&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-czfgd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-czfgd condition met E0702 01:41:19.824347 18972 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/custom-users-32039/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-czfgd&resourceVersion=1782956476272442000&timeoutSeconds=382&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-czfgd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-czfgd condition met E0702 01:41:34.013734 21100 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/custom-users-32039/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-czfgd&resourceVersion=1782956490696358000&timeoutSeconds=356&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-czfgd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-czfgd condition met E0702 01:41:53.647062 24021 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/custom-users-32039/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-czfgd&resourceVersion=1782956509894632000&timeoutSeconds=552&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-czfgd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-czfgd condition met E0702 01:42:11.365458 26861 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/custom-users-32039/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-czfgd&resourceVersion=1782956528419591000&timeoutSeconds=497&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-czfgd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-czfgd condition met E0702 01:42:33.990008 30236 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/custom-users-32039/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-czfgd&resourceVersion=1782956550359091000&timeoutSeconds=459&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-czfgd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-czfgd condition met E0702 01:42:48.394639 32392 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/custom-users-32039/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-czfgd&resourceVersion=1782956564789840000&timeoutSeconds=588&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-czfgd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- check password change ----------------------------------------------------------------------------------- secret/user-secrets patched pod/pxc-client-67fc4995bb-czfgd condition met E0702 01:43:25.349189 5762 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/custom-users-32039/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-czfgd&resourceVersion=1782956602139424000&timeoutSeconds=595&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-czfgd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-czfgd condition met E0702 01:43:38.861334 7947 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/custom-users-32039/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-czfgd&resourceVersion=1782956615929397000&timeoutSeconds=312&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-czfgd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-czfgd condition met E0702 01:43:52.352004 10047 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/custom-users-32039/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-czfgd&resourceVersion=1782956629195947000&timeoutSeconds=480&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-czfgd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- check removing secretPasswordRef from user generates user password stored in generated custom-user-secret ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/some-name patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready pod/pxc-client-67fc4995bb-czfgd condition met E0702 01:44:37.493227 16903 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/custom-users-32039/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-czfgd&resourceVersion=1782956674198136000&timeoutSeconds=428&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-czfgd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- delete initial users from CR and create a new one ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/some-name patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready pod/pxc-client-67fc4995bb-czfgd condition met E0702 01:45:12.420967 22379 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/custom-users-32039/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-czfgd&resourceVersion=1782956709897450000&timeoutSeconds=497&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-czfgd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-czfgd condition met E0702 01:45:28.986920 24811 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/custom-users-32039/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-czfgd&resourceVersion=1782956725747468000&timeoutSeconds=306&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-czfgd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-czfgd condition met E0702 01:45:43.533469 27001 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/custom-users-32039/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-czfgd&resourceVersion=1782956739803660000&timeoutSeconds=336&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-czfgd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-czfgd condition met E0702 01:46:01.701871 29753 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/custom-users-32039/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-czfgd&resourceVersion=1782956757855242000&timeoutSeconds=341&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-czfgd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- check user DBs updated ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/some-name patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready pod/pxc-client-67fc4995bb-czfgd condition met E0702 01:46:38.109607 3035 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/custom-users-32039/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-czfgd&resourceVersion=1782956794846714000&timeoutSeconds=398&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-czfgd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- check user grants updated ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/some-name patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready pod/pxc-client-67fc4995bb-czfgd condition met E0702 01:47:13.756791 8654 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/custom-users-32039/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-czfgd&resourceVersion=1782956831293693000&timeoutSeconds=538&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-czfgd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- check user recreated after deleted from DB ----------------------------------------------------------------------------------- pod/pxc-client-67fc4995bb-czfgd condition met E0702 01:47:27.075217 10776 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/custom-users-32039/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-czfgd&resourceVersion=1782956844647534000&timeoutSeconds=365&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-czfgd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-czfgd condition met E0702 01:47:57.116008 15387 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/custom-users-32039/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-czfgd&resourceVersion=1782956873673472000&timeoutSeconds=594&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-czfgd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-czfgd condition met E0702 01:48:12.733490 17847 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/custom-users-32039/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-czfgd&resourceVersion=1782956890009852000&timeoutSeconds=595&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-czfgd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- check user update from DB ----------------------------------------------------------------------------------- pod/pxc-client-67fc4995bb-czfgd condition met E0702 01:48:25.766281 19803 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/custom-users-32039/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-czfgd&resourceVersion=1782956903316100000&timeoutSeconds=557&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-czfgd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-czfgd condition met E0702 01:48:53.071525 23812 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/custom-users-32039/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-czfgd&resourceVersion=1782956931166716000&timeoutSeconds=562&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-czfgd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-czfgd condition met E0702 01:49:02.567690 25231 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/custom-users-32039/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-czfgd&resourceVersion=1782956940635949000&timeoutSeconds=306&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-czfgd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- check new user created after updated user name via CR ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/some-name patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready pod/pxc-client-67fc4995bb-czfgd condition met E0702 01:49:39.787634 30510 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/custom-users-32039/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-czfgd&resourceVersion=1782956975682178000&timeoutSeconds=551&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-czfgd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-czfgd condition met E0702 01:49:58.387111 836 reflector.go:227] "Failed to watch" err="Get \"https://35.192.179.0/api/v1/namespaces/custom-users-32039/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-czfgd&resourceVersion=1782956994798000000&timeoutSeconds=578&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-czfgd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- destroy cluster/operator and all other resources ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/some-name patched perconaxtradbcluster.pxc.percona.com "some-name" deleted from custom-users-32039 namespace No resources found validatingwebhookconfiguration.admissionregistration.k8s.io "percona-xtradbcluster-webhook" deleted namespace "pxc-operator" force deleted Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. namespace "custom-users-32039" force deleted Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. ----------------------------------------------------------------------------------- test passed -----------------------------------------------------------------------------------