Log: /mnt/jenkins/workspace/cloud-pxc-operator_PR-2467/e2e-tests/logs/custom-users-8-0.log Warning: version difference between client (1.36) and server (1.33) exceeds the supported minor version skew of +/-1 Warning: version difference between client (1.36) and server (1.33) exceeds the supported minor version skew of +/-1 error: the server doesn't have a resource type "pxc" + kubectl patch pxc -n sh --type=merge -p '{"metadata":{"finalizers":[]}}' error: the server doesn't have a resource type "pxc" error: the server doesn't have a resource type "pxc" error: the server doesn't have a resource type "pxc-backup" error: the server doesn't have a resource type "pxc-restore" error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces pxc-operator ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified Error from server (NotFound): namespaces "pxc-operator" not found waiting for namespace/pxc-operator to be deletedError from server (NotFound): namespaces "pxc-operator" not found ----------------------------------------------------------------------------------- create namespace pxc-operator ----------------------------------------------------------------------------------- namespace/pxc-operator created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2467-3dc7f023-16-cluster8" modified. ----------------------------------------------------------------------------------- start PXC operator ----------------------------------------------------------------------------------- customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterbackups.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterrestores.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusters.pxc.percona.com serverside-applied clusterrole.rbac.authorization.k8s.io/percona-xtradb-cluster-operator created serviceaccount/percona-xtradb-cluster-operator created clusterrolebinding.rbac.authorization.k8s.io/service-account-percona-xtradb-cluster-operator created deployment.apps/percona-xtradb-cluster-operator created service/percona-xtradb-cluster-operator created pod/percona-xtradb-cluster-operator-9d9fbdb5-wgd54 condition met E0516 18:13:59.556847 23077 reflector.go:227] "Failed to watch" err="Get \"https://34.123.251.145/api/v1/namespaces/pxc-operator/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpercona-xtradb-cluster-operator-9d9fbdb5-wgd54&resourceVersion=1778955239193612000&timeoutSeconds=365&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" pod/percona-xtradb-cluster-operator-9d9fbdb5-wgd54 condition met E0516 18:14:07.526056 24182 reflector.go:227] "Failed to watch" err="Get \"https://34.123.251.145/api/v1/namespaces/pxc-operator/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpercona-xtradb-cluster-operator-9d9fbdb5-wgd54&resourceVersion=1778955244695367000&timeoutSeconds=393&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/percona-xtradb-cluster-operator-9d9fbdb5-wgd54 to become Ready.Ok error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces custom-users-2118 ----------------------------------------------------------------------------------- Error from server (NotFound): namespaces "custom-users-2118" not found waiting for namespace/custom-users-2118 to be deletederror: resource(s) were provided, but no name was specified Error from server (NotFound): namespaces "custom-users-2118" not found ----------------------------------------------------------------------------------- create namespace custom-users-2118 ----------------------------------------------------------------------------------- namespace/custom-users-2118 created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2467-3dc7f023-16-cluster8" modified. ----------------------------------------------------------------------------------- create secrets for cloud storages ----------------------------------------------------------------------------------- secret/minio-secret created secret/aws-s3-secret created secret/do-spaces-secret created secret/gcp-cs-secret created secret/azure-secret created ----------------------------------------------------------------------------------- create PXC cluster ----------------------------------------------------------------------------------- secret/user-secrets created ----------------------------------------------------------------------------------- create first PXC cluster ----------------------------------------------------------------------------------- secret/my-cluster-secrets created secret/some-name-ssl created secret/some-name-ssl-internal created deployment.apps/pxc-client created perconaxtradbcluster.pxc.percona.com/some-name created ----------------------------------------------------------------------------------- check if all 3 Pods started ----------------------------------------------------------------------------------- error: no matching resources found ----------------------------------------------------------------------------------- wait for running cluster ----------------------------------------------------------------------------------- pod/some-name-haproxy-0 condition met waiting for pod/some-name-haproxy-0 to become Ready.Ok ----------------------------------------------------------------------------------- wait for running cluster ----------------------------------------------------------------------------------- pod/some-name-pxc-0 condition met E0516 18:16:30.781520 7065 reflector.go:227] "Failed to watch" err="Get \"https://34.123.251.145/api/v1/namespaces/custom-users-2118/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dsome-name-pxc-0&resourceVersion=1778955389718687018&timeoutSeconds=582&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/some-name-pxc-0 to become Ready.Ok pod/some-name-pxc-1 condition met waiting for pod/some-name-pxc-1 to become Ready.Ok pod/some-name-pxc-2 condition met waiting for pod/some-name-pxc-2 to become Ready.Ok ----------------------------------------------------------------------------------- write data ----------------------------------------------------------------------------------- pod/pxc-client-67fc4995bb-lxhh2 condition met E0516 18:19:21.734408 16029 reflector.go:227] "Failed to watch" err="Get \"https://34.123.251.145/api/v1/namespaces/custom-users-2118/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-lxhh2&resourceVersion=1778955560975543000&timeoutSeconds=556&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-lxhh2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-lxhh2 condition met E0516 18:19:27.062144 16606 reflector.go:227] "Failed to watch" err="Get \"https://34.123.251.145/api/v1/namespaces/custom-users-2118/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-lxhh2&resourceVersion=1778955566308302000&timeoutSeconds=556&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-lxhh2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-lxhh2 condition met E0516 18:20:02.309863 19440 reflector.go:227] "Failed to watch" err="Get \"https://34.123.251.145/api/v1/namespaces/custom-users-2118/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-lxhh2&resourceVersion=1778955600876500000&timeoutSeconds=369&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-lxhh2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-lxhh2 condition met E0516 18:20:08.779410 20352 reflector.go:227] "Failed to watch" err="Get \"https://34.123.251.145/api/v1/namespaces/custom-users-2118/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-lxhh2&resourceVersion=1778955608001429000&timeoutSeconds=438&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-lxhh2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-lxhh2 condition met E0516 18:20:15.469769 21200 reflector.go:227] "Failed to watch" err="Get \"https://34.123.251.145/api/v1/namespaces/custom-users-2118/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-lxhh2&resourceVersion=1778955614713228000&timeoutSeconds=366&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-lxhh2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- check users created on cluster creation ----------------------------------------------------------------------------------- pod/pxc-client-67fc4995bb-lxhh2 condition met E0516 18:20:23.095247 21836 reflector.go:227] "Failed to watch" err="Get \"https://34.123.251.145/api/v1/namespaces/custom-users-2118/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-lxhh2&resourceVersion=1778955621638277000&timeoutSeconds=595&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-lxhh2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-lxhh2 condition met E0516 18:20:30.344052 22917 reflector.go:227] "Failed to watch" err="Get \"https://34.123.251.145/api/v1/namespaces/custom-users-2118/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-lxhh2&resourceVersion=1778955629350854000&timeoutSeconds=499&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-lxhh2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-lxhh2 condition met E0516 18:20:39.991168 24106 reflector.go:227] "Failed to watch" err="Get \"https://34.123.251.145/api/v1/namespaces/custom-users-2118/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-lxhh2&resourceVersion=1778955637752236000&timeoutSeconds=596&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-lxhh2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-lxhh2 condition met E0516 18:20:51.034667 25662 reflector.go:227] "Failed to watch" err="Get \"https://34.123.251.145/api/v1/namespaces/custom-users-2118/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-lxhh2&resourceVersion=1778955648330447000&timeoutSeconds=336&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-lxhh2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-lxhh2 condition met E0516 18:21:03.372074 27509 reflector.go:227] "Failed to watch" err="Get \"https://34.123.251.145/api/v1/namespaces/custom-users-2118/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-lxhh2&resourceVersion=1778955661039711000&timeoutSeconds=535&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-lxhh2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-lxhh2 condition met E0516 18:21:25.068820 30557 reflector.go:227] "Failed to watch" err="Get \"https://34.123.251.145/api/v1/namespaces/custom-users-2118/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-lxhh2&resourceVersion=1778955681381697000&timeoutSeconds=442&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-lxhh2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-lxhh2 condition met E0516 18:21:37.081836 32431 reflector.go:227] "Failed to watch" err="Get \"https://34.123.251.145/api/v1/namespaces/custom-users-2118/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-lxhh2&resourceVersion=1778955694694738000&timeoutSeconds=554&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-lxhh2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- check password change ----------------------------------------------------------------------------------- secret/user-secrets patched pod/pxc-client-67fc4995bb-lxhh2 condition met E0516 18:22:00.066463 2441 reflector.go:227] "Failed to watch" err="Get \"https://34.123.251.145/api/v1/namespaces/custom-users-2118/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-lxhh2&resourceVersion=1778955718652251000&timeoutSeconds=539&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-lxhh2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-lxhh2 condition met E0516 18:22:07.228427 3326 reflector.go:227] "Failed to watch" err="Get \"https://34.123.251.145/api/v1/namespaces/custom-users-2118/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-lxhh2&resourceVersion=1778955725387072000&timeoutSeconds=312&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-lxhh2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-lxhh2 condition met E0516 18:22:20.661304 5158 reflector.go:227] "Failed to watch" err="Get \"https://34.123.251.145/api/v1/namespaces/custom-users-2118/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-lxhh2&resourceVersion=1778955737597748000&timeoutSeconds=332&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-lxhh2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- check removing secretPasswordRef from user generates user password stored in generated custom-user-secret ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/some-name patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready pod/pxc-client-67fc4995bb-lxhh2 condition met E0516 18:22:49.130225 9538 reflector.go:227] "Failed to watch" err="Get \"https://34.123.251.145/api/v1/namespaces/custom-users-2118/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-lxhh2&resourceVersion=1778955768339846000&timeoutSeconds=432&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-lxhh2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- delete initial users from CR and create a new one ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/some-name patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready pod/pxc-client-67fc4995bb-lxhh2 condition met E0516 18:23:14.011670 12810 reflector.go:227] "Failed to watch" err="Get \"https://34.123.251.145/api/v1/namespaces/custom-users-2118/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-lxhh2&resourceVersion=1778955792226368000&timeoutSeconds=595&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-lxhh2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-lxhh2 condition met E0516 18:23:22.594890 13947 reflector.go:227] "Failed to watch" err="Get \"https://34.123.251.145/api/v1/namespaces/custom-users-2118/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-lxhh2&resourceVersion=1778955800833967000&timeoutSeconds=384&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-lxhh2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-lxhh2 condition met E0516 18:23:33.219289 15452 reflector.go:227] "Failed to watch" err="Get \"https://34.123.251.145/api/v1/namespaces/custom-users-2118/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-lxhh2&resourceVersion=1778955810949404000&timeoutSeconds=398&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-lxhh2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-lxhh2 condition met E0516 18:23:48.069398 17487 reflector.go:227] "Failed to watch" err="Get \"https://34.123.251.145/api/v1/namespaces/custom-users-2118/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-lxhh2&resourceVersion=1778955825024392000&timeoutSeconds=549&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-lxhh2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- check user DBs updated ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/some-name patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready pod/pxc-client-67fc4995bb-lxhh2 condition met E0516 18:24:23.607027 22744 reflector.go:227] "Failed to watch" err="Get \"https://34.123.251.145/api/v1/namespaces/custom-users-2118/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-lxhh2&resourceVersion=1778955861059947000&timeoutSeconds=524&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-lxhh2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- check user grants updated ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/some-name patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready pod/pxc-client-67fc4995bb-lxhh2 condition met E0516 18:24:53.852453 27130 reflector.go:227] "Failed to watch" err="Get \"https://34.123.251.145/api/v1/namespaces/custom-users-2118/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-lxhh2&resourceVersion=1778955891571841000&timeoutSeconds=566&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-lxhh2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- check user recreated after deleted from DB ----------------------------------------------------------------------------------- pod/pxc-client-67fc4995bb-lxhh2 condition met E0516 18:25:07.690911 29193 reflector.go:227] "Failed to watch" err="Get \"https://34.123.251.145/api/v1/namespaces/custom-users-2118/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-lxhh2&resourceVersion=1778955905454981000&timeoutSeconds=562&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-lxhh2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-lxhh2 condition met E0516 18:25:36.799303 854 reflector.go:227] "Failed to watch" err="Get \"https://34.123.251.145/api/v1/namespaces/custom-users-2118/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-lxhh2&resourceVersion=1778955934046040000&timeoutSeconds=301&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-lxhh2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-lxhh2 condition met E0516 18:25:53.105283 3564 reflector.go:227] "Failed to watch" err="Get \"https://34.123.251.145/api/v1/namespaces/custom-users-2118/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-lxhh2&resourceVersion=1778955950479885000&timeoutSeconds=595&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-lxhh2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- check user update from DB ----------------------------------------------------------------------------------- pod/pxc-client-67fc4995bb-lxhh2 condition met E0516 18:26:08.978571 5651 reflector.go:227] "Failed to watch" err="Get \"https://34.123.251.145/api/v1/namespaces/custom-users-2118/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-lxhh2&resourceVersion=1778955966007899000&timeoutSeconds=370&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-lxhh2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-lxhh2 condition met E0516 18:26:38.125572 9841 reflector.go:227] "Failed to watch" err="Get \"https://34.123.251.145/api/v1/namespaces/custom-users-2118/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-lxhh2&resourceVersion=1778955996003408000&timeoutSeconds=593&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-lxhh2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-lxhh2 condition met E0516 18:26:47.492288 11187 reflector.go:227] "Failed to watch" err="Get \"https://34.123.251.145/api/v1/namespaces/custom-users-2118/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-lxhh2&resourceVersion=1778956005202036000&timeoutSeconds=470&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-lxhh2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- check new user created after updated user name via CR ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/some-name patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready pod/pxc-client-67fc4995bb-lxhh2 condition met E0516 18:27:17.510116 15525 reflector.go:227] "Failed to watch" err="Get \"https://34.123.251.145/api/v1/namespaces/custom-users-2118/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-lxhh2&resourceVersion=1778956034460651000&timeoutSeconds=579&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-lxhh2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-lxhh2 condition met E0516 18:27:32.982281 17730 reflector.go:227] "Failed to watch" err="Get \"https://34.123.251.145/api/v1/namespaces/custom-users-2118/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-lxhh2&resourceVersion=1778956050002740000&timeoutSeconds=494&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-lxhh2 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- destroy cluster/operator and all other resources ----------------------------------------------------------------------------------- + kubectl patch pxc -n custom-users-2118 some-name --type=merge -p '{"metadata":{"finalizers":[]}}' perconaxtradbcluster.pxc.percona.com/some-name patched perconaxtradbcluster.pxc.percona.com "some-name" deleted from custom-users-2118 namespace No resources found No resources found validatingwebhookconfiguration.admissionregistration.k8s.io "percona-xtradbcluster-webhook" deleted ----------------------------------------------------------------------------------- test passed -----------------------------------------------------------------------------------