Log: /mnt/jenkins/workspace/cloud-pxc-operator_PR-2473/e2e-tests/logs/users-8-0.log Warning: version difference between client (1.36) and server (1.33) exceeds the supported minor version skew of +/-1 Warning: version difference between client (1.36) and server (1.33) exceeds the supported minor version skew of +/-1 No resources found + kubectl patch pxc -n sh --type=merge -p '{"metadata":{"finalizers":[]}}' error: resource(s) were provided, but no name was specified No resources found No resources found No resources found error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces pxc-operator ----------------------------------------------------------------------------------- Error from server (NotFound): namespaces "pxc-operator" not found waiting for namespace/pxc-operator to be deletederror: resource(s) were provided, but no name was specified Error from server (NotFound): namespaces "pxc-operator" not found ----------------------------------------------------------------------------------- create namespace pxc-operator ----------------------------------------------------------------------------------- namespace/pxc-operator created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2473-6d392bea-4-cluster4" modified. ----------------------------------------------------------------------------------- start PXC operator ----------------------------------------------------------------------------------- customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterbackups.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterrestores.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusters.pxc.percona.com serverside-applied clusterrole.rbac.authorization.k8s.io/percona-xtradb-cluster-operator unchanged serviceaccount/percona-xtradb-cluster-operator created clusterrolebinding.rbac.authorization.k8s.io/service-account-percona-xtradb-cluster-operator unchanged deployment.apps/percona-xtradb-cluster-operator created service/percona-xtradb-cluster-operator created pod/percona-xtradb-cluster-operator-55d95dc9d8-mfbbd condition met E0517 02:05:27.783214 20778 reflector.go:227] "Failed to watch" err="Get \"https://35.239.222.207/api/v1/namespaces/pxc-operator/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpercona-xtradb-cluster-operator-55d95dc9d8-mfbbd&resourceVersion=1778983527423849000&timeoutSeconds=322&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" pod/percona-xtradb-cluster-operator-55d95dc9d8-mfbbd condition met E0517 02:05:34.717211 21696 reflector.go:227] "Failed to watch" err="Get \"https://35.239.222.207/api/v1/namespaces/pxc-operator/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpercona-xtradb-cluster-operator-55d95dc9d8-mfbbd&resourceVersion=1778983531761582000&timeoutSeconds=433&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/percona-xtradb-cluster-operator-55d95dc9d8-mfbbd to become Ready.Ok error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces users-26844 ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified Error from server (NotFound): namespaces "users-26844" not found waiting for namespace/users-26844 to be deletedError from server (NotFound): namespaces "users-26844" not found ----------------------------------------------------------------------------------- create namespace users-26844 ----------------------------------------------------------------------------------- namespace/users-26844 created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2473-6d392bea-4-cluster4" modified. ----------------------------------------------------------------------------------- create secrets for cloud storages ----------------------------------------------------------------------------------- secret/minio-secret created secret/aws-s3-secret created secret/do-spaces-secret created secret/gcp-cs-secret created secret/azure-secret created ----------------------------------------------------------------------------------- create PXC cluster with 1-password secret ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- create first PXC cluster ----------------------------------------------------------------------------------- secret/my-cluster-secrets created secret/some-name-ssl created secret/some-name-ssl-internal created deployment.apps/pxc-client created perconaxtradbcluster.pxc.percona.com/some-name created ----------------------------------------------------------------------------------- check if all 3 Pods started ----------------------------------------------------------------------------------- error: no matching resources found ----------------------------------------------------------------------------------- wait for running cluster ----------------------------------------------------------------------------------- pod/some-name-proxysql-0 condition met waiting for pod/some-name-proxysql-0 to become Ready.Ok ----------------------------------------------------------------------------------- wait for running cluster ----------------------------------------------------------------------------------- pod/some-name-pxc-0 condition met waiting for pod/some-name-pxc-0 to become Ready.Ok pod/some-name-pxc-1 condition met waiting for pod/some-name-pxc-1 to become Ready.Ok pod/some-name-pxc-2 condition met waiting for pod/some-name-pxc-2 to become Ready.Ok ----------------------------------------------------------------------------------- write data ----------------------------------------------------------------------------------- pod/pxc-client-67fc4995bb-vpx8q condition met E0517 02:10:41.264431 29521 reflector.go:227] "Failed to watch" err="Get \"https://35.239.222.207/api/v1/namespaces/users-26844/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-vpx8q&resourceVersion=1778983839821037000&timeoutSeconds=524&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-vpx8q to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-vpx8q condition met E0517 02:10:53.258277 30973 reflector.go:227] "Failed to watch" err="Get \"https://35.239.222.207/api/v1/namespaces/users-26844/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-vpx8q&resourceVersion=1778983850810316000&timeoutSeconds=334&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-vpx8q to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-vpx8q condition met E0517 02:11:30.411423 2003 reflector.go:227] "Failed to watch" err="Get \"https://35.239.222.207/api/v1/namespaces/users-26844/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-vpx8q&resourceVersion=1778983889649495000&timeoutSeconds=498&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-vpx8q to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-vpx8q condition met E0517 02:11:36.440511 2557 reflector.go:227] "Failed to watch" err="Get \"https://35.239.222.207/api/v1/namespaces/users-26844/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-vpx8q&resourceVersion=1778983895692399000&timeoutSeconds=467&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-vpx8q to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-vpx8q condition met E0517 02:11:42.899202 3272 reflector.go:227] "Failed to watch" err="Get \"https://35.239.222.207/api/v1/namespaces/users-26844/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-vpx8q&resourceVersion=1778983901429081000&timeoutSeconds=542&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-vpx8q to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok Unable to use a TTY - input is not a terminal or the right kind of file ----------------------------------------------------------------------------------- test missing passwords were created and present in internal secrets ----------------------------------------------------------------------------------- Checking root Running compare for root pod/pxc-client-67fc4995bb-vpx8q condition met E0517 02:11:55.084142 4866 reflector.go:227] "Failed to watch" err="Get \"https://35.239.222.207/api/v1/namespaces/users-26844/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-vpx8q&resourceVersion=1778983914282658000&timeoutSeconds=466&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-vpx8q to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok Checking xtrabackup Running compare for xtrabackup pod/pxc-client-67fc4995bb-vpx8q condition met E0517 02:12:07.426983 6453 reflector.go:227] "Failed to watch" err="Get \"https://35.239.222.207/api/v1/namespaces/users-26844/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-vpx8q&resourceVersion=1778983925225405000&timeoutSeconds=417&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-vpx8q to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok Checking monitor Running compare for monitor pod/pxc-client-67fc4995bb-vpx8q condition met E0517 02:12:18.619059 8158 reflector.go:227] "Failed to watch" err="Get \"https://35.239.222.207/api/v1/namespaces/users-26844/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-vpx8q&resourceVersion=1778983937813889000&timeoutSeconds=520&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-vpx8q to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok Checking proxyadmin Running compare for proxyadmin Checking operator Running compare for operator pod/pxc-client-67fc4995bb-vpx8q condition met E0517 02:12:36.070680 10534 reflector.go:227] "Failed to watch" err="Get \"https://35.239.222.207/api/v1/namespaces/users-26844/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-vpx8q&resourceVersion=1778983953723429000&timeoutSeconds=339&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-vpx8q to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok Checking replication Running compare for replication pod/pxc-client-67fc4995bb-vpx8q condition met E0517 02:12:49.374141 12483 reflector.go:227] "Failed to watch" err="Get \"https://35.239.222.207/api/v1/namespaces/users-26844/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-vpx8q&resourceVersion=1778983967049339000&timeoutSeconds=409&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-vpx8q to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- test root ----------------------------------------------------------------------------------- secret/my-cluster-secrets patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready pod/pxc-client-67fc4995bb-vpx8q condition met E0517 02:13:42.269127 18853 reflector.go:227] "Failed to watch" err="Get \"https://35.239.222.207/api/v1/namespaces/users-26844/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-vpx8q&resourceVersion=1778984021406188000&timeoutSeconds=470&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-vpx8q to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- test proxyadmin ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/some-name patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready secret/my-cluster-secrets patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready.... ----------------------------------------------------------------------------------- test xtrabackup ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/some-name patched secret/my-cluster-secrets patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready............................ ----------------------------------------------------------------------------------- test monitor ----------------------------------------------------------------------------------- secret/my-cluster-secrets patched pod/pxc-client-67fc4995bb-vpx8q condition met E0517 02:19:09.751194 16621 reflector.go:227] "Failed to watch" err="Get \"https://35.239.222.207/api/v1/namespaces/users-26844/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-vpx8q&resourceVersion=1778984349002835000&timeoutSeconds=496&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-vpx8q to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok {"additional_password": "$A$005$;eNc.KO3q!{X{j,3\\u000fs\\u001a\\rw8nQgohSRDWK8WBXKTczq5xy6UteTXcuVNMxFdxtID7"} Old password successfully discarded after 7 retries ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready pod/pxc-client-67fc4995bb-vpx8q condition met E0517 02:20:36.810254 23638 reflector.go:227] "Failed to watch" err="Get \"https://35.239.222.207/api/v1/namespaces/users-26844/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-vpx8q&resourceVersion=1778984436021321000&timeoutSeconds=327&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-vpx8q to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- test operator ----------------------------------------------------------------------------------- secret/my-cluster-secrets patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready... pod/pxc-client-67fc4995bb-vpx8q condition met E0517 02:21:42.946528 27938 reflector.go:227] "Failed to watch" err="Get \"https://35.239.222.207/api/v1/namespaces/users-26844/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-vpx8q&resourceVersion=1778984502185150000&timeoutSeconds=498&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-vpx8q to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- change secret name ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/some-name patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready............/mnt/jenkins/workspace/cloud-pxc-operator_PR-2473/e2e-tests/users/../functions: line 152: 32116 Terminated sleep 5