Log: /mnt/jenkins/workspace/cloud-pxc-operator_PR-2473/e2e-tests/logs/users-scheduler-8-4.log Warning: version difference between client (1.36) and server (1.33) exceeds the supported minor version skew of +/-1 Warning: version difference between client (1.36) and server (1.33) exceeds the supported minor version skew of +/-1 No resources found + kubectl patch pxc -n sh --type=merge -p '{"metadata":{"finalizers":[]}}' error: resource(s) were provided, but no name was specified No resources found No resources found No resources found error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces pxc-operator ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified namespace "pxc-operator" deleted waiting for namespace/pxc-operator to be deletedError from server (NotFound): namespaces "pxc-operator" not found ----------------------------------------------------------------------------------- create namespace pxc-operator ----------------------------------------------------------------------------------- namespace/pxc-operator created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2473-6d392bea-4-cluster2" modified. ----------------------------------------------------------------------------------- start PXC operator ----------------------------------------------------------------------------------- customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterbackups.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterrestores.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusters.pxc.percona.com serverside-applied clusterrole.rbac.authorization.k8s.io/percona-xtradb-cluster-operator unchanged serviceaccount/percona-xtradb-cluster-operator created clusterrolebinding.rbac.authorization.k8s.io/service-account-percona-xtradb-cluster-operator unchanged deployment.apps/percona-xtradb-cluster-operator created service/percona-xtradb-cluster-operator created pod/percona-xtradb-cluster-operator-55d95dc9d8-srpvj condition met E0517 02:12:39.444349 11047 reflector.go:227] "Failed to watch" err="Get \"https://34.61.233.25/api/v1/namespaces/pxc-operator/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpercona-xtradb-cluster-operator-55d95dc9d8-srpvj&resourceVersion=1778983959084591000&timeoutSeconds=446&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" pod/percona-xtradb-cluster-operator-55d95dc9d8-srpvj condition met E0517 02:12:43.762848 11668 reflector.go:227] "Failed to watch" err="Get \"https://34.61.233.25/api/v1/namespaces/pxc-operator/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpercona-xtradb-cluster-operator-55d95dc9d8-srpvj&resourceVersion=1778983961505075000&timeoutSeconds=518&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/percona-xtradb-cluster-operator-55d95dc9d8-srpvj to become Ready.Ok error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces users-scheduler-5384 ----------------------------------------------------------------------------------- Error from server (NotFound): namespaces "users-scheduler-5384" not found waiting for namespace/users-scheduler-5384 to be deletederror: resource(s) were provided, but no name was specified Error from server (NotFound): namespaces "users-scheduler-5384" not found ----------------------------------------------------------------------------------- create namespace users-scheduler-5384 ----------------------------------------------------------------------------------- namespace/users-scheduler-5384 created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2473-6d392bea-4-cluster2" modified. ----------------------------------------------------------------------------------- create secrets for cloud storages ----------------------------------------------------------------------------------- secret/minio-secret created secret/aws-s3-secret created secret/do-spaces-secret created secret/gcp-cs-secret created secret/azure-secret created ----------------------------------------------------------------------------------- create PXC cluster with 1-password secret ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- create first PXC cluster ----------------------------------------------------------------------------------- secret/my-cluster-secrets created secret/some-name-ssl created secret/some-name-ssl-internal created deployment.apps/pxc-client created perconaxtradbcluster.pxc.percona.com/some-name created ----------------------------------------------------------------------------------- check if all 3 Pods started ----------------------------------------------------------------------------------- error: no matching resources found ----------------------------------------------------------------------------------- wait for running cluster ----------------------------------------------------------------------------------- pod/some-name-proxysql-0 condition met waiting for pod/some-name-proxysql-0 to become Ready.Ok ----------------------------------------------------------------------------------- wait for running cluster ----------------------------------------------------------------------------------- pod/some-name-pxc-0 condition met waiting for pod/some-name-pxc-0 to become Ready.Ok pod/some-name-pxc-1 condition met waiting for pod/some-name-pxc-1 to become Ready.Ok pod/some-name-pxc-2 condition met waiting for pod/some-name-pxc-2 to become Ready.Ok ----------------------------------------------------------------------------------- write data ----------------------------------------------------------------------------------- pod/pxc-client-56fd5498cd-7xmc9 condition met E0517 02:17:31.229139 7986 reflector.go:227] "Failed to watch" err="Get \"https://34.61.233.25/api/v1/namespaces/users-scheduler-5384/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-56fd5498cd-7xmc9&resourceVersion=1778984250484311000&timeoutSeconds=481&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-56fd5498cd-7xmc9 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-56fd5498cd-7xmc9 condition met E0517 02:17:35.998594 8502 reflector.go:227] "Failed to watch" err="Get \"https://34.61.233.25/api/v1/namespaces/users-scheduler-5384/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-56fd5498cd-7xmc9&resourceVersion=1778984255235825000&timeoutSeconds=305&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-56fd5498cd-7xmc9 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-56fd5498cd-7xmc9 condition met E0517 02:18:12.131748 10990 reflector.go:227] "Failed to watch" err="Get \"https://34.61.233.25/api/v1/namespaces/users-scheduler-5384/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-56fd5498cd-7xmc9&resourceVersion=1778984290745318000&timeoutSeconds=582&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-56fd5498cd-7xmc9 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-56fd5498cd-7xmc9 condition met E0517 02:18:16.623668 11483 reflector.go:227] "Failed to watch" err="Get \"https://34.61.233.25/api/v1/namespaces/users-scheduler-5384/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-56fd5498cd-7xmc9&resourceVersion=1778984295865060000&timeoutSeconds=454&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-56fd5498cd-7xmc9 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-56fd5498cd-7xmc9 condition met E0517 02:18:22.178687 11982 reflector.go:227] "Failed to watch" err="Get \"https://34.61.233.25/api/v1/namespaces/users-scheduler-5384/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-56fd5498cd-7xmc9&resourceVersion=1778984300623315000&timeoutSeconds=500&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-56fd5498cd-7xmc9 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok Unable to use a TTY - input is not a terminal or the right kind of file ----------------------------------------------------------------------------------- test missing passwords were created and present in internal secrets ----------------------------------------------------------------------------------- Checking root Running compare for root pod/pxc-client-56fd5498cd-7xmc9 condition met E0517 02:18:31.034430 12797 reflector.go:227] "Failed to watch" err="Get \"https://34.61.233.25/api/v1/namespaces/users-scheduler-5384/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-56fd5498cd-7xmc9&resourceVersion=1778984309480817000&timeoutSeconds=465&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-56fd5498cd-7xmc9 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok Checking xtrabackup Running compare for xtrabackup pod/pxc-client-56fd5498cd-7xmc9 condition met E0517 02:18:38.185361 13509 reflector.go:227] "Failed to watch" err="Get \"https://34.61.233.25/api/v1/namespaces/users-scheduler-5384/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-56fd5498cd-7xmc9&resourceVersion=1778984317421171000&timeoutSeconds=375&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-56fd5498cd-7xmc9 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok Checking monitor Running compare for monitor pod/pxc-client-56fd5498cd-7xmc9 condition met E0517 02:18:44.511298 14135 reflector.go:227] "Failed to watch" err="Get \"https://34.61.233.25/api/v1/namespaces/users-scheduler-5384/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-56fd5498cd-7xmc9&resourceVersion=1778984323756451000&timeoutSeconds=403&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-56fd5498cd-7xmc9 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok Checking proxyadmin Running compare for proxyadmin Checking operator Running compare for operator pod/pxc-client-56fd5498cd-7xmc9 condition met E0517 02:18:55.346225 15258 reflector.go:227] "Failed to watch" err="Get \"https://34.61.233.25/api/v1/namespaces/users-scheduler-5384/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-56fd5498cd-7xmc9&resourceVersion=1778984334559643000&timeoutSeconds=546&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-56fd5498cd-7xmc9 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok Checking replication Running compare for replication pod/pxc-client-56fd5498cd-7xmc9 condition met E0517 02:19:01.450746 15830 reflector.go:227] "Failed to watch" err="Get \"https://34.61.233.25/api/v1/namespaces/users-scheduler-5384/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-56fd5498cd-7xmc9&resourceVersion=1778984340660321000&timeoutSeconds=424&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-56fd5498cd-7xmc9 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- test root ----------------------------------------------------------------------------------- secret/my-cluster-secrets patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready pod/pxc-client-56fd5498cd-7xmc9 condition met E0517 02:19:50.788040 20403 reflector.go:227] "Failed to watch" err="Get \"https://34.61.233.25/api/v1/namespaces/users-scheduler-5384/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-56fd5498cd-7xmc9&resourceVersion=1778984390001735000&timeoutSeconds=301&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-56fd5498cd-7xmc9 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- test proxyadmin ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/some-name patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready secret/my-cluster-secrets patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready..... ----------------------------------------------------------------------------------- test xtrabackup ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/some-name patched secret/my-cluster-secrets patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/some-name to be ready............./mnt/jenkins/workspace/cloud-pxc-operator_PR-2473/e2e-tests/users-scheduler/../functions: line 152: 32021 Terminated sleep 5