Log: /mnt/jenkins/workspace/cloud-pxc-operator_PR-2521/e2e-tests/logs/auto-tuning-8-0.log Warning: version difference between client (1.36) and server (1.33) exceeds the supported minor version skew of +/-1 Warning: version difference between client (1.36) and server (1.33) exceeds the supported minor version skew of +/-1 error: the server doesn't have a resource type "pxc" error: the server doesn't have a resource type "pxc-backup" error: the server doesn't have a resource type "pxc-restore" error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces pxc-operator ----------------------------------------------------------------------------------- Error from server (NotFound): namespaces "pxc-operator" not found waiting for namespace/pxc-operator to be deletederror: resource(s) were provided, but no name was specified Error from server (NotFound): namespaces "pxc-operator" not found ----------------------------------------------------------------------------------- create namespace pxc-operator ----------------------------------------------------------------------------------- namespace/pxc-operator created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2521-bb594380-1-cluster1" modified. ----------------------------------------------------------------------------------- start PXC operator ----------------------------------------------------------------------------------- customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterbackups.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterrestores.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusters.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusters.pxc.percona.com condition met E0611 01:25:58.877915 23354 reflector.go:227] "Failed to watch" err="Get \"https://34.72.226.31/apis/apiextensions.k8s.io/v1/customresourcedefinitions?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dperconaxtradbclusters.pxc.percona.com&resourceVersion=1781141155643391007&timeoutSeconds=504&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterbackups.pxc.percona.com condition met E0611 01:26:03.133325 23971 reflector.go:227] "Failed to watch" err="Get \"https://34.72.226.31/apis/apiextensions.k8s.io/v1/customresourcedefinitions?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dperconaxtradbclusterbackups.pxc.percona.com&resourceVersion=1781141160645044000&timeoutSeconds=362&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterrestores.pxc.percona.com condition met E0611 01:26:07.242320 24693 reflector.go:227] "Failed to watch" err="Get \"https://34.72.226.31/apis/apiextensions.k8s.io/v1/customresourcedefinitions?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dperconaxtradbclusterrestores.pxc.percona.com&resourceVersion=1781141165645113000&timeoutSeconds=424&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" clusterrole.rbac.authorization.k8s.io/percona-xtradb-cluster-operator created serviceaccount/percona-xtradb-cluster-operator created clusterrolebinding.rbac.authorization.k8s.io/service-account-percona-xtradb-cluster-operator created deployment.apps/percona-xtradb-cluster-operator created service/percona-xtradb-cluster-operator created pod/percona-xtradb-cluster-operator-774dd4b69-ggcg5 condition met E0611 01:26:39.488519 29179 reflector.go:227] "Failed to watch" err="Get \"https://34.72.226.31/api/v1/namespaces/pxc-operator/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpercona-xtradb-cluster-operator-774dd4b69-ggcg5&resourceVersion=1781141199128573000&timeoutSeconds=383&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" pod/percona-xtradb-cluster-operator-774dd4b69-ggcg5 condition met E0611 01:26:51.785453 30804 reflector.go:227] "Failed to watch" err="Get \"https://34.72.226.31/api/v1/namespaces/pxc-operator/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpercona-xtradb-cluster-operator-774dd4b69-ggcg5&resourceVersion=1781141211602151000&timeoutSeconds=395&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/percona-xtradb-cluster-operator-774dd4b69-ggcg5 to become Ready.Ok error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces auto-tuning-2404 ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified Error from server (NotFound): namespaces "auto-tuning-2404" not found waiting for namespace/auto-tuning-2404 to be deletedError from server (NotFound): namespaces "auto-tuning-2404" not found ----------------------------------------------------------------------------------- create namespace auto-tuning-2404 ----------------------------------------------------------------------------------- namespace/auto-tuning-2404 created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2521-bb594380-1-cluster1" modified. ----------------------------------------------------------------------------------- create secrets for cloud storages ----------------------------------------------------------------------------------- secret/minio-secret created secret/aws-s3-secret created secret/do-spaces-secret created secret/gcp-cs-secret created secret/azure-secret created ----------------------------------------------------------------------------------- create first PXC cluster ----------------------------------------------------------------------------------- secret/my-cluster-secrets created secret/some-name-ssl created secret/some-name-ssl-internal created deployment.apps/pxc-client created perconaxtradbcluster.pxc.percona.com/auto-tuning created ----------------------------------------------------------------------------------- waiting pods to be running for auto-tuning ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- Waiting for 3 running pods for auto-tuning-pxc ----------------------------------------------------------------------------------- pod/auto-tuning-pxc-0 condition met waiting for pod/auto-tuning-pxc-0 to become Ready.Ok pod/auto-tuning-pxc-1 condition met waiting for pod/auto-tuning-pxc-1 to become Ready.Ok pod/auto-tuning-pxc-2 condition met waiting for pod/auto-tuning-pxc-2 to become Ready.Ok ----------------------------------------------------------------------------------- Waiting for 3 running pods for auto-tuning-proxysql ----------------------------------------------------------------------------------- pod/auto-tuning-proxysql-0 condition met E0611 01:32:32.732950 29912 reflector.go:227] "Failed to watch" err="Get \"https://34.72.226.31/api/v1/namespaces/auto-tuning-2404/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dauto-tuning-proxysql-0&resourceVersion=1781141548366367004&timeoutSeconds=369&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/auto-tuning-proxysql-0 to become Ready.Ok pod/auto-tuning-proxysql-1 condition met E0611 01:32:36.346632 30271 reflector.go:227] "Failed to watch" err="Get \"https://34.72.226.31/api/v1/namespaces/auto-tuning-2404/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dauto-tuning-proxysql-1&resourceVersion=1781141553370282000&timeoutSeconds=403&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/auto-tuning-proxysql-1 to become Ready.Ok pod/auto-tuning-proxysql-2 condition met E0611 01:32:40.164937 30645 reflector.go:227] "Failed to watch" err="Get \"https://34.72.226.31/api/v1/namespaces/auto-tuning-2404/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dauto-tuning-proxysql-2&resourceVersion=1781141558370352000&timeoutSeconds=453&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/auto-tuning-proxysql-2 to become Ready.Ok ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/auto-tuning to be ready ----------------------------------------------------------------------------------- write data ----------------------------------------------------------------------------------- pod/pxc-client-67fc4995bb-j5z6g condition met E0611 01:33:11.164295 2614 reflector.go:227] "Failed to watch" err="Get \"https://34.72.226.31/api/v1/namespaces/auto-tuning-2404/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-j5z6g&resourceVersion=1781141590255607000&timeoutSeconds=469&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-j5z6g to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-j5z6g condition met E0611 01:33:26.247163 4609 reflector.go:227] "Failed to watch" err="Get \"https://34.72.226.31/api/v1/namespaces/auto-tuning-2404/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-j5z6g&resourceVersion=1781141603810797000&timeoutSeconds=557&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-j5z6g to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- compare initial data ----------------------------------------------------------------------------------- pod/pxc-client-67fc4995bb-j5z6g condition met E0611 01:34:20.543099 13045 reflector.go:227] "Failed to watch" err="Get \"https://34.72.226.31/api/v1/namespaces/auto-tuning-2404/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-j5z6g&resourceVersion=1781141656871991000&timeoutSeconds=358&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-j5z6g to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-j5z6g condition met E0611 01:34:39.100720 15915 reflector.go:227] "Failed to watch" err="Get \"https://34.72.226.31/api/v1/namespaces/auto-tuning-2404/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-j5z6g&resourceVersion=1781141675113428000&timeoutSeconds=332&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-j5z6g to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-j5z6g condition met E0611 01:35:01.950525 19451 reflector.go:227] "Failed to watch" err="Get \"https://34.72.226.31/api/v1/namespaces/auto-tuning-2404/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-j5z6g&resourceVersion=1781141697732418000&timeoutSeconds=367&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-j5z6g to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-j5z6g condition met E0611 01:35:24.173241 23060 reflector.go:227] "Failed to watch" err="Get \"https://34.72.226.31/api/v1/namespaces/auto-tuning-2404/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-j5z6g&resourceVersion=1781141720613248000&timeoutSeconds=350&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-j5z6g to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-j5z6g condition met E0611 01:35:48.025755 26723 reflector.go:227] "Failed to watch" err="Get \"https://34.72.226.31/api/v1/namespaces/auto-tuning-2404/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-j5z6g&resourceVersion=1781141744797199000&timeoutSeconds=548&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-j5z6g to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- get cm_buffer_size ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- get cm_max_connections ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- with-requests: apply config and wait cluster consistency ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/auto-tuning configured ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/auto-tuning to be ready........ Error from server (NotFound): configmaps "auto-auto-tuning-pxc" not found ----------------------------------------------------------------------------------- with-custom-config: apply config and wait cluster consistency ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/auto-tuning configured ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/auto-tuning to be ready......... pod/pxc-client-67fc4995bb-j5z6g condition met E0611 01:43:25.608359 32207 reflector.go:227] "Failed to watch" err="Get \"https://34.72.226.31/api/v1/namespaces/auto-tuning-2404/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-j5z6g&resourceVersion=1781142202638501000&timeoutSeconds=539&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-j5z6g to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-j5z6g condition met E0611 01:43:39.702407 2274 reflector.go:227] "Failed to watch" err="Get \"https://34.72.226.31/api/v1/namespaces/auto-tuning-2404/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-j5z6g&resourceVersion=1781142218562559000&timeoutSeconds=510&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-j5z6g to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- with-template: apply config and wait cluster consistency ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/auto-tuning configured ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/auto-tuning to be ready......... pod/pxc-client-67fc4995bb-j5z6g condition met E0611 01:47:15.461433 2638 reflector.go:227] "Failed to watch" err="Get \"https://34.72.226.31/api/v1/namespaces/auto-tuning-2404/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-j5z6g&resourceVersion=1781142431437181000&timeoutSeconds=344&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-j5z6g to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-j5z6g condition met E0611 01:47:37.333169 5810 reflector.go:227] "Failed to watch" err="Get \"https://34.72.226.31/api/v1/namespaces/auto-tuning-2404/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-j5z6g&resourceVersion=1781142453240951000&timeoutSeconds=442&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-j5z6g to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- with-template-transform: apply config and wait cluster consistency ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/auto-tuning configured ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/auto-tuning to be ready.......... pod/pxc-client-67fc4995bb-j5z6g condition met E0611 01:51:33.526984 9324 reflector.go:227] "Failed to watch" err="Get \"https://34.72.226.31/api/v1/namespaces/auto-tuning-2404/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-j5z6g&resourceVersion=1781142691527277000&timeoutSeconds=552&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-j5z6g to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-j5z6g condition met E0611 01:51:43.652652 10880 reflector.go:227] "Failed to watch" err="Get \"https://34.72.226.31/api/v1/namespaces/auto-tuning-2404/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-j5z6g&resourceVersion=1781142701457926000&timeoutSeconds=478&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-j5z6g to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- destroy cluster/operator and all other resources ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/auto-tuning patched perconaxtradbcluster.pxc.percona.com "auto-tuning" deleted from auto-tuning-2404 namespace No resources found validatingwebhookconfiguration.admissionregistration.k8s.io "percona-xtradbcluster-webhook" deleted namespace "pxc-operator" force deleted Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. namespace "auto-tuning-2404" force deleted Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. ----------------------------------------------------------------------------------- test passed -----------------------------------------------------------------------------------