Log: /mnt/jenkins/workspace/cloud-pxc-operator_PR-2539/e2e-tests/logs/auto-tuning-8-0.log Warning: version difference between client (1.36) and server (1.33) exceeds the supported minor version skew of +/-1 Warning: version difference between client (1.36) and server (1.33) exceeds the supported minor version skew of +/-1 error: the server doesn't have a resource type "pxc" error: the server doesn't have a resource type "pxc-backup" error: the server doesn't have a resource type "pxc-restore" error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces pxc-operator ----------------------------------------------------------------------------------- Error from server (NotFound): namespaces "pxc-operator" not found waiting for namespace/pxc-operator to be deletederror: resource(s) were provided, but no name was specified Error from server (NotFound): namespaces "pxc-operator" not found ----------------------------------------------------------------------------------- create namespace pxc-operator ----------------------------------------------------------------------------------- namespace/pxc-operator created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2539-dcdf1e8a-1-cluster1" modified. ----------------------------------------------------------------------------------- start PXC operator ----------------------------------------------------------------------------------- customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterbackups.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterrestores.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusters.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusters.pxc.percona.com condition met customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterbackups.pxc.percona.com condition met E0702 01:27:48.543994 16602 reflector.go:227] "Failed to watch" err="Get \"https://35.224.240.5/apis/apiextensions.k8s.io/v1/customresourcedefinitions?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dperconaxtradbclusterbackups.pxc.percona.com&resourceVersion=1782955666686527007&timeoutSeconds=362&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterrestores.pxc.percona.com condition met E0702 01:27:50.101775 16766 reflector.go:227] "Failed to watch" err="Get \"https://35.224.240.5/apis/apiextensions.k8s.io/v1/customresourcedefinitions?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dperconaxtradbclusterrestores.pxc.percona.com&resourceVersion=1782955666686527007&timeoutSeconds=365&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" clusterrole.rbac.authorization.k8s.io/percona-xtradb-cluster-operator created serviceaccount/percona-xtradb-cluster-operator created clusterrolebinding.rbac.authorization.k8s.io/service-account-percona-xtradb-cluster-operator created deployment.apps/percona-xtradb-cluster-operator created service/percona-xtradb-cluster-operator created pod/percona-xtradb-cluster-operator-65b5d85575-rvbmh condition met E0702 01:28:09.237528 18353 reflector.go:227] "Failed to watch" err="Get \"https://35.224.240.5/api/v1/namespaces/pxc-operator/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpercona-xtradb-cluster-operator-65b5d85575-rvbmh&resourceVersion=1782955688878070000&timeoutSeconds=538&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" pod/percona-xtradb-cluster-operator-65b5d85575-rvbmh condition met E0702 01:28:13.810477 18961 reflector.go:227] "Failed to watch" err="Get \"https://35.224.240.5/api/v1/namespaces/pxc-operator/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpercona-xtradb-cluster-operator-65b5d85575-rvbmh&resourceVersion=1782955693288175001&timeoutSeconds=374&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/percona-xtradb-cluster-operator-65b5d85575-rvbmh to become Ready.Ok error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces auto-tuning-7052 ----------------------------------------------------------------------------------- Error from server (NotFound): namespaces "auto-tuning-7052" not found waiting for namespace/auto-tuning-7052 to be deletedError from server (NotFound): namespaces "auto-tuning-7052" not found ----------------------------------------------------------------------------------- create namespace auto-tuning-7052 ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified namespace/auto-tuning-7052 created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2539-dcdf1e8a-1-cluster1" modified. ----------------------------------------------------------------------------------- create secrets for cloud storages ----------------------------------------------------------------------------------- secret/minio-secret created secret/aws-s3-secret created secret/do-spaces-secret created secret/gcp-cs-secret created secret/azure-secret created ----------------------------------------------------------------------------------- create first PXC cluster ----------------------------------------------------------------------------------- secret/my-cluster-secrets created secret/some-name-ssl created secret/some-name-ssl-internal created deployment.apps/pxc-client created perconaxtradbcluster.pxc.percona.com/auto-tuning created ----------------------------------------------------------------------------------- waiting pods to be running for auto-tuning ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- Waiting for 3 running pods for auto-tuning-pxc ----------------------------------------------------------------------------------- pod/auto-tuning-pxc-0 condition met waiting for pod/auto-tuning-pxc-0 to become Ready.Ok pod/auto-tuning-pxc-1 condition met waiting for pod/auto-tuning-pxc-1 to become Ready.Ok Error from server (NotFound): pods "auto-tuning-pxc-2" not found waiting for pod/auto-tuning-pxc-2 to become Ready...........................................................................................Ok ----------------------------------------------------------------------------------- Waiting for 3 running pods for auto-tuning-proxysql ----------------------------------------------------------------------------------- pod/auto-tuning-proxysql-0 condition met E0702 01:34:28.674836 27732 reflector.go:227] "Failed to watch" err="Get \"https://35.224.240.5/api/v1/namespaces/auto-tuning-7052/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dauto-tuning-proxysql-0&resourceVersion=1782956068120090000&timeoutSeconds=368&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/auto-tuning-proxysql-0 to become Ready.Ok pod/auto-tuning-proxysql-1 condition met E0702 01:34:31.893549 28002 reflector.go:227] "Failed to watch" err="Get \"https://35.224.240.5/api/v1/namespaces/auto-tuning-7052/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dauto-tuning-proxysql-1&resourceVersion=1782956068120090000&timeoutSeconds=569&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/auto-tuning-proxysql-1 to become Ready.Ok pod/auto-tuning-proxysql-2 condition met E0702 01:34:34.892296 28201 reflector.go:227] "Failed to watch" err="Get \"https://35.224.240.5/api/v1/namespaces/auto-tuning-7052/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dauto-tuning-proxysql-2&resourceVersion=1782956073120119000&timeoutSeconds=329&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/auto-tuning-proxysql-2 to become Ready.Ok ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/auto-tuning to be ready ----------------------------------------------------------------------------------- write data ----------------------------------------------------------------------------------- pod/pxc-client-67fc4995bb-k2d9k condition met E0702 01:35:02.182715 29997 reflector.go:227] "Failed to watch" err="Get \"https://35.224.240.5/api/v1/namespaces/auto-tuning-7052/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-k2d9k&resourceVersion=1782956100845983000&timeoutSeconds=376&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-k2d9k to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-k2d9k condition met E0702 01:35:09.503149 30725 reflector.go:227] "Failed to watch" err="Get \"https://35.224.240.5/api/v1/namespaces/auto-tuning-7052/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-k2d9k&resourceVersion=1782956108747823000&timeoutSeconds=484&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-k2d9k to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- compare initial data ----------------------------------------------------------------------------------- pod/pxc-client-67fc4995bb-k2d9k condition met E0702 01:35:47.138558 1272 reflector.go:227] "Failed to watch" err="Get \"https://35.224.240.5/api/v1/namespaces/auto-tuning-7052/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-k2d9k&resourceVersion=1782956145690206000&timeoutSeconds=481&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-k2d9k to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-k2d9k condition met E0702 01:35:56.628253 2631 reflector.go:227] "Failed to watch" err="Get \"https://35.224.240.5/api/v1/namespaces/auto-tuning-7052/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-k2d9k&resourceVersion=1782956154497444000&timeoutSeconds=368&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-k2d9k to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-k2d9k condition met E0702 01:36:04.508649 3954 reflector.go:227] "Failed to watch" err="Get \"https://35.224.240.5/api/v1/namespaces/auto-tuning-7052/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-k2d9k&resourceVersion=1782956163724395000&timeoutSeconds=300&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-k2d9k to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-k2d9k condition met E0702 01:36:16.482366 5486 reflector.go:227] "Failed to watch" err="Get \"https://35.224.240.5/api/v1/namespaces/auto-tuning-7052/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-k2d9k&resourceVersion=1782956174318906000&timeoutSeconds=518&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-k2d9k to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-k2d9k condition met E0702 01:36:24.722459 6741 reflector.go:227] "Failed to watch" err="Get \"https://35.224.240.5/api/v1/namespaces/auto-tuning-7052/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-k2d9k&resourceVersion=1782956183167675000&timeoutSeconds=364&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-k2d9k to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- get cm_buffer_size ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- get cm_max_connections ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- with-requests: apply config and wait cluster consistency ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/auto-tuning configured ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/auto-tuning to be ready.......... Error from server (NotFound): configmaps "auto-auto-tuning-pxc" not found ----------------------------------------------------------------------------------- with-custom-config: apply config and wait cluster consistency ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/auto-tuning configured ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/auto-tuning to be ready........ pod/pxc-client-67fc4995bb-k2d9k condition met E0702 01:42:52.053710 529 reflector.go:227] "Failed to watch" err="Get \"https://35.224.240.5/api/v1/namespaces/auto-tuning-7052/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-k2d9k&resourceVersion=1782956568508682000&timeoutSeconds=460&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-k2d9k to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-k2d9k condition met E0702 01:43:10.221965 3390 reflector.go:227] "Failed to watch" err="Get \"https://35.224.240.5/api/v1/namespaces/auto-tuning-7052/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-k2d9k&resourceVersion=1782956587147224000&timeoutSeconds=500&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-k2d9k to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- with-template: apply config and wait cluster consistency ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/auto-tuning configured ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/auto-tuning to be ready.......... pod/pxc-client-67fc4995bb-k2d9k condition met E0702 01:46:49.638685 4867 reflector.go:227] "Failed to watch" err="Get \"https://35.224.240.5/api/v1/namespaces/auto-tuning-7052/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-k2d9k&resourceVersion=1782956806871906000&timeoutSeconds=436&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-k2d9k to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-k2d9k condition met E0702 01:47:03.232786 6995 reflector.go:227] "Failed to watch" err="Get \"https://35.224.240.5/api/v1/namespaces/auto-tuning-7052/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-k2d9k&resourceVersion=1782956820408670000&timeoutSeconds=547&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-k2d9k to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- with-template-transform: apply config and wait cluster consistency ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/auto-tuning configured ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/auto-tuning to be ready........... pod/pxc-client-67fc4995bb-k2d9k condition met E0702 01:50:35.426703 6418 reflector.go:227] "Failed to watch" err="Get \"https://35.224.240.5/api/v1/namespaces/auto-tuning-7052/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-k2d9k&resourceVersion=1782957033655996000&timeoutSeconds=428&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-k2d9k to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-k2d9k condition met E0702 01:50:47.963341 8391 reflector.go:227] "Failed to watch" err="Get \"https://35.224.240.5/api/v1/namespaces/auto-tuning-7052/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-k2d9k&resourceVersion=1782957046050563000&timeoutSeconds=393&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-k2d9k to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- destroy cluster/operator and all other resources ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/auto-tuning patched perconaxtradbcluster.pxc.percona.com "auto-tuning" deleted from auto-tuning-7052 namespace No resources found validatingwebhookconfiguration.admissionregistration.k8s.io "percona-xtradbcluster-webhook" deleted namespace "auto-tuning-7052" force deleted Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. ----------------------------------------------------------------------------------- test passed -----------------------------------------------------------------------------------