Log: /mnt/jenkins/workspace/cloud-pxc-operator_PR-2467/e2e-tests/logs/auto-tuning-8-0.log Warning: version difference between client (1.36) and server (1.33) exceeds the supported minor version skew of +/-1 Warning: version difference between client (1.36) and server (1.33) exceeds the supported minor version skew of +/-1 error: the server doesn't have a resource type "pxc" + kubectl patch pxc -n sh --type=merge -p '{"metadata":{"finalizers":[]}}' error: the server doesn't have a resource type "pxc" error: the server doesn't have a resource type "pxc" error: the server doesn't have a resource type "pxc-backup" error: the server doesn't have a resource type "pxc-restore" error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces pxc-operator ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified Error from server (NotFound): namespaces "pxc-operator" not found waiting for namespace/pxc-operator to be deletedError from server (NotFound): namespaces "pxc-operator" not found ----------------------------------------------------------------------------------- create namespace pxc-operator ----------------------------------------------------------------------------------- namespace/pxc-operator created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2467-3dc7f023-16-cluster1" modified. ----------------------------------------------------------------------------------- start PXC operator ----------------------------------------------------------------------------------- customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterbackups.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterrestores.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusters.pxc.percona.com serverside-applied clusterrole.rbac.authorization.k8s.io/percona-xtradb-cluster-operator created serviceaccount/percona-xtradb-cluster-operator created clusterrolebinding.rbac.authorization.k8s.io/service-account-percona-xtradb-cluster-operator created deployment.apps/percona-xtradb-cluster-operator created service/percona-xtradb-cluster-operator created pod/percona-xtradb-cluster-operator-9d9fbdb5-9c4ql condition met E0516 18:13:56.080337 22694 reflector.go:227] "Failed to watch" err="Get \"https://34.28.179.30/api/v1/namespaces/pxc-operator/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpercona-xtradb-cluster-operator-9d9fbdb5-9c4ql&resourceVersion=1778955235719092000&timeoutSeconds=305&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" pod/percona-xtradb-cluster-operator-9d9fbdb5-9c4ql condition met E0516 18:14:03.982285 23680 reflector.go:227] "Failed to watch" err="Get \"https://34.28.179.30/api/v1/namespaces/pxc-operator/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpercona-xtradb-cluster-operator-9d9fbdb5-9c4ql&resourceVersion=1778955240802232000&timeoutSeconds=489&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/percona-xtradb-cluster-operator-9d9fbdb5-9c4ql to become Ready.Ok error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces auto-tuning-26507 ----------------------------------------------------------------------------------- Error from server (NotFound): namespaces "auto-tuning-26507" not found waiting for namespace/auto-tuning-26507 to be deletederror: resource(s) were provided, but no name was specified Error from server (NotFound): namespaces "auto-tuning-26507" not found ----------------------------------------------------------------------------------- create namespace auto-tuning-26507 ----------------------------------------------------------------------------------- namespace/auto-tuning-26507 created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2467-3dc7f023-16-cluster1" modified. ----------------------------------------------------------------------------------- create secrets for cloud storages ----------------------------------------------------------------------------------- secret/minio-secret created secret/aws-s3-secret created secret/do-spaces-secret created secret/gcp-cs-secret created secret/azure-secret created ----------------------------------------------------------------------------------- create first PXC cluster ----------------------------------------------------------------------------------- secret/my-cluster-secrets created secret/some-name-ssl created secret/some-name-ssl-internal created deployment.apps/pxc-client created perconaxtradbcluster.pxc.percona.com/auto-tuning created ----------------------------------------------------------------------------------- check if all 3 Pods started ----------------------------------------------------------------------------------- error: no matching resources found ----------------------------------------------------------------------------------- wait for running cluster ----------------------------------------------------------------------------------- pod/auto-tuning-proxysql-0 condition met waiting for pod/auto-tuning-proxysql-0 to become Ready.Ok ----------------------------------------------------------------------------------- wait for running cluster ----------------------------------------------------------------------------------- pod/auto-tuning-pxc-0 condition met waiting for pod/auto-tuning-pxc-0 to become Ready.Ok pod/auto-tuning-pxc-1 condition met waiting for pod/auto-tuning-pxc-1 to become Ready.Ok pod/auto-tuning-pxc-2 condition met waiting for pod/auto-tuning-pxc-2 to become Ready.Ok ----------------------------------------------------------------------------------- write data ----------------------------------------------------------------------------------- pod/pxc-client-67fc4995bb-dxrwd condition met E0516 18:19:39.245515 17307 reflector.go:227] "Failed to watch" err="Get \"https://34.28.179.30/api/v1/namespaces/auto-tuning-26507/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-dxrwd&resourceVersion=1778955577641932000&timeoutSeconds=329&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-dxrwd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-dxrwd condition met E0516 18:19:46.046934 18086 reflector.go:227] "Failed to watch" err="Get \"https://34.28.179.30/api/v1/namespaces/auto-tuning-26507/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-dxrwd&resourceVersion=1778955584553319000&timeoutSeconds=461&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-dxrwd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-dxrwd condition met E0516 18:20:22.559915 21881 reflector.go:227] "Failed to watch" err="Get \"https://34.28.179.30/api/v1/namespaces/auto-tuning-26507/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-dxrwd&resourceVersion=1778955621773578000&timeoutSeconds=564&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-dxrwd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-dxrwd condition met E0516 18:20:30.762742 22841 reflector.go:227] "Failed to watch" err="Get \"https://34.28.179.30/api/v1/namespaces/auto-tuning-26507/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-dxrwd&resourceVersion=1778955628998742000&timeoutSeconds=536&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-dxrwd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-dxrwd condition met E0516 18:20:39.609835 24062 reflector.go:227] "Failed to watch" err="Get \"https://34.28.179.30/api/v1/namespaces/auto-tuning-26507/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-dxrwd&resourceVersion=1778955637228168000&timeoutSeconds=511&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-dxrwd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-dxrwd condition met E0516 18:20:54.135706 26146 reflector.go:227] "Failed to watch" err="Get \"https://34.28.179.30/api/v1/namespaces/auto-tuning-26507/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-dxrwd&resourceVersion=1778955652007339000&timeoutSeconds=492&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-dxrwd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-dxrwd condition met E0516 18:21:08.670099 28211 reflector.go:227] "Failed to watch" err="Get \"https://34.28.179.30/api/v1/namespaces/auto-tuning-26507/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-dxrwd&resourceVersion=1778955665717191000&timeoutSeconds=509&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-dxrwd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- get cm_buffer_size ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- get cm_max_connections ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- with-requests: apply config and wait cluster consistency ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/auto-tuning configured ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/auto-tuning to be ready....................... Error from server (NotFound): configmaps "auto-auto-tuning-pxc" not found ----------------------------------------------------------------------------------- with-custom-config: apply config and wait cluster consistency ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/auto-tuning configured ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/auto-tuning to be ready..................... pod/pxc-client-67fc4995bb-dxrwd condition met E0516 18:27:47.072255 19779 reflector.go:227] "Failed to watch" err="Get \"https://34.28.179.30/api/v1/namespaces/auto-tuning-26507/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-dxrwd&resourceVersion=1778956064177805000&timeoutSeconds=494&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-dxrwd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-dxrwd condition met E0516 18:28:01.558136 21868 reflector.go:227] "Failed to watch" err="Get \"https://34.28.179.30/api/v1/namespaces/auto-tuning-26507/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-dxrwd&resourceVersion=1778956078901939000&timeoutSeconds=361&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-dxrwd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- with-template: apply config and wait cluster consistency ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/auto-tuning configured ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/auto-tuning to be ready....................... pod/pxc-client-67fc4995bb-dxrwd condition met E0516 18:31:03.995469 12831 reflector.go:227] "Failed to watch" err="Get \"https://34.28.179.30/api/v1/namespaces/auto-tuning-26507/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-dxrwd&resourceVersion=1778956262164803000&timeoutSeconds=476&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-dxrwd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-dxrwd condition met E0516 18:31:13.285777 14062 reflector.go:227] "Failed to watch" err="Get \"https://34.28.179.30/api/v1/namespaces/auto-tuning-26507/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-dxrwd&resourceVersion=1778956271465572000&timeoutSeconds=560&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-dxrwd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- with-template-transform: apply config and wait cluster consistency ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/auto-tuning configured ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/auto-tuning to be ready........................ pod/pxc-client-67fc4995bb-dxrwd condition met E0516 18:34:25.508894 4697 reflector.go:227] "Failed to watch" err="Get \"https://34.28.179.30/api/v1/namespaces/auto-tuning-26507/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-dxrwd&resourceVersion=1778956463778442000&timeoutSeconds=469&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-dxrwd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-dxrwd condition met E0516 18:34:33.011528 5774 reflector.go:227] "Failed to watch" err="Get \"https://34.28.179.30/api/v1/namespaces/auto-tuning-26507/pods?allowWatchBookmarks=true&fieldSelector=metadata.name%3Dpxc-client-67fc4995bb-dxrwd&resourceVersion=1778956472186264000&timeoutSeconds=345&watch=true\": context canceled" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" type="*unstructured.Unstructured" waiting for pod/pxc-client-67fc4995bb-dxrwd to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- destroy cluster/operator and all other resources ----------------------------------------------------------------------------------- + kubectl patch pxc -n auto-tuning-26507 auto-tuning --type=merge -p '{"metadata":{"finalizers":[]}}' perconaxtradbcluster.pxc.percona.com/auto-tuning patched (no change) perconaxtradbcluster.pxc.percona.com "auto-tuning" deleted from auto-tuning-26507 namespace No resources found No resources found validatingwebhookconfiguration.admissionregistration.k8s.io "percona-xtradbcluster-webhook" deleted ----------------------------------------------------------------------------------- test passed -----------------------------------------------------------------------------------