Log: /mnt/jenkins/workspace/cloud-pxc-operator_PR-1131/e2e-tests/logs/cross-site-8-0.log ----------------------------------------------------------------------------------- Create source cluster ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces cross-site-10550 ----------------------------------------------------------------------------------- Error from server (NotFound): namespaces "cross-site-10550" not found namespace/cross-site-10550 - Error from server (NotFound): namespaces "cross-site-10550" not found ----------------------------------------------------------------------------------- create namespace cross-site-10550 ----------------------------------------------------------------------------------- Error from server (Forbidden): namespaces "default" is forbidden: this namespace may not be deleted namespace/cross-site-10550 created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-1131-d64e70d4-2-cluster3" modified. ----------------------------------------------------------------------------------- start PXC operator ----------------------------------------------------------------------------------- customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterbackups.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterrestores.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusters.pxc.percona.com serverside-applied role.rbac.authorization.k8s.io/percona-xtradb-cluster-operator created serviceaccount/percona-xtradb-cluster-operator created rolebinding.rbac.authorization.k8s.io/service-account-percona-xtradb-cluster-operator created deployment.apps/percona-xtradb-cluster-operator created percona-xtradb-cluster-operator-55c896876f-h89j8.Ok ----------------------------------------------------------------------------------- create secrets for cloud storages ----------------------------------------------------------------------------------- secret/minio-secret created secret/aws-s3-secret created secret/gcp-cs-secret created secret/azure-secret created ----------------------------------------------------------------------------------- create first PXC cluster ----------------------------------------------------------------------------------- secret/my-cluster-secrets created secret/some-name-ssl created secret/some-name-ssl-internal created deployment.apps/pxc-client created perconaxtradbcluster.pxc.percona.com/cross-site-source created ----------------------------------------------------------------------------------- check if all 3 Pods started ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- wait for running cluster ----------------------------------------------------------------------------------- cross-site-source-haproxy-0..................error: a container name must be specified for pod cross-site-source-haproxy-0, choose one of: [haproxy pxc-monit] .Ok ----------------------------------------------------------------------------------- wait for running cluster ----------------------------------------------------------------------------------- cross-site-source-pxc-0.Ok cross-site-source-pxc-1...........Ok cross-site-source-pxc-2...............Ok ----------------------------------------------------------------------------------- write data ----------------------------------------------------------------------------------- pxc-client-5d749ff8b6-zzp6l.Ok pxc-client-5d749ff8b6-zzp6l.Ok pxc-client-5d749ff8b6-zzp6l.Ok pxc-client-5d749ff8b6-zzp6l.Ok pxc-client-5d749ff8b6-zzp6l.Ok Unable to use a TTY - input is not a terminal or the right kind of file ----------------------------------------------------------------------------------- get main cluster services endpoints ----------------------------------------------------------------------------------- pxc-client-5d749ff8b6-zzp6l.Ok ----------------------------------------------------------------------------------- patch source cluster with replicationChannels settings ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/cross-site-source patched ----------------------------------------------------------------------------------- patch main cluster secrets with replication user ----------------------------------------------------------------------------------- secret/my-cluster-secrets patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- write data to source cluster ----------------------------------------------------------------------------------- pxc-client-5d749ff8b6-zzp6l.Ok pxc-client-5d749ff8b6-zzp6l.Ok ----------------------------------------------------------------------------------- create replica cluster ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces cross-site-replica-17248 ----------------------------------------------------------------------------------- Error from server (NotFound): namespaces "cross-site-replica-17248" not found namespace/cross-site-replica-17248 - Error from server (NotFound): namespaces "cross-site-replica-17248" not found ----------------------------------------------------------------------------------- create namespace cross-site-replica-17248 ----------------------------------------------------------------------------------- namespace/cross-site-replica-17248 created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-1131-d64e70d4-2-cluster3" modified. ----------------------------------------------------------------------------------- start PXC operator ----------------------------------------------------------------------------------- customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterbackups.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterrestores.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusters.pxc.percona.com serverside-applied role.rbac.authorization.k8s.io/percona-xtradb-cluster-operator created serviceaccount/percona-xtradb-cluster-operator created rolebinding.rbac.authorization.k8s.io/service-account-percona-xtradb-cluster-operator created deployment.apps/percona-xtradb-cluster-operator created percona-xtradb-cluster-operator-55c896876f-xqgsb.Ok ----------------------------------------------------------------------------------- create secrets for cloud storages ----------------------------------------------------------------------------------- secret/minio-secret created secret/aws-s3-secret created secret/gcp-cs-secret created secret/azure-secret created ----------------------------------------------------------------------------------- create first PXC cluster ----------------------------------------------------------------------------------- secret/my-cluster-secrets created secret/some-name-ssl created secret/some-name-ssl-internal created deployment.apps/pxc-client created perconaxtradbcluster.pxc.percona.com/cross-site-replica created ----------------------------------------------------------------------------------- check if all 3 Pods started ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- wait for running cluster ----------------------------------------------------------------------------------- cross-site-replica-haproxy-0.........................error: a container name must be specified for pod cross-site-replica-haproxy-0, choose one of: [haproxy pxc-monit] .Ok ----------------------------------------------------------------------------------- wait for running cluster ----------------------------------------------------------------------------------- cross-site-replica-pxc-0.Ok cross-site-replica-pxc-1................Ok cross-site-replica-pxc-2................Ok ----------------------------------------------------------------------------------- write data ----------------------------------------------------------------------------------- pxc-client-5d749ff8b6-p8kz7.Ok pxc-client-5d749ff8b6-p8kz7.Ok pxc-client-5d749ff8b6-p8kz7.Ok pxc-client-5d749ff8b6-p8kz7.Ok pxc-client-5d749ff8b6-p8kz7.Ok Unable to use a TTY - input is not a terminal or the right kind of file ----------------------------------------------------------------------------------- get replica cluster services endpoints ----------------------------------------------------------------------------------- pxc-client-5d749ff8b6-p8kz7.Ok pxc-client-5d749ff8b6-p8kz7.Ok ----------------------------------------------------------------------------------- patch replica cluster with replicationChannels settings ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/cross-site-replica patched ----------------------------------------------------------------------------------- patch replica cluster secrets with replication user ----------------------------------------------------------------------------------- secret/my-cluster-secrets patched ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- Check replication source-> replica works on ----------------------------------------------------------------------------------- pxc-client-5d749ff8b6-p8kz7.Ok pxc-client-5d749ff8b6-p8kz7.Ok pxc-client-5d749ff8b6-p8kz7.Ok ----------------------------------------------------------------------------------- Switch clusters over ----------------------------------------------------------------------------------- Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-1131-d64e70d4-2-cluster3" modified. pxc-client-5d749ff8b6-zzp6l.Ok pxc-client-5d749ff8b6-zzp6l.Ok perconaxtradbcluster.pxc.percona.com/cross-site-source patched Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-1131-d64e70d4-2-cluster3" modified. perconaxtradbcluster.pxc.percona.com/cross-site-replica patched ----------------------------------------------------------------------------------- Write data to replica cluster ----------------------------------------------------------------------------------- pxc-client-5d749ff8b6-p8kz7.Ok pxc-client-5d749ff8b6-p8kz7.Ok ----------------------------------------------------------------------------------- Check replication replica -> source works on ----------------------------------------------------------------------------------- Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-1131-d64e70d4-2-cluster3" modified. pxc-client-5d749ff8b6-zzp6l.Ok pxc-client-5d749ff8b6-zzp6l.Ok pxc-client-5d749ff8b6-zzp6l.Ok ----------------------------------------------------------------------------------- destroy cluster/operator and all other resources ----------------------------------------------------------------------------------- + kubectl patch pxc -n cross-site-10550 cross-site-source --type=merge -p '{"metadata":{"finalizers":[]}}' perconaxtradbcluster.pxc.percona.com/cross-site-source patched + kubectl patch pxc -n cross-site-replica-17248 cross-site-replica --type=merge -p '{"metadata":{"finalizers":[]}}' perconaxtradbcluster.pxc.percona.com/cross-site-replica patched perconaxtradbcluster.pxc.percona.com "cross-site-source" deleted perconaxtradbcluster.pxc.percona.com "cross-site-replica" deleted No resources found No resources found Error from server (NotFound): validatingwebhookconfigurations.admissionregistration.k8s.io "percona-xtradbcluster-webhook" not found ----------------------------------------------------------------------------------- destroy cluster/operator and all other resources ----------------------------------------------------------------------------------- No resources found + kubectl patch pxc -n sh --type=merge -p '{"metadata":{"finalizers":[]}}' error: resource(s) were provided, but no name was specified No resources found No resources found No resources found Error from server (NotFound): validatingwebhookconfigurations.admissionregistration.k8s.io "percona-xtradbcluster-webhook" not found ----------------------------------------------------------------------------------- test passed -----------------------------------------------------------------------------------