Log: /mnt/jenkins/workspace/cloud-pxc-operator_PR-2396/e2e-tests/logs/security-context-8-0.log Warning: version difference between client (1.35) and server (1.32) exceeds the supported minor version skew of +/-1 Warning: version difference between client (1.35) and server (1.32) exceeds the supported minor version skew of +/-1 No resources found + kubectl patch pxc -n sh --type=merge -p '{"metadata":{"finalizers":[]}}' error: resource(s) were provided, but no name was specified No resources found No resources found No resources found error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces pxc-operator ----------------------------------------------------------------------------------- Error from server (NotFound): namespaces "pxc-operator" not found waiting for namespace/pxc-operator to be deletederror: resource(s) were provided, but no name was specified Error from server (NotFound): namespaces "pxc-operator" not found ----------------------------------------------------------------------------------- create namespace pxc-operator ----------------------------------------------------------------------------------- namespace/pxc-operator created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2396-53e742e6-3-cluster2" modified. ----------------------------------------------------------------------------------- start PXC operator ----------------------------------------------------------------------------------- customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterbackups.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterrestores.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusters.pxc.percona.com serverside-applied clusterrole.rbac.authorization.k8s.io/percona-xtradb-cluster-operator unchanged serviceaccount/percona-xtradb-cluster-operator created clusterrolebinding.rbac.authorization.k8s.io/service-account-percona-xtradb-cluster-operator unchanged deployment.apps/percona-xtradb-cluster-operator created service/percona-xtradb-cluster-operator created pod/percona-xtradb-cluster-operator-75f5f44b59-v4gkq condition met pod/percona-xtradb-cluster-operator-75f5f44b59-v4gkq condition met waiting for pod/percona-xtradb-cluster-operator-75f5f44b59-v4gkq to become Ready.Ok error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces security-context-2178 ----------------------------------------------------------------------------------- Error from server (NotFound): namespaces "security-context-2178" not found waiting for namespace/security-context-2178 to be deletederror: resource(s) were provided, but no name was specified Error from server (NotFound): namespaces "security-context-2178" not found ----------------------------------------------------------------------------------- create namespace security-context-2178 ----------------------------------------------------------------------------------- namespace/security-context-2178 created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2396-53e742e6-3-cluster2" modified. ----------------------------------------------------------------------------------- create secrets for cloud storages ----------------------------------------------------------------------------------- secret/minio-secret created secret/aws-s3-secret created secret/gcp-cs-secret created secret/azure-secret created ----------------------------------------------------------------------------------- deploy cert manager ----------------------------------------------------------------------------------- namespace/cert-manager created namespace/cert-manager labeled namespace/cert-manager configured customresourcedefinition.apiextensions.k8s.io/challenges.acme.cert-manager.io created customresourcedefinition.apiextensions.k8s.io/orders.acme.cert-manager.io created customresourcedefinition.apiextensions.k8s.io/certificaterequests.cert-manager.io created customresourcedefinition.apiextensions.k8s.io/certificates.cert-manager.io created customresourcedefinition.apiextensions.k8s.io/clusterissuers.cert-manager.io created customresourcedefinition.apiextensions.k8s.io/issuers.cert-manager.io created serviceaccount/cert-manager-cainjector created serviceaccount/cert-manager created serviceaccount/cert-manager-webhook created clusterrole.rbac.authorization.k8s.io/cert-manager-cainjector created clusterrole.rbac.authorization.k8s.io/cert-manager-controller-issuers created clusterrole.rbac.authorization.k8s.io/cert-manager-controller-clusterissuers created clusterrole.rbac.authorization.k8s.io/cert-manager-controller-certificates created clusterrole.rbac.authorization.k8s.io/cert-manager-controller-orders created clusterrole.rbac.authorization.k8s.io/cert-manager-controller-challenges created clusterrole.rbac.authorization.k8s.io/cert-manager-controller-ingress-shim created clusterrole.rbac.authorization.k8s.io/cert-manager-cluster-view created clusterrole.rbac.authorization.k8s.io/cert-manager-view created clusterrole.rbac.authorization.k8s.io/cert-manager-edit created clusterrole.rbac.authorization.k8s.io/cert-manager-controller-approve:cert-manager-io created clusterrole.rbac.authorization.k8s.io/cert-manager-controller-certificatesigningrequests created clusterrole.rbac.authorization.k8s.io/cert-manager-webhook:subjectaccessreviews created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-cainjector created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-controller-issuers created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-controller-clusterissuers created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-controller-certificates created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-controller-orders created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-controller-challenges created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-controller-ingress-shim created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-controller-approve:cert-manager-io created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-controller-certificatesigningrequests created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-webhook:subjectaccessreviews created role.rbac.authorization.k8s.io/cert-manager-cainjector:leaderelection created role.rbac.authorization.k8s.io/cert-manager:leaderelection created role.rbac.authorization.k8s.io/cert-manager-tokenrequest created role.rbac.authorization.k8s.io/cert-manager-webhook:dynamic-serving created rolebinding.rbac.authorization.k8s.io/cert-manager-cainjector:leaderelection created rolebinding.rbac.authorization.k8s.io/cert-manager:leaderelection created rolebinding.rbac.authorization.k8s.io/cert-manager-tokenrequest created rolebinding.rbac.authorization.k8s.io/cert-manager-webhook:dynamic-serving created service/cert-manager-cainjector created service/cert-manager created service/cert-manager-webhook created deployment.apps/cert-manager-cainjector created deployment.apps/cert-manager created deployment.apps/cert-manager-webhook created mutatingwebhookconfiguration.admissionregistration.k8s.io/cert-manager-webhook created validatingwebhookconfiguration.admissionregistration.k8s.io/cert-manager-webhook created Warning: resource namespaces/cert-manager is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. serviceaccount/percona-xtradb-cluster-operator-workload created ----------------------------------------------------------------------------------- create first PXC cluster ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- create first PXC cluster ----------------------------------------------------------------------------------- secret/my-cluster-secrets created deployment.apps/pxc-client created perconaxtradbcluster.pxc.percona.com/sec-context created ----------------------------------------------------------------------------------- check if all 3 Pods started ----------------------------------------------------------------------------------- error: no matching resources found ----------------------------------------------------------------------------------- wait for running cluster ----------------------------------------------------------------------------------- Error from server (NotFound): pods "sec-context-proxysql-0" not found waiting for pod/sec-context-proxysql-0 to become Ready.............Ok ----------------------------------------------------------------------------------- wait for running cluster ----------------------------------------------------------------------------------- pod/sec-context-pxc-0 condition met waiting for pod/sec-context-pxc-0 to become Ready.Ok pod/sec-context-pxc-1 condition met waiting for pod/sec-context-pxc-1 to become Ready.Ok pod/sec-context-pxc-2 condition met waiting for pod/sec-context-pxc-2 to become Ready.Ok ----------------------------------------------------------------------------------- write data ----------------------------------------------------------------------------------- pod/pxc-client-67fc4995bb-xdsc6 condition met waiting for pod/pxc-client-67fc4995bb-xdsc6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-xdsc6 condition met waiting for pod/pxc-client-67fc4995bb-xdsc6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-xdsc6 condition met waiting for pod/pxc-client-67fc4995bb-xdsc6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-xdsc6 condition met waiting for pod/pxc-client-67fc4995bb-xdsc6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-xdsc6 condition met waiting for pod/pxc-client-67fc4995bb-xdsc6 to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- check if service and statefulset created with expected config ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- compare statefulset/sec-context-pxc- ----------------------------------------------------------------------------------- [2026-03-16T12:52:22+0000] compare_kubectl: statefulset/sec-context-pxc OK ----------------------------------------------------------------------------------- compare statefulset/sec-context-proxysql- ----------------------------------------------------------------------------------- [2026-03-16T12:52:24+0000] compare_kubectl: statefulset/sec-context-proxysql OK ----------------------------------------------------------------------------------- change security context in PXC cluster ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/sec-context configured ----------------------------------------------------------------------------------- check if service and statefulset changed to expected config ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- compare statefulset/sec-context-pxc--changes ----------------------------------------------------------------------------------- [2026-03-16T12:52:59+0000] compare_kubectl: statefulset/sec-context-pxc OK ----------------------------------------------------------------------------------- compare statefulset/sec-context-proxysql--changes ----------------------------------------------------------------------------------- [2026-03-16T12:53:00+0000] compare_kubectl: statefulset/sec-context-proxysql OK ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/sec-context to be ready...................... ----------------------------------------------------------------------------------- run pvc backup ----------------------------------------------------------------------------------- perconaxtradbclusterbackup.pxc.percona.com/on-demand-backup-pvc created waiting for pxc-backup/on-demand-backup-pvc to reach Succeeded state.............................Succeeded /mnt/jenkins/workspace/cloud-pxc-operator_PR-2396/e2e-tests/security-context/compare/ ----------------------------------------------------------------------------------- compare job.batch/xb-on-demand-backup-pvc- ----------------------------------------------------------------------------------- [2026-03-16T12:56:12+0000] compare_kubectl: job.batch/xb-on-demand-backup-pvc OK Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2396-53e742e6-3-cluster2" modified. ----------------------------------------------------------------------------------- run pvc restore ----------------------------------------------------------------------------------- perconaxtradbclusterrestore.pxc.percona.com/restore-pvc created Error from server (NotFound): pods "restore-src-restore-pvc-sec-context" not found waiting for pod/restore-src-restore-pvc-sec-context to become Ready................................Defaulted container "ncat" out of: ncat, backup-init (init) .Ok apiVersion: v1 kind: Pod metadata: annotations: openshift.io/scc: privileged creationTimestamp: "2026-03-16T12:57:10Z" labels: app.kubernetes.io/instance: sec-context app.kubernetes.io/managed-by: percona-xtradb-cluster-operator app.kubernetes.io/name: percona-xtradb-cluster app.kubernetes.io/part-of: percona-xtradb-cluster percona.com/restore-svc-name: restore-src-restore-pvc-sec-context name: restore-src-restore-pvc-sec-context namespace: security-context-2178 ownerReferences: - apiVersion: pxc.percona.com/v1 blockOwnerDeletion: true controller: true kind: PerconaXtraDBClusterRestore name: restore-pvc uid: f88e4ce0-83a3-4be4-a057-4126b189f3ef resourceVersion: "1773665847948911006" uid: ba1474b7-e5b4-427e-be4d-23fd7fedf65e spec: containers: - command: - /opt/percona/backup/recovery-pvc-donor.sh image: perconalab/percona-xtradb-cluster-operator:main-pxc8.0-backup imagePullPolicy: Always name: ncat resources: {} securityContext: privileged: true terminationMessagePath: /dev/termination-log terminationMessagePolicy: File volumeMounts: - mountPath: /backup name: backup - mountPath: /etc/mysql/ssl name: ssl - mountPath: /etc/mysql/ssl-internal name: ssl-internal - mountPath: /etc/mysql/vault-keyring-secret name: vault-keyring-secret - mountPath: /opt/percona name: bin - mountPath: /var/run/secrets/kubernetes.io/serviceaccount name: kube-api-access-mzzmq readOnly: true dnsPolicy: ClusterFirst enableServiceLinks: true initContainers: - command: - /backup-init-entrypoint.sh image: perconalab/percona-xtradb-cluster-operator:PR-2396-53e742e6 imagePullPolicy: Always name: backup-init resources: limits: cpu: 50m memory: 50M requests: cpu: 50m memory: 50M securityContext: privileged: true terminationMessagePath: /dev/termination-log terminationMessagePolicy: File volumeMounts: - mountPath: /opt/percona name: bin - mountPath: /var/run/secrets/kubernetes.io/serviceaccount name: kube-api-access-mzzmq readOnly: true nodeName: gke-jen-pxc-2396-53e742e-default-pool-8d9d1e6e-ds6g preemptionPolicy: PreemptLowerPriority priority: 0 restartPolicy: Always schedulerName: default-scheduler securityContext: fsGroup: 1001 supplementalGroups: - 1001 - 1002 - 1003 serviceAccount: percona-xtradb-cluster-operator-workload serviceAccountName: percona-xtradb-cluster-operator-workload terminationGracePeriodSeconds: 30 tolerations: - effect: NoExecute key: node.kubernetes.io/not-ready operator: Exists tolerationSeconds: 300 - effect: NoExecute key: node.kubernetes.io/unreachable operator: Exists tolerationSeconds: 300 volumes: - name: backup persistentVolumeClaim: claimName: xb-on-demand-backup-pvc-20260316125529-92059e6e - name: ssl-internal secret: defaultMode: 420 optional: true secretName: some-name-ssl-internal - name: ssl secret: defaultMode: 420 optional: false secretName: some-name-ssl - name: vault-keyring-secret secret: defaultMode: 420 optional: true secretName: sec-context-vault - emptyDir: {} name: bin - name: kube-api-access-mzzmq projected: defaultMode: 420 sources: - serviceAccountToken: expirationSeconds: 3607 path: token - configMap: items: - key: ca.crt path: ca.crt name: kube-root-ca.crt - downwardAPI: items: - fieldRef: apiVersion: v1 fieldPath: metadata.namespace path: namespace status: conditions: - lastProbeTime: null lastTransitionTime: "2026-03-16T12:57:23Z" status: "True" type: PodReadyToStartContainers - lastProbeTime: null lastTransitionTime: "2026-03-16T12:57:26Z" status: "True" type: Initialized - lastProbeTime: null lastTransitionTime: "2026-03-16T12:57:27Z" status: "True" type: Ready - lastProbeTime: null lastTransitionTime: "2026-03-16T12:57:27Z" status: "True" type: ContainersReady - lastProbeTime: null lastTransitionTime: "2026-03-16T12:57:10Z" status: "True" type: PodScheduled containerStatuses: - containerID: containerd://680ed8f7976ef790ff4f30f849cdd8cb26139c1ee443fa7c8b91bc2bcd136460 image: docker.io/perconalab/percona-xtradb-cluster-operator:main-pxc8.0-backup imageID: docker.io/perconalab/percona-xtradb-cluster-operator@sha256:fabdd64d94a7ca635c0a31a45d10010b5ace17da1bfe3c538c7f27c433c54f31 lastState: {} name: ncat ready: true restartCount: 0 started: true state: running: startedAt: "2026-03-16T12:57:27Z" volumeMounts: - mountPath: /backup name: backup - mountPath: /etc/mysql/ssl name: ssl - mountPath: /etc/mysql/ssl-internal name: ssl-internal - mountPath: /etc/mysql/vault-keyring-secret name: vault-keyring-secret - mountPath: /opt/percona name: bin - mountPath: /var/run/secrets/kubernetes.io/serviceaccount name: kube-api-access-mzzmq readOnly: true recursiveReadOnly: Disabled hostIP: 10.209.0.105 hostIPs: - ip: 10.209.0.105 initContainerStatuses: - containerID: containerd://60399ad0e2f6cb97041c723e98297cd4bf81e412fde575ea22d023c625e7ac9f image: docker.io/perconalab/percona-xtradb-cluster-operator:PR-2396-53e742e6 imageID: docker.io/perconalab/percona-xtradb-cluster-operator@sha256:d492fd4dcc973f55031d7497f5bc04b20c2c7ee6a3fccad83ab27733c847c866 lastState: {} name: backup-init ready: true restartCount: 0 started: false state: terminated: containerID: containerd://60399ad0e2f6cb97041c723e98297cd4bf81e412fde575ea22d023c625e7ac9f exitCode: 0 finishedAt: "2026-03-16T12:57:26Z" reason: Completed startedAt: "2026-03-16T12:57:23Z" volumeMounts: - mountPath: /opt/percona name: bin - mountPath: /var/run/secrets/kubernetes.io/serviceaccount name: kube-api-access-mzzmq readOnly: true recursiveReadOnly: Disabled phase: Running podIP: 10.190.112.72 podIPs: - ip: 10.190.112.72 qosClass: Burstable startTime: "2026-03-16T12:57:10Z" ----------------------------------------------------------------------------------- compare pod/restore-src-restore-pvc-sec-context- ----------------------------------------------------------------------------------- [2026-03-16T12:57:33+0000] compare_kubectl: pod/restore-src-restore-pvc-sec-context OK waiting for pxc-restore/restore-pvc to reach Succeeded state 2026-03-16T12:57:34 pxc-restore/restore-pvc state: Restoring 2026-03-16T12:57:36 pxc-restore/restore-pvc state: Restoring 2026-03-16T12:57:38 pxc-restore/restore-pvc state: Restoring 2026-03-16T12:57:40 pxc-restore/restore-pvc state: Restoring 2026-03-16T12:57:43 pxc-restore/restore-pvc state: Restoring 2026-03-16T12:57:45 pxc-restore/restore-pvc state: Restoring 2026-03-16T12:57:47 pxc-restore/restore-pvc state: Restoring 2026-03-16T12:57:50 pxc-restore/restore-pvc state: Restoring 2026-03-16T12:57:52 pxc-restore/restore-pvc state: Restoring 2026-03-16T12:57:54 pxc-restore/restore-pvc state: Restoring 2026-03-16T12:57:56 pxc-restore/restore-pvc state: Restoring 2026-03-16T12:57:58 pxc-restore/restore-pvc state: Restoring 2026-03-16T12:58:00 pxc-restore/restore-pvc state: Restoring 2026-03-16T12:58:02 pxc-restore/restore-pvc state: Restoring 2026-03-16T12:58:04 pxc-restore/restore-pvc state: Restoring 2026-03-16T12:58:06 pxc-restore/restore-pvc state: Restoring 2026-03-16T12:58:07 pxc-restore/restore-pvc state: Restoring 2026-03-16T12:58:09 pxc-restore/restore-pvc state: Restoring 2026-03-16T12:58:11 pxc-restore/restore-pvc state: Restoring 2026-03-16T12:58:13 pxc-restore/restore-pvc state: Restoring 2026-03-16T12:58:15 pxc-restore/restore-pvc state: Restoring 2026-03-16T12:58:17 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:58:19 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:58:21 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:58:24 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:58:26 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:58:29 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:58:31 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:58:34 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:58:36 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:58:39 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:58:41 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:58:43 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:58:46 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:58:48 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:58:50 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:58:52 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:58:55 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:58:57 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:58:59 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:59:01 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:59:03 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:59:06 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:59:08 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:59:10 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:59:12 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:59:14 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:59:17 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:59:19 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:59:21 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:59:23 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:59:25 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:59:27 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:59:29 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:59:32 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:59:34 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:59:36 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T12:59:37 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T12:59:40 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T12:59:42 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T12:59:44 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T12:59:46 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T12:59:48 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T12:59:50 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T12:59:52 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T12:59:54 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T12:59:57 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T12:59:59 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:00:01 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:00:03 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:00:05 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:00:07 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:00:09 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:00:11 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:00:13 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:00:15 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:00:17 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:00:20 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:00:22 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:00:24 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:00:27 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:00:29 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:00:31 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:00:34 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:00:36 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:00:38 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:00:40 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:00:42 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:00:44 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:00:46 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:00:48 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:00:50 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:00:52 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:00:54 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:00:56 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:00:58 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:01:00 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:01:03 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:01:05 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:01:08 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:01:11 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:01:13 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:01:15 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:01:18 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:01:20 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:01:22 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:01:24 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:01:26 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:01:29 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:01:31 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:01:33 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:01:35 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:01:38 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:01:40 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:01:42 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:01:44 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:01:45 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:01:47 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:01:49 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:01:50 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:01:52 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:01:54 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:01:56 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:01:57 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:01:59 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:02:01 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:02:03 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:02:05 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:02:07 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:02:09 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:02:11 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:02:13 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:02:15 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:02:17 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:02:19 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:02:21 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:02:23 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:02:25 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:02:27 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:02:29 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:02:32 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:02:34 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:02:36 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:02:38 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:02:40 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:02:41 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:02:43 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:02:45 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:02:47 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:02:49 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:02:51 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:02:53 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:02:55 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:02:57 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:02:59 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:03:01 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:03:03 pxc-restore/restore-pvc state: Succeeded ----------------------------------------------------------------------------------- compare job.batch/restore-job-restore-pvc-sec-context- ----------------------------------------------------------------------------------- [2026-03-16T13:03:05+0000] compare_kubectl: job.batch/restore-job-restore-pvc-sec-context OK ----------------------------------------------------------------------------------- run s3 backup ----------------------------------------------------------------------------------- secret/minio-secret unchanged "hashicorp" already exists with the same configuration, skipping "minio" already exists with the same configuration, skipping Hang tight while we grab the latest from your chart repositories... ...Successfully got an update from the "minio" chart repository ...Successfully got an update from the "chaos-mesh" chart repository ...Successfully got an update from the "hashicorp" chart repository ...Successfully got an update from the "percona" chart repository Update Complete. ⎈Happy Helming!⎈ ----------------------------------------------------------------------------------- install Minio ----------------------------------------------------------------------------------- Error: uninstall: Release not loaded: minio-service: release: not found NAME: minio-service LAST DEPLOYED: Mon Mar 16 13:03:09 2026 NAMESPACE: security-context-2178 STATUS: deployed REVISION: 1 TEST SUITE: None NOTES: MinIO can be accessed via port 9000 on the following DNS name from within your cluster: minio-service.security-context-2178.cluster.local To access MinIO from localhost, run the below commands: 1. export POD_NAME=$(kubectl get pods --namespace security-context-2178 -l "release=minio-service" -o jsonpath="{.items[0].metadata.name}") 2. kubectl port-forward $POD_NAME 9000 --namespace security-context-2178 Read more about port forwarding here: http://kubernetes.io/docs/user-guide/kubectl/kubectl_port-forward/ You can now access MinIO server on http://localhost:9000. Follow the below steps to connect to MinIO server with mc client: 1. Download the MinIO mc client - https://min.io/docs/minio/linux/reference/minio-mc.html#quickstart 2. export MC_HOST_minio-service-local=http://$(kubectl get secret --namespace security-context-2178 minio-service -o jsonpath="{.data.rootUser}" | base64 --decode):$(kubectl get secret --namespace security-context-2178 minio-service -o jsonpath="{.data.rootPassword}" | base64 --decode)@localhost:9000 3. mc ls minio-service-local pod/minio-service-5fd5489bdc-cv8nh condition met waiting for pod/minio-service-5fd5489bdc-cv8nh to become Ready.Ok pod "aws-cli" deleted from security-context-2178 namespace All commands and output from this session will be recorded in container logs, including credentials and sensitive information passed through the command prompt. If you don't see a command prompt, try pressing enter. ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/sec-context to be ready perconaxtradbclusterbackup.pxc.percona.com/on-demand-backup-s3 created waiting for pxc-backup/on-demand-backup-s3 to reach Succeeded state......................Succeeded ----------------------------------------------------------------------------------- compare job.batch/xb-on-demand-backup-s3- ----------------------------------------------------------------------------------- [2026-03-16T13:05:07+0000] compare_kubectl: job.batch/xb-on-demand-backup-s3 OK ----------------------------------------------------------------------------------- run s3 restore ----------------------------------------------------------------------------------- perconaxtradbclusterrestore.pxc.percona.com/restore-s3 created waiting for pxc-restore/restore-s3 to reach Succeeded state 2026-03-16T13:05:10 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:05:12 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:05:14 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:05:16 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:05:17 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:05:19 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:05:21 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:05:23 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:05:25 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:05:27 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:05:30 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:05:32 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:05:34 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:05:36 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:05:38 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:05:40 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:05:42 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:05:44 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:05:46 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:05:48 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:05:50 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:05:52 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:05:54 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:05:56 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:05:57 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:05:59 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:06:01 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:06:03 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:06:04 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:06:06 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:06:08 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:06:10 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:06:12 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:06:14 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:06:16 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:06:19 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:06:21 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:06:23 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:06:25 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:06:27 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:06:29 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:06:31 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:06:33 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:06:35 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:06:37 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:06:39 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:06:42 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:06:44 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:06:46 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:06:48 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:06:50 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:06:52 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:06:54 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:06:56 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:06:58 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:07:00 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:07:03 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:07:04 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:07:06 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:07:08 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:07:10 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:07:12 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:07:14 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:07:17 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:07:19 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:07:21 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:07:23 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:07:25 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:07:27 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:07:30 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:07:32 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:07:35 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:07:37 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:07:39 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:07:42 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:07:44 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:07:46 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:07:48 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:07:50 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:07:52 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:07:54 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:07:55 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:07:57 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:07:59 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:08:01 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:08:03 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:08:05 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:08:07 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:08:09 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:08:12 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:08:14 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:08:16 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:08:19 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:08:22 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:08:24 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:08:27 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:08:29 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:08:32 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:08:34 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:08:36 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:08:39 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:08:41 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:08:43 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:08:46 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:08:48 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:08:50 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:08:52 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:08:54 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:08:56 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:08:58 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:09:00 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:09:02 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:09:04 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:09:06 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:09:09 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:09:11 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:09:13 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:09:16 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:09:18 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:09:20 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:09:22 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:09:24 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:09:26 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:09:29 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:09:31 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:09:33 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:09:35 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:09:37 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:09:39 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:09:41 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:09:43 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:09:46 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:09:48 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:09:50 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:09:53 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:09:55 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:09:57 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:10:00 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:10:02 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:10:04 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:10:06 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:10:08 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:10:10 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:10:13 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:10:15 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:10:17 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:10:19 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:10:22 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:10:24 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:10:26 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:10:28 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:10:30 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:10:33 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:10:35 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:10:37 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:10:39 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:10:42 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:10:44 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:10:46 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:10:48 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:10:51 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:10:53 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:10:55 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:10:57 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:10:59 pxc-restore/restore-s3 state: Succeeded ----------------------------------------------------------------------------------- compare job.batch/restore-job-restore-s3-sec-context- ----------------------------------------------------------------------------------- [2026-03-16T13:11:02+0000] compare_kubectl: job.batch/restore-job-restore-s3-sec-context OK ----------------------------------------------------------------------------------- destroy cluster/operator and all other resources ----------------------------------------------------------------------------------- + kubectl patch pxc -n security-context-2178 sec-context --type=merge -p '{"metadata":{"finalizers":[]}}' perconaxtradbcluster.pxc.percona.com/sec-context patched perconaxtradbcluster.pxc.percona.com "sec-context" deleted from security-context-2178 namespace perconaxtradbclusterbackup.pxc.percona.com "on-demand-backup-pvc" deleted from security-context-2178 namespace perconaxtradbclusterbackup.pxc.percona.com "on-demand-backup-s3" deleted from security-context-2178 namespace perconaxtradbclusterrestore.pxc.percona.com "restore-pvc" deleted from security-context-2178 namespace perconaxtradbclusterrestore.pxc.percona.com "restore-s3" deleted from security-context-2178 namespace validatingwebhookconfiguration.admissionregistration.k8s.io "percona-xtradbcluster-webhook" deleted namespace "cert-manager" deleted customresourcedefinition.apiextensions.k8s.io "challenges.acme.cert-manager.io" deleted customresourcedefinition.apiextensions.k8s.io "orders.acme.cert-manager.io" deleted customresourcedefinition.apiextensions.k8s.io "certificaterequests.cert-manager.io" deleted customresourcedefinition.apiextensions.k8s.io "certificates.cert-manager.io" deleted customresourcedefinition.apiextensions.k8s.io "clusterissuers.cert-manager.io" deleted customresourcedefinition.apiextensions.k8s.io "issuers.cert-manager.io" deleted serviceaccount "cert-manager-cainjector" deleted from cert-manager namespace serviceaccount "cert-manager" deleted from cert-manager namespace serviceaccount "cert-manager-webhook" deleted from cert-manager namespace clusterrole.rbac.authorization.k8s.io "cert-manager-cainjector" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-issuers" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-clusterissuers" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-certificates" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-orders" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-challenges" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-ingress-shim" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-cluster-view" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-view" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-edit" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-approve:cert-manager-io" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-certificatesigningrequests" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-webhook:subjectaccessreviews" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-cainjector" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-issuers" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-clusterissuers" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-certificates" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-orders" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-challenges" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-ingress-shim" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-approve:cert-manager-io" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-certificatesigningrequests" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-webhook:subjectaccessreviews" deleted role.rbac.authorization.k8s.io "cert-manager-cainjector:leaderelection" deleted from kube-system namespace role.rbac.authorization.k8s.io "cert-manager:leaderelection" deleted from kube-system namespace rolebinding.rbac.authorization.k8s.io "cert-manager-cainjector:leaderelection" deleted from kube-system namespace rolebinding.rbac.authorization.k8s.io "cert-manager:leaderelection" deleted from kube-system namespace rolebinding.rbac.authorization.k8s.io "cert-manager-tokenrequest" deleted from cert-manager namespace rolebinding.rbac.authorization.k8s.io "cert-manager-webhook:dynamic-serving" deleted from cert-manager namespace deployment.apps "cert-manager-cainjector" deleted from cert-manager namespace deployment.apps "cert-manager" deleted from cert-manager namespace deployment.apps "cert-manager-webhook" deleted from cert-manager namespace mutatingwebhookconfiguration.admissionregistration.k8s.io "cert-manager-webhook" deleted validatingwebhookconfiguration.admissionregistration.k8s.io "cert-manager-webhook" deleted ----------------------------------------------------------------------------------- test passed -----------------------------------------------------------------------------------