Log: /mnt/jenkins/workspace/cloud-pxc-operator_PR-2399/e2e-tests/logs/security-context-8-0.log Warning: version difference between client (1.35) and server (1.32) exceeds the supported minor version skew of +/-1 Warning: version difference between client (1.35) and server (1.32) exceeds the supported minor version skew of +/-1 No resources found + kubectl patch pxc -n sh --type=merge -p '{"metadata":{"finalizers":[]}}' error: resource(s) were provided, but no name was specified No resources found No resources found No resources found error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces pxc-operator ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified namespace "pxc-operator" deleted waiting for namespace/pxc-operator to be deletedError from server (NotFound): namespaces "pxc-operator" not found ----------------------------------------------------------------------------------- create namespace pxc-operator ----------------------------------------------------------------------------------- namespace/pxc-operator created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2399-dbfcca1d-3-cluster9" modified. ----------------------------------------------------------------------------------- start PXC operator ----------------------------------------------------------------------------------- customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterbackups.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusterrestores.pxc.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaxtradbclusters.pxc.percona.com serverside-applied clusterrole.rbac.authorization.k8s.io/percona-xtradb-cluster-operator unchanged serviceaccount/percona-xtradb-cluster-operator created clusterrolebinding.rbac.authorization.k8s.io/service-account-percona-xtradb-cluster-operator unchanged deployment.apps/percona-xtradb-cluster-operator created service/percona-xtradb-cluster-operator created pod/percona-xtradb-cluster-operator-c7445dd5-km6bp condition met pod/percona-xtradb-cluster-operator-c7445dd5-km6bp condition met waiting for pod/percona-xtradb-cluster-operator-c7445dd5-km6bp to become Ready.Ok error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces security-context-23306 ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified Error from server (NotFound): namespaces "security-context-23306" not found waiting for namespace/security-context-23306 to be deletedError from server (NotFound): namespaces "security-context-23306" not found ----------------------------------------------------------------------------------- create namespace security-context-23306 ----------------------------------------------------------------------------------- namespace/security-context-23306 created Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2399-dbfcca1d-3-cluster9" modified. ----------------------------------------------------------------------------------- create secrets for cloud storages ----------------------------------------------------------------------------------- secret/minio-secret created secret/aws-s3-secret created secret/gcp-cs-secret created secret/azure-secret created ----------------------------------------------------------------------------------- deploy cert manager ----------------------------------------------------------------------------------- namespace/cert-manager created namespace/cert-manager labeled namespace/cert-manager configured customresourcedefinition.apiextensions.k8s.io/challenges.acme.cert-manager.io created customresourcedefinition.apiextensions.k8s.io/orders.acme.cert-manager.io created customresourcedefinition.apiextensions.k8s.io/certificaterequests.cert-manager.io created customresourcedefinition.apiextensions.k8s.io/certificates.cert-manager.io created customresourcedefinition.apiextensions.k8s.io/clusterissuers.cert-manager.io created customresourcedefinition.apiextensions.k8s.io/issuers.cert-manager.io created serviceaccount/cert-manager-cainjector created serviceaccount/cert-manager created serviceaccount/cert-manager-webhook created clusterrole.rbac.authorization.k8s.io/cert-manager-cainjector created clusterrole.rbac.authorization.k8s.io/cert-manager-controller-issuers created clusterrole.rbac.authorization.k8s.io/cert-manager-controller-clusterissuers created clusterrole.rbac.authorization.k8s.io/cert-manager-controller-certificates created clusterrole.rbac.authorization.k8s.io/cert-manager-controller-orders created clusterrole.rbac.authorization.k8s.io/cert-manager-controller-challenges created clusterrole.rbac.authorization.k8s.io/cert-manager-controller-ingress-shim created clusterrole.rbac.authorization.k8s.io/cert-manager-cluster-view created clusterrole.rbac.authorization.k8s.io/cert-manager-view created clusterrole.rbac.authorization.k8s.io/cert-manager-edit created clusterrole.rbac.authorization.k8s.io/cert-manager-controller-approve:cert-manager-io created clusterrole.rbac.authorization.k8s.io/cert-manager-controller-certificatesigningrequests created clusterrole.rbac.authorization.k8s.io/cert-manager-webhook:subjectaccessreviews created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-cainjector created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-controller-issuers created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-controller-clusterissuers created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-controller-certificates created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-controller-orders created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-controller-challenges created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-controller-ingress-shim created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-controller-approve:cert-manager-io created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-controller-certificatesigningrequests created clusterrolebinding.rbac.authorization.k8s.io/cert-manager-webhook:subjectaccessreviews created role.rbac.authorization.k8s.io/cert-manager-cainjector:leaderelection created role.rbac.authorization.k8s.io/cert-manager:leaderelection created role.rbac.authorization.k8s.io/cert-manager-tokenrequest created role.rbac.authorization.k8s.io/cert-manager-webhook:dynamic-serving created rolebinding.rbac.authorization.k8s.io/cert-manager-cainjector:leaderelection created rolebinding.rbac.authorization.k8s.io/cert-manager:leaderelection created rolebinding.rbac.authorization.k8s.io/cert-manager-tokenrequest created rolebinding.rbac.authorization.k8s.io/cert-manager-webhook:dynamic-serving created service/cert-manager-cainjector created service/cert-manager created service/cert-manager-webhook created deployment.apps/cert-manager-cainjector created deployment.apps/cert-manager created deployment.apps/cert-manager-webhook created mutatingwebhookconfiguration.admissionregistration.k8s.io/cert-manager-webhook created validatingwebhookconfiguration.admissionregistration.k8s.io/cert-manager-webhook created Warning: resource namespaces/cert-manager is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. serviceaccount/percona-xtradb-cluster-operator-workload created ----------------------------------------------------------------------------------- create first PXC cluster ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- create first PXC cluster ----------------------------------------------------------------------------------- secret/my-cluster-secrets created deployment.apps/pxc-client created perconaxtradbcluster.pxc.percona.com/sec-context created ----------------------------------------------------------------------------------- check if all 3 Pods started ----------------------------------------------------------------------------------- error: no matching resources found ----------------------------------------------------------------------------------- wait for running cluster ----------------------------------------------------------------------------------- Error from server (NotFound): pods "sec-context-proxysql-0" not found waiting for pod/sec-context-proxysql-0 to become Ready...........Ok ----------------------------------------------------------------------------------- wait for running cluster ----------------------------------------------------------------------------------- pod/sec-context-pxc-0 condition met waiting for pod/sec-context-pxc-0 to become Ready.Ok pod/sec-context-pxc-1 condition met waiting for pod/sec-context-pxc-1 to become Ready.Ok pod/sec-context-pxc-2 condition met waiting for pod/sec-context-pxc-2 to become Ready.Ok ----------------------------------------------------------------------------------- write data ----------------------------------------------------------------------------------- pod/pxc-client-67fc4995bb-zvw8l condition met waiting for pod/pxc-client-67fc4995bb-zvw8l to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-zvw8l condition met waiting for pod/pxc-client-67fc4995bb-zvw8l to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-zvw8l condition met waiting for pod/pxc-client-67fc4995bb-zvw8l to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-zvw8l condition met waiting for pod/pxc-client-67fc4995bb-zvw8l to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok pod/pxc-client-67fc4995bb-zvw8l condition met waiting for pod/pxc-client-67fc4995bb-zvw8l to become ReadyDefaulted container "pxc-client" out of: pxc-client, backup .Ok ----------------------------------------------------------------------------------- check if service and statefulset created with expected config ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- compare statefulset/sec-context-pxc- ----------------------------------------------------------------------------------- [2026-03-16T12:58:44+0000] compare_kubectl: statefulset/sec-context-pxc OK ----------------------------------------------------------------------------------- compare statefulset/sec-context-proxysql- ----------------------------------------------------------------------------------- [2026-03-16T12:58:46+0000] compare_kubectl: statefulset/sec-context-proxysql OK ----------------------------------------------------------------------------------- change security context in PXC cluster ----------------------------------------------------------------------------------- perconaxtradbcluster.pxc.percona.com/sec-context configured ----------------------------------------------------------------------------------- check if service and statefulset changed to expected config ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- compare statefulset/sec-context-pxc--changes ----------------------------------------------------------------------------------- [2026-03-16T12:59:22+0000] compare_kubectl: statefulset/sec-context-pxc OK ----------------------------------------------------------------------------------- compare statefulset/sec-context-proxysql--changes ----------------------------------------------------------------------------------- [2026-03-16T12:59:23+0000] compare_kubectl: statefulset/sec-context-proxysql OK ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/sec-context to be ready...................... ----------------------------------------------------------------------------------- run pvc backup ----------------------------------------------------------------------------------- perconaxtradbclusterbackup.pxc.percona.com/on-demand-backup-pvc created waiting for pxc-backup/on-demand-backup-pvc to reach Succeeded state.........................Succeeded /mnt/jenkins/workspace/cloud-pxc-operator_PR-2399/e2e-tests/security-context/compare/ ----------------------------------------------------------------------------------- compare job.batch/xb-on-demand-backup-pvc- ----------------------------------------------------------------------------------- [2026-03-16T13:02:40+0000] compare_kubectl: job.batch/xb-on-demand-backup-pvc OK Context "gke_cloud-dev-112233_us-central1-a_jen-pxc-2399-dbfcca1d-3-cluster9" modified. ----------------------------------------------------------------------------------- run pvc restore ----------------------------------------------------------------------------------- perconaxtradbclusterrestore.pxc.percona.com/restore-pvc created Error from server (NotFound): pods "restore-src-restore-pvc-sec-context" not found waiting for pod/restore-src-restore-pvc-sec-context to become Ready...............................Defaulted container "ncat" out of: ncat, backup-init (init) .Ok apiVersion: v1 kind: Pod metadata: annotations: openshift.io/scc: privileged creationTimestamp: "2026-03-16T13:03:37Z" labels: app.kubernetes.io/instance: sec-context app.kubernetes.io/managed-by: percona-xtradb-cluster-operator app.kubernetes.io/name: percona-xtradb-cluster app.kubernetes.io/part-of: percona-xtradb-cluster percona.com/restore-svc-name: restore-src-restore-pvc-sec-context name: restore-src-restore-pvc-sec-context namespace: security-context-23306 ownerReferences: - apiVersion: pxc.percona.com/v1 blockOwnerDeletion: true controller: true kind: PerconaXtraDBClusterRestore name: restore-pvc uid: eb9e20f9-0d4e-4791-831b-cbbb2db8e438 resourceVersion: "1773666232208623008" uid: 8d34412f-162b-453b-9492-015bc60287e5 spec: containers: - command: - /opt/percona/backup/recovery-pvc-donor.sh image: perconalab/percona-xtradb-cluster-operator:main-pxc8.0-backup imagePullPolicy: Always name: ncat resources: {} securityContext: privileged: true terminationMessagePath: /dev/termination-log terminationMessagePolicy: File volumeMounts: - mountPath: /backup name: backup - mountPath: /etc/mysql/ssl name: ssl - mountPath: /etc/mysql/ssl-internal name: ssl-internal - mountPath: /etc/mysql/vault-keyring-secret name: vault-keyring-secret - mountPath: /opt/percona name: bin - mountPath: /var/run/secrets/kubernetes.io/serviceaccount name: kube-api-access-h58zz readOnly: true dnsPolicy: ClusterFirst enableServiceLinks: true initContainers: - command: - /backup-init-entrypoint.sh image: perconalab/percona-xtradb-cluster-operator:PR-2399-dbfcca1d imagePullPolicy: Always name: backup-init resources: limits: cpu: 50m memory: 50M requests: cpu: 50m memory: 50M securityContext: privileged: true terminationMessagePath: /dev/termination-log terminationMessagePolicy: File volumeMounts: - mountPath: /opt/percona name: bin - mountPath: /var/run/secrets/kubernetes.io/serviceaccount name: kube-api-access-h58zz readOnly: true nodeName: gke-jen-pxc-2399-dbfcca1-default-pool-e011f22b-bcj1 preemptionPolicy: PreemptLowerPriority priority: 0 restartPolicy: Always schedulerName: default-scheduler securityContext: fsGroup: 1001 supplementalGroups: - 1001 - 1002 - 1003 serviceAccount: percona-xtradb-cluster-operator-workload serviceAccountName: percona-xtradb-cluster-operator-workload terminationGracePeriodSeconds: 30 tolerations: - effect: NoExecute key: node.kubernetes.io/not-ready operator: Exists tolerationSeconds: 300 - effect: NoExecute key: node.kubernetes.io/unreachable operator: Exists tolerationSeconds: 300 volumes: - name: backup persistentVolumeClaim: claimName: xb-on-demand-backup-pvc-20260316130152-6e5a6d73 - name: ssl-internal secret: defaultMode: 420 optional: true secretName: some-name-ssl-internal - name: ssl secret: defaultMode: 420 optional: false secretName: some-name-ssl - name: vault-keyring-secret secret: defaultMode: 420 optional: true secretName: sec-context-vault - emptyDir: {} name: bin - name: kube-api-access-h58zz projected: defaultMode: 420 sources: - serviceAccountToken: expirationSeconds: 3607 path: token - configMap: items: - key: ca.crt path: ca.crt name: kube-root-ca.crt - downwardAPI: items: - fieldRef: apiVersion: v1 fieldPath: metadata.namespace path: namespace status: conditions: - lastProbeTime: null lastTransitionTime: "2026-03-16T13:03:48Z" status: "True" type: PodReadyToStartContainers - lastProbeTime: null lastTransitionTime: "2026-03-16T13:03:51Z" status: "True" type: Initialized - lastProbeTime: null lastTransitionTime: "2026-03-16T13:03:52Z" status: "True" type: Ready - lastProbeTime: null lastTransitionTime: "2026-03-16T13:03:52Z" status: "True" type: ContainersReady - lastProbeTime: null lastTransitionTime: "2026-03-16T13:03:37Z" status: "True" type: PodScheduled containerStatuses: - containerID: containerd://4ec63d63ab3f27c7bd8e5a625e14c44bd070318fd22dda700dd49e029a339170 image: docker.io/perconalab/percona-xtradb-cluster-operator:main-pxc8.0-backup imageID: docker.io/perconalab/percona-xtradb-cluster-operator@sha256:fabdd64d94a7ca635c0a31a45d10010b5ace17da1bfe3c538c7f27c433c54f31 lastState: {} name: ncat ready: true restartCount: 0 started: true state: running: startedAt: "2026-03-16T13:03:52Z" volumeMounts: - mountPath: /backup name: backup - mountPath: /etc/mysql/ssl name: ssl - mountPath: /etc/mysql/ssl-internal name: ssl-internal - mountPath: /etc/mysql/vault-keyring-secret name: vault-keyring-secret - mountPath: /opt/percona name: bin - mountPath: /var/run/secrets/kubernetes.io/serviceaccount name: kube-api-access-h58zz readOnly: true recursiveReadOnly: Disabled hostIP: 10.216.0.109 hostIPs: - ip: 10.216.0.109 initContainerStatuses: - containerID: containerd://a70a358bc0207616cff13ea35f037639ad5b45b8a626ebf5ec49959e04ebc0d7 image: docker.io/perconalab/percona-xtradb-cluster-operator:PR-2399-dbfcca1d imageID: docker.io/perconalab/percona-xtradb-cluster-operator@sha256:3688c2eae5cb37842137e072e5fc22bead7412510bd93a28bba96124d9fc9ec9 lastState: {} name: backup-init ready: true restartCount: 0 started: false state: terminated: containerID: containerd://a70a358bc0207616cff13ea35f037639ad5b45b8a626ebf5ec49959e04ebc0d7 exitCode: 0 finishedAt: "2026-03-16T13:03:50Z" reason: Completed startedAt: "2026-03-16T13:03:47Z" volumeMounts: - mountPath: /opt/percona name: bin - mountPath: /var/run/secrets/kubernetes.io/serviceaccount name: kube-api-access-h58zz readOnly: true recursiveReadOnly: Disabled phase: Running podIP: 10.102.225.54 podIPs: - ip: 10.102.225.54 qosClass: Burstable startTime: "2026-03-16T13:03:37Z" ----------------------------------------------------------------------------------- compare pod/restore-src-restore-pvc-sec-context- ----------------------------------------------------------------------------------- [2026-03-16T13:03:56+0000] compare_kubectl: pod/restore-src-restore-pvc-sec-context OK waiting for pxc-restore/restore-pvc to reach Succeeded state 2026-03-16T13:03:56 pxc-restore/restore-pvc state: Restoring 2026-03-16T13:03:58 pxc-restore/restore-pvc state: Restoring 2026-03-16T13:04:00 pxc-restore/restore-pvc state: Restoring 2026-03-16T13:04:02 pxc-restore/restore-pvc state: Restoring 2026-03-16T13:04:03 pxc-restore/restore-pvc state: Restoring 2026-03-16T13:04:05 pxc-restore/restore-pvc state: Restoring 2026-03-16T13:04:07 pxc-restore/restore-pvc state: Restoring 2026-03-16T13:04:09 pxc-restore/restore-pvc state: Restoring 2026-03-16T13:04:11 pxc-restore/restore-pvc state: Restoring 2026-03-16T13:04:13 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:04:15 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:04:18 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:04:20 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:04:22 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:04:24 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:04:26 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:04:28 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:04:30 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:04:32 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:04:35 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:04:37 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:04:39 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:04:41 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:04:43 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:04:45 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:04:47 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:04:49 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:04:51 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:04:53 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:04:55 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:04:57 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:04:59 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:05:01 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:05:03 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:05:05 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:05:07 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:05:09 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:05:11 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:05:13 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:05:15 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:05:17 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:05:19 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:05:21 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:05:22 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:05:24 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:05:25 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:05:27 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:05:30 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:05:32 pxc-restore/restore-pvc state: Preparing Cluster 2026-03-16T13:05:33 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:05:36 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:05:38 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:05:40 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:05:42 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:05:45 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:05:47 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:05:49 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:05:51 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:05:53 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:05:55 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:05:57 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:05:59 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:06:01 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:06:03 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:06:05 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:06:07 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:06:09 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:06:11 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:06:12 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:06:14 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:06:17 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:06:19 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:06:21 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:06:23 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:06:25 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:06:27 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:06:29 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:06:31 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:06:33 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:06:35 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:06:38 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:06:40 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:06:42 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:06:44 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:06:46 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:06:48 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:06:50 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:06:52 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:06:54 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:06:57 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:06:59 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:07:01 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:07:03 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:07:05 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:07:07 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:07:09 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:07:11 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:07:13 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:07:15 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:07:17 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:07:19 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:07:21 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:07:23 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:07:25 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:07:26 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:07:28 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:07:30 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:07:33 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:07:35 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:07:37 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:07:39 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:07:41 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:07:43 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:07:45 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:07:47 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:07:49 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:07:51 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:07:53 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:07:55 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:07:56 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:07:58 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:08:00 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:08:01 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:08:03 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:08:05 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:08:07 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:08:09 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:08:11 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:08:13 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:08:15 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:08:17 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:08:19 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:08:22 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:08:24 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:08:27 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:08:29 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:08:32 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:08:34 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:08:36 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:08:38 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:08:40 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:08:42 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:08:44 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:08:46 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:08:48 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:08:50 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:08:52 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:08:54 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:08:56 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:08:58 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:09:00 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:09:02 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:09:04 pxc-restore/restore-pvc state: Starting Cluster 2026-03-16T13:09:06 pxc-restore/restore-pvc state: Succeeded ----------------------------------------------------------------------------------- compare job.batch/restore-job-restore-pvc-sec-context- ----------------------------------------------------------------------------------- [2026-03-16T13:09:08+0000] compare_kubectl: job.batch/restore-job-restore-pvc-sec-context OK ----------------------------------------------------------------------------------- run s3 backup ----------------------------------------------------------------------------------- secret/minio-secret unchanged "hashicorp" already exists with the same configuration, skipping "minio" already exists with the same configuration, skipping Hang tight while we grab the latest from your chart repositories... ...Successfully got an update from the "minio" chart repository ...Successfully got an update from the "chaos-mesh" chart repository ...Successfully got an update from the "percona" chart repository ...Successfully got an update from the "hashicorp" chart repository Update Complete. ⎈Happy Helming!⎈ ----------------------------------------------------------------------------------- install Minio ----------------------------------------------------------------------------------- Error: uninstall: Release not loaded: minio-service: release: not found NAME: minio-service LAST DEPLOYED: Mon Mar 16 13:09:12 2026 NAMESPACE: security-context-23306 STATUS: deployed REVISION: 1 TEST SUITE: None NOTES: MinIO can be accessed via port 9000 on the following DNS name from within your cluster: minio-service.security-context-23306.cluster.local To access MinIO from localhost, run the below commands: 1. export POD_NAME=$(kubectl get pods --namespace security-context-23306 -l "release=minio-service" -o jsonpath="{.items[0].metadata.name}") 2. kubectl port-forward $POD_NAME 9000 --namespace security-context-23306 Read more about port forwarding here: http://kubernetes.io/docs/user-guide/kubectl/kubectl_port-forward/ You can now access MinIO server on http://localhost:9000. Follow the below steps to connect to MinIO server with mc client: 1. Download the MinIO mc client - https://min.io/docs/minio/linux/reference/minio-mc.html#quickstart 2. export MC_HOST_minio-service-local=http://$(kubectl get secret --namespace security-context-23306 minio-service -o jsonpath="{.data.rootUser}" | base64 --decode):$(kubectl get secret --namespace security-context-23306 minio-service -o jsonpath="{.data.rootPassword}" | base64 --decode)@localhost:9000 3. mc ls minio-service-local pod/minio-service-5fd5489bdc-tbxdz condition met waiting for pod/minio-service-5fd5489bdc-tbxdz to become Ready.Ok pod "aws-cli" deleted from security-context-23306 namespace All commands and output from this session will be recorded in container logs, including credentials and sensitive information passed through the command prompt. If you don't see a command prompt, try pressing enter. ----------------------------------------------------------------------------------- wait cluster consistency ----------------------------------------------------------------------------------- waiting for pxc/sec-context to be ready perconaxtradbclusterbackup.pxc.percona.com/on-demand-backup-s3 created waiting for pxc-backup/on-demand-backup-s3 to reach Succeeded state....................Succeeded ----------------------------------------------------------------------------------- compare job.batch/xb-on-demand-backup-s3- ----------------------------------------------------------------------------------- [2026-03-16T13:11:16+0000] compare_kubectl: job.batch/xb-on-demand-backup-s3 OK ----------------------------------------------------------------------------------- run s3 restore ----------------------------------------------------------------------------------- perconaxtradbclusterrestore.pxc.percona.com/restore-s3 created waiting for pxc-restore/restore-s3 to reach Succeeded state 2026-03-16T13:11:22 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:11:24 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:11:26 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:11:29 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:11:31 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:11:33 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:11:35 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:11:37 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:11:39 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:11:41 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:11:43 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:11:45 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:11:47 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:11:49 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:11:51 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:11:54 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:11:56 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:11:58 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:12:01 pxc-restore/restore-s3 state: Stopping Cluster 2026-03-16T13:12:04 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:12:06 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:12:09 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:12:12 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:12:15 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:12:17 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:12:19 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:12:21 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:12:24 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:12:26 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:12:29 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:12:31 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:12:33 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:12:35 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:12:37 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:12:39 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:12:41 pxc-restore/restore-s3 state: Restoring 2026-03-16T13:12:44 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:12:46 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:12:48 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:12:51 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:12:53 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:12:55 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:12:57 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:13:00 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:13:02 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:13:04 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:13:06 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:13:08 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:13:10 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:13:12 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:13:15 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:13:17 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:13:19 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:13:22 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:13:24 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:13:26 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:13:28 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:13:31 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:13:34 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:13:36 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:13:38 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:13:41 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:13:43 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:13:46 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:13:49 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:13:51 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:13:53 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:13:56 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:13:58 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:14:00 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:14:02 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:14:04 pxc-restore/restore-s3 state: Preparing Cluster 2026-03-16T13:14:07 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:14:09 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:14:12 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:14:14 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:14:16 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:14:19 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:14:21 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:14:23 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:14:25 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:14:27 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:14:29 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:14:31 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:14:33 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:14:35 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:14:38 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:14:40 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:14:42 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:14:44 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:14:46 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:14:48 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:14:50 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:14:52 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:14:54 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:14:56 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:14:58 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:15:00 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:15:02 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:15:04 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:15:06 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:15:09 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:15:11 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:15:13 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:15:15 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:15:17 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:15:19 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:15:21 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:15:24 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:15:26 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:15:28 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:15:30 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:15:32 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:15:34 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:15:36 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:15:39 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:15:41 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:15:43 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:15:45 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:15:47 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:15:49 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:15:52 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:15:54 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:15:56 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:15:58 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:16:00 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:16:03 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:16:05 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:16:07 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:16:09 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:16:11 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:16:13 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:16:15 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:16:17 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:16:19 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:16:21 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:16:23 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:16:25 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:16:27 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:16:29 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:16:31 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:16:33 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:16:35 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:16:37 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:16:39 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:16:41 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:16:43 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:16:46 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:16:48 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:16:50 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:16:53 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:16:55 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:16:56 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:16:59 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:17:01 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:17:03 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:17:05 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:17:07 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:17:09 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:17:11 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:17:13 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:17:15 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:17:17 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:17:19 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:17:21 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:17:23 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:17:25 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:17:27 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:17:29 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:17:31 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:17:33 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:17:35 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:17:37 pxc-restore/restore-s3 state: Starting Cluster 2026-03-16T13:17:39 pxc-restore/restore-s3 state: Succeeded ----------------------------------------------------------------------------------- compare job.batch/restore-job-restore-s3-sec-context- ----------------------------------------------------------------------------------- [2026-03-16T13:17:41+0000] compare_kubectl: job.batch/restore-job-restore-s3-sec-context OK ----------------------------------------------------------------------------------- destroy cluster/operator and all other resources ----------------------------------------------------------------------------------- + kubectl patch pxc -n security-context-23306 sec-context --type=merge -p '{"metadata":{"finalizers":[]}}' perconaxtradbcluster.pxc.percona.com/sec-context patched perconaxtradbcluster.pxc.percona.com "sec-context" deleted from security-context-23306 namespace perconaxtradbclusterbackup.pxc.percona.com "on-demand-backup-pvc" deleted from security-context-23306 namespace perconaxtradbclusterbackup.pxc.percona.com "on-demand-backup-s3" deleted from security-context-23306 namespace perconaxtradbclusterrestore.pxc.percona.com "restore-pvc" deleted from security-context-23306 namespace perconaxtradbclusterrestore.pxc.percona.com "restore-s3" deleted from security-context-23306 namespace validatingwebhookconfiguration.admissionregistration.k8s.io "percona-xtradbcluster-webhook" deleted namespace "cert-manager" deleted customresourcedefinition.apiextensions.k8s.io "challenges.acme.cert-manager.io" deleted customresourcedefinition.apiextensions.k8s.io "orders.acme.cert-manager.io" deleted customresourcedefinition.apiextensions.k8s.io "certificaterequests.cert-manager.io" deleted customresourcedefinition.apiextensions.k8s.io "certificates.cert-manager.io" deleted customresourcedefinition.apiextensions.k8s.io "clusterissuers.cert-manager.io" deleted customresourcedefinition.apiextensions.k8s.io "issuers.cert-manager.io" deleted serviceaccount "cert-manager-cainjector" deleted from cert-manager namespace serviceaccount "cert-manager" deleted from cert-manager namespace serviceaccount "cert-manager-webhook" deleted from cert-manager namespace clusterrole.rbac.authorization.k8s.io "cert-manager-cainjector" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-issuers" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-clusterissuers" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-certificates" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-orders" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-challenges" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-ingress-shim" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-cluster-view" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-view" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-edit" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-approve:cert-manager-io" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-controller-certificatesigningrequests" deleted clusterrole.rbac.authorization.k8s.io "cert-manager-webhook:subjectaccessreviews" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-cainjector" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-issuers" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-clusterissuers" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-certificates" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-orders" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-challenges" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-ingress-shim" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-approve:cert-manager-io" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-controller-certificatesigningrequests" deleted clusterrolebinding.rbac.authorization.k8s.io "cert-manager-webhook:subjectaccessreviews" deleted role.rbac.authorization.k8s.io "cert-manager-cainjector:leaderelection" deleted from kube-system namespace role.rbac.authorization.k8s.io "cert-manager:leaderelection" deleted from kube-system namespace role.rbac.authorization.k8s.io "cert-manager-tokenrequest" deleted from cert-manager namespace role.rbac.authorization.k8s.io "cert-manager-webhook:dynamic-serving" deleted from cert-manager namespace rolebinding.rbac.authorization.k8s.io "cert-manager-cainjector:leaderelection" deleted from kube-system namespace rolebinding.rbac.authorization.k8s.io "cert-manager:leaderelection" deleted from kube-system namespace rolebinding.rbac.authorization.k8s.io "cert-manager-tokenrequest" deleted from cert-manager namespace rolebinding.rbac.authorization.k8s.io "cert-manager-webhook:dynamic-serving" deleted from cert-manager namespace mutatingwebhookconfiguration.admissionregistration.k8s.io "cert-manager-webhook" deleted validatingwebhookconfiguration.admissionregistration.k8s.io "cert-manager-webhook" deleted ----------------------------------------------------------------------------------- test passed -----------------------------------------------------------------------------------