Log: /mnt/jenkins/workspace/cloud-psmdb-operator_PR-2304/e2e-tests/logs/demand-backup-fs.log Warning: version difference between client (1.35) and server (1.32) exceeds the supported minor version skew of +/-1 Warning: version difference between client (1.35) and server (1.32) exceeds the supported minor version skew of +/-1 Warning: version difference between client (1.35) and server (1.32) exceeds the supported minor version skew of +/-1 ----------------------------------------------------------------------------------- get and delete old CRDs and RBAC ----------------------------------------------------------------------------------- grep: warning: stray \ before - grep: warning: stray \ before - error: the server doesn't have a resource type "perconaservermongodbbackups" + kubectl patch perconaservermongodbbackups.psmdb.percona.com -n sh --type=merge -p '{"metadata":{"finalizers":[]}}' error: the server doesn't have a resource type "perconaservermongodbbackups" error: the server doesn't have a resource type "perconaservermongodbrestores" + kubectl patch perconaservermongodbrestores.psmdb.percona.com -n sh --type=merge -p '{"metadata":{"finalizers":[]}}' error: the server doesn't have a resource type "perconaservermongodbrestores" error: the server doesn't have a resource type "perconaservermongodbs" + kubectl patch perconaservermongodbs.psmdb.percona.com -n sh --type=merge -p '{"metadata":{"finalizers":[]}}' error: the server doesn't have a resource type "perconaservermongodbs" Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "null" not found Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "null" not found Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "null" not found Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "null" not found ----------------------------------------------------------------------------------- destroy chaos-mesh ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces psmdb-operator ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- create namespace psmdb-operator ----------------------------------------------------------------------------------- namespace/psmdb-operator created Context "gke_cloud-dev-112233_us-central1-a_jen-psmdb-2304-ae33139d-1-cluster12" modified. ----------------------------------------------------------------------------------- start PSMDB operator: docker.io/perconalab/percona-server-mongodb-operator:PR-2304-ae33139d ----------------------------------------------------------------------------------- customresourcedefinition.apiextensions.k8s.io/perconaservermongodbbackups.psmdb.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaservermongodbrestores.psmdb.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaservermongodbs.psmdb.percona.com serverside-applied clusterrole.rbac.authorization.k8s.io/percona-server-mongodb-operator created serviceaccount/percona-server-mongodb-operator created clusterrolebinding.rbac.authorization.k8s.io/service-account-percona-server-mongodb-operator created deployment.apps/percona-server-mongodb-operator created waiting for pod/percona-server-mongodb-operator-849686b845-92bjz to be ready.OK Print operator info from log 2026-04-09T10:46:10.773Z INFO setup Manager starting up {"gitCommit": "ae33139d7c2ef2cb5a6caaa4ae2fab412b4016e0", "gitBranch": "PR-2304-ae33139d", "buildTime": "", "goVersion": "go1.25.9", "os": "linux", "arch": "amd64"} ----------------------------------------------------------------------------------- destroy chaos-mesh ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces demand-backup-fs-5075 ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- create namespace demand-backup-fs-5075 ----------------------------------------------------------------------------------- namespace/demand-backup-fs-5075 created Context "gke_cloud-dev-112233_us-central1-a_jen-psmdb-2304-ae33139d-1-cluster12" modified. Error from server (NotFound): namespaces "storage" not found Error from server (NotFound): namespaces "storage" not found Error from server (NotFound): namespaces "storage" not found Error from server (NotFound): namespaces "storage" not found [2026-04-09T10:46:58+0000] deploying NFS server namespace/storage created serviceaccount/nfs-server created rolebinding.rbac.authorization.k8s.io/system:openshift:scc:privileged created persistentvolumeclaim/nfs-pvc created deployment.apps/nfs-server created service/nfs-service created [2026-04-09T10:47:09+0000] Waiting for nfs-server-7654469b4d-d8plq to start Running [2026-04-09T10:47:11+0000] Waiting for nfs-server-7654469b4d-d8plq to start Running [2026-04-09T10:47:13+0000] Waiting for nfs-server-7654469b4d-d8plq to start Running [2026-04-09T10:47:15+0000] Waiting for nfs-server-7654469b4d-d8plq to start Running [2026-04-09T10:47:17+0000] Waiting for nfs-server-7654469b4d-d8plq to start Running [2026-04-09T10:47:19+0000] Waiting for nfs-server-7654469b4d-d8plq to start Running [2026-04-09T10:47:24+0000] creating secrets and start client secret/some-users created deployment.apps/psmdb-client created [2026-04-09T10:47:26+0000] creating PSMDB cluster some-name perconaservermongodb.psmdb.percona.com/some-name created [2026-04-09T10:47:29+0000] wait for all 3 pods to start waiting for pod/some-name-rs0-0 to be ready..................OK waiting for pod/some-name-rs0-1 to be ready...............OK waiting for pod/some-name-rs0-2 to be ready...............OK Waiting for cluster readyness........... [2026-04-09T10:50:11+0000] checking if statefulset created with expected config [2026-04-09T10:50:12+0000] compare_kubectl: statefulset/some-name-rs0 OK [2026-04-09T10:50:12+0000] creating user Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://some-name-rs0-0.some-name-rs0.demand-backup-fs-5075.svc.cluster.local:27017,some-name-rs0-2.some-name-rs0.demand-backup-fs-5075.svc.cluster.local:27017,some-name-rs0-1.some-name-rs0.demand-backup-fs-5075.svc.cluster.local:27017/admin?compressors=disabled&gssapiServiceName=mongodb&replicaSet=rs0&ssl=false Implicit session: session { "id" : UUID("2989f482-613d-4257-ba7e-9d918690681f") } Percona Server for MongoDB server version: v8.0.20-8 WARNING: shell and server versions do not match Successfully added user: { "user" : "myApp", "roles" : [ { "db" : "myApp", "role" : "readWrite" } ] } bye [2026-04-09T10:50:17+0000] write initial data Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://some-name-rs0-2.some-name-rs0.demand-backup-fs-5075.svc.cluster.local:27017,some-name-rs0-1.some-name-rs0.demand-backup-fs-5075.svc.cluster.local:27017,some-name-rs0-0.some-name-rs0.demand-backup-fs-5075.svc.cluster.local:27017/admin?compressors=disabled&gssapiServiceName=mongodb&replicaSet=rs0&ssl=false Implicit session: session { "id" : UUID("a1158382-b3ed-4505-b0f8-b310f1ee0775") } Percona Server for MongoDB server version: v8.0.20-8 WARNING: shell and server versions do not match switched to db myApp WriteResult({ "nInserted" : 1 }) bye [2026-04-09T10:50:20+0000] running db.test.find() in myApp waiting for pbm-agent to be ready in some-name-rs0-0...2026-04-09T10:49:33.000+0000 I listening for the commands waiting for pbm-agent to be ready in some-name-rs0-1...2026-04-09T10:50:10.000+0000 I listening for the commands waiting for pbm-agent to be ready in some-name-rs0-2...2026-04-09T10:50:10.000+0000 I listening for the commands ----------------------------------------------------------------------------------- CASE 1: Logical backup and restore ----------------------------------------------------------------------------------- [2026-04-09T10:50:26+0000] running backup backup-nfs-logical perconaservermongodbbackup.psmdb.percona.com/backup-nfs-logical created waiting for backup-nfs-logical to reach ready state.......OK Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://some-name-rs0-0.some-name-rs0.demand-backup-fs-5075.svc.cluster.local:27017,some-name-rs0-2.some-name-rs0.demand-backup-fs-5075.svc.cluster.local:27017,some-name-rs0-1.some-name-rs0.demand-backup-fs-5075.svc.cluster.local:27017/admin?compressors=disabled&gssapiServiceName=mongodb&replicaSet=rs0&ssl=false Implicit session: session { "id" : UUID("f4ad4692-defd-4367-bf3c-460de64baa14") } Percona Server for MongoDB server version: v8.0.20-8 WARNING: shell and server versions do not match switched to db myApp WriteResult({ "nInserted" : 1 }) bye [2026-04-09T10:50:44+0000] running db.test.find() in myApp [2026-04-09T10:50:46+0000] running restore restore-backup-nfs-logical perconaservermongodbrestore.psmdb.percona.com/restore-backup-nfs-logical created Waiting for the psmdb-restore/restore-backup-nfs-logical object to be created.OK Waiting psmdb-restore/restore-backup-nfs-logical to reach state "ready" .OK after 0 minutes waiting for cluster readyness.OK [2026-04-09T10:51:08+0000] running db.test.find() in myApp ----------------------------------------------------------------------------------- CASE 2: Logical backup and PiTR ----------------------------------------------------------------------------------- [2026-04-09T10:51:10+0000] running backup backup-nfs-logical-pitr perconaservermongodbbackup.psmdb.percona.com/backup-nfs-logical-pitr created waiting for backup-nfs-logical-pitr to reach ready state.......OK Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://some-name-rs0-0.some-name-rs0.demand-backup-fs-5075.svc.cluster.local:27017,some-name-rs0-2.some-name-rs0.demand-backup-fs-5075.svc.cluster.local:27017,some-name-rs0-1.some-name-rs0.demand-backup-fs-5075.svc.cluster.local:27017/admin?compressors=disabled&gssapiServiceName=mongodb&replicaSet=rs0&ssl=false Implicit session: session { "id" : UUID("75acc69b-5cb9-41b4-b14f-c352ade5cdf5") } Percona Server for MongoDB server version: v8.0.20-8 WARNING: shell and server versions do not match switched to db myApp WriteResult({ "nInserted" : 1 }) bye [2026-04-09T10:51:27+0000] running db.test.find() in myApp [2026-04-09T10:51:35+0000] Waiting for last oplog chunk (2026-04-09 10:51:14) to be greater than last write (2026-04-09 10:51:19) [2026-04-09T10:51:47+0000] Waiting for last oplog chunk (2026-04-09 10:51:19) to be greater than last write (2026-04-09 10:51:19) [2026-04-09T10:51:59+0000] Waiting for last oplog chunk (2026-04-09 10:51:19) to be greater than last write (2026-04-09 10:51:19) [2026-04-09T10:52:10+0000] Waiting for last oplog chunk (2026-04-09 10:51:19) to be greater than last write (2026-04-09 10:51:19) [2026-04-09T10:52:22+0000] Waiting for last oplog chunk (2026-04-09 10:52:15) to be greater than last write (2026-04-09 10:51:19) [2026-04-09T10:52:34+0000] dropping test collection Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://some-name-rs0-1.some-name-rs0.demand-backup-fs-5075.svc.cluster.local:27017,some-name-rs0-0.some-name-rs0.demand-backup-fs-5075.svc.cluster.local:27017,some-name-rs0-2.some-name-rs0.demand-backup-fs-5075.svc.cluster.local:27017/admin?compressors=disabled&gssapiServiceName=mongodb&replicaSet=rs0&ssl=false Implicit session: session { "id" : UUID("427359ad-a215-4ca7-abb7-6fcd7f1ad161") } Percona Server for MongoDB server version: v8.0.20-8 WARNING: shell and server versions do not match switched to db myApp true bye [2026-04-09T10:52:36+0000] checking pitr... backup: backup-nfs-logical-pitr target: 2026-04-09 10:52:15 perconaservermongodbrestore.psmdb.percona.com/restore-backup-nfs-logical-pitr created Waiting for the psmdb-restore/restore-backup-nfs-logical-pitr object to be created.OK Waiting psmdb-restore/restore-backup-nfs-logical-pitr to reach state "ready" .OK after 0 minutes waiting for cluster readyness.OK [2026-04-09T10:52:58+0000] running db.test.find() in myApp ----------------------------------------------------------------------------------- CASE 3: Physical backup and restore ----------------------------------------------------------------------------------- [2026-04-09T10:53:00+0000] running backup backup-nfs-physical perconaservermongodbbackup.psmdb.percona.com/backup-nfs-physical created waiting for backup-nfs-physical to reach ready state.......OK Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://some-name-rs0-0.some-name-rs0.demand-backup-fs-5075.svc.cluster.local:27017,some-name-rs0-2.some-name-rs0.demand-backup-fs-5075.svc.cluster.local:27017,some-name-rs0-1.some-name-rs0.demand-backup-fs-5075.svc.cluster.local:27017/admin?compressors=disabled&gssapiServiceName=mongodb&replicaSet=rs0&ssl=false Implicit session: session { "id" : UUID("5cde101b-46b0-4a42-b95f-32e9c774b5f9") } Percona Server for MongoDB server version: v8.0.20-8 WARNING: shell and server versions do not match switched to db myApp WriteResult({ "nInserted" : 1 }) bye [2026-04-09T10:53:16+0000] running db.test.find() in myApp [2026-04-09T10:53:19+0000] running restore restore-backup-nfs-physical perconaservermongodbrestore.psmdb.percona.com/restore-backup-nfs-physical created Waiting for the psmdb-restore/restore-backup-nfs-physical object to be created.OK Waiting psmdb-restore/restore-backup-nfs-physical to reach state "ready" .... ----------------------------------------------------------------------------------- pbm-agent logs from some-name-rs0-0 ----------------------------------------------------------------------------------- Defaulted container "mongod" out of: mongod, mongo-init (init), pbm-init (init) error: Internal error occurred: error sending request: Post "https://10.219.0.108:10250/exec/demand-backup-fs-5075/some-name-rs0-0/mongod?command=cat&command=%2Ftmp%2Fpbm-agent.log&error=1&output=1": dial tcp 10.219.0.108:10250: i/o timeout Defaulted container "mongod" out of: mongod, mongo-init (init), pbm-init (init) Error from server (BadRequest): pod some-name-rs0-0 does not have a host assigned Defaulted container "mongod" out of: mongod, mongo-init (init), pbm-init (init) Error from server (BadRequest): pod some-name-rs0-0 does not have a host assigned Defaulted container "mongod" out of: mongod, mongo-init (init), pbm-init (init) Error from server (BadRequest): pod some-name-rs0-0 does not have a host assigned failed to get /tmp/pbm-agent.log from some-name-rs0-0 ----------------------------------------------------------------------------------- pbm-agent logs from some-name-rs0-1 ----------------------------------------------------------------------------------- 2026/04/09 10:54:26 [entrypoint] starting `pbm-agent` 2026-04-09T10:54:31.000+0000 I % _____ %%% | __ \ ###%%%%%%%%%%%%* | |__) |__ _ __ ___ ___ _ __ __ _ ### ##%% %%%% | ___/ _ \ '__/ __/ _ \| '_ \ / _` | #### ##% %%%% | | | __/ | | (_| (_) | | | | (_| | ### #### %%% |_| \___|_| \___\___/|_| |_|\__,_| ,((### ### %%% _____ _ (((( (### #### %%%% / ____| | | ((( ((# ###### | (___ __ _ _ _ __ _ __| | (((( (((# #### \___ \ / _` | | | |/ _` |/ _` | /(( ,((( *### ____) | (_| | |_| | (_| | (_| | //// ((( #### |_____/ \__, |\__,_|\__,_|\__,_| /// (((( #### | | /////////////(((((((((((((((((######## |_| Join @ squad.percona.com/mongodb ** Join Percona Squad! ** Participate in monthly SWAG raffles, get early access to new product features, invite-only ”ask me anything” sessions with database performance experts. Interested? Fill in the form at squad.percona.com/mongodb 2026-04-09T10:54:31.000+0000 I log options: log-path=/dev/stderr, log-level:D, log-json:false 2026-04-09T10:54:31.000+0000 I pbm-agent: Version: 2.13.0 Platform: linux/amd64 GitCommit: e9b57e1395fe2602bd9637d5e4ef19b1df2bb3b7 GitBranch: release-2.13.0 BuildTime: 2026-02-26_12:41_UTC GoVersion: go1.25.7 2026-04-09T10:54:31.000+0000 I starting PITR routine 2026-04-09T10:54:31.000+0000 I node: rs0/some-name-rs0-1.some-name-rs0.demand-backup-fs-5075.svc.cluster.local:27017 2026-04-09T10:54:31.000+0000 I conn level ReadConcern: majority; WriteConcern: majority 2026-04-09T10:54:31.000+0000 I listening for the commands 2026-04-09T10:55:15.000+0000 I got command restore [name: 2026-04-09T10:55:14.752578284Z, snapshot: 2026-04-09T10:53:03Z] , opid: 69d78592762f8bd5a42e6d78 2026-04-09T10:55:15.000+0000 I got epoch {1775732115 8} 2026-04-09T10:55:15.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] backup: 2026-04-09T10:53:03Z 2026-04-09T10:55:15.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] recovery started 2026-04-09T10:55:15.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] port: 27413 2026-04-09T10:55:16.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] mongod binary: mongod, version: v8.0.20-8 2026-04-09T10:55:16.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] restore opts: fallbackEnabled: false; allowPartlyDone: true 2026-04-09T10:55:16.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] moving to state starting 2026-04-09T10:55:16.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] waiting for cluster 2026-04-09T10:55:46.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] converged to state starting 2026-04-09T10:55:46.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] starting 2026-04-09T10:55:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] moving to state running 2026-04-09T10:55:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] waiting for cluster 2026-04-09T10:57:29.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] converged to state running 2026-04-09T10:57:29.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] send to stopAgent chan 2026-04-09T10:57:29.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] stop agents heartbeats 2026-04-09T10:57:29.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] stopping mongod and flushing old data 2026-04-09T10:57:29.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] shutting down server 2026-04-09T10:57:31.000+0000 D [pitr] stopping main loop 2026-04-09T10:57:44.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] waiting for the node to shutdown 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-3-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-14-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-51-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-46-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-64-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-31-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-57-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-73-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-61-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-5-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-104-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-65-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-2-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-12-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-100-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-98-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-28-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-21-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-41-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-80-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-66-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-29-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/storage.bson 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/WiredTiger.turtle 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-82-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-39-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/WiredTiger 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-18-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-40-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/sizeStorer.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/mongod.lock 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-34-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-91-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-32-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-44-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-1-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-90-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-43-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-35-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-37-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-38-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-89-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-50-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/journal 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-47-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/psmdb_telemetry.data 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/WiredTiger.lock 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-70-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-67-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-78-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-60-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-93-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-75-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-49-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-15-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-83-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-53-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-19-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-69-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-0-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-20-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-45-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-26-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-81-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-63-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-71-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-95-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-88-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-42-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-97-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-4-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-55-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-87-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-99-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-11-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-7-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/key.db 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-59-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-22-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-48-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/_mdb_catalog.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-58-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-77-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-10-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/diagnostic.data 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-94-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-96-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-85-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-36-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-62-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-68-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-27-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-101-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/mongod-data 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-6-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-24-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-25-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-13-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/lost+found 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-9-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-92-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-30-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-102-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-56-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-72-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-52-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-86-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/WiredTigerHS.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-76-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-23-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-8-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-54-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/WiredTiger.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-84-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/collection-74-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-33-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-103-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] remove /data/db/index-79-13395645978624998898.wt 2026-04-09T10:57:45.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copying backup data 2026-04-09T10:57:45.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/key.db/WiredTigerLog.0000000001.gz> to 2026-04-09T10:57:45.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/key.db/WiredTigerHS.wt.gz> to 2026-04-09T10:57:45.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/key.db/key.wt.gz> to 2026-04-09T10:57:45.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/key.db/parameters.wt.gz> to 2026-04-09T10:57:45.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/key.db/WiredTiger.backup.gz> to 2026-04-09T10:57:45.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/key.db/WiredTiger.gz> to 2026-04-09T10:57:45.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/journal/WiredTigerLog.0000000001.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/WiredTigerHS.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/_mdb_catalog.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-0-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-10-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-100-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-12-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-14-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-18-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-19-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-2-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-22-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-24-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-28-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-30-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-34-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-37-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-4-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-40-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-42-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-44-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-49-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-51-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-53-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-56-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-58-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-6-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-61-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-64-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-67-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-70-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-71-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-74-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-76-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-78-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-8-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-80-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-82-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-84-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-86-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-88-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-90-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-92-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-94-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-96-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/collection-98-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-1-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-101-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-11-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-13-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-15-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-20-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-21-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-23-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-25-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-26-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-27-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-29-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-3-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-31-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-32-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-33-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-35-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-36-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-38-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-39-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-41-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-43-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-45-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-46-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-47-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-48-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-5-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-50-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-52-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-54-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-55-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-57-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-59-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-60-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-62-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-63-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-65-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-66-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-68-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-69-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-7-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-72-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-73-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-75-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-77-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-79-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-81-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-83-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-85-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-87-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-89-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-9-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-91-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-93-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-95-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-97-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/index-99-13395645978624998898.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/sizeStorer.wt.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/WiredTiger.backup.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/WiredTiger.gz> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/storage.bson.gz.0-114> to 2026-04-09T10:57:46.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/journal/WiredTigerLog.0000000002.gz> to 2026-04-09T10:57:47.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/key.db/WiredTigerLog.0000000002.gz> to 2026-04-09T10:57:47.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] copy <2026-04-09T10:53:03Z/rs0/key.db/WiredTigerLog.0000000001.gz> to 2026-04-09T10:57:47.000+0000 I [restore/2026-04-09T10:55:14.752578284Z] preparing data 2026-04-09T10:57:52.000+0000 D [restore/2026-04-09T10:55:14.752578284Z] oplogTruncateAfterPoint: {1775731984 7} Defaulted container "mongod" out of: mongod, mongo-init (init), pbm-init (init) ----------------------------------------------------------------------------------- pbm-agent logs from some-name-rs0-2 ----------------------------------------------------------------------------------- error: cannot exec into a container in a completed pod; current phase is Failed error: cannot exec into a container in a completed pod; current phase is Failed error: cannot exec into a container in a completed pod; current phase is Failed error: cannot exec into a container in a completed pod; current phase is Failed failed to get /tmp/pbm-agent.log from some-name-rs0-2 2026-04-09T10:56:28.257Z DEBUG checking if restore is allowed {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-nfs-physical","namespace":"demand-backup-fs-5075"}, "namespace": "demand-backup-fs-5075", "name": "restore-backup-nfs-physical", "reconcileID": "063eb82e-3f2f-447e-a646-48605e5c8723", "cluster": "some-name", "namespace": "demand-backup-fs-5075"} 2026-04-09T10:56:28.358Z DEBUG Pod is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-nfs-physical","namespace":"demand-backup-fs-5075"}, "namespace": "demand-backup-fs-5075", "name": "restore-backup-nfs-physical", "reconcileID": "063eb82e-3f2f-447e-a646-48605e5c8723", "pod": "some-name-rs0-1"} 2026-04-09T10:56:28.358Z DEBUG Pod is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-nfs-physical","namespace":"demand-backup-fs-5075"}, "namespace": "demand-backup-fs-5075", "name": "restore-backup-nfs-physical", "reconcileID": "063eb82e-3f2f-447e-a646-48605e5c8723", "pod": "some-name-rs0-0"} 2026-04-09T10:56:28.358Z DEBUG Pod is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-nfs-physical","namespace":"demand-backup-fs-5075"}, "namespace": "demand-backup-fs-5075", "name": "restore-backup-nfs-physical", "reconcileID": "063eb82e-3f2f-447e-a646-48605e5c8723", "pod": "some-name-rs0-2"} 2026-04-09T10:56:28.358Z DEBUG Statefulset is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-nfs-physical","namespace":"demand-backup-fs-5075"}, "namespace": "demand-backup-fs-5075", "name": "restore-backup-nfs-physical", "reconcileID": "063eb82e-3f2f-447e-a646-48605e5c8723", "sts": "some-name-rs0", "replset": "rs0"} 2026-04-09T10:56:28.358Z DEBUG Check restore status {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-nfs-physical","namespace":"demand-backup-fs-5075"}, "namespace": "demand-backup-fs-5075", "name": "restore-backup-nfs-physical", "reconcileID": "063eb82e-3f2f-447e-a646-48605e5c8723", "command": ["/opt/percona/pbm", "describe-restore", "2026-04-09T10:55:14.752578284Z", "--config", "/etc/pbm/pbm_config.yaml", "--out", "json"], "pod": "some-name-rs0-0"} 2026-04-09T10:56:28.483Z ERROR failed to make restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-nfs-physical","namespace":"demand-backup-fs-5075"}, "namespace": "demand-backup-fs-5075", "name": "restore-backup-nfs-physical", "reconcileID": "063eb82e-3f2f-447e-a646-48605e5c8723", "restore": "restore-backup-nfs-physical", "backup": "backup-nfs-physical", "error": "describe restore stderr: stdout: : Internal error occurred: error executing command in container: failed to exec in container: failed to start exec \"d0a4a4aa89d0d8f59aeb9229ab08ae790d11da68be440c9bc5f0e27fc075cf1b\": OCI runtime exec failed: exec failed: unable to start container process: error executing setns process: exit status 1: unknown", "errorVerbose": "Internal error occurred: error executing command in container: failed to exec in container: failed to start exec \"d0a4a4aa89d0d8f59aeb9229ab08ae790d11da68be440c9bc5f0e27fc075cf1b\": OCI runtime exec failed: exec failed: unable to start container process: error executing setns process: exit status 1: unknown\ndescribe restore stderr: stdout: \ngithub.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodbrestore.(*ReconcilePerconaServerMongoDBRestore).reconcilePhysicalRestore.func6\n\t/go/src/github.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodbrestore/physical.go:231\nk8s.io/client-go/util/retry.OnError.func1\n\t/go/pkg/mod/k8s.io/client-go@v0.35.2/util/retry/util.go:51\nk8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtection\n\t/go/pkg/mod/k8s.io/apimachinery@v0.35.2/pkg/util/wait/wait.go:150\nk8s.io/apimachinery/pkg/util/wait.ExponentialBackoff\n\t/go/pkg/mod/k8s.io/apimachinery@v0.35.2/pkg/util/wait/backoff.go:477\nk8s.io/client-go/util/retry.OnError\n\t/go/pkg/mod/k8s.io/client-go@v0.35.2/util/retry/util.go:50\ngithub.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodbrestore.(*ReconcilePerconaServerMongoDBRestore).reconcilePhysicalRestore\n\t/go/src/github.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodbrestore/physical.go:208\ngithub.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodbrestore.(*ReconcilePerconaServerMongoDBRestore).Reconcile\n\t/go/src/github.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodbrestore/psmdb_restore_controller.go:260\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.1/pkg/internal/controller/controller.go:222\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.1/pkg/internal/controller/controller.go:479\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.1/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.1/pkg/internal/controller/controller.go:313\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1693"} 2026-04-09T10:56:28.483Z INFO Restore state changed {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-nfs-physical","namespace":"demand-backup-fs-5075"}, "namespace": "demand-backup-fs-5075", "name": "restore-backup-nfs-physical", "reconcileID": "063eb82e-3f2f-447e-a646-48605e5c8723", "previous": "running", "current": "error"} 2026-04-09T10:56:29.078Z INFO Warning: Reconciler returned both a result with either RequeueAfter or Requeue set and a non-nil error. RequeueAfter and Requeue will always be ignored if the error is non-nil. For more details, see: https://pkg.go.dev/sigs.k8s.io/controller-runtime/pkg/reconcile#Reconciler {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-nfs-physical","namespace":"demand-backup-fs-5075"}, "namespace": "demand-backup-fs-5075", "name": "restore-backup-nfs-physical", "reconcileID": "063eb82e-3f2f-447e-a646-48605e5c8723"} 2026-04-09T10:56:29.078Z ERROR Reconciler error {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-nfs-physical","namespace":"demand-backup-fs-5075"}, "namespace": "demand-backup-fs-5075", "name": "restore-backup-nfs-physical", "reconcileID": "063eb82e-3f2f-447e-a646-48605e5c8723", "error": "reconcile physical restore: describe restore stderr: stdout: : Internal error occurred: error executing command in container: failed to exec in container: failed to start exec \"d0a4a4aa89d0d8f59aeb9229ab08ae790d11da68be440c9bc5f0e27fc075cf1b\": OCI runtime exec failed: exec failed: unable to start container process: error executing setns process: exit status 1: unknown", "errorVerbose": "Internal error occurred: error executing command in container: failed to exec in container: failed to start exec \"d0a4a4aa89d0d8f59aeb9229ab08ae790d11da68be440c9bc5f0e27fc075cf1b\": OCI runtime exec failed: exec failed: unable to start container process: error executing setns process: exit status 1: unknown\ndescribe restore stderr: stdout: \ngithub.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodbrestore.(*ReconcilePerconaServerMongoDBRestore).reconcilePhysicalRestore.func6\n\t/go/src/github.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodbrestore/physical.go:231\nk8s.io/client-go/util/retry.OnError.func1\n\t/go/pkg/mod/k8s.io/client-go@v0.35.2/util/retry/util.go:51\nk8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtection\n\t/go/pkg/mod/k8s.io/apimachinery@v0.35.2/pkg/util/wait/wait.go:150\nk8s.io/apimachinery/pkg/util/wait.ExponentialBackoff\n\t/go/pkg/mod/k8s.io/apimachinery@v0.35.2/pkg/util/wait/backoff.go:477\nk8s.io/client-go/util/retry.OnError\n\t/go/pkg/mod/k8s.io/client-go@v0.35.2/util/retry/util.go:50\ngithub.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodbrestore.(*ReconcilePerconaServerMongoDBRestore).reconcilePhysicalRestore\n\t/go/src/github.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodbrestore/physical.go:208\ngithub.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodbrestore.(*ReconcilePerconaServerMongoDBRestore).Reconcile\n\t/go/src/github.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodbrestore/psmdb_restore_controller.go:260\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.1/pkg/internal/controller/controller.go:222\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.1/pkg/internal/controller/controller.go:479\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.1/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.1/pkg/internal/controller/controller.go:313\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1693\nreconcile physical restore\ngithub.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodbrestore.(*ReconcilePerconaServerMongoDBRestore).Reconcile\n\t/go/src/github.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodbrestore/psmdb_restore_controller.go:262\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.1/pkg/internal/controller/controller.go:222\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.1/pkg/internal/controller/controller.go:479\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.1/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.1/pkg/internal/controller/controller.go:313\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1693"} apiVersion: psmdb.percona.com/v1 kind: PerconaServerMongoDBRestore metadata: annotations: kubectl.kubernetes.io/last-applied-configuration: | {"apiVersion":"psmdb.percona.com/v1","kind":"PerconaServerMongoDBRestore","metadata":{"annotations":{},"name":"restore-backup-nfs-physical","namespace":"demand-backup-fs-5075"},"spec":{"backupName":"backup-nfs-physical","clusterName":"some-name"}} creationTimestamp: "2026-04-09T10:53:21Z" generation: 1 name: restore-backup-nfs-physical namespace: demand-backup-fs-5075 resourceVersion: "1775732188505119008" uid: fcb42f41-9f51-42ee-b20d-776b3ff1d121 spec: backupName: backup-nfs-physical clusterName: some-name status: error: 'describe restore stderr: stdout: : Internal error occurred: error executing command in container: failed to exec in container: failed to start exec "d0a4a4aa89d0d8f59aeb9229ab08ae790d11da68be440c9bc5f0e27fc075cf1b": OCI runtime exec failed: exec failed: unable to start container process: error executing setns process: exit status 1: unknown' pbmName: "2026-04-09T10:55:14.752578284Z" state: error Name: restore-backup-nfs-physical Namespace: demand-backup-fs-5075 Labels: Annotations: API Version: psmdb.percona.com/v1 Kind: PerconaServerMongoDBRestore Metadata: Creation Timestamp: 2026-04-09T10:53:21Z Generation: 1 Resource Version: 1775732188505119008 UID: fcb42f41-9f51-42ee-b20d-776b3ff1d121 Spec: Backup Name: backup-nfs-physical Cluster Name: some-name Status: Error: describe restore stderr: stdout: : Internal error occurred: error executing command in container: failed to exec in container: failed to start exec "d0a4a4aa89d0d8f59aeb9229ab08ae790d11da68be440c9bc5f0e27fc075cf1b": OCI runtime exec failed: exec failed: unable to start container process: error executing setns process: exit status 1: unknown Pbm Name: 2026-04-09T10:55:14.752578284Z State: error Events: Restore object restore-backup-nfs-physical is in error state after 4 minutes. something went wrong with operator or kubernetes cluster