Log: /mnt/jenkins/workspace/cloud-psmdb-operator_PR-2219/e2e-tests/logs/demand-backup-incremental-gcp-native.log Warning: version difference between client (1.35) and server (1.32) exceeds the supported minor version skew of +/-1 Warning: version difference between client (1.35) and server (1.32) exceeds the supported minor version skew of +/-1 Warning: version difference between client (1.35) and server (1.32) exceeds the supported minor version skew of +/-1 ----------------------------------------------------------------------------------- get and delete old CRDs and RBAC ----------------------------------------------------------------------------------- grep: warning: stray \ before - grep: warning: stray \ before - error: the server doesn't have a resource type "perconaservermongodbbackups" + kubectl patch perconaservermongodbbackups.psmdb.percona.com -n sh --type=merge -p '{"metadata":{"finalizers":[]}}' error: the server doesn't have a resource type "perconaservermongodbbackups" error: the server doesn't have a resource type "perconaservermongodbrestores" + kubectl patch perconaservermongodbrestores.psmdb.percona.com -n sh --type=merge -p '{"metadata":{"finalizers":[]}}' error: the server doesn't have a resource type "perconaservermongodbrestores" error: the server doesn't have a resource type "perconaservermongodbs" + kubectl patch perconaservermongodbs.psmdb.percona.com -n sh --type=merge -p '{"metadata":{"finalizers":[]}}' error: the server doesn't have a resource type "perconaservermongodbs" Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "null" not found Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "null" not found Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "null" not found Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "null" not found ----------------------------------------------------------------------------------- destroy chaos-mesh ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces psmdb-operator ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- create namespace psmdb-operator ----------------------------------------------------------------------------------- namespace/psmdb-operator created Context "gke_cloud-dev-112233_us-central1-a_jen-psmdb-2219-d7e802db-7-cluster11" modified. ----------------------------------------------------------------------------------- start PSMDB operator: docker.io/perconalab/percona-server-mongodb-operator:PR-2219-d7e802db ----------------------------------------------------------------------------------- customresourcedefinition.apiextensions.k8s.io/perconaservermongodbbackups.psmdb.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaservermongodbrestores.psmdb.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaservermongodbs.psmdb.percona.com serverside-applied clusterrole.rbac.authorization.k8s.io/percona-server-mongodb-operator created serviceaccount/percona-server-mongodb-operator created clusterrolebinding.rbac.authorization.k8s.io/service-account-percona-server-mongodb-operator created deployment.apps/percona-server-mongodb-operator created waiting for pod/percona-server-mongodb-operator-76758dcf9-nw58q to be ready.OK Print operator info from log 2026-03-10T20:59:38.390Z INFO setup Manager starting up {"gitCommit": "d7e802db10c9b2b2028f56c7b5227cb276fe5878", "gitBranch": "PR-2219-d7e802db", "buildTime": "", "goVersion": "go1.25.8", "os": "linux", "arch": "amd64"} ----------------------------------------------------------------------------------- destroy chaos-mesh ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces demand-backup-incremental-gcp-native-19303 ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- create namespace demand-backup-incremental-gcp-native-19303 ----------------------------------------------------------------------------------- namespace/demand-backup-incremental-gcp-native-19303 created Context "gke_cloud-dev-112233_us-central1-a_jen-psmdb-2219-d7e802db-7-cluster11" modified. ----------------------------------------------------------------------------------- create secrets for cloud storages ----------------------------------------------------------------------------------- secret/minio-secret created secret/aws-s3-secret created secret/gcp-cs-secret created secret/azure-secret created secret/gcp-cs-sa-key-secret created ----------------------------------------------------------------------------------- Testing on not sharded cluster ----------------------------------------------------------------------------------- [2026-03-10T21:00:14+0000] Creating PSMDB cluster secret/some-users created perconaservermongodb.psmdb.percona.com/some-name created deployment.apps/psmdb-client created [2026-03-10T21:00:20+0000] check if all pods started waiting for pod/some-name-rs0-0 to be ready.................OK waiting for pod/some-name-rs0-1 to be ready................OK waiting for pod/some-name-rs0-2 to be ready.......................................OK Waiting for cluster readyness....... waiting for cluster readyness.OK [2026-03-10T21:09:12+0000] writing test data Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://some-name-rs0-0.some-name-rs0.demand-backup-incremental-gcp-native-19303.svc.cluster.local:27017,some-name-rs0-2.some-name-rs0.demand-backup-incremental-gcp-native-19303.svc.cluster.local:27017,some-name-rs0-1.some-name-rs0.demand-backup-incremental-gcp-native-19303.svc.cluster.local:27017/admin?compressors=disabled&gssapiServiceName=mongodb&replicaSet=rs0&ssl=false Implicit session: session { "id" : UUID("b2e4a3a1-84cd-47eb-a23a-d16374be360d") } Percona Server for MongoDB server version: v8.0.19-7 WARNING: shell and server versions do not match Successfully added user: { "user" : "myApp", "roles" : [ { "db" : "myApp", "role" : "readWrite" } ] } bye Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://some-name-rs0-0.some-name-rs0.demand-backup-incremental-gcp-native-19303.svc.cluster.local:27017,some-name-rs0-2.some-name-rs0.demand-backup-incremental-gcp-native-19303.svc.cluster.local:27017,some-name-rs0-1.some-name-rs0.demand-backup-incremental-gcp-native-19303.svc.cluster.local:27017/admin?compressors=disabled&gssapiServiceName=mongodb&replicaSet=rs0&ssl=false Implicit session: session { "id" : UUID("ca4e90f7-afb5-4187-b0e3-f04c1c2a9a9d") } Percona Server for MongoDB server version: v8.0.19-7 WARNING: shell and server versions do not match switched to db myApp WriteResult({ "nInserted" : 1 }) bye [2026-03-10T21:09:24+0000] running db.test.find() in myApp [2026-03-10T21:09:26+0000] running db.test.find() in myApp [2026-03-10T21:09:29+0000] running db.test.find() in myApp [2026-03-10T21:09:31+0000] running backup [2026-03-10T21:09:31+0000] running backup backup-gcp-cs-native perconaservermongodbbackup.psmdb.percona.com/backup-gcp-cs-native created waiting for backup-gcp-cs-native to reach ready state............OK Setting up GCS credentials from K8s secret: gcp-cs-secret GCS credentials configured successfully Backup gs://operator-testing/psmdb-demand-backup-incremental-gcp-native/2026-03-10T21:09:33Z/rs0/filelist.pbm found in gcp-cs [2026-03-10T21:10:02+0000] drop collection Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://some-name-rs0-2.some-name-rs0.demand-backup-incremental-gcp-native-19303.svc.cluster.local:27017,some-name-rs0-1.some-name-rs0.demand-backup-incremental-gcp-native-19303.svc.cluster.local:27017,some-name-rs0-0.some-name-rs0.demand-backup-incremental-gcp-native-19303.svc.cluster.local:27017/admin?compressors=disabled&gssapiServiceName=mongodb&replicaSet=rs0&ssl=false Implicit session: session { "id" : UUID("44e38b42-2bc9-4a59-9c2f-62ff3effda73") } Percona Server for MongoDB server version: v8.0.19-7 WARNING: shell and server versions do not match switched to db myApp true bye [2026-03-10T21:10:04+0000] check backup and restore -- [2026-03-10T21:10:04+0000] running restore [2026-03-10T21:10:04+0000] running restore restore-backup-gcp-cs-native perconaservermongodbrestore.psmdb.percona.com/restore-backup-gcp-cs-native created Waiting for the psmdb-restore/restore-backup-gcp-cs-native object to be created.OK Waiting psmdb-restore/restore-backup-gcp-cs-native to reach state "requested" ...OK after 2 minutes [2026-03-10T21:12:16+0000] compare_kubectl: statefulset/some-name-rs0 OK Waiting for the psmdb-restore/restore-backup-gcp-cs-native object to be created.OK Waiting psmdb-restore/restore-backup-gcp-cs-native to reach state "ready" .2026-03-10T21:10:44.233Z INFO Waiting for statefulsets to be ready before restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "79ada613-8542-4860-a828-b624bfb88796", "ready": false} 2026-03-10T21:10:49.234Z DEBUG checking if restore is allowed {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "5e8090d1-4bdf-4a0e-ac41-6b9c7615847c", "cluster": "some-name", "namespace": "demand-backup-incremental-gcp-native-19303"} 2026-03-10T21:10:49.235Z INFO Waiting for statefulsets to be ready before restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "5e8090d1-4bdf-4a0e-ac41-6b9c7615847c", "ready": false} 2026-03-10T21:10:54.236Z DEBUG checking if restore is allowed {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "4492ede7-778b-44d0-93c5-7b427538d29f", "cluster": "some-name", "namespace": "demand-backup-incremental-gcp-native-19303"} 2026-03-10T21:10:54.236Z INFO Waiting for statefulsets to be ready before restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "4492ede7-778b-44d0-93c5-7b427538d29f", "ready": false} 2026-03-10T21:10:59.237Z DEBUG checking if restore is allowed {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "0abe1a96-fb9a-4bb3-a0b8-ef744b5b34d7", "cluster": "some-name", "namespace": "demand-backup-incremental-gcp-native-19303"} 2026-03-10T21:10:59.238Z INFO Waiting for statefulsets to be ready before restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "0abe1a96-fb9a-4bb3-a0b8-ef744b5b34d7", "ready": false} 2026-03-10T21:11:04.239Z DEBUG checking if restore is allowed {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "f18c92fb-5628-4710-b113-12d75a99dfac", "cluster": "some-name", "namespace": "demand-backup-incremental-gcp-native-19303"} 2026-03-10T21:11:04.240Z INFO Waiting for statefulsets to be ready before restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "f18c92fb-5628-4710-b113-12d75a99dfac", "ready": false} 2026-03-10T21:11:09.241Z DEBUG checking if restore is allowed {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "96138f2a-b389-403f-bb62-cc3da8c6d4e6", "cluster": "some-name", "namespace": "demand-backup-incremental-gcp-native-19303"} 2026-03-10T21:11:09.241Z INFO Waiting for statefulsets to be ready before restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "96138f2a-b389-403f-bb62-cc3da8c6d4e6", "ready": false} 2026-03-10T21:11:14.243Z DEBUG checking if restore is allowed {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "fe3e0d35-d682-4e45-97bf-0cc05783ec2b", "cluster": "some-name", "namespace": "demand-backup-incremental-gcp-native-19303"} 2026-03-10T21:11:14.243Z INFO Waiting for statefulsets to be ready before restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "fe3e0d35-d682-4e45-97bf-0cc05783ec2b", "ready": false} 2026-03-10T21:11:19.244Z DEBUG checking if restore is allowed {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "5a8bcc87-066a-4dc2-9771-9eda4dfce4d6", "cluster": "some-name", "namespace": "demand-backup-incremental-gcp-native-19303"} 2026-03-10T21:11:19.245Z INFO Waiting for statefulsets to be ready before restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "5a8bcc87-066a-4dc2-9771-9eda4dfce4d6", "ready": false} 2026-03-10T21:11:24.247Z DEBUG checking if restore is allowed {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "762517af-0ddd-4fbb-a0d6-752dbf85881e", "cluster": "some-name", "namespace": "demand-backup-incremental-gcp-native-19303"} 2026-03-10T21:11:24.247Z INFO Waiting for statefulsets to be ready before restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "762517af-0ddd-4fbb-a0d6-752dbf85881e", "ready": false} 2026-03-10T21:11:29.248Z DEBUG checking if restore is allowed {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "d8354bb6-b1eb-49ab-9884-921cccec3e44", "cluster": "some-name", "namespace": "demand-backup-incremental-gcp-native-19303"} 2026-03-10T21:11:29.249Z INFO Waiting for statefulsets to be ready before restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "d8354bb6-b1eb-49ab-9884-921cccec3e44", "ready": false} 2026-03-10T21:11:34.250Z DEBUG checking if restore is allowed {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "29077978-7296-456c-ade3-92faa486029e", "cluster": "some-name", "namespace": "demand-backup-incremental-gcp-native-19303"} 2026-03-10T21:11:34.251Z INFO Waiting for statefulsets to be ready before restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "29077978-7296-456c-ade3-92faa486029e", "ready": false} 2026-03-10T21:11:39.252Z DEBUG checking if restore is allowed {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "d18be174-ac6f-47dd-8ab7-066d7dd8ff37", "cluster": "some-name", "namespace": "demand-backup-incremental-gcp-native-19303"} 2026-03-10T21:11:39.252Z INFO Waiting for statefulsets to be ready before restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "d18be174-ac6f-47dd-8ab7-066d7dd8ff37", "ready": false} 2026-03-10T21:11:44.254Z DEBUG checking if restore is allowed {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "0ab957df-c758-4012-9c88-793870e0a4ea", "cluster": "some-name", "namespace": "demand-backup-incremental-gcp-native-19303"} 2026-03-10T21:11:44.255Z INFO Waiting for statefulsets to be ready before restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "0ab957df-c758-4012-9c88-793870e0a4ea", "ready": false} 2026-03-10T21:11:49.256Z DEBUG checking if restore is allowed {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "02bcd791-7086-4648-bfdb-d395ee5ea3a3", "cluster": "some-name", "namespace": "demand-backup-incremental-gcp-native-19303"} 2026-03-10T21:11:49.256Z INFO Waiting for statefulsets to be ready before restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "02bcd791-7086-4648-bfdb-d395ee5ea3a3", "ready": false} 2026-03-10T21:11:54.258Z DEBUG checking if restore is allowed {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "95a72e84-1e61-4a68-b1b5-a8162a62d221", "cluster": "some-name", "namespace": "demand-backup-incremental-gcp-native-19303"} 2026-03-10T21:11:54.258Z INFO Waiting for statefulsets to be ready before restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "95a72e84-1e61-4a68-b1b5-a8162a62d221", "ready": false} 2026-03-10T21:11:59.259Z DEBUG checking if restore is allowed {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "b00d5ea0-62e8-44d7-b2d9-8a37f424aa8e", "cluster": "some-name", "namespace": "demand-backup-incremental-gcp-native-19303"} 2026-03-10T21:11:59.260Z INFO Waiting for statefulsets to be ready before restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "b00d5ea0-62e8-44d7-b2d9-8a37f424aa8e", "ready": false} 2026-03-10T21:12:04.261Z DEBUG checking if restore is allowed {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "16ceedc9-080f-4169-80bc-231d313f861c", "cluster": "some-name", "namespace": "demand-backup-incremental-gcp-native-19303"} 2026-03-10T21:12:04.262Z INFO Waiting for statefulsets to be ready before restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "16ceedc9-080f-4169-80bc-231d313f861c", "ready": false} 2026-03-10T21:12:09.262Z DEBUG checking if restore is allowed {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "fd6fac00-e67b-498e-a128-b667a1618ca4", "cluster": "some-name", "namespace": "demand-backup-incremental-gcp-native-19303"} 2026-03-10T21:12:09.267Z INFO Waiting for statefulsets to be ready before restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "fd6fac00-e67b-498e-a128-b667a1618ca4", "ready": false} 2026-03-10T21:12:14.268Z DEBUG checking if restore is allowed {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "da551407-f96d-4441-9a9c-592374026638", "cluster": "some-name", "namespace": "demand-backup-incremental-gcp-native-19303"} 2026-03-10T21:12:14.269Z DEBUG Pod is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "da551407-f96d-4441-9a9c-592374026638", "pod": "some-name-rs0-0"} 2026-03-10T21:12:14.269Z DEBUG Pod is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "da551407-f96d-4441-9a9c-592374026638", "pod": "some-name-rs0-1"} 2026-03-10T21:12:14.269Z DEBUG Pod is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "da551407-f96d-4441-9a9c-592374026638", "pod": "some-name-rs0-2"} 2026-03-10T21:12:14.269Z DEBUG Statefulset is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "da551407-f96d-4441-9a9c-592374026638", "sts": "some-name-rs0", "replset": "rs0"} 2026-03-10T21:12:14.918Z INFO Starting restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "da551407-f96d-4441-9a9c-592374026638", "command": ["/opt/percona/pbm", "restore", "2026-03-10T21:09:33Z", "--out", "json"], "pod": "some-name-rs0-0"} 2026-03-10T21:12:15.528Z INFO Restore started {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "da551407-f96d-4441-9a9c-592374026638", "pod": "some-name-rs0-0"} 2026-03-10T21:12:15.528Z INFO Restore state changed {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "da551407-f96d-4441-9a9c-592374026638", "previous": "waiting", "current": "requested"} 2026-03-10T21:12:16.107Z DEBUG checking if restore is allowed {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "f2c80005-fc0d-4ba0-9674-d16aeabde612", "cluster": "some-name", "namespace": "demand-backup-incremental-gcp-native-19303"} 2026-03-10T21:12:16.108Z DEBUG Pod is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "f2c80005-fc0d-4ba0-9674-d16aeabde612", "pod": "some-name-rs0-0"} 2026-03-10T21:12:16.108Z DEBUG Pod is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "f2c80005-fc0d-4ba0-9674-d16aeabde612", "pod": "some-name-rs0-1"} 2026-03-10T21:12:16.108Z DEBUG Pod is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "f2c80005-fc0d-4ba0-9674-d16aeabde612", "pod": "some-name-rs0-2"} 2026-03-10T21:12:16.108Z DEBUG Statefulset is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "f2c80005-fc0d-4ba0-9674-d16aeabde612", "sts": "some-name-rs0", "replset": "rs0"} 2026-03-10T21:12:16.108Z DEBUG Check restore status {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "f2c80005-fc0d-4ba0-9674-d16aeabde612", "command": ["/opt/percona/pbm", "describe-restore", "2026-03-10T21:12:15.510728826Z", "--config", "/etc/pbm/pbm_config.yaml", "--out", "json"], "pod": "some-name-rs0-0"} 2026-03-10T21:12:16.850Z DEBUG PBM restore status {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "f2c80005-fc0d-4ba0-9674-d16aeabde612", "status": {"type":"physical","opid":"","name":"2026-03-10T21:12:15.510728826Z","replsets":[{"name":"rs0","start_ts":0,"status":"","size":0,"size_uncompressed":0,"last_transition_ts":0,"first_write_ts":{"T":0,"I":0},"last_write_ts":{"T":0,"I":0},"node":"","conditions":null}],"compression":"","store":{"type":""},"size":0,"size_uncompressed":0,"mongodb_version":"","fcv":"","start_ts":0,"last_transition_ts":0,"first_write_ts":{"T":0,"I":0},"last_write_ts":{"T":0,"I":0},"hb":{"T":0,"I":0},"status":"","conditions":null,"n":null,"pbm_version":"","balancer":""}} 2026-03-10T21:12:21.851Z DEBUG checking if restore is allowed {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "6109b46e-0c42-473d-b442-1cdbbddb808d", "cluster": "some-name", "namespace": "demand-backup-incremental-gcp-native-19303"} 2026-03-10T21:12:21.852Z DEBUG Pod is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "6109b46e-0c42-473d-b442-1cdbbddb808d", "pod": "some-name-rs0-0"} 2026-03-10T21:12:21.852Z DEBUG Pod is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "6109b46e-0c42-473d-b442-1cdbbddb808d", "pod": "some-name-rs0-1"} 2026-03-10T21:12:21.852Z DEBUG Pod is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "6109b46e-0c42-473d-b442-1cdbbddb808d", "pod": "some-name-rs0-2"} 2026-03-10T21:12:21.852Z DEBUG Statefulset is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "6109b46e-0c42-473d-b442-1cdbbddb808d", "sts": "some-name-rs0", "replset": "rs0"} 2026-03-10T21:12:21.852Z DEBUG Check restore status {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "6109b46e-0c42-473d-b442-1cdbbddb808d", "command": ["/opt/percona/pbm", "describe-restore", "2026-03-10T21:12:15.510728826Z", "--config", "/etc/pbm/pbm_config.yaml", "--out", "json"], "pod": "some-name-rs0-0"} 2026-03-10T21:12:22.970Z DEBUG PBM restore status {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "6109b46e-0c42-473d-b442-1cdbbddb808d", "status": {"type":"physical","opid":"","name":"2026-03-10T21:12:15.510728826Z","replsets":[{"name":"rs0","start_ts":0,"status":"","size":0,"size_uncompressed":0,"last_transition_ts":0,"first_write_ts":{"T":0,"I":0},"last_write_ts":{"T":0,"I":0},"node":"","conditions":null}],"compression":"","store":{"type":""},"size":0,"size_uncompressed":0,"mongodb_version":"","fcv":"","start_ts":0,"last_transition_ts":0,"first_write_ts":{"T":0,"I":0},"last_write_ts":{"T":0,"I":0},"hb":{"T":0,"I":0},"status":"","conditions":null,"n":null,"pbm_version":"","balancer":""}} 2026-03-10T21:12:27.972Z DEBUG checking if restore is allowed {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "77439009-e8e1-48e0-af3c-aecd2ecaeb8c", "cluster": "some-name", "namespace": "demand-backup-incremental-gcp-native-19303"} 2026-03-10T21:12:27.972Z DEBUG Pod is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "77439009-e8e1-48e0-af3c-aecd2ecaeb8c", "pod": "some-name-rs0-0"} 2026-03-10T21:12:27.972Z DEBUG Pod is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "77439009-e8e1-48e0-af3c-aecd2ecaeb8c", "pod": "some-name-rs0-1"} 2026-03-10T21:12:27.972Z DEBUG Pod is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "77439009-e8e1-48e0-af3c-aecd2ecaeb8c", "pod": "some-name-rs0-2"} 2026-03-10T21:12:27.972Z DEBUG Statefulset is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "77439009-e8e1-48e0-af3c-aecd2ecaeb8c", "sts": "some-name-rs0", "replset": "rs0"} 2026-03-10T21:12:27.972Z DEBUG Check restore status {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "77439009-e8e1-48e0-af3c-aecd2ecaeb8c", "command": ["/opt/percona/pbm", "describe-restore", "2026-03-10T21:12:15.510728826Z", "--config", "/etc/pbm/pbm_config.yaml", "--out", "json"], "pod": "some-name-rs0-0"} 2026-03-10T21:12:29.125Z DEBUG PBM restore status {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "77439009-e8e1-48e0-af3c-aecd2ecaeb8c", "status": {"type":"physical","opid":"","name":"2026-03-10T21:12:15.510728826Z","replsets":[{"name":"rs0","start_ts":0,"status":"starting","size":0,"size_uncompressed":0,"last_transition_ts":1773177142,"first_write_ts":{"T":0,"I":0},"last_write_ts":{"T":0,"I":0},"node":"","conditions":null}],"compression":"","store":{"type":""},"size":0,"size_uncompressed":0,"mongodb_version":"","fcv":"","start_ts":0,"last_transition_ts":1773177148,"first_write_ts":{"T":0,"I":0},"last_write_ts":{"T":0,"I":0},"hb":{"T":0,"I":0},"status":"starting","conditions":null,"n":null,"pbm_version":"","balancer":""}} 2026-03-10T21:12:34.126Z DEBUG checking if restore is allowed {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "626f31bc-5a10-413e-8535-d2529d8e096f", "cluster": "some-name", "namespace": "demand-backup-incremental-gcp-native-19303"} 2026-03-10T21:12:34.127Z DEBUG Pod is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "626f31bc-5a10-413e-8535-d2529d8e096f", "pod": "some-name-rs0-0"} 2026-03-10T21:12:34.127Z DEBUG Pod is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "626f31bc-5a10-413e-8535-d2529d8e096f", "pod": "some-name-rs0-1"} 2026-03-10T21:12:34.127Z DEBUG Pod is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "626f31bc-5a10-413e-8535-d2529d8e096f", "pod": "some-name-rs0-2"} 2026-03-10T21:12:34.127Z DEBUG Statefulset is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "626f31bc-5a10-413e-8535-d2529d8e096f", "sts": "some-name-rs0", "replset": "rs0"} 2026-03-10T21:12:34.127Z DEBUG Check restore status {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "626f31bc-5a10-413e-8535-d2529d8e096f", "command": ["/opt/percona/pbm", "describe-restore", "2026-03-10T21:12:15.510728826Z", "--config", "/etc/pbm/pbm_config.yaml", "--out", "json"], "pod": "some-name-rs0-0"} 2026-03-10T21:12:35.467Z DEBUG PBM restore status {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "626f31bc-5a10-413e-8535-d2529d8e096f", "status": {"type":"physical","opid":"","name":"2026-03-10T21:12:15.510728826Z","replsets":[{"name":"rs0","start_ts":0,"status":"starting","size":0,"size_uncompressed":0,"last_transition_ts":1773177142,"first_write_ts":{"T":0,"I":0},"last_write_ts":{"T":0,"I":0},"node":"","conditions":null}],"compression":"","store":{"type":""},"size":0,"size_uncompressed":0,"mongodb_version":"","fcv":"","start_ts":0,"last_transition_ts":1773177148,"first_write_ts":{"T":0,"I":0},"last_write_ts":{"T":0,"I":0},"hb":{"T":0,"I":0},"status":"starting","conditions":null,"n":null,"pbm_version":"","balancer":""}} 2026-03-10T21:12:40.468Z DEBUG checking if restore is allowed {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "fc4f34fd-83ad-4467-a6f2-010bb1cc7f87", "cluster": "some-name", "namespace": "demand-backup-incremental-gcp-native-19303"} 2026-03-10T21:12:40.469Z DEBUG Pod is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "fc4f34fd-83ad-4467-a6f2-010bb1cc7f87", "pod": "some-name-rs0-0"} 2026-03-10T21:12:40.469Z DEBUG Pod is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "fc4f34fd-83ad-4467-a6f2-010bb1cc7f87", "pod": "some-name-rs0-1"} 2026-03-10T21:12:40.469Z DEBUG Pod is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "fc4f34fd-83ad-4467-a6f2-010bb1cc7f87", "pod": "some-name-rs0-2"} 2026-03-10T21:12:40.469Z DEBUG Statefulset is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "fc4f34fd-83ad-4467-a6f2-010bb1cc7f87", "sts": "some-name-rs0", "replset": "rs0"} 2026-03-10T21:12:40.469Z DEBUG Check restore status {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "fc4f34fd-83ad-4467-a6f2-010bb1cc7f87", "command": ["/opt/percona/pbm", "describe-restore", "2026-03-10T21:12:15.510728826Z", "--config", "/etc/pbm/pbm_config.yaml", "--out", "json"], "pod": "some-name-rs0-0"} 2026-03-10T21:12:41.942Z DEBUG PBM restore status {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "fc4f34fd-83ad-4467-a6f2-010bb1cc7f87", "status": {"type":"physical","opid":"","name":"2026-03-10T21:12:15.510728826Z","replsets":[{"name":"rs0","start_ts":0,"status":"running","size":0,"size_uncompressed":0,"last_transition_ts":1773177158,"first_write_ts":{"T":0,"I":0},"last_write_ts":{"T":0,"I":0},"node":"","conditions":null}],"compression":"","store":{"type":""},"size":0,"size_uncompressed":0,"mongodb_version":"","fcv":"","start_ts":0,"last_transition_ts":1773177148,"first_write_ts":{"T":0,"I":0},"last_write_ts":{"T":0,"I":0},"hb":{"T":0,"I":0},"status":"starting","conditions":null,"n":null,"pbm_version":"","balancer":""}} 2026-03-10T21:12:41.942Z INFO Restore state changed {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "fc4f34fd-83ad-4467-a6f2-010bb1cc7f87", "previous": "requested", "current": "running"} 2026-03-10T21:12:42.526Z DEBUG checking if restore is allowed {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "889ec6ba-6064-4a64-bae9-33cebdb94195", "cluster": "some-name", "namespace": "demand-backup-incremental-gcp-native-19303"} 2026-03-10T21:12:42.526Z DEBUG Pod is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "889ec6ba-6064-4a64-bae9-33cebdb94195", "pod": "some-name-rs0-1"} 2026-03-10T21:12:42.526Z DEBUG Pod is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "889ec6ba-6064-4a64-bae9-33cebdb94195", "pod": "some-name-rs0-2"} 2026-03-10T21:12:42.526Z DEBUG Pod is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "889ec6ba-6064-4a64-bae9-33cebdb94195", "pod": "some-name-rs0-0"} 2026-03-10T21:12:42.526Z DEBUG Statefulset is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "889ec6ba-6064-4a64-bae9-33cebdb94195", "sts": "some-name-rs0", "replset": "rs0"} 2026-03-10T21:12:42.527Z DEBUG Check restore status {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "889ec6ba-6064-4a64-bae9-33cebdb94195", "command": ["/opt/percona/pbm", "describe-restore", "2026-03-10T21:12:15.510728826Z", "--config", "/etc/pbm/pbm_config.yaml", "--out", "json"], "pod": "some-name-rs0-0"} 2026-03-10T21:12:43.632Z DEBUG PBM restore status {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "889ec6ba-6064-4a64-bae9-33cebdb94195", "status": {"type":"physical","opid":"","name":"2026-03-10T21:12:15.510728826Z","replsets":[{"name":"rs0","start_ts":0,"status":"running","size":0,"size_uncompressed":0,"last_transition_ts":1773177158,"first_write_ts":{"T":0,"I":0},"last_write_ts":{"T":0,"I":0},"node":"","conditions":null}],"compression":"","store":{"type":""},"size":0,"size_uncompressed":0,"mongodb_version":"","fcv":"","start_ts":0,"last_transition_ts":1773177148,"first_write_ts":{"T":0,"I":0},"last_write_ts":{"T":0,"I":0},"hb":{"T":0,"I":0},"status":"starting","conditions":null,"n":null,"pbm_version":"","balancer":""}} 2026-03-10T21:12:48.633Z DEBUG checking if restore is allowed {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "ff07314a-7561-4d4e-97f5-aca17c97b1e8", "cluster": "some-name", "namespace": "demand-backup-incremental-gcp-native-19303"} 2026-03-10T21:12:48.634Z DEBUG Pod is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "ff07314a-7561-4d4e-97f5-aca17c97b1e8", "pod": "some-name-rs0-0"} 2026-03-10T21:12:48.634Z DEBUG Pod is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "ff07314a-7561-4d4e-97f5-aca17c97b1e8", "pod": "some-name-rs0-1"} 2026-03-10T21:12:48.634Z DEBUG Pod is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "ff07314a-7561-4d4e-97f5-aca17c97b1e8", "pod": "some-name-rs0-2"} 2026-03-10T21:12:48.634Z DEBUG Statefulset is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "ff07314a-7561-4d4e-97f5-aca17c97b1e8", "sts": "some-name-rs0", "replset": "rs0"} 2026-03-10T21:12:48.634Z DEBUG Check restore status {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "ff07314a-7561-4d4e-97f5-aca17c97b1e8", "command": ["/opt/percona/pbm", "describe-restore", "2026-03-10T21:12:15.510728826Z", "--config", "/etc/pbm/pbm_config.yaml", "--out", "json"], "pod": "some-name-rs0-0"} 2026-03-10T21:12:50.348Z DEBUG PBM restore status {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "ff07314a-7561-4d4e-97f5-aca17c97b1e8", "status": {"type":"physical","opid":"","name":"2026-03-10T21:12:15.510728826Z","replsets":[{"name":"rs0","start_ts":0,"status":"running","size":0,"size_uncompressed":0,"last_transition_ts":1773177158,"first_write_ts":{"T":0,"I":0},"last_write_ts":{"T":0,"I":0},"node":"","conditions":null}],"compression":"","store":{"type":""},"size":0,"size_uncompressed":0,"mongodb_version":"","fcv":"","start_ts":0,"last_transition_ts":1773177164,"first_write_ts":{"T":0,"I":0},"last_write_ts":{"T":0,"I":0},"hb":{"T":0,"I":0},"status":"running","conditions":null,"n":null,"pbm_version":"","balancer":""}} 2026-03-10T21:12:55.349Z DEBUG checking if restore is allowed {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "7df4ed02-f1ad-41a5-a712-fe4d28aad342", "cluster": "some-name", "namespace": "demand-backup-incremental-gcp-native-19303"} 2026-03-10T21:12:55.350Z DEBUG Pod is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "7df4ed02-f1ad-41a5-a712-fe4d28aad342", "pod": "some-name-rs0-0"} 2026-03-10T21:12:55.350Z DEBUG Pod is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "7df4ed02-f1ad-41a5-a712-fe4d28aad342", "pod": "some-name-rs0-1"} 2026-03-10T21:12:55.350Z DEBUG Pod is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "7df4ed02-f1ad-41a5-a712-fe4d28aad342", "pod": "some-name-rs0-2"} 2026-03-10T21:12:55.350Z DEBUG Statefulset is ready for physical restore {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "7df4ed02-f1ad-41a5-a712-fe4d28aad342", "sts": "some-name-rs0", "replset": "rs0"} 2026-03-10T21:12:55.350Z DEBUG Check restore status {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "7df4ed02-f1ad-41a5-a712-fe4d28aad342", "command": ["/opt/percona/pbm", "describe-restore", "2026-03-10T21:12:15.510728826Z", "--config", "/etc/pbm/pbm_config.yaml", "--out", "json"], "pod": "some-name-rs0-0"} 2026-03-10T21:12:56.853Z DEBUG PBM restore status {"controller": "psmdbrestore-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBRestore", "PerconaServerMongoDBRestore": {"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"}, "namespace": "demand-backup-incremental-gcp-native-19303", "name": "restore-backup-gcp-cs-native", "reconcileID": "7df4ed02-f1ad-41a5-a712-fe4d28aad342", "status": {"type":"physical","opid":"","name":"2026-03-10T21:12:15.510728826Z","replsets":[{"name":"rs0","start_ts":0,"status":"running","size":0,"size_uncompressed":0,"last_transition_ts":1773177158,"first_write_ts":{"T":0,"I":0},"last_write_ts":{"T":0,"I":0},"node":"","conditions":null}],"compression":"","store":{"type":""},"size":0,"size_uncompressed":0,"mongodb_version":"","fcv":"","start_ts":0,"last_transition_ts":1773177164,"first_write_ts":{"T":0,"I":0},"last_write_ts":{"T":0,"I":0},"hb":{"T":0,"I":0},"status":"running","conditions":null,"n":null,"pbm_version":"","balancer":""}} apiVersion: psmdb.percona.com/v1 kind: PerconaServerMongoDBRestore metadata: annotations: kubectl.kubernetes.io/last-applied-configuration: | {"apiVersion":"psmdb.percona.com/v1","kind":"PerconaServerMongoDBRestore","metadata":{"annotations":{},"name":"restore-backup-gcp-cs-native","namespace":"demand-backup-incremental-gcp-native-19303"},"spec":{"backupName":"backup-gcp-cs-native","clusterName":"some-name"}} creationTimestamp: "2026-03-10T21:10:07Z" generation: 1 name: restore-backup-gcp-cs-native namespace: demand-backup-incremental-gcp-native-19303 resourceVersion: "1773177195860255004" uid: 64690f9b-015b-46f8-9eb4-34e6b648c5a0 spec: backupName: backup-gcp-cs-native clusterName: some-name status: error: 'describe restore stderr: stdout: : unable to upgrade connection: container not found ("mongod")' pbmName: "2026-03-10T21:12:15.510728826Z" state: error Name: restore-backup-gcp-cs-native Namespace: demand-backup-incremental-gcp-native-19303 Labels: Annotations: API Version: psmdb.percona.com/v1 Kind: PerconaServerMongoDBRestore Metadata: Creation Timestamp: 2026-03-10T21:10:07Z Generation: 1 Resource Version: 1773177195860255004 UID: 64690f9b-015b-46f8-9eb4-34e6b648c5a0 Spec: Backup Name: backup-gcp-cs-native Cluster Name: some-name Status: Error: describe restore stderr: stdout: : unable to upgrade connection: container not found ("mongod") Pbm Name: 2026-03-10T21:12:15.510728826Z State: error Events: Restore object restore-backup-gcp-cs-native is in error state after 1 minutes. something went wrong with operator or kubernetes cluster