Log: /mnt/jenkins/workspace/cloud-psmdb-operator_PR-2266/e2e-tests/logs/demand-backup-physical-sharded-gcp-native.log Warning: version difference between client (1.35) and server (1.32) exceeds the supported minor version skew of +/-1 Warning: version difference between client (1.35) and server (1.32) exceeds the supported minor version skew of +/-1 Warning: version difference between client (1.35) and server (1.32) exceeds the supported minor version skew of +/-1 ----------------------------------------------------------------------------------- get and delete old CRDs and RBAC ----------------------------------------------------------------------------------- grep: warning: stray \ before - grep: warning: stray \ before - error: the server doesn't have a resource type "perconaservermongodbbackups" + kubectl patch perconaservermongodbbackups.psmdb.percona.com -n sh --type=merge -p '{"metadata":{"finalizers":[]}}' error: the server doesn't have a resource type "perconaservermongodbbackups" error: the server doesn't have a resource type "perconaservermongodbrestores" + kubectl patch perconaservermongodbrestores.psmdb.percona.com -n sh --type=merge -p '{"metadata":{"finalizers":[]}}' error: the server doesn't have a resource type "perconaservermongodbrestores" error: the server doesn't have a resource type "perconaservermongodbs" + kubectl patch perconaservermongodbs.psmdb.percona.com -n sh --type=merge -p '{"metadata":{"finalizers":[]}}' error: the server doesn't have a resource type "perconaservermongodbs" Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "null" not found Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "null" not found Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "null" not found Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "null" not found ----------------------------------------------------------------------------------- destroy chaos-mesh ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces psmdb-operator ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- create namespace psmdb-operator ----------------------------------------------------------------------------------- namespace/psmdb-operator created Context "gke_cloud-dev-112233_us-central1-a_jen-psmdb-2266-f9fc55604-9-cluster6" modified. ----------------------------------------------------------------------------------- start PSMDB operator: docker.io/perconalab/percona-server-mongodb-operator:PR-2266-f9fc55604 ----------------------------------------------------------------------------------- customresourcedefinition.apiextensions.k8s.io/perconaservermongodbbackups.psmdb.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaservermongodbrestores.psmdb.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaservermongodbs.psmdb.percona.com serverside-applied clusterrole.rbac.authorization.k8s.io/percona-server-mongodb-operator created serviceaccount/percona-server-mongodb-operator created clusterrolebinding.rbac.authorization.k8s.io/service-account-percona-server-mongodb-operator created deployment.apps/percona-server-mongodb-operator created waiting for pod/percona-server-mongodb-operator-5554c4df68-cl4hw to be ready.OK Print operator info from log 2026-03-10T06:51:22.817Z INFO setup Manager starting up {"gitCommit": "f9fc5560468cd2df79998ec06ba830d1104a31a3", "gitBranch": "PR-2266-f9fc55604", "buildTime": "", "goVersion": "go1.25.8", "os": "linux", "arch": "amd64"} ----------------------------------------------------------------------------------- destroy chaos-mesh ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces demand-backup-physical-sharded-gcp-native-17862 ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- create namespace demand-backup-physical-sharded-gcp-native-17862 ----------------------------------------------------------------------------------- namespace/demand-backup-physical-sharded-gcp-native-17862 created Context "gke_cloud-dev-112233_us-central1-a_jen-psmdb-2266-f9fc55604-9-cluster6" modified. ----------------------------------------------------------------------------------- create secrets for cloud storages ----------------------------------------------------------------------------------- secret/minio-secret created secret/aws-s3-secret created secret/gcp-cs-secret created secret/azure-secret created secret/gcp-cs-sa-key-secret created ----------------------------------------------------------------------------------- Testing on sharded cluster ----------------------------------------------------------------------------------- Creating PSMDB cluster secret/some-users created perconaservermongodb.psmdb.percona.com/some-name created deployment.apps/psmdb-client created Check if all pods started waiting for pod/some-name-rs0-0 to be ready........OK waiting for pod/some-name-rs0-1 to be ready.......OK waiting for pod/some-name-rs0-2 to be ready......OK Waiting for cluster readyness.......................................... waiting for pod/some-name-cfg-0 to be ready.OK waiting for pod/some-name-cfg-1 to be ready.OK waiting for pod/some-name-cfg-2 to be ready.OK Waiting for cluster readyness waiting for pod/some-name-mongos-0 to be ready.OK waiting for pod/some-name-mongos-1 to be ready.OK waiting for pod/some-name-mongos-2 to be ready.OK Waiting for cluster readyness waiting for cluster readyness.OK Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://some-name-mongos.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017/admin?compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("e37e6cab-a26b-4dc9-bf64-cd512d11c4f1") } Percona Server for MongoDB server version: v8.0.19-7 WARNING: shell and server versions do not match Successfully added user: { "user" : "myApp", "roles" : [ { "db" : "myApp", "role" : "readWrite" } ] } bye Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://some-name-mongos.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017/admin?compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("3dfdedda-9465-4f24-9d1b-acfe58b35c8e") } Percona Server for MongoDB server version: v8.0.19-7 WARNING: shell and server versions do not match switched to db myApp WriteResult({ "nInserted" : 1 }) bye [2026-03-10T06:55:53+0000] running db.test.command() in myApp Waiting 60 seconds for stable timestamp in wiredtiger Running GCP storage backups [2026-03-10T06:57:16+0000] running backup backup-gcp-cs-sa-sharded perconaservermongodbbackup.psmdb.percona.com/backup-gcp-cs-sa-sharded created waiting for backup-gcp-cs-sa-sharded to reach ready state............................................................2026-03-10T06:57:19.727Z DEBUG Added finalizer {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "94cea9e8-9a97-479a-9f13-6e3deadc5a10", "finalizer": "internal.percona.com/release-lock"} 2026-03-10T06:57:19.727Z INFO Starting backup {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "94cea9e8-9a97-479a-9f13-6e3deadc5a10", "backup": "backup-gcp-cs-sa-sharded", "storage": "gcp-cs-sa"} 2026-03-10T06:57:19.728Z INFO Sending backup command {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "94cea9e8-9a97-479a-9f13-6e3deadc5a10", "backup": "backup-gcp-cs-sa-sharded", "storage": "gcp-cs-sa", "backupCmd": "backup [name: 2026-03-10T06:57:19Z, compression: gzip (level: default)] ", "profile": ""} 2026-03-10T06:57:19.733Z INFO Backup state changed {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "94cea9e8-9a97-479a-9f13-6e3deadc5a10", "previous": "", "current": "requested"} 2026-03-10T06:57:19.855Z ERROR failed to update backup status {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "94cea9e8-9a97-479a-9f13-6e3deadc5a10", "backup": "backup-gcp-cs-sa-sharded", "error": "write status: Operation cannot be fulfilled on perconaservermongodbbackups.psmdb.percona.com \"backup-gcp-cs-sa-sharded\": the object has been modified; please apply your changes to the latest version and try again", "errorVerbose": "Operation cannot be fulfilled on perconaservermongodbbackups.psmdb.percona.com \"backup-gcp-cs-sa-sharded\": the object has been modified; please apply your changes to the latest version and try again\nwrite status\ngithub.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodbbackup.(*ReconcilePerconaServerMongoDBBackup).updateStatus\n\t/go/src/github.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodbbackup/psmdb_backup_controller.go:708\ngithub.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodbbackup.(*ReconcilePerconaServerMongoDBBackup).Reconcile.func1\n\t/go/src/github.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodbbackup/psmdb_backup_controller.go:152\ngithub.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodbbackup.(*ReconcilePerconaServerMongoDBBackup).Reconcile\n\t/go/src/github.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodbbackup/psmdb_backup_controller.go:228\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.1/pkg/internal/controller/controller.go:222\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.1/pkg/internal/controller/controller.go:479\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.1/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.1/pkg/internal/controller/controller.go:313\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1693"} github.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodbbackup.(*ReconcilePerconaServerMongoDBBackup).Reconcile.func1 /go/src/github.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodbbackup/psmdb_backup_controller.go:154 github.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodbbackup.(*ReconcilePerconaServerMongoDBBackup).Reconcile /go/src/github.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodbbackup/psmdb_backup_controller.go:228 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile /go/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.1/pkg/internal/controller/controller.go:222 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler /go/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.1/pkg/internal/controller/controller.go:479 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem /go/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.1/pkg/internal/controller/controller.go:438 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1 /go/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.1/pkg/internal/controller/controller.go:313 2026-03-10T06:57:19.855Z DEBUG Reconcile finished {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "94cea9e8-9a97-479a-9f13-6e3deadc5a10"} 2026-03-10T06:57:20.287Z DEBUG Reconciling {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "6caedc52-be1b-46d1-be39-2f8fcfa908d9"} 2026-03-10T06:57:20.298Z DEBUG Got object from API server {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "6caedc52-be1b-46d1-be39-2f8fcfa908d9", "state": ""} 2026-03-10T06:57:20.375Z DEBUG checking if backup is allowed {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "6caedc52-be1b-46d1-be39-2f8fcfa908d9", "cluster": "some-name", "namespace": "demand-backup-physical-sharded-gcp-native-17862"} 2026-03-10T06:57:20.375Z DEBUG Checking for active jobs {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "6caedc52-be1b-46d1-be39-2f8fcfa908d9", "currentJob": {"Name":"backup-gcp-cs-sa-sharded","Type":0}} 2026-03-10T06:57:20.463Z INFO Acquiring the backup lock {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "6caedc52-be1b-46d1-be39-2f8fcfa908d9"} 2026-03-10T06:57:20.463Z INFO Starting backup {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "6caedc52-be1b-46d1-be39-2f8fcfa908d9", "backup": "backup-gcp-cs-sa-sharded", "storage": "gcp-cs-sa"} 2026-03-10T06:57:20.463Z INFO Sending backup command {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "6caedc52-be1b-46d1-be39-2f8fcfa908d9", "backup": "backup-gcp-cs-sa-sharded", "storage": "gcp-cs-sa", "backupCmd": "backup [name: 2026-03-10T06:57:20Z, compression: gzip (level: default)] ", "profile": ""} 2026-03-10T06:57:20.471Z INFO Backup state changed {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "6caedc52-be1b-46d1-be39-2f8fcfa908d9", "previous": "", "current": "requested"} 2026-03-10T06:57:20.489Z DEBUG Reconcile finished {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "6caedc52-be1b-46d1-be39-2f8fcfa908d9"} 2026-03-10T06:57:20.898Z DEBUG Reconciling {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "0fa80648-f505-40d2-838c-207be05935c5"} 2026-03-10T06:57:20.911Z DEBUG Got object from API server {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "0fa80648-f505-40d2-838c-207be05935c5", "state": "requested"} 2026-03-10T06:57:20.999Z DEBUG checking if backup is allowed {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "0fa80648-f505-40d2-838c-207be05935c5", "cluster": "some-name", "namespace": "demand-backup-physical-sharded-gcp-native-17862"} 2026-03-10T06:57:20.999Z DEBUG Checking for active jobs {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "0fa80648-f505-40d2-838c-207be05935c5", "currentJob": {"Name":"backup-gcp-cs-sa-sharded","Type":0}} 2026-03-10T06:57:21.082Z INFO Acquiring the backup lock {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "0fa80648-f505-40d2-838c-207be05935c5"} 2026-03-10T06:57:21.083Z DEBUG backupStatus Got backup meta {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "0fa80648-f505-40d2-838c-207be05935c5", "backup": "backup-gcp-cs-sa-sharded", "pbmName": "2026-03-10T06:57:20Z", "meta": {"type":"physical","opid":"69afc0d08dd96963da5158a9","name":"2026-03-10T06:57:20Z","shardRemap":{"cfg":"config"},"replsets":[],"compression":"gzip","store":{"type":"gcs","gcs":{"bucket":"operator-testing","prefix":"psmdb-demand-backup-physical-sharded","chunkSize":10485760,"retryer":{"backoffInitial":1000000000,"backoffMax":30000000000,"backoffMultiplier":2,"maxAttempts":5,"chunkRetryDeadline":32000000000}}},"size":0,"size_uncompressed":0,"mongodb_version":"8.0.19-7","fcv":"8.0","start_ts":1773125840,"last_transition_ts":1773125840,"first_write_ts":{"T":1,"I":1},"last_write_ts":{"T":1,"I":1},"hb":{"T":1773125840,"I":41},"status":"starting","conditions":[{"timestamp":1773125840,"status":"starting"}],"n":[{"rs":"cfg","n":["some-name-cfg-1.some-name-cfg.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017","some-name-cfg-2.some-name-cfg.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""},{"rs":"rs0","n":["some-name-rs0-1.some-name-rs0.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017","some-name-rs0-2.some-name-rs0.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""}],"pbm_version":"2.13.0","balancer":"full"}} 2026-03-10T06:57:21.085Z DEBUG Reconcile finished {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "0fa80648-f505-40d2-838c-207be05935c5"} 2026-03-10T06:57:26.087Z DEBUG Reconciling {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "257650b3-3e20-4b63-9cc9-21a536d81101"} 2026-03-10T06:57:26.099Z DEBUG Got object from API server {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "257650b3-3e20-4b63-9cc9-21a536d81101", "state": "requested"} 2026-03-10T06:57:26.184Z DEBUG checking if backup is allowed {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "257650b3-3e20-4b63-9cc9-21a536d81101", "cluster": "some-name", "namespace": "demand-backup-physical-sharded-gcp-native-17862"} 2026-03-10T06:57:26.184Z DEBUG Checking for active jobs {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "257650b3-3e20-4b63-9cc9-21a536d81101", "currentJob": {"Name":"backup-gcp-cs-sa-sharded","Type":0}} 2026-03-10T06:57:26.275Z INFO Acquiring the backup lock {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "257650b3-3e20-4b63-9cc9-21a536d81101"} 2026-03-10T06:57:26.277Z DEBUG backupStatus Got backup meta {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "257650b3-3e20-4b63-9cc9-21a536d81101", "backup": "backup-gcp-cs-sa-sharded", "pbmName": "2026-03-10T06:57:20Z", "meta": {"type":"physical","opid":"69afc0d08dd96963da5158a9","name":"2026-03-10T06:57:20Z","shardRemap":{"cfg":"config"},"replsets":[],"compression":"gzip","store":{"type":"gcs","gcs":{"bucket":"operator-testing","prefix":"psmdb-demand-backup-physical-sharded","chunkSize":10485760,"retryer":{"backoffInitial":1000000000,"backoffMax":30000000000,"backoffMultiplier":2,"maxAttempts":5,"chunkRetryDeadline":32000000000}}},"size":0,"size_uncompressed":0,"mongodb_version":"8.0.19-7","fcv":"8.0","start_ts":1773125840,"last_transition_ts":1773125840,"first_write_ts":{"T":1,"I":1},"last_write_ts":{"T":1,"I":1},"hb":{"T":1773125845,"I":26},"status":"starting","conditions":[{"timestamp":1773125840,"status":"starting"}],"n":[{"rs":"cfg","n":["some-name-cfg-0.some-name-cfg.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""},{"rs":"rs0","n":["some-name-rs0-0.some-name-rs0.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""}],"pbm_version":"2.13.0","balancer":"full"}} 2026-03-10T06:57:26.280Z DEBUG Reconcile finished {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "257650b3-3e20-4b63-9cc9-21a536d81101"} 2026-03-10T06:57:31.280Z DEBUG Reconciling {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "a1f0de46-e9e6-4fc8-83b4-56b7aa592889"} 2026-03-10T06:57:31.293Z DEBUG Got object from API server {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "a1f0de46-e9e6-4fc8-83b4-56b7aa592889", "state": "requested"} 2026-03-10T06:57:31.399Z DEBUG checking if backup is allowed {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "a1f0de46-e9e6-4fc8-83b4-56b7aa592889", "cluster": "some-name", "namespace": "demand-backup-physical-sharded-gcp-native-17862"} 2026-03-10T06:57:31.399Z DEBUG Checking for active jobs {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "a1f0de46-e9e6-4fc8-83b4-56b7aa592889", "currentJob": {"Name":"backup-gcp-cs-sa-sharded","Type":0}} 2026-03-10T06:57:31.512Z INFO Acquiring the backup lock {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "a1f0de46-e9e6-4fc8-83b4-56b7aa592889"} 2026-03-10T06:57:31.513Z DEBUG backupStatus Got backup meta {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "a1f0de46-e9e6-4fc8-83b4-56b7aa592889", "backup": "backup-gcp-cs-sa-sharded", "pbmName": "2026-03-10T06:57:20Z", "meta": {"type":"physical","opid":"69afc0d08dd96963da5158a9","name":"2026-03-10T06:57:20Z","shardRemap":{"cfg":"config"},"replsets":[],"compression":"gzip","store":{"type":"gcs","gcs":{"bucket":"operator-testing","prefix":"psmdb-demand-backup-physical-sharded","chunkSize":10485760,"retryer":{"backoffInitial":1000000000,"backoffMax":30000000000,"backoffMultiplier":2,"maxAttempts":5,"chunkRetryDeadline":32000000000}}},"size":0,"size_uncompressed":0,"mongodb_version":"8.0.19-7","fcv":"8.0","start_ts":1773125840,"last_transition_ts":1773125840,"first_write_ts":{"T":1,"I":1},"last_write_ts":{"T":1,"I":1},"hb":{"T":1773125845,"I":26},"status":"starting","conditions":[{"timestamp":1773125840,"status":"starting"}],"n":[{"rs":"cfg","n":["some-name-cfg-0.some-name-cfg.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""},{"rs":"rs0","n":["some-name-rs0-0.some-name-rs0.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""}],"pbm_version":"2.13.0","balancer":"full"}} 2026-03-10T06:57:31.516Z DEBUG Reconcile finished {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "a1f0de46-e9e6-4fc8-83b4-56b7aa592889"} 2026-03-10T06:57:36.516Z DEBUG Reconciling {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "89665664-93ae-4f0a-97a8-78b05c7407fd"} 2026-03-10T06:57:36.536Z DEBUG Got object from API server {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "89665664-93ae-4f0a-97a8-78b05c7407fd", "state": "requested"} 2026-03-10T06:57:36.621Z DEBUG checking if backup is allowed {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "89665664-93ae-4f0a-97a8-78b05c7407fd", "cluster": "some-name", "namespace": "demand-backup-physical-sharded-gcp-native-17862"} 2026-03-10T06:57:36.621Z DEBUG Checking for active jobs {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "89665664-93ae-4f0a-97a8-78b05c7407fd", "currentJob": {"Name":"backup-gcp-cs-sa-sharded","Type":0}} 2026-03-10T06:57:36.706Z INFO Acquiring the backup lock {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "89665664-93ae-4f0a-97a8-78b05c7407fd"} 2026-03-10T06:57:36.707Z DEBUG backupStatus Got backup meta {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "89665664-93ae-4f0a-97a8-78b05c7407fd", "backup": "backup-gcp-cs-sa-sharded", "pbmName": "2026-03-10T06:57:20Z", "meta": {"type":"physical","opid":"69afc0d08dd96963da5158a9","name":"2026-03-10T06:57:20Z","shardRemap":{"cfg":"config"},"replsets":[],"compression":"gzip","store":{"type":"gcs","gcs":{"bucket":"operator-testing","prefix":"psmdb-demand-backup-physical-sharded","chunkSize":10485760,"retryer":{"backoffInitial":1000000000,"backoffMax":30000000000,"backoffMultiplier":2,"maxAttempts":5,"chunkRetryDeadline":32000000000}}},"size":0,"size_uncompressed":0,"mongodb_version":"8.0.19-7","fcv":"8.0","start_ts":1773125840,"last_transition_ts":1773125840,"first_write_ts":{"T":1,"I":1},"last_write_ts":{"T":1,"I":1},"hb":{"T":1773125845,"I":26},"status":"starting","conditions":[{"timestamp":1773125840,"status":"starting"}],"n":[{"rs":"cfg","n":["some-name-cfg-0.some-name-cfg.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""},{"rs":"rs0","n":["some-name-rs0-0.some-name-rs0.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""}],"pbm_version":"2.13.0","balancer":"full"}} 2026-03-10T06:57:36.710Z DEBUG Reconcile finished {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "89665664-93ae-4f0a-97a8-78b05c7407fd"} 2026-03-10T06:57:41.711Z DEBUG Reconciling {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "8f79541b-7e5f-4039-90d5-888cbc5eeb85"} 2026-03-10T06:57:41.723Z DEBUG Got object from API server {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "8f79541b-7e5f-4039-90d5-888cbc5eeb85", "state": "requested"} 2026-03-10T06:57:41.799Z DEBUG checking if backup is allowed {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "8f79541b-7e5f-4039-90d5-888cbc5eeb85", "cluster": "some-name", "namespace": "demand-backup-physical-sharded-gcp-native-17862"} 2026-03-10T06:57:41.800Z DEBUG Checking for active jobs {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "8f79541b-7e5f-4039-90d5-888cbc5eeb85", "currentJob": {"Name":"backup-gcp-cs-sa-sharded","Type":0}} 2026-03-10T06:57:41.880Z INFO Acquiring the backup lock {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "8f79541b-7e5f-4039-90d5-888cbc5eeb85"} 2026-03-10T06:57:41.881Z DEBUG backupStatus Got backup meta {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "8f79541b-7e5f-4039-90d5-888cbc5eeb85", "backup": "backup-gcp-cs-sa-sharded", "pbmName": "2026-03-10T06:57:20Z", "meta": {"type":"physical","opid":"69afc0d08dd96963da5158a9","name":"2026-03-10T06:57:20Z","shardRemap":{"cfg":"config"},"replsets":[],"compression":"gzip","store":{"type":"gcs","gcs":{"bucket":"operator-testing","prefix":"psmdb-demand-backup-physical-sharded","chunkSize":10485760,"retryer":{"backoffInitial":1000000000,"backoffMax":30000000000,"backoffMultiplier":2,"maxAttempts":5,"chunkRetryDeadline":32000000000}}},"size":0,"size_uncompressed":0,"mongodb_version":"8.0.19-7","fcv":"8.0","start_ts":1773125840,"last_transition_ts":1773125840,"first_write_ts":{"T":1,"I":1},"last_write_ts":{"T":1,"I":1},"hb":{"T":1773125845,"I":26},"status":"starting","conditions":[{"timestamp":1773125840,"status":"starting"}],"n":[{"rs":"cfg","n":["some-name-cfg-0.some-name-cfg.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""},{"rs":"rs0","n":["some-name-rs0-0.some-name-rs0.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""}],"pbm_version":"2.13.0","balancer":"full"}} 2026-03-10T06:57:41.884Z DEBUG Reconcile finished {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "8f79541b-7e5f-4039-90d5-888cbc5eeb85"} 2026-03-10T06:57:46.885Z DEBUG Reconciling {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "37a983f2-af38-496a-8f0f-3b81c8296076"} 2026-03-10T06:57:46.899Z DEBUG Got object from API server {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "37a983f2-af38-496a-8f0f-3b81c8296076", "state": "requested"} 2026-03-10T06:57:46.976Z DEBUG checking if backup is allowed {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "37a983f2-af38-496a-8f0f-3b81c8296076", "cluster": "some-name", "namespace": "demand-backup-physical-sharded-gcp-native-17862"} 2026-03-10T06:57:46.976Z DEBUG Checking for active jobs {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "37a983f2-af38-496a-8f0f-3b81c8296076", "currentJob": {"Name":"backup-gcp-cs-sa-sharded","Type":0}} 2026-03-10T06:57:47.056Z INFO Acquiring the backup lock {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "37a983f2-af38-496a-8f0f-3b81c8296076"} 2026-03-10T06:57:47.057Z DEBUG backupStatus Got backup meta {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "37a983f2-af38-496a-8f0f-3b81c8296076", "backup": "backup-gcp-cs-sa-sharded", "pbmName": "2026-03-10T06:57:20Z", "meta": {"type":"physical","opid":"69afc0d08dd96963da5158a9","name":"2026-03-10T06:57:20Z","shardRemap":{"cfg":"config"},"replsets":[],"compression":"gzip","store":{"type":"gcs","gcs":{"bucket":"operator-testing","prefix":"psmdb-demand-backup-physical-sharded","chunkSize":10485760,"retryer":{"backoffInitial":1000000000,"backoffMax":30000000000,"backoffMultiplier":2,"maxAttempts":5,"chunkRetryDeadline":32000000000}}},"size":0,"size_uncompressed":0,"mongodb_version":"8.0.19-7","fcv":"8.0","start_ts":1773125840,"last_transition_ts":1773125840,"first_write_ts":{"T":1,"I":1},"last_write_ts":{"T":1,"I":1},"hb":{"T":1773125845,"I":26},"status":"starting","conditions":[{"timestamp":1773125840,"status":"starting"}],"n":[{"rs":"cfg","n":["some-name-cfg-0.some-name-cfg.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""},{"rs":"rs0","n":["some-name-rs0-0.some-name-rs0.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""}],"pbm_version":"2.13.0","balancer":"full"}} 2026-03-10T06:57:47.059Z DEBUG Reconcile finished {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "37a983f2-af38-496a-8f0f-3b81c8296076"} 2026-03-10T06:57:52.060Z DEBUG Reconciling {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "15887596-3339-4304-964d-b425b17fbce9"} 2026-03-10T06:57:52.074Z DEBUG Got object from API server {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "15887596-3339-4304-964d-b425b17fbce9", "state": "requested"} 2026-03-10T06:57:52.149Z DEBUG checking if backup is allowed {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "15887596-3339-4304-964d-b425b17fbce9", "cluster": "some-name", "namespace": "demand-backup-physical-sharded-gcp-native-17862"} 2026-03-10T06:57:52.149Z DEBUG Checking for active jobs {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "15887596-3339-4304-964d-b425b17fbce9", "currentJob": {"Name":"backup-gcp-cs-sa-sharded","Type":0}} 2026-03-10T06:57:52.289Z INFO Acquiring the backup lock {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "15887596-3339-4304-964d-b425b17fbce9"} 2026-03-10T06:57:52.291Z DEBUG backupStatus Got backup meta {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "15887596-3339-4304-964d-b425b17fbce9", "backup": "backup-gcp-cs-sa-sharded", "pbmName": "2026-03-10T06:57:20Z", "meta": {"type":"physical","opid":"69afc0d08dd96963da5158a9","name":"2026-03-10T06:57:20Z","shardRemap":{"cfg":"config"},"replsets":[],"compression":"gzip","store":{"type":"gcs","gcs":{"bucket":"operator-testing","prefix":"psmdb-demand-backup-physical-sharded","chunkSize":10485760,"retryer":{"backoffInitial":1000000000,"backoffMax":30000000000,"backoffMultiplier":2,"maxAttempts":5,"chunkRetryDeadline":32000000000}}},"size":0,"size_uncompressed":0,"mongodb_version":"8.0.19-7","fcv":"8.0","start_ts":1773125840,"last_transition_ts":1773125840,"first_write_ts":{"T":1,"I":1},"last_write_ts":{"T":1,"I":1},"hb":{"T":1773125845,"I":26},"status":"starting","conditions":[{"timestamp":1773125840,"status":"starting"}],"n":[{"rs":"cfg","n":["some-name-cfg-0.some-name-cfg.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""},{"rs":"rs0","n":["some-name-rs0-0.some-name-rs0.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""}],"pbm_version":"2.13.0","balancer":"full"}} 2026-03-10T06:57:52.292Z DEBUG Reconcile finished {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "15887596-3339-4304-964d-b425b17fbce9"} 2026-03-10T06:57:57.293Z DEBUG Reconciling {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "af8ee067-5c14-4934-8b1e-f59ec89aaaca"} 2026-03-10T06:57:57.302Z DEBUG Got object from API server {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "af8ee067-5c14-4934-8b1e-f59ec89aaaca", "state": "requested"} 2026-03-10T06:57:57.369Z DEBUG checking if backup is allowed {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "af8ee067-5c14-4934-8b1e-f59ec89aaaca", "cluster": "some-name", "namespace": "demand-backup-physical-sharded-gcp-native-17862"} 2026-03-10T06:57:57.369Z DEBUG Checking for active jobs {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "af8ee067-5c14-4934-8b1e-f59ec89aaaca", "currentJob": {"Name":"backup-gcp-cs-sa-sharded","Type":0}} 2026-03-10T06:57:57.455Z INFO Acquiring the backup lock {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "af8ee067-5c14-4934-8b1e-f59ec89aaaca"} 2026-03-10T06:57:57.456Z DEBUG backupStatus Got backup meta {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "af8ee067-5c14-4934-8b1e-f59ec89aaaca", "backup": "backup-gcp-cs-sa-sharded", "pbmName": "2026-03-10T06:57:20Z", "meta": {"type":"physical","opid":"69afc0d08dd96963da5158a9","name":"2026-03-10T06:57:20Z","shardRemap":{"cfg":"config"},"replsets":[],"compression":"gzip","store":{"type":"gcs","gcs":{"bucket":"operator-testing","prefix":"psmdb-demand-backup-physical-sharded","chunkSize":10485760,"retryer":{"backoffInitial":1000000000,"backoffMax":30000000000,"backoffMultiplier":2,"maxAttempts":5,"chunkRetryDeadline":32000000000}}},"size":0,"size_uncompressed":0,"mongodb_version":"8.0.19-7","fcv":"8.0","start_ts":1773125840,"last_transition_ts":1773125840,"first_write_ts":{"T":1,"I":1},"last_write_ts":{"T":1,"I":1},"hb":{"T":1773125845,"I":26},"status":"starting","conditions":[{"timestamp":1773125840,"status":"starting"}],"n":[{"rs":"cfg","n":["some-name-cfg-0.some-name-cfg.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""},{"rs":"rs0","n":["some-name-rs0-0.some-name-rs0.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""}],"pbm_version":"2.13.0","balancer":"full"}} 2026-03-10T06:57:57.460Z DEBUG Reconcile finished {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "af8ee067-5c14-4934-8b1e-f59ec89aaaca"} 2026-03-10T06:58:02.461Z DEBUG Reconciling {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "1c5291f4-3cd6-4449-8a86-7712c3190e50"} 2026-03-10T06:58:02.472Z DEBUG Got object from API server {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "1c5291f4-3cd6-4449-8a86-7712c3190e50", "state": "requested"} 2026-03-10T06:58:02.546Z DEBUG checking if backup is allowed {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "1c5291f4-3cd6-4449-8a86-7712c3190e50", "cluster": "some-name", "namespace": "demand-backup-physical-sharded-gcp-native-17862"} 2026-03-10T06:58:02.546Z DEBUG Checking for active jobs {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "1c5291f4-3cd6-4449-8a86-7712c3190e50", "currentJob": {"Name":"backup-gcp-cs-sa-sharded","Type":0}} 2026-03-10T06:58:02.631Z INFO Acquiring the backup lock {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "1c5291f4-3cd6-4449-8a86-7712c3190e50"} 2026-03-10T06:58:02.632Z DEBUG backupStatus Got backup meta {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "1c5291f4-3cd6-4449-8a86-7712c3190e50", "backup": "backup-gcp-cs-sa-sharded", "pbmName": "2026-03-10T06:57:20Z", "meta": {"type":"physical","opid":"69afc0d08dd96963da5158a9","name":"2026-03-10T06:57:20Z","shardRemap":{"cfg":"config"},"replsets":[],"compression":"gzip","store":{"type":"gcs","gcs":{"bucket":"operator-testing","prefix":"psmdb-demand-backup-physical-sharded","chunkSize":10485760,"retryer":{"backoffInitial":1000000000,"backoffMax":30000000000,"backoffMultiplier":2,"maxAttempts":5,"chunkRetryDeadline":32000000000}}},"size":0,"size_uncompressed":0,"mongodb_version":"8.0.19-7","fcv":"8.0","start_ts":1773125840,"last_transition_ts":1773125840,"first_write_ts":{"T":1,"I":1},"last_write_ts":{"T":1,"I":1},"hb":{"T":1773125845,"I":26},"status":"starting","conditions":[{"timestamp":1773125840,"status":"starting"}],"n":[{"rs":"cfg","n":["some-name-cfg-0.some-name-cfg.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""},{"rs":"rs0","n":["some-name-rs0-0.some-name-rs0.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""}],"pbm_version":"2.13.0","balancer":"full"}} 2026-03-10T06:58:02.633Z DEBUG Reconcile finished {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "1c5291f4-3cd6-4449-8a86-7712c3190e50"} 2026-03-10T06:58:07.634Z DEBUG Reconciling {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "b14ab61d-e8da-48e9-8804-302250381520"} 2026-03-10T06:58:07.647Z DEBUG Got object from API server {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "b14ab61d-e8da-48e9-8804-302250381520", "state": "requested"} 2026-03-10T06:58:07.721Z DEBUG checking if backup is allowed {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "b14ab61d-e8da-48e9-8804-302250381520", "cluster": "some-name", "namespace": "demand-backup-physical-sharded-gcp-native-17862"} 2026-03-10T06:58:07.721Z DEBUG Checking for active jobs {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "b14ab61d-e8da-48e9-8804-302250381520", "currentJob": {"Name":"backup-gcp-cs-sa-sharded","Type":0}} 2026-03-10T06:58:07.787Z INFO Acquiring the backup lock {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "b14ab61d-e8da-48e9-8804-302250381520"} 2026-03-10T06:58:07.788Z DEBUG backupStatus Got backup meta {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "b14ab61d-e8da-48e9-8804-302250381520", "backup": "backup-gcp-cs-sa-sharded", "pbmName": "2026-03-10T06:57:20Z", "meta": {"type":"physical","opid":"69afc0d08dd96963da5158a9","name":"2026-03-10T06:57:20Z","shardRemap":{"cfg":"config"},"replsets":[],"compression":"gzip","store":{"type":"gcs","gcs":{"bucket":"operator-testing","prefix":"psmdb-demand-backup-physical-sharded","chunkSize":10485760,"retryer":{"backoffInitial":1000000000,"backoffMax":30000000000,"backoffMultiplier":2,"maxAttempts":5,"chunkRetryDeadline":32000000000}}},"size":0,"size_uncompressed":0,"mongodb_version":"8.0.19-7","fcv":"8.0","start_ts":1773125840,"last_transition_ts":1773125840,"first_write_ts":{"T":1,"I":1},"last_write_ts":{"T":1,"I":1},"hb":{"T":1773125845,"I":26},"status":"starting","conditions":[{"timestamp":1773125840,"status":"starting"}],"n":[{"rs":"cfg","n":["some-name-cfg-0.some-name-cfg.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""},{"rs":"rs0","n":["some-name-rs0-0.some-name-rs0.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""}],"pbm_version":"2.13.0","balancer":"full"}} 2026-03-10T06:58:07.789Z DEBUG Reconcile finished {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "b14ab61d-e8da-48e9-8804-302250381520"} 2026-03-10T06:58:12.790Z DEBUG Reconciling {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "3fc3003b-7574-4037-94f8-6f1ece9ecca1"} 2026-03-10T06:58:12.799Z DEBUG Got object from API server {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "3fc3003b-7574-4037-94f8-6f1ece9ecca1", "state": "requested"} 2026-03-10T06:58:12.871Z DEBUG checking if backup is allowed {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "3fc3003b-7574-4037-94f8-6f1ece9ecca1", "cluster": "some-name", "namespace": "demand-backup-physical-sharded-gcp-native-17862"} 2026-03-10T06:58:12.871Z DEBUG Checking for active jobs {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "3fc3003b-7574-4037-94f8-6f1ece9ecca1", "currentJob": {"Name":"backup-gcp-cs-sa-sharded","Type":0}} 2026-03-10T06:58:12.949Z INFO Acquiring the backup lock {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "3fc3003b-7574-4037-94f8-6f1ece9ecca1"} 2026-03-10T06:58:12.950Z DEBUG backupStatus Got backup meta {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "3fc3003b-7574-4037-94f8-6f1ece9ecca1", "backup": "backup-gcp-cs-sa-sharded", "pbmName": "2026-03-10T06:57:20Z", "meta": {"type":"physical","opid":"69afc0d08dd96963da5158a9","name":"2026-03-10T06:57:20Z","shardRemap":{"cfg":"config"},"replsets":[],"compression":"gzip","store":{"type":"gcs","gcs":{"bucket":"operator-testing","prefix":"psmdb-demand-backup-physical-sharded","chunkSize":10485760,"retryer":{"backoffInitial":1000000000,"backoffMax":30000000000,"backoffMultiplier":2,"maxAttempts":5,"chunkRetryDeadline":32000000000}}},"size":0,"size_uncompressed":0,"mongodb_version":"8.0.19-7","fcv":"8.0","start_ts":1773125840,"last_transition_ts":1773125840,"first_write_ts":{"T":1,"I":1},"last_write_ts":{"T":1,"I":1},"hb":{"T":1773125845,"I":26},"status":"starting","conditions":[{"timestamp":1773125840,"status":"starting"}],"n":[{"rs":"cfg","n":["some-name-cfg-0.some-name-cfg.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""},{"rs":"rs0","n":["some-name-rs0-0.some-name-rs0.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""}],"pbm_version":"2.13.0","balancer":"full"}} 2026-03-10T06:58:12.952Z DEBUG Reconcile finished {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "3fc3003b-7574-4037-94f8-6f1ece9ecca1"} 2026-03-10T06:58:17.952Z DEBUG Reconciling {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "26de0eed-c380-446b-9940-4a7620dc384f"} 2026-03-10T06:58:17.963Z DEBUG Got object from API server {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "26de0eed-c380-446b-9940-4a7620dc384f", "state": "requested"} 2026-03-10T06:58:18.036Z DEBUG checking if backup is allowed {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "26de0eed-c380-446b-9940-4a7620dc384f", "cluster": "some-name", "namespace": "demand-backup-physical-sharded-gcp-native-17862"} 2026-03-10T06:58:18.036Z DEBUG Checking for active jobs {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "26de0eed-c380-446b-9940-4a7620dc384f", "currentJob": {"Name":"backup-gcp-cs-sa-sharded","Type":0}} 2026-03-10T06:58:18.110Z INFO Acquiring the backup lock {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "26de0eed-c380-446b-9940-4a7620dc384f"} 2026-03-10T06:58:18.111Z DEBUG backupStatus Got backup meta {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "26de0eed-c380-446b-9940-4a7620dc384f", "backup": "backup-gcp-cs-sa-sharded", "pbmName": "2026-03-10T06:57:20Z", "meta": {"type":"physical","opid":"69afc0d08dd96963da5158a9","name":"2026-03-10T06:57:20Z","shardRemap":{"cfg":"config"},"replsets":[],"compression":"gzip","store":{"type":"gcs","gcs":{"bucket":"operator-testing","prefix":"psmdb-demand-backup-physical-sharded","chunkSize":10485760,"retryer":{"backoffInitial":1000000000,"backoffMax":30000000000,"backoffMultiplier":2,"maxAttempts":5,"chunkRetryDeadline":32000000000}}},"size":0,"size_uncompressed":0,"mongodb_version":"8.0.19-7","fcv":"8.0","start_ts":1773125840,"last_transition_ts":1773125840,"first_write_ts":{"T":1,"I":1},"last_write_ts":{"T":1,"I":1},"hb":{"T":1773125845,"I":26},"status":"starting","conditions":[{"timestamp":1773125840,"status":"starting"}],"n":[{"rs":"cfg","n":["some-name-cfg-0.some-name-cfg.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""},{"rs":"rs0","n":["some-name-rs0-0.some-name-rs0.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""}],"pbm_version":"2.13.0","balancer":"full"}} 2026-03-10T06:58:18.112Z DEBUG Reconcile finished {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "26de0eed-c380-446b-9940-4a7620dc384f"} 2026-03-10T06:58:23.113Z DEBUG Reconciling {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "36c32ddb-a6c7-4641-b554-1659ac957835"} 2026-03-10T06:58:23.125Z DEBUG Got object from API server {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "36c32ddb-a6c7-4641-b554-1659ac957835", "state": "requested"} 2026-03-10T06:58:23.206Z DEBUG checking if backup is allowed {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "36c32ddb-a6c7-4641-b554-1659ac957835", "cluster": "some-name", "namespace": "demand-backup-physical-sharded-gcp-native-17862"} 2026-03-10T06:58:23.206Z DEBUG Checking for active jobs {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "36c32ddb-a6c7-4641-b554-1659ac957835", "currentJob": {"Name":"backup-gcp-cs-sa-sharded","Type":0}} 2026-03-10T06:58:23.286Z INFO Acquiring the backup lock {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "36c32ddb-a6c7-4641-b554-1659ac957835"} 2026-03-10T06:58:23.288Z DEBUG backupStatus Got backup meta {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "36c32ddb-a6c7-4641-b554-1659ac957835", "backup": "backup-gcp-cs-sa-sharded", "pbmName": "2026-03-10T06:57:20Z", "meta": {"type":"physical","opid":"69afc0d08dd96963da5158a9","name":"2026-03-10T06:57:20Z","shardRemap":{"cfg":"config"},"replsets":[],"compression":"gzip","store":{"type":"gcs","gcs":{"bucket":"operator-testing","prefix":"psmdb-demand-backup-physical-sharded","chunkSize":10485760,"retryer":{"backoffInitial":1000000000,"backoffMax":30000000000,"backoffMultiplier":2,"maxAttempts":5,"chunkRetryDeadline":32000000000}}},"size":0,"size_uncompressed":0,"mongodb_version":"8.0.19-7","fcv":"8.0","start_ts":1773125840,"last_transition_ts":1773125840,"first_write_ts":{"T":1,"I":1},"last_write_ts":{"T":1,"I":1},"hb":{"T":1773125845,"I":26},"status":"starting","conditions":[{"timestamp":1773125840,"status":"starting"}],"n":[{"rs":"cfg","n":["some-name-cfg-0.some-name-cfg.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""},{"rs":"rs0","n":["some-name-rs0-0.some-name-rs0.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""}],"pbm_version":"2.13.0","balancer":"full"}} 2026-03-10T06:58:23.291Z DEBUG Reconcile finished {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "36c32ddb-a6c7-4641-b554-1659ac957835"} 2026-03-10T06:58:28.291Z DEBUG Reconciling {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "55b00c3e-2e75-41b3-8613-e49000299c94"} 2026-03-10T06:58:28.304Z DEBUG Got object from API server {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "55b00c3e-2e75-41b3-8613-e49000299c94", "state": "requested"} 2026-03-10T06:58:28.385Z DEBUG checking if backup is allowed {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "55b00c3e-2e75-41b3-8613-e49000299c94", "cluster": "some-name", "namespace": "demand-backup-physical-sharded-gcp-native-17862"} 2026-03-10T06:58:28.385Z DEBUG Checking for active jobs {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "55b00c3e-2e75-41b3-8613-e49000299c94", "currentJob": {"Name":"backup-gcp-cs-sa-sharded","Type":0}} 2026-03-10T06:58:28.471Z INFO Acquiring the backup lock {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "55b00c3e-2e75-41b3-8613-e49000299c94"} 2026-03-10T06:58:28.472Z DEBUG backupStatus Got backup meta {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "55b00c3e-2e75-41b3-8613-e49000299c94", "backup": "backup-gcp-cs-sa-sharded", "pbmName": "2026-03-10T06:57:20Z", "meta": {"type":"physical","opid":"69afc0d08dd96963da5158a9","name":"2026-03-10T06:57:20Z","shardRemap":{"cfg":"config"},"replsets":[],"compression":"gzip","store":{"type":"gcs","gcs":{"bucket":"operator-testing","prefix":"psmdb-demand-backup-physical-sharded","chunkSize":10485760,"retryer":{"backoffInitial":1000000000,"backoffMax":30000000000,"backoffMultiplier":2,"maxAttempts":5,"chunkRetryDeadline":32000000000}}},"size":0,"size_uncompressed":0,"mongodb_version":"8.0.19-7","fcv":"8.0","start_ts":1773125840,"last_transition_ts":1773125840,"first_write_ts":{"T":1,"I":1},"last_write_ts":{"T":1,"I":1},"hb":{"T":1773125845,"I":26},"status":"starting","conditions":[{"timestamp":1773125840,"status":"starting"}],"n":[{"rs":"cfg","n":["some-name-cfg-0.some-name-cfg.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""},{"rs":"rs0","n":["some-name-rs0-0.some-name-rs0.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""}],"pbm_version":"2.13.0","balancer":"full"}} 2026-03-10T06:58:28.475Z DEBUG Reconcile finished {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "55b00c3e-2e75-41b3-8613-e49000299c94"} 2026-03-10T06:58:33.476Z DEBUG Reconciling {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "1aae05ee-04b8-46c0-abe1-27c205c1e703"} 2026-03-10T06:58:33.487Z DEBUG Got object from API server {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "1aae05ee-04b8-46c0-abe1-27c205c1e703", "state": "requested"} 2026-03-10T06:58:33.590Z DEBUG checking if backup is allowed {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "1aae05ee-04b8-46c0-abe1-27c205c1e703", "cluster": "some-name", "namespace": "demand-backup-physical-sharded-gcp-native-17862"} 2026-03-10T06:58:33.590Z DEBUG Checking for active jobs {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "1aae05ee-04b8-46c0-abe1-27c205c1e703", "currentJob": {"Name":"backup-gcp-cs-sa-sharded","Type":0}} 2026-03-10T06:58:33.670Z INFO Acquiring the backup lock {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "1aae05ee-04b8-46c0-abe1-27c205c1e703"} 2026-03-10T06:58:33.671Z DEBUG backupStatus Got backup meta {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "1aae05ee-04b8-46c0-abe1-27c205c1e703", "backup": "backup-gcp-cs-sa-sharded", "pbmName": "2026-03-10T06:57:20Z", "meta": {"type":"physical","opid":"69afc0d08dd96963da5158a9","name":"2026-03-10T06:57:20Z","shardRemap":{"cfg":"config"},"replsets":[],"compression":"gzip","store":{"type":"gcs","gcs":{"bucket":"operator-testing","prefix":"psmdb-demand-backup-physical-sharded","chunkSize":10485760,"retryer":{"backoffInitial":1000000000,"backoffMax":30000000000,"backoffMultiplier":2,"maxAttempts":5,"chunkRetryDeadline":32000000000}}},"size":0,"size_uncompressed":0,"mongodb_version":"8.0.19-7","fcv":"8.0","start_ts":1773125840,"last_transition_ts":1773125840,"first_write_ts":{"T":1,"I":1},"last_write_ts":{"T":1,"I":1},"hb":{"T":1773125845,"I":26},"status":"starting","conditions":[{"timestamp":1773125840,"status":"starting"}],"n":[{"rs":"cfg","n":["some-name-cfg-0.some-name-cfg.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""},{"rs":"rs0","n":["some-name-rs0-0.some-name-rs0.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""}],"pbm_version":"2.13.0","balancer":"full"}} 2026-03-10T06:58:33.672Z DEBUG Reconcile finished {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "1aae05ee-04b8-46c0-abe1-27c205c1e703"} 2026-03-10T06:58:38.673Z DEBUG Reconciling {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "9f98954c-ea58-466c-94db-115293983773"} 2026-03-10T06:58:38.683Z DEBUG Got object from API server {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "9f98954c-ea58-466c-94db-115293983773", "state": "requested"} 2026-03-10T06:58:38.757Z DEBUG checking if backup is allowed {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "9f98954c-ea58-466c-94db-115293983773", "cluster": "some-name", "namespace": "demand-backup-physical-sharded-gcp-native-17862"} 2026-03-10T06:58:38.757Z DEBUG Checking for active jobs {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "9f98954c-ea58-466c-94db-115293983773", "currentJob": {"Name":"backup-gcp-cs-sa-sharded","Type":0}} 2026-03-10T06:58:38.826Z INFO Acquiring the backup lock {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "9f98954c-ea58-466c-94db-115293983773"} 2026-03-10T06:58:38.827Z DEBUG backupStatus Got backup meta {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "9f98954c-ea58-466c-94db-115293983773", "backup": "backup-gcp-cs-sa-sharded", "pbmName": "2026-03-10T06:57:20Z", "meta": {"type":"physical","opid":"69afc0d08dd96963da5158a9","name":"2026-03-10T06:57:20Z","shardRemap":{"cfg":"config"},"replsets":[],"compression":"gzip","store":{"type":"gcs","gcs":{"bucket":"operator-testing","prefix":"psmdb-demand-backup-physical-sharded","chunkSize":10485760,"retryer":{"backoffInitial":1000000000,"backoffMax":30000000000,"backoffMultiplier":2,"maxAttempts":5,"chunkRetryDeadline":32000000000}}},"size":0,"size_uncompressed":0,"mongodb_version":"8.0.19-7","fcv":"8.0","start_ts":1773125840,"last_transition_ts":1773125840,"first_write_ts":{"T":1,"I":1},"last_write_ts":{"T":1,"I":1},"hb":{"T":1773125845,"I":26},"status":"starting","conditions":[{"timestamp":1773125840,"status":"starting"}],"n":[{"rs":"cfg","n":["some-name-cfg-0.some-name-cfg.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""},{"rs":"rs0","n":["some-name-rs0-0.some-name-rs0.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""}],"pbm_version":"2.13.0","balancer":"full"}} 2026-03-10T06:58:38.828Z DEBUG Reconcile finished {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "9f98954c-ea58-466c-94db-115293983773"} 2026-03-10T06:58:43.829Z DEBUG Reconciling {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "405a070b-348e-4bcb-ab16-66c00caaa178"} 2026-03-10T06:58:43.868Z DEBUG Got object from API server {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "405a070b-348e-4bcb-ab16-66c00caaa178", "state": "requested"} 2026-03-10T06:58:43.947Z DEBUG checking if backup is allowed {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "405a070b-348e-4bcb-ab16-66c00caaa178", "cluster": "some-name", "namespace": "demand-backup-physical-sharded-gcp-native-17862"} 2026-03-10T06:58:43.947Z DEBUG Checking for active jobs {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "405a070b-348e-4bcb-ab16-66c00caaa178", "currentJob": {"Name":"backup-gcp-cs-sa-sharded","Type":0}} 2026-03-10T06:58:44.030Z INFO Acquiring the backup lock {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "405a070b-348e-4bcb-ab16-66c00caaa178"} 2026-03-10T06:58:44.032Z DEBUG backupStatus Got backup meta {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "405a070b-348e-4bcb-ab16-66c00caaa178", "backup": "backup-gcp-cs-sa-sharded", "pbmName": "2026-03-10T06:57:20Z", "meta": {"type":"physical","opid":"69afc0d08dd96963da5158a9","name":"2026-03-10T06:57:20Z","shardRemap":{"cfg":"config"},"replsets":[],"compression":"gzip","store":{"type":"gcs","gcs":{"bucket":"operator-testing","prefix":"psmdb-demand-backup-physical-sharded","chunkSize":10485760,"retryer":{"backoffInitial":1000000000,"backoffMax":30000000000,"backoffMultiplier":2,"maxAttempts":5,"chunkRetryDeadline":32000000000}}},"size":0,"size_uncompressed":0,"mongodb_version":"8.0.19-7","fcv":"8.0","start_ts":1773125840,"last_transition_ts":1773125840,"first_write_ts":{"T":1,"I":1},"last_write_ts":{"T":1,"I":1},"hb":{"T":1773125845,"I":26},"status":"starting","conditions":[{"timestamp":1773125840,"status":"starting"}],"n":[{"rs":"cfg","n":["some-name-cfg-0.some-name-cfg.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""},{"rs":"rs0","n":["some-name-rs0-0.some-name-rs0.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""}],"pbm_version":"2.13.0","balancer":"full"}} 2026-03-10T06:58:44.034Z DEBUG Reconcile finished {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "405a070b-348e-4bcb-ab16-66c00caaa178"} 2026-03-10T06:58:49.036Z DEBUG Reconciling {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "a94721a6-e331-452f-a255-7df8f6b9948b"} 2026-03-10T06:58:49.047Z DEBUG Got object from API server {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "a94721a6-e331-452f-a255-7df8f6b9948b", "state": "requested"} 2026-03-10T06:58:49.124Z DEBUG checking if backup is allowed {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "a94721a6-e331-452f-a255-7df8f6b9948b", "cluster": "some-name", "namespace": "demand-backup-physical-sharded-gcp-native-17862"} 2026-03-10T06:58:49.124Z DEBUG Checking for active jobs {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "a94721a6-e331-452f-a255-7df8f6b9948b", "currentJob": {"Name":"backup-gcp-cs-sa-sharded","Type":0}} 2026-03-10T06:58:49.221Z INFO Acquiring the backup lock {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "a94721a6-e331-452f-a255-7df8f6b9948b"} 2026-03-10T06:58:49.222Z DEBUG backupStatus Got backup meta {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "a94721a6-e331-452f-a255-7df8f6b9948b", "backup": "backup-gcp-cs-sa-sharded", "pbmName": "2026-03-10T06:57:20Z", "meta": {"type":"physical","opid":"69afc0d08dd96963da5158a9","name":"2026-03-10T06:57:20Z","shardRemap":{"cfg":"config"},"replsets":[],"compression":"gzip","store":{"type":"gcs","gcs":{"bucket":"operator-testing","prefix":"psmdb-demand-backup-physical-sharded","chunkSize":10485760,"retryer":{"backoffInitial":1000000000,"backoffMax":30000000000,"backoffMultiplier":2,"maxAttempts":5,"chunkRetryDeadline":32000000000}}},"size":0,"size_uncompressed":0,"mongodb_version":"8.0.19-7","fcv":"8.0","start_ts":1773125840,"last_transition_ts":1773125840,"first_write_ts":{"T":1,"I":1},"last_write_ts":{"T":1,"I":1},"hb":{"T":1773125845,"I":26},"status":"starting","conditions":[{"timestamp":1773125840,"status":"starting"}],"n":[{"rs":"cfg","n":["some-name-cfg-0.some-name-cfg.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""},{"rs":"rs0","n":["some-name-rs0-0.some-name-rs0.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""}],"pbm_version":"2.13.0","balancer":"full"}} 2026-03-10T06:58:49.260Z DEBUG Reconcile finished {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "a94721a6-e331-452f-a255-7df8f6b9948b"} 2026-03-10T06:58:54.261Z DEBUG Reconciling {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "3f295316-c545-4593-aaf3-42835e2aacfc"} 2026-03-10T06:58:54.274Z DEBUG Got object from API server {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "3f295316-c545-4593-aaf3-42835e2aacfc", "state": "requested"} 2026-03-10T06:58:54.354Z DEBUG checking if backup is allowed {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "3f295316-c545-4593-aaf3-42835e2aacfc", "cluster": "some-name", "namespace": "demand-backup-physical-sharded-gcp-native-17862"} 2026-03-10T06:58:54.354Z DEBUG Checking for active jobs {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "3f295316-c545-4593-aaf3-42835e2aacfc", "currentJob": {"Name":"backup-gcp-cs-sa-sharded","Type":0}} 2026-03-10T06:58:54.426Z INFO Acquiring the backup lock {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "3f295316-c545-4593-aaf3-42835e2aacfc"} 2026-03-10T06:58:54.427Z DEBUG backupStatus Got backup meta {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "3f295316-c545-4593-aaf3-42835e2aacfc", "backup": "backup-gcp-cs-sa-sharded", "pbmName": "2026-03-10T06:57:20Z", "meta": {"type":"physical","opid":"69afc0d08dd96963da5158a9","name":"2026-03-10T06:57:20Z","shardRemap":{"cfg":"config"},"replsets":[],"compression":"gzip","store":{"type":"gcs","gcs":{"bucket":"operator-testing","prefix":"psmdb-demand-backup-physical-sharded","chunkSize":10485760,"retryer":{"backoffInitial":1000000000,"backoffMax":30000000000,"backoffMultiplier":2,"maxAttempts":5,"chunkRetryDeadline":32000000000}}},"size":0,"size_uncompressed":0,"mongodb_version":"8.0.19-7","fcv":"8.0","start_ts":1773125840,"last_transition_ts":1773125840,"first_write_ts":{"T":1,"I":1},"last_write_ts":{"T":1,"I":1},"hb":{"T":1773125845,"I":26},"status":"starting","conditions":[{"timestamp":1773125840,"status":"starting"}],"n":[{"rs":"cfg","n":["some-name-cfg-0.some-name-cfg.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""},{"rs":"rs0","n":["some-name-rs0-0.some-name-rs0.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""}],"pbm_version":"2.13.0","balancer":"full"}} 2026-03-10T06:58:54.429Z DEBUG Reconcile finished {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "3f295316-c545-4593-aaf3-42835e2aacfc"} 2026-03-10T06:58:59.429Z DEBUG Reconciling {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "ddb8f78a-776c-43c7-a98f-e52a583419f7"} 2026-03-10T06:58:59.441Z DEBUG Got object from API server {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "ddb8f78a-776c-43c7-a98f-e52a583419f7", "state": "requested"} 2026-03-10T06:58:59.530Z DEBUG checking if backup is allowed {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "ddb8f78a-776c-43c7-a98f-e52a583419f7", "cluster": "some-name", "namespace": "demand-backup-physical-sharded-gcp-native-17862"} 2026-03-10T06:58:59.530Z DEBUG Checking for active jobs {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "ddb8f78a-776c-43c7-a98f-e52a583419f7", "currentJob": {"Name":"backup-gcp-cs-sa-sharded","Type":0}} 2026-03-10T06:58:59.603Z INFO Acquiring the backup lock {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "ddb8f78a-776c-43c7-a98f-e52a583419f7"} 2026-03-10T06:58:59.604Z DEBUG backupStatus Got backup meta {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "ddb8f78a-776c-43c7-a98f-e52a583419f7", "backup": "backup-gcp-cs-sa-sharded", "pbmName": "2026-03-10T06:57:20Z", "meta": {"type":"physical","opid":"69afc0d08dd96963da5158a9","name":"2026-03-10T06:57:20Z","shardRemap":{"cfg":"config"},"replsets":[],"compression":"gzip","store":{"type":"gcs","gcs":{"bucket":"operator-testing","prefix":"psmdb-demand-backup-physical-sharded","chunkSize":10485760,"retryer":{"backoffInitial":1000000000,"backoffMax":30000000000,"backoffMultiplier":2,"maxAttempts":5,"chunkRetryDeadline":32000000000}}},"size":0,"size_uncompressed":0,"mongodb_version":"8.0.19-7","fcv":"8.0","start_ts":1773125840,"last_transition_ts":1773125840,"first_write_ts":{"T":1,"I":1},"last_write_ts":{"T":1,"I":1},"hb":{"T":1773125845,"I":26},"status":"starting","conditions":[{"timestamp":1773125840,"status":"starting"}],"n":[{"rs":"cfg","n":["some-name-cfg-0.some-name-cfg.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""},{"rs":"rs0","n":["some-name-rs0-0.some-name-rs0.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""}],"pbm_version":"2.13.0","balancer":"full"}} 2026-03-10T06:58:59.605Z DEBUG Reconcile finished {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "ddb8f78a-776c-43c7-a98f-e52a583419f7"} 2026-03-10T06:59:04.605Z DEBUG Reconciling {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "8e70ef91-a9ca-4782-aa11-149002c4a666"} 2026-03-10T06:59:04.616Z DEBUG Got object from API server {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "8e70ef91-a9ca-4782-aa11-149002c4a666", "state": "requested"} 2026-03-10T06:59:04.692Z DEBUG checking if backup is allowed {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "8e70ef91-a9ca-4782-aa11-149002c4a666", "cluster": "some-name", "namespace": "demand-backup-physical-sharded-gcp-native-17862"} 2026-03-10T06:59:04.693Z DEBUG Checking for active jobs {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "8e70ef91-a9ca-4782-aa11-149002c4a666", "currentJob": {"Name":"backup-gcp-cs-sa-sharded","Type":0}} 2026-03-10T06:59:04.766Z INFO Acquiring the backup lock {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "8e70ef91-a9ca-4782-aa11-149002c4a666"} 2026-03-10T06:59:04.767Z DEBUG backupStatus Got backup meta {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "8e70ef91-a9ca-4782-aa11-149002c4a666", "backup": "backup-gcp-cs-sa-sharded", "pbmName": "2026-03-10T06:57:20Z", "meta": {"type":"physical","opid":"69afc0d08dd96963da5158a9","name":"2026-03-10T06:57:20Z","shardRemap":{"cfg":"config"},"replsets":[],"compression":"gzip","store":{"type":"gcs","gcs":{"bucket":"operator-testing","prefix":"psmdb-demand-backup-physical-sharded","chunkSize":10485760,"retryer":{"backoffInitial":1000000000,"backoffMax":30000000000,"backoffMultiplier":2,"maxAttempts":5,"chunkRetryDeadline":32000000000}}},"size":0,"size_uncompressed":0,"mongodb_version":"8.0.19-7","fcv":"8.0","start_ts":1773125840,"last_transition_ts":1773125840,"first_write_ts":{"T":1,"I":1},"last_write_ts":{"T":1,"I":1},"hb":{"T":1773125845,"I":26},"status":"starting","conditions":[{"timestamp":1773125840,"status":"starting"}],"n":[{"rs":"cfg","n":["some-name-cfg-0.some-name-cfg.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""},{"rs":"rs0","n":["some-name-rs0-0.some-name-rs0.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""}],"pbm_version":"2.13.0","balancer":"full"}} 2026-03-10T06:59:04.768Z DEBUG Reconcile finished {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "8e70ef91-a9ca-4782-aa11-149002c4a666"} 2026-03-10T06:59:09.769Z DEBUG Reconciling {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "b2dba524-d294-424f-a6bf-790a26b908b9"} 2026-03-10T06:59:09.777Z DEBUG Got object from API server {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "b2dba524-d294-424f-a6bf-790a26b908b9", "state": "requested"} 2026-03-10T06:59:09.859Z DEBUG checking if backup is allowed {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "b2dba524-d294-424f-a6bf-790a26b908b9", "cluster": "some-name", "namespace": "demand-backup-physical-sharded-gcp-native-17862"} 2026-03-10T06:59:09.859Z DEBUG Checking for active jobs {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "b2dba524-d294-424f-a6bf-790a26b908b9", "currentJob": {"Name":"backup-gcp-cs-sa-sharded","Type":0}} 2026-03-10T06:59:09.935Z INFO Acquiring the backup lock {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "b2dba524-d294-424f-a6bf-790a26b908b9"} 2026-03-10T06:59:09.936Z DEBUG backupStatus Got backup meta {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "b2dba524-d294-424f-a6bf-790a26b908b9", "backup": "backup-gcp-cs-sa-sharded", "pbmName": "2026-03-10T06:57:20Z", "meta": {"type":"physical","opid":"69afc0d08dd96963da5158a9","name":"2026-03-10T06:57:20Z","shardRemap":{"cfg":"config"},"replsets":[],"compression":"gzip","store":{"type":"gcs","gcs":{"bucket":"operator-testing","prefix":"psmdb-demand-backup-physical-sharded","chunkSize":10485760,"retryer":{"backoffInitial":1000000000,"backoffMax":30000000000,"backoffMultiplier":2,"maxAttempts":5,"chunkRetryDeadline":32000000000}}},"size":0,"size_uncompressed":0,"mongodb_version":"8.0.19-7","fcv":"8.0","start_ts":1773125840,"last_transition_ts":1773125840,"first_write_ts":{"T":1,"I":1},"last_write_ts":{"T":1,"I":1},"hb":{"T":1773125845,"I":26},"status":"starting","conditions":[{"timestamp":1773125840,"status":"starting"}],"n":[{"rs":"cfg","n":["some-name-cfg-0.some-name-cfg.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""},{"rs":"rs0","n":["some-name-rs0-0.some-name-rs0.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""}],"pbm_version":"2.13.0","balancer":"full"}} 2026-03-10T06:59:09.937Z DEBUG Reconcile finished {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "b2dba524-d294-424f-a6bf-790a26b908b9"} 2026-03-10T06:59:14.938Z DEBUG Reconciling {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "d0e4e2b3-530f-4ece-b3dd-067c43f6ae52"} 2026-03-10T06:59:14.948Z DEBUG Got object from API server {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "d0e4e2b3-530f-4ece-b3dd-067c43f6ae52", "state": "requested"} 2026-03-10T06:59:15.023Z DEBUG checking if backup is allowed {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "d0e4e2b3-530f-4ece-b3dd-067c43f6ae52", "cluster": "some-name", "namespace": "demand-backup-physical-sharded-gcp-native-17862"} 2026-03-10T06:59:15.023Z DEBUG Checking for active jobs {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "d0e4e2b3-530f-4ece-b3dd-067c43f6ae52", "currentJob": {"Name":"backup-gcp-cs-sa-sharded","Type":0}} 2026-03-10T06:59:15.089Z INFO Acquiring the backup lock {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "d0e4e2b3-530f-4ece-b3dd-067c43f6ae52"} 2026-03-10T06:59:15.090Z DEBUG backupStatus Got backup meta {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "d0e4e2b3-530f-4ece-b3dd-067c43f6ae52", "backup": "backup-gcp-cs-sa-sharded", "pbmName": "2026-03-10T06:57:20Z", "meta": {"type":"physical","opid":"69afc0d08dd96963da5158a9","name":"2026-03-10T06:57:20Z","shardRemap":{"cfg":"config"},"replsets":[],"compression":"gzip","store":{"type":"gcs","gcs":{"bucket":"operator-testing","prefix":"psmdb-demand-backup-physical-sharded","chunkSize":10485760,"retryer":{"backoffInitial":1000000000,"backoffMax":30000000000,"backoffMultiplier":2,"maxAttempts":5,"chunkRetryDeadline":32000000000}}},"size":0,"size_uncompressed":0,"mongodb_version":"8.0.19-7","fcv":"8.0","start_ts":1773125840,"last_transition_ts":1773125840,"first_write_ts":{"T":1,"I":1},"last_write_ts":{"T":1,"I":1},"hb":{"T":1773125845,"I":26},"status":"starting","conditions":[{"timestamp":1773125840,"status":"starting"}],"n":[{"rs":"cfg","n":["some-name-cfg-0.some-name-cfg.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""},{"rs":"rs0","n":["some-name-rs0-0.some-name-rs0.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""}],"pbm_version":"2.13.0","balancer":"full"}} 2026-03-10T06:59:15.092Z DEBUG Reconcile finished {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "d0e4e2b3-530f-4ece-b3dd-067c43f6ae52"} 2026-03-10T06:59:20.092Z DEBUG Reconciling {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "d5faa566-3229-4498-a8d5-752ef8d1d191"} 2026-03-10T06:59:20.102Z DEBUG Got object from API server {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "d5faa566-3229-4498-a8d5-752ef8d1d191", "state": "requested"} 2026-03-10T06:59:20.176Z DEBUG checking if backup is allowed {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "d5faa566-3229-4498-a8d5-752ef8d1d191", "cluster": "some-name", "namespace": "demand-backup-physical-sharded-gcp-native-17862"} 2026-03-10T06:59:20.176Z DEBUG Checking for active jobs {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "d5faa566-3229-4498-a8d5-752ef8d1d191", "currentJob": {"Name":"backup-gcp-cs-sa-sharded","Type":0}} 2026-03-10T06:59:20.251Z INFO Acquiring the backup lock {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "d5faa566-3229-4498-a8d5-752ef8d1d191"} 2026-03-10T06:59:20.252Z DEBUG backupStatus Got backup meta {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "d5faa566-3229-4498-a8d5-752ef8d1d191", "backup": "backup-gcp-cs-sa-sharded", "pbmName": "2026-03-10T06:57:20Z", "meta": {"type":"physical","opid":"69afc0d08dd96963da5158a9","name":"2026-03-10T06:57:20Z","shardRemap":{"cfg":"config"},"replsets":[],"compression":"gzip","store":{"type":"gcs","gcs":{"bucket":"operator-testing","prefix":"psmdb-demand-backup-physical-sharded","chunkSize":10485760,"retryer":{"backoffInitial":1000000000,"backoffMax":30000000000,"backoffMultiplier":2,"maxAttempts":5,"chunkRetryDeadline":32000000000}}},"size":0,"size_uncompressed":0,"mongodb_version":"8.0.19-7","fcv":"8.0","start_ts":1773125840,"last_transition_ts":1773125840,"first_write_ts":{"T":1,"I":1},"last_write_ts":{"T":1,"I":1},"hb":{"T":1773125845,"I":26},"status":"starting","conditions":[{"timestamp":1773125840,"status":"starting"}],"n":[{"rs":"cfg","n":["some-name-cfg-0.some-name-cfg.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""},{"rs":"rs0","n":["some-name-rs0-0.some-name-rs0.demand-backup-physical-sharded-gcp-native-17862.svc.cluster.local:27017"],"ack":""}],"pbm_version":"2.13.0","balancer":"full"}} 2026-03-10T06:59:20.254Z INFO Backup state changed {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "d5faa566-3229-4498-a8d5-752ef8d1d191", "previous": "requested", "current": "error"} 2026-03-10T06:59:20.278Z INFO Releasing backup lock {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "d5faa566-3229-4498-a8d5-752ef8d1d191", "lease": "psmdb-some-name-backup-lock"} 2026-03-10T06:59:20.304Z DEBUG Reconcile finished {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "d5faa566-3229-4498-a8d5-752ef8d1d191"} 2026-03-10T06:59:20.304Z DEBUG Reconciling {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "70b832aa-5c14-48fc-92b1-7cf2a07b90c1"} 2026-03-10T06:59:20.313Z DEBUG Got object from API server {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "70b832aa-5c14-48fc-92b1-7cf2a07b90c1", "state": "error"} 2026-03-10T06:59:20.314Z DEBUG Reconcile finished {"controller": "psmdbbackup-controller", "controllerGroup": "psmdb.percona.com", "controllerKind": "PerconaServerMongoDBBackup", "PerconaServerMongoDBBackup": {"name":"backup-gcp-cs-sa-sharded","namespace":"demand-backup-physical-sharded-gcp-native-17862"}, "namespace": "demand-backup-physical-sharded-gcp-native-17862", "name": "backup-gcp-cs-sa-sharded", "reconcileID": "70b832aa-5c14-48fc-92b1-7cf2a07b90c1"} NAME CLUSTER STORAGE DESTINATION TYPE SIZE STATUS COMPLETED AGE backup-gcp-cs-sa-sharded some-name gcp-cs-sa gs://operator-testing/psmdb-demand-backup-physical-sharded/2026-03-10T06:57:20Z physical error 2m5s Name: backup-gcp-cs-sa-sharded Namespace: demand-backup-physical-sharded-gcp-native-17862 Labels: Annotations: API Version: psmdb.percona.com/v1 Kind: PerconaServerMongoDBBackup Metadata: Creation Timestamp: 2026-03-10T06:57:18Z Finalizers: percona.com/delete-backup internal.percona.com/release-lock Generation: 1 Resource Version: 1773125960268607014 UID: 0629a0c2-8dae-430c-aebb-ca12ec74a542 Spec: Cluster Name: some-name Starting Deadline Seconds: 120 Storage Name: gcp-cs-sa Type: physical Status: Destination: gs://operator-testing/psmdb-demand-backup-physical-sharded/2026-03-10T06:57:20Z Error: backup did not progress from 'starting' state within the allowed timeout Gcs: Bucket: operator-testing Credentials Secret: gcp-cs-sa-key-secret Prefix: psmdb-demand-backup-physical-sharded Last Transition: 2026-03-10T06:57:20Z Pbm Name: 2026-03-10T06:57:20Z Replset Names: cfg rs0 Start: 2026-03-10T06:57:20Z State: error Storage Name: gcp-cs-sa Type: physical Events: Backup object psmdb-backup/backup-gcp-cs-sa-sharded is in error state.