Log: /mnt/jenkins/workspace/cloud-psmdb-operator_PR-2482/e2e-tests/demand-backup-physical-oss-s3/../logs/demand-backup-physical-oss-s3.log ----------------------------------------------------------------------------------- get and delete old CRDs and RBAC ----------------------------------------------------------------------------------- grep: warning: stray \ before - grep: warning: stray \ before - error: the server doesn't have a resource type "perconaservermongodbbackups" + kubectl patch perconaservermongodbbackups.psmdb.percona.com -n sh --type=merge -p '{"metadata":{"finalizers":[]}}' error: the server doesn't have a resource type "perconaservermongodbbackups" error: the server doesn't have a resource type "perconaservermongodbclustersyncs" + kubectl patch perconaservermongodbclustersyncs.psmdb.percona.com -n sh --type=merge -p '{"metadata":{"finalizers":[]}}' error: the server doesn't have a resource type "perconaservermongodbclustersyncs" error: the server doesn't have a resource type "perconaservermongodbrestores" + kubectl patch perconaservermongodbrestores.psmdb.percona.com -n sh --type=merge -p '{"metadata":{"finalizers":[]}}' error: the server doesn't have a resource type "perconaservermongodbrestores" error: the server doesn't have a resource type "perconaservermongodbs" + kubectl patch perconaservermongodbs.psmdb.percona.com -n sh --type=merge -p '{"metadata":{"finalizers":[]}}' error: the server doesn't have a resource type "perconaservermongodbs" Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "null" not found Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "null" not found Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "null" not found Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "null" not found ----------------------------------------------------------------------------------- destroy chaos-mesh ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces psmdb-operator ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- create namespace psmdb-operator ----------------------------------------------------------------------------------- namespace/psmdb-operator created Context "gke_cloud-dev-112233_us-central1-a_jen-psmdb-2482-8b0df9c16-1-cluster10" modified. ----------------------------------------------------------------------------------- start PSMDB operator: docker.io/perconalab/percona-server-mongodb-operator:PR-2482-8b0df9c16 ----------------------------------------------------------------------------------- customresourcedefinition.apiextensions.k8s.io/perconaservermongodbbackups.psmdb.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaservermongodbclustersyncs.psmdb.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaservermongodbrestores.psmdb.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaservermongodbs.psmdb.percona.com serverside-applied clusterrole.rbac.authorization.k8s.io/percona-server-mongodb-operator created serviceaccount/percona-server-mongodb-operator created clusterrolebinding.rbac.authorization.k8s.io/service-account-percona-server-mongodb-operator created deployment.apps/percona-server-mongodb-operator created waiting for pod/percona-server-mongodb-operator-7bd84d97c9-w4686 to be ready.OK Print operator info from log 2026-07-22T14:48:47.635Z INFO setup Manager starting up {"gitCommit": "8b0df9c16ae5b53d685e586a02802fc4ac09d2ba", "gitBranch": "PR-2482-8b0df9c16", "buildTime": "", "goVersion": "go1.26.5", "os": "linux", "arch": "amd64"} ----------------------------------------------------------------------------------- destroy chaos-mesh ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces demand-backup-physical-oss-s3-9047 ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- create namespace demand-backup-physical-oss-s3-9047 ----------------------------------------------------------------------------------- namespace/demand-backup-physical-oss-s3-9047 created Context "gke_cloud-dev-112233_us-central1-a_jen-psmdb-2482-8b0df9c16-1-cluster10" modified. ----------------------------------------------------------------------------------- create secrets for cloud storages ----------------------------------------------------------------------------------- secret/minio-secret created secret/aws-s3-secret created secret/alibaba-cloud-secret created secret/oci-secret created secret/gcp-cs-secret created secret/azure-secret created secret/gcp-cs-sa-key-secret created ----------------------------------------------------------------------------------- Testing on not sharded cluster ----------------------------------------------------------------------------------- Creating PSMDB cluster secret/some-users created perconaservermongodb.psmdb.percona.com/some-name created deployment.apps/psmdb-client created Check if all pods started waiting for pod/some-name-rs0-0 to be ready..........OK waiting for pod/some-name-rs0-1 to be ready.......OK waiting for pod/some-name-rs0-2 to be ready......OK Waiting for cluster some-name to be ready............. waiting for cluster some-name to be ready.OK waiting for PBM operation to finish.OK Writing test data Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://some-name-rs0-0.some-name-rs0.demand-backup-physical-oss-s3-9047.svc.cluster.local:27017,some-name-rs0-1.some-name-rs0.demand-backup-physical-oss-s3-9047.svc.cluster.local:27017,some-name-rs0-2.some-name-rs0.demand-backup-physical-oss-s3-9047.svc.cluster.local:27017/admin?compressors=disabled&gssapiServiceName=mongodb&replicaSet=rs0&ssl=false Implicit session: session { "id" : UUID("d14f603a-62d7-48e3-a054-2334509cc3c7") } Percona Server for MongoDB server version: v8.0.26-11 WARNING: shell and server versions do not match Successfully added user: { "user" : "myApp", "roles" : [ { "db" : "myApp", "role" : "readWrite" } ] } bye Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://some-name-rs0-1.some-name-rs0.demand-backup-physical-oss-s3-9047.svc.cluster.local:27017,some-name-rs0-2.some-name-rs0.demand-backup-physical-oss-s3-9047.svc.cluster.local:27017,some-name-rs0-0.some-name-rs0.demand-backup-physical-oss-s3-9047.svc.cluster.local:27017/admin?compressors=disabled&gssapiServiceName=mongodb&replicaSet=rs0&ssl=false Implicit session: session { "id" : UUID("a2c9d6d6-82c5-4a59-ae14-bd9932725a82") } Percona Server for MongoDB server version: v8.0.26-11 WARNING: shell and server versions do not match switched to db myApp WriteResult({ "nInserted" : 1 }) bye [2026-07-22T14:52:47+0000] running db.test.find() in myApp [2026-07-22T14:52:49+0000] running db.test.find() in myApp [2026-07-22T14:52:51+0000] running db.test.find() in myApp Running OSS S3-compatible backup [2026-07-22T14:52:53+0000] running backup backup-oss-s3 perconaservermongodbbackup.psmdb.percona.com/backup-oss-s3 created waiting for backup-oss-s3 to reach ready state.........................................OK Setting up Alibaba Cloud S3-compatible credentials from secret: alibaba-cloud-secret Backup operator-testing/psmdb-demand-backup-physical-oss-s3/2026-07-22T14:52:56Z//rs0/filelist.pbm found in alibaba-cloud-s3 Drop collection Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://some-name-rs0-0.some-name-rs0.demand-backup-physical-oss-s3-9047.svc.cluster.local:27017,some-name-rs0-1.some-name-rs0.demand-backup-physical-oss-s3-9047.svc.cluster.local:27017,some-name-rs0-2.some-name-rs0.demand-backup-physical-oss-s3-9047.svc.cluster.local:27017/admin?compressors=disabled&gssapiServiceName=mongodb&replicaSet=rs0&ssl=false Implicit session: session { "id" : UUID("b9e1e9a2-bd11-4afd-9ff6-2038529c9546") } Percona Server for MongoDB server version: v8.0.26-11 WARNING: shell and server versions do not match switched to db myApp true bye check backup and restore -- oss-s3 [2026-07-22T14:54:24+0000] running restore restore-backup-oss-s3 perconaservermongodbrestore.psmdb.percona.com/restore-backup-oss-s3 created Waiting for the psmdb-restore/restore-backup-oss-s3 object to be created.OK Waiting psmdb-restore/restore-backup-oss-s3 to reach state "requested" ..OK after 1 minutes [2026-07-22T14:56:21+0000] compare_kubectl: statefulset/some-name-rs0 OK Waiting for the psmdb-restore/restore-backup-oss-s3 object to be created.OK Waiting psmdb-restore/restore-backup-oss-s3 to reach state "ready" ...OK after 2 minutes [2026-07-22T14:58:39+0000] Physical restore finished: OK waiting for cluster some-name to be ready...............................max retry count 32 reached. something went wrong with operator or kubernetes cluster