Log: /mnt/jenkins/workspace/cloud-psmdb-operator_PR-2275/e2e-tests/logs/demand-backup-incremental-aws.log Warning: version difference between client (1.35) and server (1.32) exceeds the supported minor version skew of +/-1 Warning: version difference between client (1.35) and server (1.32) exceeds the supported minor version skew of +/-1 Warning: version difference between client (1.35) and server (1.32) exceeds the supported minor version skew of +/-1 ----------------------------------------------------------------------------------- get and delete old CRDs and RBAC ----------------------------------------------------------------------------------- grep: warning: stray \ before - grep: warning: stray \ before - error: the server doesn't have a resource type "perconaservermongodbbackups" + kubectl patch perconaservermongodbbackups.psmdb.percona.com -n sh --type=merge -p '{"metadata":{"finalizers":[]}}' error: the server doesn't have a resource type "perconaservermongodbbackups" error: the server doesn't have a resource type "perconaservermongodbrestores" + kubectl patch perconaservermongodbrestores.psmdb.percona.com -n sh --type=merge -p '{"metadata":{"finalizers":[]}}' error: the server doesn't have a resource type "perconaservermongodbrestores" error: the server doesn't have a resource type "perconaservermongodbs" + kubectl patch perconaservermongodbs.psmdb.percona.com -n sh --type=merge -p '{"metadata":{"finalizers":[]}}' error: the server doesn't have a resource type "perconaservermongodbs" Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "null" not found Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "null" not found Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "null" not found Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "null" not found ----------------------------------------------------------------------------------- destroy chaos-mesh ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces psmdb-operator ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- create namespace psmdb-operator ----------------------------------------------------------------------------------- namespace/psmdb-operator created Context "gke_cloud-dev-112233_us-central1-a_jen-psmdb-2275-09b2b9dda-2-cluster14" modified. ----------------------------------------------------------------------------------- start PSMDB operator: docker.io/perconalab/percona-server-mongodb-operator:PR-2275-09b2b9dda ----------------------------------------------------------------------------------- customresourcedefinition.apiextensions.k8s.io/perconaservermongodbbackups.psmdb.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaservermongodbrestores.psmdb.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaservermongodbs.psmdb.percona.com serverside-applied clusterrole.rbac.authorization.k8s.io/percona-server-mongodb-operator created serviceaccount/percona-server-mongodb-operator created clusterrolebinding.rbac.authorization.k8s.io/service-account-percona-server-mongodb-operator created deployment.apps/percona-server-mongodb-operator created waiting for pod/percona-server-mongodb-operator-588c99f779-xqnnk to be ready.OK Print operator info from log 2026-03-10T09:03:06.969Z INFO setup Manager starting up {"gitCommit": "09b2b9ddacec6e8bceff5ada2f351faf3bab2304", "gitBranch": "PR-2275-09b2b9dda", "buildTime": "", "goVersion": "go1.25.8", "os": "linux", "arch": "amd64"} ----------------------------------------------------------------------------------- destroy chaos-mesh ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces demand-backup-incremental-aws-1871 ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- create namespace demand-backup-incremental-aws-1871 ----------------------------------------------------------------------------------- namespace/demand-backup-incremental-aws-1871 created Context "gke_cloud-dev-112233_us-central1-a_jen-psmdb-2275-09b2b9dda-2-cluster14" modified. ----------------------------------------------------------------------------------- create secrets for cloud storages ----------------------------------------------------------------------------------- secret/minio-secret created secret/aws-s3-secret created secret/gcp-cs-secret created secret/azure-secret created secret/gcp-cs-sa-key-secret created ----------------------------------------------------------------------------------- Testing on not sharded cluster ----------------------------------------------------------------------------------- [2026-03-10T09:03:32+0000] Creating PSMDB cluster secret/some-users created perconaservermongodb.psmdb.percona.com/some-name created deployment.apps/psmdb-client created [2026-03-10T09:03:38+0000] check if all pods started waiting for pod/some-name-rs0-0 to be ready......................OK waiting for pod/some-name-rs0-1 to be ready...................OK waiting for pod/some-name-rs0-2 to be ready...............OK Waiting for cluster readyness........... waiting for cluster readyness.OK [2026-03-10T09:06:23+0000] writing test data Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://some-name-rs0-1.some-name-rs0.demand-backup-incremental-aws-1871.svc.cluster.local:27017,some-name-rs0-2.some-name-rs0.demand-backup-incremental-aws-1871.svc.cluster.local:27017,some-name-rs0-0.some-name-rs0.demand-backup-incremental-aws-1871.svc.cluster.local:27017/admin?compressors=disabled&gssapiServiceName=mongodb&replicaSet=rs0&ssl=false Implicit session: session { "id" : UUID("30e957ab-0193-4a1a-ad63-102b9ac7866e") } Percona Server for MongoDB server version: v8.0.19-7 WARNING: shell and server versions do not match Successfully added user: { "user" : "myApp", "roles" : [ { "db" : "myApp", "role" : "readWrite" } ] } bye Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://some-name-rs0-1.some-name-rs0.demand-backup-incremental-aws-1871.svc.cluster.local:27017,some-name-rs0-2.some-name-rs0.demand-backup-incremental-aws-1871.svc.cluster.local:27017,some-name-rs0-0.some-name-rs0.demand-backup-incremental-aws-1871.svc.cluster.local:27017/admin?compressors=disabled&gssapiServiceName=mongodb&replicaSet=rs0&ssl=false Implicit session: session { "id" : UUID("1561277b-856c-4087-b739-a026f77bba21") } Percona Server for MongoDB server version: v8.0.19-7 WARNING: shell and server versions do not match switched to db myApp WriteResult({ "nInserted" : 1 }) bye [2026-03-10T09:06:34+0000] running db.test.find() in myApp [2026-03-10T09:06:37+0000] running db.test.find() in myApp [2026-03-10T09:06:40+0000] running db.test.find() in myApp [2026-03-10T09:06:42+0000] running backup [2026-03-10T09:06:42+0000] running backup backup-aws-s3 perconaservermongodbbackup.psmdb.percona.com/backup-aws-s3 created waiting for backup-aws-s3 to reach ready state.................OK AWS credentials already set in environment Backup operator-testing/psmdb-demand-backup-incremental-aws/2026-03-10T09:06:44Z//rs0/filelist.pbm found in aws-s3 [2026-03-10T09:07:17+0000] drop collection Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://some-name-rs0-1.some-name-rs0.demand-backup-incremental-aws-1871.svc.cluster.local:27017,some-name-rs0-2.some-name-rs0.demand-backup-incremental-aws-1871.svc.cluster.local:27017,some-name-rs0-0.some-name-rs0.demand-backup-incremental-aws-1871.svc.cluster.local:27017/admin?compressors=disabled&gssapiServiceName=mongodb&replicaSet=rs0&ssl=false Implicit session: session { "id" : UUID("ceafeb67-b4a0-47c7-90d7-5f72244a48b9") } Percona Server for MongoDB server version: v8.0.19-7 WARNING: shell and server versions do not match switched to db myApp true bye [2026-03-10T09:07:20+0000] check backup and restore -- [2026-03-10T09:07:20+0000] running restore [2026-03-10T09:07:20+0000] running restore restore-backup-aws-s3 perconaservermongodbrestore.psmdb.percona.com/restore-backup-aws-s3 created Waiting for the psmdb-restore/restore-backup-aws-s3 object to be created.OK Waiting psmdb-restore/restore-backup-aws-s3 to reach state "requested" ..OK after 1 minutes [2026-03-10T09:09:13+0000] compare_kubectl: statefulset/some-name-rs0 OK Waiting for the psmdb-restore/restore-backup-aws-s3 object to be created.OK Waiting psmdb-restore/restore-backup-aws-s3 to reach state "ready" .Unable to connect to the server: dial tcp 104.197.166.173:443: i/o timeout Unable to connect to the server: dial tcp 104.197.166.173:443: i/o timeout Unable to connect to the server: dial tcp 104.197.166.173:443: i/o timeout Unable to connect to the server: dial tcp 104.197.166.173:443: i/o timeout