Log: /mnt/jenkins/workspace/cloud-psmdb-operator_PR-2094/e2e-tests/logs/init-deploy.log grep: warning: stray \ before - Warning: version difference between client (1.34) and server (1.31) exceeds the supported minor version skew of +/-1 Warning: version difference between client (1.34) and server (1.31) exceeds the supported minor version skew of +/-1 Warning: version difference between client (1.34) and server (1.31) exceeds the supported minor version skew of +/-1 ----------------------------------------------------------------------------------- get and delete old CRDs and RBAC ----------------------------------------------------------------------------------- grep: warning: stray \ before - grep: warning: stray \ before - error: the server doesn't have a resource type "perconaservermongodbbackups" + kubectl patch perconaservermongodbbackups.psmdb.percona.com -n sh --type=merge -p '{"metadata":{"finalizers":[]}}' error: the server doesn't have a resource type "perconaservermongodbbackups" error: the server doesn't have a resource type "perconaservermongodbrestores" + kubectl patch perconaservermongodbrestores.psmdb.percona.com -n sh --type=merge -p '{"metadata":{"finalizers":[]}}' error: the server doesn't have a resource type "perconaservermongodbrestores" error: the server doesn't have a resource type "perconaservermongodbs" + kubectl patch perconaservermongodbs.psmdb.percona.com -n sh --type=merge -p '{"metadata":{"finalizers":[]}}' error: the server doesn't have a resource type "perconaservermongodbs" Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "null" not found Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "null" not found Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "null" not found Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "null" not found ----------------------------------------------------------------------------------- destroy chaos-mesh ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces psmdb-operator ----------------------------------------------------------------------------------- egrep: warning: egrep is obsolescent; using grep -E error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- create namespace psmdb-operator ----------------------------------------------------------------------------------- namespace/psmdb-operator created Context "gke_cloud-dev-112233_us-central1-a_jen-psmdb-2094-d1213e33-2-cluster9" modified. ----------------------------------------------------------------------------------- start PSMDB operator: perconalab/percona-server-mongodb-operator:PR-2094-d1213e33 ----------------------------------------------------------------------------------- customresourcedefinition.apiextensions.k8s.io/perconaservermongodbbackups.psmdb.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaservermongodbrestores.psmdb.percona.com serverside-applied customresourcedefinition.apiextensions.k8s.io/perconaservermongodbs.psmdb.percona.com serverside-applied clusterrole.rbac.authorization.k8s.io/percona-server-mongodb-operator created serviceaccount/percona-server-mongodb-operator created clusterrolebinding.rbac.authorization.k8s.io/service-account-percona-server-mongodb-operator created deployment.apps/percona-server-mongodb-operator created waiting for pod/percona-server-mongodb-operator-6b4f59fb84-47fnw to be ready.OK Print operator info from log 2025-10-17T19:59:06.238Z INFO setup Manager starting up {"gitCommit": "d1213e330eb33e2bd719f7d0e5ab9ed64bab87a4", "gitBranch": "PR-2094-d1213e33", "buildTime": "", "goVersion": "go1.25.3", "os": "linux", "arch": "amd64"} ----------------------------------------------------------------------------------- destroy chaos-mesh ----------------------------------------------------------------------------------- error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- cleaned up all old namespaces ----------------------------------------------------------------------------------- ----------------------------------------------------------------------------------- cleaned up old namespaces init-deploy-17082 ----------------------------------------------------------------------------------- egrep: warning: egrep is obsolescent; using grep -E error: resource(s) were provided, but no name was specified ----------------------------------------------------------------------------------- create namespace init-deploy-17082 ----------------------------------------------------------------------------------- namespace/init-deploy-17082 created Context "gke_cloud-dev-112233_us-central1-a_jen-psmdb-2094-d1213e33-2-cluster9" modified. ----------------------------------------------------------------------------------- create secrets and start client ----------------------------------------------------------------------------------- secret/some-users created secret/some-name-ssl created secret/some-name-ssl-internal created deployment.apps/psmdb-client created ----------------------------------------------------------------------------------- create custom RuntimeClass ----------------------------------------------------------------------------------- runtimeclass.node.k8s.io/container-rc created ----------------------------------------------------------------------------------- create first PSMDB cluster some-name-rs0 ----------------------------------------------------------------------------------- perconaservermongodb.psmdb.percona.com/some-name created ----------------------------------------------------------------------------------- check if all 3 Pods started ----------------------------------------------------------------------------------- waiting for pod/some-name-rs0-0 to be ready.............OK waiting for pod/some-name-rs0-1 to be ready............OK waiting for pod/some-name-rs0-2 to be ready............OK Waiting for cluster readyness ----------------------------------------------------------------------------------- check if service and statefulset created with expected config ----------------------------------------------------------------------------------- [2025-10-17T20:01:28+0000] compare_kubectl: statefulset/some-name-rs0 OK [2025-10-17T20:01:29+0000] compare_kubectl: service/some-name-rs0 OK ----------------------------------------------------------------------------------- check if users created ----------------------------------------------------------------------------------- egrep: warning: egrep is obsolescent; using grep -E egrep: warning: egrep is obsolescent; using grep -E egrep: warning: egrep is obsolescent; using grep -E egrep: warning: egrep is obsolescent; using grep -E Error: can't connect to new replica set master [some-name-rs0-0.some-name-rs0.init-deploy-17082.svc.cluster.local:27017], err: AuthenticationFailed: Authentication failed. : Error: can't connect to new replica set master [some-name-rs0-0.some-name-rs0.init-deploy-17082.svc.cluster.local:27017], err: AuthenticationFailed: Authentication failed. : Error: can't connect to new replica set master [some-name-rs0-0.some-name-rs0.init-deploy-17082.svc.cluster.local:27017], err: AuthenticationFailed: Authentication failed. : Error: can't connect to new replica set master [some-name-rs0-0.some-name-rs0.init-deploy-17082.svc.cluster.local:27017], err: AuthenticationFailed: Authentication failed. : ----------------------------------------------------------------------------------- create user ----------------------------------------------------------------------------------- Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://some-name-rs0-2.some-name-rs0.init-deploy-17082.svc.cluster.local:27017,some-name-rs0-1.some-name-rs0.init-deploy-17082.svc.cluster.local:27017,some-name-rs0-0.some-name-rs0.init-deploy-17082.svc.cluster.local:27017/admin?compressors=disabled&gssapiServiceName=mongodb&replicaSet=rs0&ssl=false Implicit session: session { "id" : UUID("fdc68f7b-14b4-4ad3-b40a-aa1b0e410489") } Percona Server for MongoDB server version: v7.0.24-13 WARNING: shell and server versions do not match Successfully added user: { "user" : "myApp", "roles" : [ { "db" : "myApp", "role" : "readWrite" } ] } bye ----------------------------------------------------------------------------------- write data, read from all ----------------------------------------------------------------------------------- Percona Server for MongoDB shell version v4.4.29-28 connecting to: mongodb://some-name-rs0-2.some-name-rs0.init-deploy-17082.svc.cluster.local:27017,some-name-rs0-1.some-name-rs0.init-deploy-17082.svc.cluster.local:27017,some-name-rs0-0.some-name-rs0.init-deploy-17082.svc.cluster.local:27017/admin?compressors=disabled&gssapiServiceName=mongodb&replicaSet=rs0&ssl=false Implicit session: session { "id" : UUID("506c064f-0f83-4a11-a50b-d253bfc719a1") } Percona Server for MongoDB server version: v7.0.24-13 WARNING: shell and server versions do not match switched to db myApp WriteResult({ "nInserted" : 1 }) bye [2025-10-17T20:02:13+0000] running db.test.find() in myApp egrep: warning: egrep is obsolescent; using grep -E [2025-10-17T20:02:16+0000] running db.test.find() in myApp egrep: warning: egrep is obsolescent; using grep -E command terminated with exit code 1 command terminated with exit code 1 error: Internal error occurred: error sending request: Post "https://10.216.0.24:10250/exec/init-deploy-17082/psmdb-client-696897d69b-vrx5t/psmdb-client?command=bash&command=-c&command=printf+%27use+myApp%5Cn+db.test.find%28%29%5Cn%27+%7C+mongo+mongodb%3A%2F%2FmyApp%3AmyPass%40some-name-rs0-1.some-name-rs0.init-deploy-17082.svc.cluster.local%2Fadmin%3Fssl%3Dfalse%5C%26replicaSet%3Drs0+&error=1&output=1": dial timeout, backstop error: Internal error occurred: error sending request: Post "https://10.216.0.24:10250/exec/init-deploy-17082/psmdb-client-696897d69b-vrx5t/psmdb-client?command=bash&command=-c&command=printf+%27use+myApp%5Cn+db.test.find%28%29%5Cn%27+%7C+mongo+mongodb%3A%2F%2FmyApp%3AmyPass%40some-name-rs0-1.some-name-rs0.init-deploy-17082.svc.cluster.local%2Fadmin%3Fssl%3Dfalse%5C%26replicaSet%3Drs0+&error=1&output=1": dial timeout, backstop --- /mnt/jenkins/workspace/cloud-psmdb-operator_PR-2094/e2e-tests/init-deploy/compare/find.json 2025-10-17 18:53:38.476522589 +0000 +++ /tmp/tmp.VtI2JHbSMq/find 2025-10-17 20:03:34.062445532 +0000 @@ -1,3 +1,12 @@ -switched to db myApp -{ "_id" : , "x" : 100500 } -bye +{"t":{"$date":"2025-10-17T20:02:33.431Z"},"s":"I", "c":"NETWORK", "id":4333208, "ctx":"ReplicaSetMonitor-TaskExecutor","msg":"RSM host selection timeout","attr":{"replicaSet":"rs0","error":"FailedToSatisfyReadPreference: Could not find host matching read preference { mode: \"nearest\" } for set rs0"}} +Error: connect failed to replica set rs0/some-name-rs0-1.some-name-rs0.init-deploy-xxx.svc.cluster.local:27017 : +connect@src/mongo/shell/mongo.js:374:17 +@(connect):2:6 +exception: connect failed +exiting with code 1 +{"t":{"$date":"2025-10-17T20:02:50.259Z"},"s":"I", "c":"NETWORK", "id":4333208, "ctx":"ReplicaSetMonitor-TaskExecutor","msg":"RSM host selection timeout","attr":{"replicaSet":"rs0","error":"FailedToSatisfyReadPreference: Could not find host matching read preference { mode: \"nearest\" } for set rs0"}} +Error: connect failed to replica set rs0/some-name-rs0-1.some-name-rs0.init-deploy-xxx.svc.cluster.local:27017 : +connect@src/mongo/shell/mongo.js:374:17 +@(connect):2:6 +exception: connect failed +exiting with code 1