All Questions
Tagged with kubernetes google-kubernetes-engine
320
questions
0
votes
0
answers
35
views
Kubelet/Cadvisor on GKE not exporting container_fs_* metrics for attached volumes
In our GKE 1.27.12 cluster, we run a couple of stateful workloads using GCP Volumes, e.g. using this storage class:
apiVersion: storage.k8s.io/v1
kind: StorageClass
metadata:
name: pd-ssd
...
0
votes
0
answers
10
views
Efficiently Managing Dynamic Jupyter Kernels in GKE with Python Backend
I'm working on setting up an environment where I can dynamically create Jupyter notebook kernels as separate pods within a Google Kubernetes Engine (GKE) cluster. Each pod needs to have customizable ...
1
vote
0
answers
68
views
What are my groups in kubernetes (GKE) on GCP?
The answer is supposedly easy:
$ kubectl auth whoami
But it says that I belong only to system:authenticated. That's not pretty informative, and I believe I must belong to system:masters. Why? Because ...
0
votes
1
answer
348
views
Google Cloud Composer 2 Environment won't become healthy
I am trying to create a Google Cloud Composer 2 environment in my project, but it fails to become healthy.
I am creating it with the default settings and a service account that has the Cloud Composer ...
1
vote
1
answer
194
views
What should be the NodeClassRef for Karpenter's NodePool in GKE?
I have created a GKE cluster in GCP and wanted to install Karpenter on it for the autoscaling. While trying to install Karpenter, pods gives the error asking to create the NodeClaim resource which ...
0
votes
1
answer
351
views
Ansible "Failed to create temporary directory" (GCP)
I've encountered an issue with my Ansible playbook that provisions both a Kubernetes cluster and other servers within our cloud infrastructure. Specifically, the problem arises when I configure the &...
0
votes
0
answers
88
views
Tried to set up a K8 cluster from scratch on Ubuntu 22 but the kubelet is failing to register nodes
The kubelet service shows the below error
Apr 05 14:13:06 estk8worker0 kubelet[90209]: E0405 14:13:06.863258 90209 kubelet_node_status.go:92] "Unable to register node with API server" err=&...
0
votes
1
answer
201
views
GKE Autopilot - consume reservation
I had some issues creating GKE deployment with nvidia t4 GPU (Node scale up in zones europe-west1-b associated with this pod failed: GCE out of resources. Pod is at risk of not being scheduled.) so I ...
0
votes
1
answer
254
views
Kubernetes API returns 403 Forbidden from inside a pod with seemingly correct ClusterRole bound to pod Service Account
I have a Python script that runs inside a k8s pod (Google Kubernetes Engine 1.25) and queries K8S API to create VaultStaticSecret's resources.
I'll paste Helm Chart templates for brevity:
apiVersion: ...
0
votes
1
answer
238
views
All cluster resources were brought up, but: 1 nodes out of 1 are unhealthy
Unable to create a gke autopilot cluster using shared vpc .
The same shared vpc works fine with standard private cluster .
Repeated this multiple times with the same error. Followed google ...
0
votes
0
answers
55
views
Deploying Multi-Cluster/Multi-Region Gateway AND have redundant stateful services with GKE Autopilot?
I want two clusters to each be in a different region so I have basic region redundancy. Some of the services I want to run are stateful (which includes keeping track of user sessions). I am not ...
0
votes
0
answers
28
views
Possible to deploy service to GKE Autopilot cluster without YAML?
Is it possible to deploy to GKE Autopilot cluster without YAML and just command line? I have inherited a project where deployment generates command line to deploy to CloudRun. I am in the process of ...
1
vote
1
answer
334
views
What CNI is used (and what are the alternatives) in GKE?
I'm confused with Google Cloud's documentation on GKE. In the Compare network models doc, it says GKE has a fully integrated networking model which suggests to me it has its own CNI implementation. ...
0
votes
0
answers
48
views
Argocd Sync issue error validating data: ValidationError(Deployment.spec.template.metadata):
I have deployed my app using terraform and I'd like to now sync it to my ArgoCD but I keep getting this error and I can't bypass it.
error validating data: ValidationError(Deployment.spec.template....
1
vote
0
answers
177
views
HEALTH CHECK not resolving for ClamAV hosted in GKE cluster
Couldn't resolve health check related issue for the clamAV:1.2 deployment hosted in the GKE cluster in the port 3310, 7357.
Facing some backend services are in UNHEALTHY state, in the ingress after ...
-2
votes
1
answer
125
views
Set up minikube installation with gke
I just want to set up minikube on kubernetes
While installing facing an error
Minikube start--kubernetes-version=vm-driver="hyperv'--hyperv-virtual-switch=minikube
I want to resolve above error
...
2
votes
1
answer
1k
views
What would lead to a "Cancelling deletion of pod" message?
I see these messages in my GKE logs several times a day...
Cancelling deletion of Pod <pod-namespace>/<pod name>
It looks like they are happening due to the taint-controller with a ...
0
votes
0
answers
137
views
New VM is not getting attached to K8S Cluster using kubeadm join command
I have K8s cluster of 1 master and 2 Worker node working fine, having OS Rocky Linux.
I added one more VM of same OS and installed all dependencies such as docker, containerd, kubelet, kubeadm, ...
0
votes
0
answers
216
views
GKE and multiple VPN
I have a GKE autopilot cluster where I deployed a workload that needs to connect to two SQL databases via two different on-premise VPNs. The network is on another project and it is a shared VPC.
The ...
0
votes
0
answers
316
views
Kubernetes outages potentially being caused by kube-dns
We've got a production kubernetes cluster that has been having a bunch of ~1-5 minute outages on a semi-regular basis.
We're trying to troubleshoot, but running into various gaps of information/...
0
votes
1
answer
33
views
GCP Automatic Instance Template replacement issue in Compute Engine
I'm using Google Kubernetes Engine where my cluster's node pool is connected to Compute Engine instances defined by instance templates. I'm controlling these instance templates by Managed Instance ...
0
votes
0
answers
107
views
GKE Arm-based cluster starts in invalid state
After I install a new GKE cluster on Arm-based VM it immediately starts in a failing state. Specifically antrea-controller-horizontal-autoscaler cannot be run as it has no toleration for Arm-based ...
0
votes
0
answers
82
views
I want to check the storage used by GKE Node
I have created a GKE cluster with 20 GB of storage and it is runnning 4 pods. 3 of them are angular application and 1 is node applicaiton and 10.5GB is already used and only 3.96 GB is left. I wanted ...
0
votes
0
answers
80
views
GKE: metric server crashlooping (crosspost from r/googlecloud)
I have several (<10) gke clusters, all but one are all in the same condition and I can't figure out what and why is it happening. I hope to find someone that managed to solve the same issue :)
Some ...
2
votes
1
answer
2k
views
Error:unable to upgrade connection:Authorization error (user=kube apiserver, verb=create, resource=nodes, sub resource=proxy)
I have set up my cluster with my app but now I'm facing issue in my gke cluster
Error:unable to upgrade connection:Authorization error (user=kube apiserver, verb=create, resource=nodes, sub resource=...
1
vote
1
answer
439
views
Kubernetes cluster with certificate authority
Certificate error after upgrade of kubernetes
Error is SSL certificate problem:unable to get local issuer certificate
After doing multiple modifications Now I'm getting above error.
1
vote
1
answer
1k
views
How to find the maximum number of nodes in a GCP Kubernetes cluster?
In a GCP Kubernetes cluster is there a command to find out the maximum number of nodes? I have a Kubernetes cluster and need to identify if I can fit my pods to the nodes since there is a taint ...
0
votes
1
answer
2k
views
How to fix HPA deprecation warning on GKE?
Observed output
kubectl describe hpa
Warning: autoscaling/v2beta2 HorizontalPodAutoscaler is deprecated in v1.23+, unavailable in v1.26+; use autoscaling/v2 HorizontalPodAutoscaler
Attempted fix
...
0
votes
0
answers
68
views
How to manage utility pods on GKE autopilot?
My company is going to migrate to GCP, and I found some issues with how we want to manage our infrastructure and projects.
Our stack is mainly based on Kubernetes, right now we have 2 clusters:
...
1
vote
0
answers
32
views
Strange behavior of GCP Load Balancer
I had a strange behavior with google global lb. On the one zone traffic evenly , but on other zone with same load traffic loads pods not evenly. Configs at zones are the same. Can it appears to gcp ...
1
vote
0
answers
2k
views
Is it possible to have multiple ingress paths under the same host that point to the same backend service
I'm trying to restrict access to certain paths on my service how can I accomplish this on kubernetes?
I have a service that runs a basic API but it also runs an admin service. Is it possible to use ...
1
vote
1
answer
299
views
GKE pods to other VPC peered instance not reachable
I've created a VPC-native GKE private cluster. My Pod address range is 10.20.0.0/16 and my Service address range is 10.26.1.0/16.
GKE is setup on vpc-8 private subnet (100.17.8.0/24). I need to ...
-1
votes
1
answer
74
views
Debug ASP.NET k8s services on GKE
Is there any way to remote debug ASP.NET kubernetes services on GKE?
I tried to search related articles but I only found debugging local kubernetes services or them on AKS (with Visual Studio or ...
0
votes
0
answers
187
views
What is the csi driver for google cloud?
For aws eks service there is helm chart for csi driver to handle volumes.
aws-ebs-csi-driver
What is the alternative for gke, google kubernetes engine?
Please suggest.
3
votes
1
answer
5k
views
the gcp auth plugin is deprecated, how to skip this error?
I have install gke on a test account and configured the cli.
kuebctl get pods
is giving below warning.
W0916 17:23:58.063534 67381 gcp.go:119] WARNING: the gcp auth plugin is deprecated in v1.22+, ...
0
votes
1
answer
482
views
OpenVPN on Google Kubernetes Engine: expose private IPs to clients
Our scenario: We've got an OpenVPN server installed on a GKE pod with VPN clients that want to connect to our VPN. We need to expose to clients a service on another pod in our GKE cluster (an MQTT ...
0
votes
1
answer
167
views
How often managed kubernetes cluster should be upgraded?
We use managed Kubernetes cluster (GKE) and wonder how often the Kubernetes cluster should be upgraded. We use release channels: regular (dev/test), stable (staging), stable (production). Different ...
0
votes
2
answers
552
views
Accessing internal GKE resources from external IP
In GKE you can use External Ingress Controller to expose a service to the world and if you want you can use Google Cloud Armor to manage traffic and if required deny it with codes 403, 404, 502.
Lets ...
0
votes
1
answer
688
views
How to send a file from Google Cloud Platform Kubernetes Pod to external FTP?
I have an issue when trying to upload a file using PHP FTP from my website that is deployed on the GCP Kubernetes Engine. And when I try to upload it manually from the Pod terminal using the ftp ...
0
votes
1
answer
2k
views
Cannot properly edit and save worker node specs in Kubernetes
I have a Kubernetes cluster setup using KubeAdm (Setup in EC2 instances in AWS Cloud). The CNI used is Flannel and the cluster is running quite well. My requirement is that I am trying to setup ...
0
votes
2
answers
216
views
Cloudflare Origin Issuer not getting ready
I am currently debugging an strange error where my Cloudflare OriginIssuers are not getting ready, which blocks renewals.
I have tried restarting it once but that did not help, I looked at the port ...
1
vote
0
answers
576
views
kube-dns not resolving external urls with missing endpoints
I am trying to find out why my kube-dns does not resolve external urls and it seems it is caused by missing endpoints as described in:
(I am using Google Kubernetes engine and the cluster was created ...
0
votes
1
answer
2k
views
Calico Kubernetes Network Policy is denying all traffic and not working as expected
I am trying to implement some Calico based Kubernetes Network Policies. I have already setup Calico in my cluster and all the Calico based pods are running fine.
In my cluster, There are two pods.
1. ...
0
votes
1
answer
572
views
Ingress in GKE does not do the routing identically despite same IP at DNS level
I have setup in my GKE cluster an nginx ingress as follows:
helm repo add ingress-nginx https://kubernetes.github.io/ingress-nginx
helm install ingress-nginx ingress-nginx/ingress-nginx --namespace ...
1
vote
1
answer
102
views
Security context in Kubernetes
Under the K8s component Statefulset as shown below, the security context works fine for Kubernetes 1.21 version, but when I tried with new versions it did not work fine. I understand this is due to ...
3
votes
1
answer
943
views
Change container ports in Kubernetes in production
I have an nginx Dockerimage listening on some port as defined int its nginx.conf. That image is deployed as a workload in Kubernetes (GKE) and an ingress points to it.
The image's port is - both as ...
0
votes
1
answer
1k
views
No matching NodeSelectorTerms
Until yesterday this used to work, we are able to create a new set of pods under a namespace. However, today any new deployment fails to mount the PVC and I have no idea why.
How can I investigate ...
1
vote
1
answer
1k
views
Kubernetes Cert-Manager Expired Certificates
I inherited a GKE Kubernetes environment and have been trying to figure this out for days but unfortunately just don't know what to try next.
The cluster is setup to use cert-manager (installed via ...
0
votes
0
answers
116
views
Force pod creation order
Is there some way to force pod creation order on Kubernetes?
I have a scenario where Kubernetes are selecting a node pool with few resources and the first pod to be deployed consume a very small ...
0
votes
1
answer
836
views
Node pool selection
I have a Kubernetes cluster with many node pools. Sometimes the deployment fails because the selected node pool that Kubernetes select has not enough available resources.
Is there some way to force ...