Skip to main content

All Questions

Filter by
Sorted by
Tagged with
0 votes
0 answers
35 views

Kubelet/Cadvisor on GKE not exporting container_fs_* metrics for attached volumes

In our GKE 1.27.12 cluster, we run a couple of stateful workloads using GCP Volumes, e.g. using this storage class: apiVersion: storage.k8s.io/v1 kind: StorageClass metadata: name: pd-ssd ...
antaxify's user avatar
  • 123
0 votes
0 answers
10 views

Efficiently Managing Dynamic Jupyter Kernels in GKE with Python Backend

I'm working on setting up an environment where I can dynamically create Jupyter notebook kernels as separate pods within a Google Kubernetes Engine (GKE) cluster. Each pod needs to have customizable ...
Lawrence Xiao's user avatar
1 vote
0 answers
68 views

What are my groups in kubernetes (GKE) on GCP?

The answer is supposedly easy: $ kubectl auth whoami But it says that I belong only to system:authenticated. That's not pretty informative, and I believe I must belong to system:masters. Why? Because ...
x-yuri's user avatar
  • 2,328
0 votes
1 answer
348 views

Google Cloud Composer 2 Environment won't become healthy

I am trying to create a Google Cloud Composer 2 environment in my project, but it fails to become healthy. I am creating it with the default settings and a service account that has the Cloud Composer ...
Nikolai Jay Summers's user avatar
1 vote
1 answer
194 views

What should be the NodeClassRef for Karpenter's NodePool in GKE?

I have created a GKE cluster in GCP and wanted to install Karpenter on it for the autoscaling. While trying to install Karpenter, pods gives the error asking to create the NodeClaim resource which ...
Harshit Agarwal's user avatar
0 votes
1 answer
351 views

Ansible "Failed to create temporary directory" (GCP)

I've encountered an issue with my Ansible playbook that provisions both a Kubernetes cluster and other servers within our cloud infrastructure. Specifically, the problem arises when I configure the &...
1wonder's user avatar
0 votes
0 answers
88 views

Tried to set up a K8 cluster from scratch on Ubuntu 22 but the kubelet is failing to register nodes

The kubelet service shows the below error Apr 05 14:13:06 estk8worker0 kubelet[90209]: E0405 14:13:06.863258 90209 kubelet_node_status.go:92] "Unable to register node with API server" err=&...
Sks's user avatar
  • 1
0 votes
1 answer
201 views

GKE Autopilot - consume reservation

I had some issues creating GKE deployment with nvidia t4 GPU (Node scale up in zones europe-west1-b associated with this pod failed: GCE out of resources. Pod is at risk of not being scheduled.) so I ...
Noskol's user avatar
  • 101
0 votes
1 answer
254 views

Kubernetes API returns 403 Forbidden from inside a pod with seemingly correct ClusterRole bound to pod Service Account

I have a Python script that runs inside a k8s pod (Google Kubernetes Engine 1.25) and queries K8S API to create VaultStaticSecret's resources. I'll paste Helm Chart templates for brevity: apiVersion: ...
Dima Medvedev's user avatar
0 votes
1 answer
238 views

All cluster resources were brought up, but: 1 nodes out of 1 are unhealthy

Unable to create a gke autopilot cluster using shared vpc . The same shared vpc works fine with standard private cluster . Repeated this multiple times with the same error. Followed google ...
Mujeeb Sayed's user avatar
0 votes
0 answers
55 views

Deploying Multi-Cluster/Multi-Region Gateway AND have redundant stateful services with GKE Autopilot?

I want two clusters to each be in a different region so I have basic region redundancy. Some of the services I want to run are stateful (which includes keeping track of user sessions). I am not ...
ift-436t's user avatar
0 votes
0 answers
28 views

Possible to deploy service to GKE Autopilot cluster without YAML?

Is it possible to deploy to GKE Autopilot cluster without YAML and just command line? I have inherited a project where deployment generates command line to deploy to CloudRun. I am in the process of ...
ift-436t's user avatar
1 vote
1 answer
334 views

What CNI is used (and what are the alternatives) in GKE?

I'm confused with Google Cloud's documentation on GKE. In the Compare network models doc, it says GKE has a fully integrated networking model which suggests to me it has its own CNI implementation. ...
johny.bravo's user avatar
0 votes
0 answers
48 views

Argocd Sync issue error validating data: ValidationError(Deployment.spec.template.metadata):

I have deployed my app using terraform and I'd like to now sync it to my ArgoCD but I keep getting this error and I can't bypass it. error validating data: ValidationError(Deployment.spec.template....
SumMmGuy's user avatar
1 vote
0 answers
177 views

HEALTH CHECK not resolving for ClamAV hosted in GKE cluster

Couldn't resolve health check related issue for the clamAV:1.2 deployment hosted in the GKE cluster in the port 3310, 7357. Facing some backend services are in UNHEALTHY state, in the ingress after ...
Vikram R's user avatar
-2 votes
1 answer
125 views

Set up minikube installation with gke

I just want to set up minikube on kubernetes While installing facing an error Minikube start--kubernetes-version=vm-driver="hyperv'--hyperv-virtual-switch=minikube I want to resolve above error ...
Paul's user avatar
  • 15
2 votes
1 answer
1k views

What would lead to a "Cancelling deletion of pod" message?

I see these messages in my GKE logs several times a day... Cancelling deletion of Pod <pod-namespace>/<pod name> It looks like they are happening due to the taint-controller with a ...
Jty.tan's user avatar
  • 123
0 votes
0 answers
137 views

New VM is not getting attached to K8S Cluster using kubeadm join command

I have K8s cluster of 1 master and 2 Worker node working fine, having OS Rocky Linux. I added one more VM of same OS and installed all dependencies such as docker, containerd, kubelet, kubeadm, ...
Divyank's user avatar
  • 103
0 votes
0 answers
216 views

GKE and multiple VPN

I have a GKE autopilot cluster where I deployed a workload that needs to connect to two SQL databases via two different on-premise VPNs. The network is on another project and it is a shared VPC. The ...
Lic's user avatar
  • 101
0 votes
0 answers
316 views

Kubernetes outages potentially being caused by kube-dns

We've got a production kubernetes cluster that has been having a bunch of ~1-5 minute outages on a semi-regular basis. We're trying to troubleshoot, but running into various gaps of information/...
Jty.tan's user avatar
  • 123
0 votes
1 answer
33 views

GCP Automatic Instance Template replacement issue in Compute Engine

I'm using Google Kubernetes Engine where my cluster's node pool is connected to Compute Engine instances defined by instance templates. I'm controlling these instance templates by Managed Instance ...
rapago's user avatar
  • 1
0 votes
0 answers
107 views

GKE Arm-based cluster starts in invalid state

After I install a new GKE cluster on Arm-based VM it immediately starts in a failing state. Specifically antrea-controller-horizontal-autoscaler cannot be run as it has no toleration for Arm-based ...
Martin D's user avatar
  • 101
0 votes
0 answers
82 views

I want to check the storage used by GKE Node

I have created a GKE cluster with 20 GB of storage and it is runnning 4 pods. 3 of them are angular application and 1 is node applicaiton and 10.5GB is already used and only 3.96 GB is left. I wanted ...
Robin's user avatar
  • 1
0 votes
0 answers
80 views

GKE: metric server crashlooping (crosspost from r/googlecloud)

I have several (<10) gke clusters, all but one are all in the same condition and I can't figure out what and why is it happening. I hope to find someone that managed to solve the same issue :) Some ...
Luca Gervasi's user avatar
2 votes
1 answer
2k views

Error:unable to upgrade connection:Authorization error (user=kube apiserver, verb=create, resource=nodes, sub resource=proxy)

I have set up my cluster with my app but now I'm facing issue in my gke cluster Error:unable to upgrade connection:Authorization error (user=kube apiserver, verb=create, resource=nodes, sub resource=...
Martin rudez's user avatar
1 vote
1 answer
439 views

Kubernetes cluster with certificate authority

Certificate error after upgrade of kubernetes Error is SSL certificate problem:unable to get local issuer certificate After doing multiple modifications Now I'm getting above error.
Ruthew's user avatar
  • 11
1 vote
1 answer
1k views

How to find the maximum number of nodes in a GCP Kubernetes cluster?

In a GCP Kubernetes cluster is there a command to find out the maximum number of nodes? I have a Kubernetes cluster and need to identify if I can fit my pods to the nodes since there is a taint ...
Phil's user avatar
  • 275
0 votes
1 answer
2k views

How to fix HPA deprecation warning on GKE?

Observed output kubectl describe hpa Warning: autoscaling/v2beta2 HorizontalPodAutoscaler is deprecated in v1.23+, unavailable in v1.26+; use autoscaling/v2 HorizontalPodAutoscaler Attempted fix ...
Jared Beck's user avatar
0 votes
0 answers
68 views

How to manage utility pods on GKE autopilot?

My company is going to migrate to GCP, and I found some issues with how we want to manage our infrastructure and projects. Our stack is mainly based on Kubernetes, right now we have 2 clusters: ...
pida's user avatar
  • 101
1 vote
0 answers
32 views

Strange behavior of GCP Load Balancer

I had a strange behavior with google global lb. On the one zone traffic evenly , but on other zone with same load traffic loads pods not evenly. Configs at zones are the same. Can it appears to gcp ...
Danila Eliseev's user avatar
1 vote
0 answers
2k views

Is it possible to have multiple ingress paths under the same host that point to the same backend service

I'm trying to restrict access to certain paths on my service how can I accomplish this on kubernetes? I have a service that runs a basic API but it also runs an admin service. Is it possible to use ...
James's user avatar
  • 11
1 vote
1 answer
299 views

GKE pods to other VPC peered instance not reachable

I've created a VPC-native GKE private cluster. My Pod address range is 10.20.0.0/16 and my Service address range is 10.26.1.0/16. GKE is setup on vpc-8 private subnet (100.17.8.0/24). I need to ...
pbms's user avatar
  • 141
-1 votes
1 answer
74 views

Debug ASP.NET k8s services on GKE

Is there any way to remote debug ASP.NET kubernetes services on GKE? I tried to search related articles but I only found debugging local kubernetes services or them on AKS (with Visual Studio or ...
Ellisein's user avatar
0 votes
0 answers
187 views

What is the csi driver for google cloud?

For aws eks service there is helm chart for csi driver to handle volumes. aws-ebs-csi-driver What is the alternative for gke, google kubernetes engine? Please suggest.
Kalel's user avatar
  • 254
3 votes
1 answer
5k views

the gcp auth plugin is deprecated, how to skip this error?

I have install gke on a test account and configured the cli. kuebctl get pods is giving below warning. W0916 17:23:58.063534 67381 gcp.go:119] WARNING: the gcp auth plugin is deprecated in v1.22+, ...
Kalel's user avatar
  • 254
0 votes
1 answer
482 views

OpenVPN on Google Kubernetes Engine: expose private IPs to clients

Our scenario: We've got an OpenVPN server installed on a GKE pod with VPN clients that want to connect to our VPN. We need to expose to clients a service on another pod in our GKE cluster (an MQTT ...
Simone Pulcini's user avatar
0 votes
1 answer
167 views

How often managed kubernetes cluster should be upgraded?

We use managed Kubernetes cluster (GKE) and wonder how often the Kubernetes cluster should be upgraded. We use release channels: regular (dev/test), stable (staging), stable (production). Different ...
sacherus's user avatar
  • 101
0 votes
2 answers
552 views

Accessing internal GKE resources from external IP

In GKE you can use External Ingress Controller to expose a service to the world and if you want you can use Google Cloud Armor to manage traffic and if required deny it with codes 403, 404, 502. Lets ...
sanevi's user avatar
  • 1
0 votes
1 answer
688 views

How to send a file from Google Cloud Platform Kubernetes Pod to external FTP?

I have an issue when trying to upload a file using PHP FTP from my website that is deployed on the GCP Kubernetes Engine. And when I try to upload it manually from the Pod terminal using the ftp ...
Praditha's user avatar
  • 153
0 votes
1 answer
2k views

Cannot properly edit and save worker node specs in Kubernetes

I have a Kubernetes cluster setup using KubeAdm (Setup in EC2 instances in AWS Cloud). The CNI used is Flannel and the cluster is running quite well. My requirement is that I am trying to setup ...
arjunbnair's user avatar
0 votes
2 answers
216 views

Cloudflare Origin Issuer not getting ready

I am currently debugging an strange error where my Cloudflare OriginIssuers are not getting ready, which blocks renewals. I have tried restarting it once but that did not help, I looked at the port ...
HeroOnSocks's user avatar
1 vote
0 answers
576 views

kube-dns not resolving external urls with missing endpoints

I am trying to find out why my kube-dns does not resolve external urls and it seems it is caused by missing endpoints as described in: (I am using Google Kubernetes engine and the cluster was created ...
Vojtěch's user avatar
  • 295
0 votes
1 answer
2k views

Calico Kubernetes Network Policy is denying all traffic and not working as expected

I am trying to implement some Calico based Kubernetes Network Policies. I have already setup Calico in my cluster and all the Calico based pods are running fine. In my cluster, There are two pods. 1. ...
arjunbnair's user avatar
0 votes
1 answer
572 views

Ingress in GKE does not do the routing identically despite same IP at DNS level

I have setup in my GKE cluster an nginx ingress as follows: helm repo add ingress-nginx https://kubernetes.github.io/ingress-nginx helm install ingress-nginx ingress-nginx/ingress-nginx --namespace ...
tobias's user avatar
  • 101
1 vote
1 answer
102 views

Security context in Kubernetes

Under the K8s component Statefulset as shown below, the security context works fine for Kubernetes 1.21 version, but when I tried with new versions it did not work fine. I understand this is due to ...
RockyCool's user avatar
3 votes
1 answer
943 views

Change container ports in Kubernetes in production

I have an nginx Dockerimage listening on some port as defined int its nginx.conf. That image is deployed as a workload in Kubernetes (GKE) and an ingress points to it. The image's port is - both as ...
cis's user avatar
  • 247
0 votes
1 answer
1k views

No matching NodeSelectorTerms

Until yesterday this used to work, we are able to create a new set of pods under a namespace. However, today any new deployment fails to mount the PVC and I have no idea why. How can I investigate ...
Rodrigo's user avatar
  • 65
1 vote
1 answer
1k views

Kubernetes Cert-Manager Expired Certificates

I inherited a GKE Kubernetes environment and have been trying to figure this out for days but unfortunately just don't know what to try next. The cluster is setup to use cert-manager (installed via ...
Steven Carlton's user avatar
0 votes
0 answers
116 views

Force pod creation order

Is there some way to force pod creation order on Kubernetes? I have a scenario where Kubernetes are selecting a node pool with few resources and the first pod to be deployed consume a very small ...
Rodrigo's user avatar
  • 65
0 votes
1 answer
836 views

Node pool selection

I have a Kubernetes cluster with many node pools. Sometimes the deployment fails because the selected node pool that Kubernetes select has not enough available resources. Is there some way to force ...
Rodrigo's user avatar
  • 65

1
2 3 4 5
7