All Questions
Tagged with kubernetes amazon-web-services
147
questions
0
votes
0
answers
10
views
Public IP should not be changed when aws eks cluster and managed nodegroup is upgraded
We have used the eks cluster(current version 1.20) and managed nodegroup and used the public IPs of the nodes for our purpose so now when we upgrade the eks cluster and nodegroup with version 1.21 all ...
0
votes
1
answer
38
views
k8s pods on different EKS nodes not getting traffic
I have eks cluster with two nodes, I have four k8s services deployed in the cluster, two of them are in node-1 and the other two in node-2. I have have a Kong api gateway in front of these k8s ...
- 101
2
votes
2
answers
70
views
How to obtain authorization to access EKS cluster
Followed this document Cert Signing to get the certificate issued.
I created cluster role and role binding to test it.
$ kubectl auth can-i create pods --as=myserver
yes
$ kubectl auth can-i list pods ...
0
votes
1
answer
61
views
Internet speed from AWS Singapore region to EU is very slow
We are running k8s cluster in AWS Singapure region. We also have self-managed EC2 NAT instance of type t3.xlarge. According to spec, it has 1 Gbps baseline speed, and burst up to 5 Gbps.
When running ...
- 101
0
votes
1
answer
57
views
When trying to connect to the cluster via lens: Failed to get /version for clusterId=id Internal Server Error
I am trying to connect to my kubernetes cluster which was spunup using kubeadm on aws instances.
I am using lens desktop app on windows.
My kubeconfig file
apiVersion: v1
clusters:
- cluster:
...
- 1
0
votes
1
answer
68
views
Not possible to update Helm AWS TargetGroupBinding
I have a helm chart that contains a TargetGroupBinding
{{- range $v := .Values.targetBindings }}
apiVersion: elbv2.k8s.aws/v1beta1
kind: TargetGroupBinding
metadata:
name: {{ include "...
0
votes
0
answers
75
views
Assign static IP address (outbound traffic) for every pod in EKS cluster
I have my software running in EKS cluster, where every node can fit up to 5 pods. The software uses multiple accounts on 3rd-party service which requires IP whitelisting. I have separate manifest ...
0
votes
0
answers
46
views
How to use bare metal Kubernetes with existing AWS Load Balancer (NLB)
I created a cluster manually with kubespray (NO cloud providers used) on AWS EC2 machines that I created myself. I have an AWS NLB that I created myself.
What is the proper way to configure Kubernetes ...
0
votes
0
answers
38
views
ARP resolution does not work as intended in VPC when doing L2 Announcements with CIlium CNI on a K8S Cluster spanning EC2 instances
VPC Configuration
VPC CIDR: 10.0.0.0/16
Region 1: 10.0.0.0/24 (public), 10.0.64.0/24 (private)
Region 2: 10.0.16.0/24 (public), 10.0.80.0/24 (private)
Region 3: 10.0.32.0/24 (public), 10.0.96.0/24 (...
- 131
0
votes
0
answers
120
views
AWS application load balancer not registering targets for Kubernetes EKS node target group
I have an EKS cluster with public/private access on a VPC with public and private subnets. I've setup my ALB in the public subnets on port 80, internet-facing and ip and installed the AWS controller ...
0
votes
0
answers
47
views
Kubernetes pod name or print something unique in the pod logs entries or any alternative (rsyslog implementation)
I have implemented Rsyslog server for fetch the pod logs from EKS nodes (Rsyslog client). Everything is working fine but in the logs I need pod name or something uniq to identify the log entries ...
0
votes
0
answers
55
views
Is it possible to deploy Milvus on Kubernetes without using Helm?
I'm trying to deploy an application on Kubernetes using a Helm chart, specifically the storage classes, following the instructions provided in the documentation (https://milvus.io/docs/eks.md). ...
- 1
0
votes
0
answers
41
views
Unable to join EC2 worker to VirtualBox master
Im deploying a Hybrid Cloud(VirtualBox-AWS) Kubernetes cluster. What I have done so far:
Set the control-plane on Ubuntu Server 22.04 LTS via VirtualBox 6.1.
Change network adapter to bridged
Ran the ...
- 101
0
votes
1
answer
286
views
AWS VPC CNI PLUGIN - Error: container runtime network not ready due to NetworkPluginNotReady - How to Resolve
I am facing difficulty in this, maybe the answer is simple so if someone knows the answer, please comment here.
I have created an EKS cluster using the following manifest.
apiVersion: eksctl.io/...
- 1
0
votes
0
answers
42
views
Updating csi-driver without stopping
I'm now facing this.
# module.eks_volume_provisioning.aws_eks_addon.csi_driver will be updated in-place
~ resource "aws_eks_addon" "csi_driver" {
~ addon_version ...
- 1
0
votes
0
answers
76
views
Cluster Openshift on AWS with IPI, installation error no such host
I'm trying to deploy an OpenShift cluster on AWS using the IPI installation. I've used a t3.xlarge instance and followed the steps in the following guide https://docs.openshift.com/container-platform/...
0
votes
0
answers
106
views
dns problems in self managed aws ec2 cluster with aws-vpc-cni
I'm new to k8s and I've been trying to learn it. I faced a problem with trying to setup aws-vpc-k8s-cni on my fresh k8s cluster with coredns. Here's the problem in detail.
Cluster & Network ...
- 131
0
votes
0
answers
63
views
PVC is in terminating state and PV is in bound state in Kubernetes
I have the PVC which is in terminating state (because it is referenced from 3 other pods) and the PV is in bound state. PV has the retain reclaiming policy.
Also I am not sure on the reason for the ...
- 111
0
votes
0
answers
55
views
404 error on jaeger-collector in kubernetes deployment
I've tried istio in kubernetes by referring official site of istio. In that, I can access kiali, prometheus but I can't connect the jaeger-collector. Since I'm using EKS and VM, I've exposed them as ...
- 1
0
votes
0
answers
10
views
K8 Dual stack one master and multiple worker nodes - centos7
I have k8 dual stack one master and multiple worker node(oci-centos7). how I can failover if my master nodes goes down or whether it will impact running pods on worker nodes?
1
vote
1
answer
420
views
Velero Web UI for kubernetes
Does Velero supports Web UI or is it just CLI,
I have seen couple of Github repos with the SC.
https://github.com/winnieoursbrun/velero-ui
https://github.com/hsmade/velero-ui
- 119
0
votes
0
answers
108
views
Kasten k10 dashboard 504 error
I Have installed the Kasten k10 on AWS k8, trying to access the dashboard from service port forward.
Dashboard has an network error with error logs on dashboard-svc pod and Gateway pod.
Below are the ...
- 119
0
votes
0
answers
139
views
Why can't I schedule more pods even with Ipv4Prefix enabled in my EKS cluster
I am using cilium as my CNI. I have successfully run the cilium connectivity test and all tests pass. My nodegroup schedules a t3.small nodes (3 of them), which allows me to run 11 pods without ...
- 123
0
votes
0
answers
247
views
The "count" value depends on resource attributes that cannot be determined until apply, Terraform cannot predict how many instances will be created
I am trying to create EKS cluster with manages nodegroup and I want to execute shell script that hardens worker nodes and sets proxy settings before cluster bootstrapp.
here is my "main.tf" ...
0
votes
1
answer
400
views
How can i get cilium to pass the failing connectivity test
I am trying to deploy cilium to my eks cluster, for context, this cluster is a private cluster running behind a private subnet, and routed to the internet through a NAT gateway and then an internet ...
- 123
0
votes
0
answers
41
views
Stop EKS/Traefik overwriting Inbound Security Group rules every 2 weeks
I have a kubernetes cluster (EKS AWS Managed) with Traefik Ingress service installed. Now, my understanding is the ingress service creates and manages the load balancer in AWS, and also the security ...
- 101
0
votes
0
answers
180
views
AWS ALB gives 504 timeout when vpc cni network policies applied
I've got argocd deployed on EKS, with ingress running on top of AWS Load Balancer Controller.
Alb controller is deployed in kube-system. Argo is deployed in argocd namespace with internal alb created ...
- 101
0
votes
0
answers
13
views
Removing kubernetes.io/aws-ebs in-tree StorageClass
After installation of aws-ebs-csi-driver I've realized that there is default in-tree implementation kubernetes.io/aws-ebs which is deprecated according to official doc:
$ kubectl get StorageClass
NAME ...
- 321
0
votes
1
answer
536
views
CoreDNS pods in AWS EKS Fargate unable to pull image
I created a PRIVATE EKS Cluster using AWS Console. Then, followed the documentation to configure Fargate. After I finished, I can see my Fargate nodes under Compute tab in my cluster in AWS Console, ...
- 1
0
votes
1
answer
1k
views
OpenSearch Cluster deployment in Kubernetes - Connection Refused Issue 9200 Port
I am running a Kubernetes cluster in AWS EC2 instances.
I have one master node (t2.2large EC2 Instance) and two worker nodes (t2.xlarge EC2 instance). I created the cluster using KubeADM. The cluster ...
- 63
0
votes
0
answers
114
views
K8s Kops 1/3 Master nodes always turn into Not Ready & kube-apiserver pod of that node abnormally restarts frequently
Our production KOPS Kubernetes v1.20 deployed in AWS is unhealthy. Intermittently, 1 of the 3 master nodes we have is frequently going into Not Ready Status. Furthermore, the kube-apiserver pod is ...
1
vote
1
answer
91
views
failed to get disk format of disk /dev/nvme1n1: exit status 127
What happened?
I had an old AWS EKS kubernetes cluster, running 1.21, so i decided to upgrade it.
While upgrading to 1.23 if not mistaken i was prompted that i need to install the AWS EBS CSI driver, ...
- 11
0
votes
0
answers
128
views
Spot instance sometime slow down and loss connection
I have a system deployed in AWS EKS, sometimes spot instances metrics is down, and API call to these nodes are very slow. Here is my system:
1 EKS cluster
1 on-demand node group
1 Karpenter v0.29.2 ...
- 21
0
votes
0
answers
342
views
Why Kube state metrics only shows metrics related to the namespace where it is running?
I have AWS EKS cluster with kube-state-metrics installed in a namespace called "monitoring". This installation is using service monitor and other components (see yaml files below).
In this ...
1
vote
0
answers
333
views
Fluent Bit doesn't create log stream in CloudWatch
Fluent Bit sends only the first logstream and the others not. This is my configuration:
config:
inputs: |
[INPUT]
Name tail
Path ...
- 11
0
votes
1
answer
129
views
CRI-O Pulling Image From AWS ECR: Failed to pull image, authentication required
Unable to pull an image from AWS ECR with the following error from Kubernetes using CRI-O as Container Runtime Interface.
Failed to pull image "<aws_account_id>.dkr.ecr.<region-name>....
- 435
0
votes
0
answers
100
views
Getting ioctl(setctty): operation not permitted: unknown error in K8S-Docker setup
Getting the permission error when trying to start a container in Ubuntu-AWS virtual machine. I am using kubectl apply -f test.yaml to deploy. Nginx is working normally in the same VM. I tried changing ...
- 1
0
votes
0
answers
32
views
Unable to enable Singlestore studio in Singlestore kubernetes operator
I deployed a singlestore test cluster using the documentation from https://docs.singlestore.com/db/v7.3/deploy/kubernetes/ on AWS.
The deployment was successful, and I managed to get the cluster up ...
0
votes
1
answer
2k
views
AWS EKS Cluster : InvalidParameterException: Unsupported Kubernetes minor version update ,Terraform Gitlab CI
The following errors occur every time I run the pipeline
│ Error: error updating EKS Cluster (business-staging) version: InvalidParameterException: Unsupported Kubernetes minor version update from 1....
- 59
0
votes
1
answer
822
views
EKS cluster access - aws-auth : add groups in mapRoles
i try to access an EKS cluster on AWS with AWS Account (same i use for the console)
steps i followed :
aws configure with info provided in the "Command line or programmatic access" (AWS ...
- 81
0
votes
0
answers
150
views
How to configure shared VPC for kOps?
As described in this documentation, I want to create a Kubernetes cluster using kOps in an existing VPC. I have created a VPC, Internet Gateway, Route Table, Subnet and an EC2 instance which I want to ...
- 101
0
votes
0
answers
2k
views
How to create EKS cluster with VPC CNI addon via CloudFormation?
I create a EKS cluster (1.24) via cloudformation, it works fine without a CNI plugin but fails when I add vpc-cni addon:
AddonCNI:
Type: 'AWS::EKS::Addon'
Properties:
AddonName: vpc-...
- 243
1
vote
0
answers
151
views
`aws-cloud-controller` fails to set `NodeNetworkUnavailable` to false
I'm running a cluster with kops on AWS. Since I needed to have instances in the same VPC of the cluster, I reused an existing subnet:
kops create cluster --cloud=aws --zones=us-east-2a --node-size=t3....
- 81
0
votes
0
answers
3k
views
How to skip resources during terraform destroy?
It seems there is an issue with order of deletion, the aws-auth configmap used for accessing the cluster is getting destroyed before the deletion of other resources, even after that EBS volumes are ...
- 254
0
votes
1
answer
2k
views
Pods stuck at terminating stage and the PVC, how to fix that?
My kubernetes cluster got stuck at terminating state.
below is the current state.
pods:
kubectl get po
NAME READY STATUS RESTARTS AGE
dashboard-0 1/1 Terminating 0 ...
- 254
0
votes
0
answers
1k
views
terraform destroy failing for kubernetes provider with pvc in aws eks, how to fix that?
We have done kubernetes deployment using terraform kubernetes provider, while creating the cluster eks itself.
When we try to destroy after that, didn't use the product yet, just testing the destroy.
...
- 254
6
votes
1
answer
3k
views
Why are system:nodes, system:masters, etc. not listed under "kubectl get roles -A" or "kubectl get clusterroles"?
I'm really struggling to follow the AWS documentation for "Enabling IAM user and role access to your cluster".
When I run kubectl edit -n kube-system configmap/aws-auth, I see this:
...
- 340
0
votes
0
answers
1k
views
Configure EKS to use Nexus Private Docker Registry (HTTP/HTTPS)
I've created an EKS cluster on AWS along with Nexus Repository on DigitalOcean using Terraform & Ansible.
Also I've not created any SSL for the Nexus Repository, so it is "http."
...
0
votes
0
answers
2k
views
Kubernetes pods failing with ImagePullBackOff when trying to pull image from AWS ECR
I are trying to run some Kubernetes pods in my Windows machine by using Docker-Desktop.
I am trying to install them using HELM. I have created my Docker images and have pushed them into AWS ECR ...
- 63
0
votes
1
answer
3k
views
Best way to add static routes to every pod in a Kubernetes cluster?
I have 3 nodes running several OpenVPN pods, each pod has a VPN network of 100.70.0.0/16, and clients that connect to these pods receive IP addresses in this range, for example, let's say that client ...
- 58