Questions tagged [k3s]
The k3s tag has no usage guidance.
69
questions
7
votes
3
answers
18k
views
Can I run a single-node K3S cluster?
I am aware of the consequences and issues with running a single-node cluster. However, I'm still curious if it's possible. I plan on setting everything up myself.
In other words, can I run the control ...
3
votes
1
answer
2k
views
Forward real requestor IP in K3S NGINX ingress
I've set up a K3S Kubernetes Environment in my private Home-Lab on Raspberry PIs in order to teach myself some Kubernetes (Noob-Alert), using NGINX as Ingress Controller and I'm kind of stuck at ...
- 31
3
votes
0
answers
1k
views
k3s without HA: how to switch master node?
Rancher documentation on k3s is quite nice and its HA support (both with external DB or embedded etcd) look nice, but I don't want/need an HA setup.
In case my master node fails, I don't mind having ...
- 123
2
votes
3
answers
3k
views
How to delete all namespaces except the kube-system in K3s cluster
I have a K3s cluster with system pods (i.e. kube-system namespace) and my application pods:
kube-system pod/calico-node-xxxx
kube-system pod/calico-kube-controllers-...
- 265
2
votes
1
answer
9k
views
In k3s, how can I promote a worker node to a master node?
I currently have a Raspberry Pi-based Kubernetes cluster based on k3s which, while originally a single-master cluster, has now grown to the point at which it is practical to have multiple (odd-number) ...
- 174
2
votes
1
answer
16k
views
How can I restart or reset the K3s cluster pods
I have a k3s (v1.21.1+k3s1) cluster with following pods:
kube-system pod/calico-node-xxxx
kube-system pod/calico-kube-controllers-xxxxxx
kube-system pod/metrics-...
- 265
2
votes
2
answers
8k
views
How can I delete manually calicoctl and iptables created by calico from my k3s setup
I have a K3s setup with calico pods [calico-node- & calico-kube-controllers-] running. On uninstalling K3s, calico pods get deleted but I see that calicoctl and iptables -S commands still running ...
- 265
2
votes
1
answer
965
views
Schedule pod on a node and access pv on another node
I'm running a k3s cluster on RPi4, with heterogenous config (a node has a high capacity but slow hdd, another has a ssd drive, a third only has a sd card).
I have persistent volumes & claims of ...
- 123
2
votes
1
answer
11k
views
Getting 401 Unauthorized while trying to pull images from local docker registry (harbor) from k3s
Due to work I need to self-host a local docker proxy cache using Harbor. So i wen to their doc and I installed the server and configured it properly, accesing it via FQDN and using a self-signed ...
- 131
2
votes
1
answer
72
views
Deduplicating nodes listed in `kubectl top nodes`
I've set up a new kubernetes cluster using k3s. When I run kubectl top nodes there are 6 listed even though the cluster only has 4 nodes. Some of the hosts have changed hostnames since first being set ...
- 143
2
votes
2
answers
530
views
K3S: understanding the network model and applying TLS certificates
In order to learn a bit more about K8S I started running a single server/node K3S cluster as a home lab. But I believe I've reached an impasse on my understanding of the network model, maybe specific ...
- 133
2
votes
1
answer
1k
views
How to add a domain to k3s certificate
When trying to access a k3s Kubernetes cluster that's running on another machine, I get the following error message:
E0204 19:13:27.185678 8066 proxy_server.go:147]
Error while proxying request:
...
- 121
2
votes
1
answer
595
views
The pod's /etc/resolv.conf does not reflect the changes on the host
When my pod's dnsPolicy is set to Default it picks up the DNS servers from the host's /run/systemd/resolve/resolv.conf (as configured by the resolvConf flag in Kubernetes) and stores them in /etc/...
- 121
2
votes
1
answer
85
views
k3s - select ingress nodes with default traefik
I have a k3s cluster with
1 master + 2 nodes
default traefik as ingress
Traefik is running on the master node.
Is there a way to label nodes / change manifest so that traefik runs on the nodes ...
- 541
1
vote
1
answer
358
views
What does "FailedMount: no Pending workload pods for volume" mean?
In a k3s cluster (with multiple control-plane nodes) and with Rancher Longhorn installed, I am observing the following warning for pods that have a pvc with the default longhorn storage class (output ...
- 375
1
vote
1
answer
491
views
How to access k3s cluster created in an azure vm with public and private ip?
I tried below steps to setup k3s cluster.
Here are the steps to create a K3s cluster on an Azure VM with both private and public IP addresses, and access it from your laptop using kubectl:
Create an ...
- 11
1
vote
1
answer
4k
views
Kubernetes pods can ping external IPs but not any domain
I have a Kubernetes cluster using the Antrea CNI.
The problem is that I can't curl any domain names.
I can do nslookup inside the pod and get the IP of any domain, but I can't directly curl the domain....
- 517
1
vote
1
answer
4k
views
Kubernetes failing to start: failed to build map of initial containers
Starting today, k3s is failing to start with the following error: "Failed to start ContainerManager" err="failed to build map of initial containers from runtime: no PodsandBox found ...
- 31
1
vote
1
answer
95
views
Issues Adding Non-Hetzner Provider Nodes to Rancher Cluster: Stuck at "Waiting for agent to check in and apply initial plan"
I have successfully deployed a Rancher server on one out of five servers obtained from Hetzner. For the cluster configuration, I designated one of the remaining servers for the control plane and etcd ...
- 21
1
vote
1
answer
616
views
Ansible shell module fails to find kubectl
Running the command from the CLI on the server works perfect, but from playbook using Ansible shell module fails with:
fatal: [localhost]: FAILED! => {"changed": true, "msg": &...
- 149
1
vote
1
answer
4k
views
k3s fail to start as daemoan but works when running manually from command line
I am trying to install k3s on a redhat operating system, on an EC2 instance (t3.xlarge)
OS version:
$ cat /etc/*release
NAME="Red Hat Enterprise Linux"
VERSION="8.6 (Ootpa)"
I ...
- 483
1
vote
2
answers
1k
views
which K3S ports should (not) be exposed on a public interface
The K3S documentation explains which ports are required for this kubernetes distribution to work.
What it does NOT explain is, which of these ports are OK to be open on a public interface.
K3S seem to ...
- 413
1
vote
1
answer
5k
views
Free up space on K3s cluster
I have a K3s single-node cluster running with Containerd and where I'm reaching the space disk limit.
It seems I have some old unused docker images on the machine.
How can I cleanup those in order to ...
- 121
1
vote
2
answers
177
views
Discrepancy between Kubernetes node memory usage reported by kubectl top and summed pod memory usage
I'm facing a discrepancy in memory usage reporting in my Kubernetes cluster, and I'm hoping to gain some insights into what might be causing it.
When I run kubectl top pods --all-namespaces, I get the ...
- 61
1
vote
1
answer
413
views
Can't connect to UDP service running in k3s and exposed via nodePort
I am trying to expose a UDP service (tftp) through a k3s nodePort but can't seem to connect. The TCP service work fine, but the UDP service doesn't seem to be exposed.
The deployment lists the ports:
....
- 744
1
vote
0
answers
131
views
truenas NFS on kubernetes
I am using the following link to setup my k3s setup with Truenas. I am only interested in NFS. I will not be doing ISCSI. After I applied the "helm upgrade --install --create-namespace --values ...
- 163
1
vote
1
answer
1k
views
Pgadmin4 cannot start in Kubernetes
I have set up Postgres in Kubernetes (k3s administered with Rancher) which seems to be working fine but in order to take a look at the databases I tried to add a pgadmin4 pod.
I first tried adding the ...
- 111
1
vote
1
answer
3k
views
K3S can't pull public docker hub images
K3S cluster is failling to pull public docker hub images. in this instance i will user linuxserver/webtop which presents the error
Failed to pull image "linuxserver/webtop": rpc error: code =...
- 11
1
vote
1
answer
9k
views
K3s - dial tcp 10.43.0.1:443: connect: connection refused
I created a K3s multi-master embedded cluster like this:
hostname: k3s01
curl -sfL https://get.k3s.io | K3S_TOKEN=xxx INSTALL_K3S_EXEC="server --disable servicelb --disable traefik --bind-address=...
- 240
0
votes
1
answer
2k
views
How can I restart or reset the custom namespace pods
I have a k3s cluster with kube-system pods and my application's (xyz-system namespace) pods:
kube-system pod/calico-node-xxxx
kube-system pod/calico-kube-controllers-...
- 265
0
votes
1
answer
1k
views
Aggregate multiple log files in a directory
I have k3s single node cluster running on a machine.
I do not have any logging infrastructure set up yet and I'd leave this as a future learning experience for now.
On that k3s I run some cron jobs ...
- 166
0
votes
1
answer
2k
views
How to bring K3s server & pods up again after k3s-killall.sh
I am having K3s cluster with system pods (kube-system namespace) & my application pods (xyz-system namespace) running.
I want to stop all of the K3s pods & reset the containerd state, so I ...
- 71
0
votes
1
answer
100
views
How to create Persistent Volume Claim in Kubernetes with Ansible?
I am trying to install Unifi on a Kubernetes cluster server (K3S) using Ansible and ran into troubles when trying to define a persistent volume claim.
I am using Kubernetes.Core module and I have ...
- 1,055
0
votes
1
answer
91
views
How to setup external load balancing to my kubernetes cluster securely?
We have for a period of time just pointed our dns to one of the nodes in our cluster. That node has then load balanced internally to the correct node and application.
Something like this:
The problem ...
- 103
0
votes
1
answer
1k
views
How do I configure Wireguard for a K8s multi-site?
I tried to configure Wireguard for a K3s multi-site cluster, my issue is with routing.
There are at least 4 nodes, 2 in one location + 1 in other location and + 1 in other location.
Assumptions:
10....
0
votes
2
answers
2k
views
Calicoctl rejecting certificate on fresh k3s install
I have a fresh install of Ubuntu, a fresh install of k3s, and a fresh download of calicoctl. I have installed it the following way.
curl -sfL https://get.k3s.io | K3S_KUBECONFIG_MODE="644"\
...
0
votes
0
answers
62
views
How to configure k3s with ingress-nginx to correctly forward user IP in X-Real-IP header?
I am trying to configure k3s with ingress-nginx on some VPS from Hetzner. I have set up a server with a public IP and others without public IPs, all connected in a private network. When I install ...
- 101
0
votes
1
answer
98
views
Fluent-bit bitnami helm chart - kubernetes filter does not work
I am trying to run fluent-bit using bitnami helm chart and I want to use kubernetes filter. It does collect the logs but the kubernetes filter does not add any information(pod id, pod name etc). When ...
- 1
0
votes
0
answers
52
views
cannot create subdomain because dns client is nil
when I deploy from docker registry app (abdomamdouh/kiada:0.1) to k3s cluster using porter.run text, I get this error
my porter config cluster: 4 driver: local helmrepo: "0" host: http://...
0
votes
0
answers
181
views
NodePort not accessible on all nodes in a k3s cluster
I've got a 3 node k3s cluster, installed using the following commands on fresh Ubuntu server 22.04 installs:
# first server
curl -sfL https://get.k3s.io | sh -s - server --cluster-init
# other two
...
- 111
0
votes
1
answer
62
views
Changes done in mysql backend database not getting reflected neither on frontend website nor inside the server [closed]
https://stackoverflow.com/questions/45920596/update-made-in-mysql-database-does-not-reflect-on-the-webpage
I've curled inside the server itself and still the updated data was not received.
I've:
...
- 122
0
votes
0
answers
164
views
404 page not found rancher and k3s, how to resolve?
Step 1
Download k3s
curl -sfL https://get.k3s.io | INSTALL_K3S_VERSION=v1.26.11+k3s1 sh -s - server --write-kubeconfig-mode 666
Step 2
Install cert manager.
kubectl apply -f https://github.com/cert-...
- 122
0
votes
1
answer
348
views
Load Balancer is not accessible outside cluster
I have setup 3 master and 6 worker nodes using the same IP segment, 172.26.10.XX.
For load balancer services, I'm using Kube-Vip for load balancer with configuration namespace specifics as below: -
...
- 1
0
votes
0
answers
154
views
Add server node to existing k3s cluster using kubevip
I have a k3s cluster consiting of one server node and three worker nodes, currently running. I would like to add a new server node to ensure HA if the server nodes goes down. I am using ksup and ...
- 163
0
votes
0
answers
298
views
server network fails when starting k3s server
We have a k3s cluster in our staging environment with one master and two agents. Recently, I noticed that the master node was using high resources. I was also unable to SSH to the server from our ...
- 1
0
votes
0
answers
634
views
Why are my DNS query responses from Technitium failing to make it back to my kubernetes container?
I've explored every nook and cranny I can imagine, and I can't figure out what's going wrong.
I've got a k3s setup on my server where I'm hosting technitium in hostNetwork mode. Technitium is ...
- 1
0
votes
1
answer
732
views
k3s fails to parse registries.yaml
I have set up a k3s Kubernetes standalone server with a insecure private registry but k3s fails to pull images from it.
The registries.yaml file is set as documentation says. It is below.
mirrors:
&...
- 101
0
votes
0
answers
282
views
OpenVPN Server on K3s Kubernetes Cluster: No Internet Access
I've set up an OpenVPN server on a K3s Kubernetes cluster. While I can successfully deploy the OpenVPN server pod and connect from a client machine, the client doesn't have internet access through the ...
0
votes
0
answers
307
views
Can't access Rancher UI after deploying it on K3S via helm
I deployed Rancher on K3S cluster using steps documented in below guide: https://ranchermanager.docs.rancher.com/getting-started/quick-start-guides/deploy-rancher-manager/helm-cli
The pod is working ...
- 1
0
votes
0
answers
109
views
K3s - Two pods in the same CIDR subnet doing SNAT in a cluster
We have a multi master k3s cluster with etcd. We have launched 2 pods in deployment and both get the IPs from the same CIDR i.e., 10.244.0.xx. cni0 interface ip is 10.244.1.1 on node 1 and 10.244.0.1 ...
- 1