mesos-m3s
Mesos Framework to run Kubernetes (K3S)
Issues
To open an issue, please use this place: https://github.com/m3scluster/m3s/issues
Requirements
- Apache Mesos min 1.6.0
- Mesos with SSL and Authentication is optional
- Persistent Storage to keep K3S data (not object storage)
- Redis DB
Run Framework
The following environment parameters are only a example. All parameters and the default values are documented in
the init.go
file (real documentation will be coming later). These example assume, that we run mesos-mini.
Step 1
Run a redis server:
docker run --rm --name redis -d -p 6379:6379 redis
Step 2
M3s needs some parameters to connect to Mesos. The following serve only as an example.
export MESOS_SSL=false
export DOCKER_CNI=mini
export LOGLEVEL=DEBUG
export AUTH_USERNAME=user
export AUTH_PASSWORD=password
export VOLUME_K3S_SERVER=local_k3sserver
export K3S_TOKEN=df54383b5659b9280aa1e73e60ef78fc
export DOMAIN=.mini
export BOOTSTRAP_URL=https://raw.githubusercontent.com/AVENTER-UG/mesos-m3s/master/bootstrap/bootstrap.sh
export K3S_AGENT_LABELS=[{"key":"traefik.enable","value":"true"},{"key":"traefik.http.routers.m3s.entrypoints","value":"web"},{"key":"traefik.http.routers.m3s.service","value":"m3s-http"},{"key":"traefik.http.routers.m3s.rule","value":"HostRegexp(`example.com`, `{subdomain:[a-z]+}.example.com`)"}]
The variable K3S_AGENT_LABELS gives the possibility to create labels for Traefik or other load balancers connected to mesos. In the example given here are labels for our Traefik Provider.
Step 3
Before we launch M3s, we create in Docker in dedicated network.
docker network create --subnet 10.40.0.0/24 mini
Step 4
Now M3s can be started:
./mesos-m3s
Mesos-M3s in real Apache Mesos environments
In real mesos environments, we have to set at least the following environment variables:
export MESOS_MASTER="leader.mesos:5050"
export MESOS_USERNAME=""
export MESOS_PASSWORD=""
Also the following could be usefull.
export REDIS_SERVER="127.0.0.1:6379"
export REDIS_PASSWORD=""
export REDIS_DB="1"
export MESOS_CNI="weave"
Screenshots
Access Kubernetes Dashboard
kubectl -n kubernetes-dashboard describe secret admin-user-token | grep '^token'
kubectl proxy
http://localhost:8001/api/v1/namespaces/kubernetes-dashboard/services
Apache Mesos running K3S Framework
Access Traefik Dashboard
kubectl port-forward $(kubectl get pods --selector "app.kubernetes.io/name=traefik" --output=name -n kube-system) -n kube-system 9000:9000
http://127.0.0.1:9000/dashboard/