Her er kommandoer brukt for å opprette public cluster templates
Set a template as private/hidden
When a new template is rolled out, set the old version to hidden:
openstack coe cluster template update <id> replace hidden=true
2023.1 (Antelope)
In Antelope there is hack/workaround the users has to apply after the cluster is CREATE_COMPLETE, if they want to use the Cinder CSI. NOTE: Only needed for single master clusters, for some reason.....
kubectl edit deployment csi-cinder-controllerplugin # Find the key "dnsPolicy: ClusterFirst" and change it to "dnsPolicy: Default" # Save and exit. The pod will rebuild
kubernetes-template for v1.24.17
openstack coe cluster template create kubernetes-v1.24.17 \ --coe kubernetes \ --external-network ntnu-internal \ --dns-nameserver 129.241.0.200,129.241.0.201 \ --volume-driver cinder \ --docker-volume-size 20 \ --docker-storage-driver overlay2 \ --master-flavor gx1.2c4r \ --flavor gx1.2c4r \ --image fedora-coreos35-stable \ --labels keystone_auth_enabled=False,kube_tag=v1.24.17-rancher1,container_runtime=containerd,containerd_version=1.6.6,containerd_tarball_sha256=a64568c8ce792dd73859ce5f336d5485fcbceab15dc3e06d5d1bc1c3353fa20f,flannel_network_cidr=172.29.0.0/16,cloud_provider_tag=v1.24.6,cinder_csi_plugin_tag=v1.24.6 \ --public
kubernetes-template-ha for v1.24.17
openstack coe cluster template create kubernetes-v1.24.17-ha \ --coe kubernetes \ --external-network ntnu-internal \ --dns-nameserver 129.241.0.200,129.241.0.201 \ --volume-driver cinder \ --docker-volume-size 20 \ --docker-storage-driver overlay2 \ --master-flavor gx3.4c8r \ --flavor gx1.2c4r \ --image fedora-coreos35-stable \ --labels keystone_auth_enabled=False,kube_tag=v1.24.17-rancher1,container_runtime=containerd,containerd_version=1.6.6,containerd_tarball_sha256=a64568c8ce792dd73859ce5f336d5485fcbceab15dc3e06d5d1bc1c3353fa20f,flannel_network_cidr=172.29.0.0/16,cloud_provider_tag=v1.24.6,cinder_csi_plugin_tag=v1.24.6 \ --master-lb-enabled \ --public
Zed
No kubernetes changes needed (nor supported) for Zed. But we will change back to using flannel from now on. We are also bumping clustered masters to a default flavor with more CPU and RAM.
kubernetes-template for v1.23.16
openstack coe cluster template create kubernetes-v1.23.16 \ --coe kubernetes \ --external-network ntnu-internal \ --dns-nameserver 129.241.0.200,129.241.0.201 \ --volume-driver cinder \ --docker-volume-size 20 \ --docker-storage-driver overlay2 \ --master-flavor gx1.2c4r \ --flavor gx1.2c4r \ --image fedora-coreos35-stable \ --labels keystone_auth_enabled=False,kube_tag=v1.23.16-rancher1,container_runtime=containerd,containerd_version=1.6.6,containerd_tarball_sha256=a64568c8ce792dd73859ce5f336d5485fcbceab15dc3e06d5d1bc1c3353fa20f,flannel_backend=vxlan,flannel_network_cidr=172.29.0.0/16,csi_snapshotter_tag=v4.0.0 \ --public
kubernetes-template-ha for v1.23.16
openstack coe cluster template create kubernetes-v1.23.16-ha \ --coe kubernetes \ --external-network ntnu-internal \ --dns-nameserver 129.241.0.200,129.241.0.201 \ --volume-driver cinder \ --docker-volume-size 20 \ --docker-storage-driver overlay2 \ --master-flavor gx3.4c8r \ --flavor gx1.2c4r \ --image fedora-coreos35-stable \ --labels keystone_auth_enabled=False,kube_tag=v1.23.16-rancher1,container_runtime=containerd,containerd_version=1.6.6,containerd_tarball_sha256=a64568c8ce792dd73859ce5f336d5485fcbceab15dc3e06d5d1bc1c3353fa20f,flannel_backend=vxlan,flannel_network_cidr=172.29.0.0/16,csi_snapshotter_tag=v4.0.0 \ --master-lb-enabled \ --public
Yoga
kubernetes-template for v1.23.16
openstack coe cluster template create kubernetes-v1.23.16 \ --coe kubernetes \ --external-network ntnu-internal \ --dns-nameserver 129.241.0.200,129.241.0.201 \ --volume-driver cinder \ --docker-volume-size 20 \ --docker-storage-driver overlay2 \ --network-driver calico \ --master-flavor gx1.2c4r \ --flavor gx1.2c4r \ --image fedora-coreos35-stable \ --labels keystone_auth_enabled=False,kube_tag=v1.23.16-rancher1,container_runtime=containerd,containerd_version=1.6.6,containerd_tarball_sha256=a64568c8ce792dd73859ce5f336d5485fcbceab15dc3e06d5d1bc1c3353fa20f,csi_snapshotter_tag=v4.0.0 \ --public
kubernetes-template-ha for v1.23.16
openstack coe cluster template create kubernetes-v1.23.16-ha \ --coe kubernetes \ --external-network ntnu-internal \ --dns-nameserver 129.241.0.200,129.241.0.201 \ --volume-driver cinder \ --docker-volume-size 20 \ --docker-storage-driver overlay2 \ --network-driver calico \ --master-flavor gx1.2c4r \ --flavor gx1.2c4r \ --image fedora-coreos35-stable \ --labels keystone_auth_enabled=False,kube_tag=v1.23.16-rancher1,container_runtime=containerd,containerd_version=1.6.6,containerd_tarball_sha256=a64568c8ce792dd73859ce5f336d5485fcbceab15dc3e06d5d1bc1c3353fa20f,csi_snapshotter_tag=v4.0.0 \ --master-lb-enabled \ --public
Xena
kubernetes-template for v1.21.14
openstack coe cluster template create kubernetes-v1.21.14 \ --coe kubernetes \ --external-network ntnu-internal \ --dns-nameserver 129.241.0.200,129.241.0.201 \ --volume-driver cinder \ --docker-volume-size 20 \ --docker-storage-driver overlay2 \ --network-driver calico \ --master-flavor gx1.2c4r \ --flavor gx1.2c4r \ --image fedora-coreos33-stable \ --labels keystone_auth_enabled=False,kube_tag=v1.21.14-rancher1,hyperkube_prefix=docker.io/rancher/ \ --public
kubernetes-template-ha for v1.21.14
openstack coe cluster template create kubernetes-v1.21.14-ha \ --coe kubernetes \ --external-network ntnu-internal \ --dns-nameserver 129.241.0.200,129.241.0.201 \ --volume-driver cinder \ --docker-volume-size 20 \ --docker-storage-driver overlay2 \ --network-driver calico \ --master-flavor gx1.2c4r \ --flavor gx1.2c4r \ --image fedora-coreos33-stable \ --labels keystone_auth_enabled=False,kube_tag=v1.21.14-rancher1,hyperkube_prefix=docker.io/rancher/ \ --master-lb-enabled \ --public
Wallaby
kubernetes-template for v1.21.12
NOTE: With new flavor scheme, tha flavor may vary between platforms
openstack coe cluster template create kubernetes-v1.21.12 \ --coe kubernetes \ --external-network ntnu-internal \ --dns-nameserver 129.241.0.200,129.241.0.201 \ --volume-driver cinder \ --docker-volume-size 20 \ --docker-storage-driver overlay2 \ --network-driver calico \ --master-flavor gx1.2c4r \ --flavor gx1.2c4r \ --image fedora-coreos33-stable \ --labels keystone_auth_enabled=False,kube_tag=v1.21.12-rancher1,hyperkube_prefix=docker.io/rancher/ \ --public
kubernetes-template-ha for v1.21.12
openstack coe cluster template create kubernetes-v1.21.12-ha \ --coe kubernetes \ --external-network ntnu-internal \ --dns-nameserver 129.241.0.200,129.241.0.201 \ --volume-driver cinder \ --docker-volume-size 20 \ --docker-storage-driver overlay2 \ --network-driver calico \ --master-flavor gx1.2c4r \ --flavor gx1.2c4r \ --image fedora-coreos33-stable \ --labels keystone_auth_enabled=False,kube_tag=v1.21.12-rancher1,hyperkube_prefix=docker.io/rancher/ \ --master-lb-enabled \ --public
Victoria
kubernetes-template for v1.21.x
openstack coe cluster template create kubernetes-v1.21.7 \ --coe kubernetes \ --external-network ntnu-internal \ --dns-nameserver 129.241.0.200,129.241.0.201 \ --volume-driver cinder \ --docker-volume-size 20 \ --docker-storage-driver overlay2 \ --network-driver calico \ --master-flavor m1.small \ --flavor m1.small \ --image fedora-coreos33-stable \ --labels keystone_auth_enabled=False,kube_tag=v1.21.7-rancher1,hyperkube_prefix=docker.io/rancher/ \ --public
kubernetes-template-ha for v1.21.x
openstack coe cluster template create kubernetes-v1.21.7-ha \ --coe kubernetes \ --external-network ntnu-internal \ --dns-nameserver 129.241.0.200,129.241.0.201 \ --volume-driver cinder \ --docker-volume-size 20 \ --docker-storage-driver overlay2 \ --network-driver calico \ --master-flavor m1.small \ --flavor m1.small \ --image fedora-coreos33-stable \ --labels keystone_auth_enabled=False,kube_tag=v1.21.7-rancher1,hyperkube_prefix=docker.io/rancher/ \ --master-lb-enabled \ --public
kubernetes-template
openstack coe cluster template create kubernetes-v1.18.20 \ --coe kubernetes \ --external-network ntnu-internal \ --dns-nameserver 129.241.0.200,129.241.0.201 \ --volume-driver cinder \ --docker-volume-size 20 \ --docker-storage-driver overlay2 \ --network-driver calico \ --master-flavor m1.small \ --flavor m1.small \ --image fedora-coreos33-stable \ --labels keystone_auth_enabled=False,kube_tag=v1.18.20 \ --public
kubernetes-template-ha
openstack coe cluster template create kubernetes-v1.18.20-ha \ --coe kubernetes \ --external-network ntnu-internal \ --dns-nameserver 129.241.0.200,129.241.0.201 \ --volume-driver cinder \ --docker-volume-size 20 \ --docker-storage-driver overlay2 \ --network-driver calico \ --master-flavor m1.small \ --flavor m1.small \ --image fedora-coreos33-stable \ --labels keystone_auth_enabled=False,kube_tag=v1.18.20 \ --master-lb-enabled \ --public
Docker swarm doesn't work in Victoria....
Ussuri
kubernetes-template
openstack coe cluster template create kubernetes-v1.18.10 \ --coe kubernetes \ --external-network ntnu-internal \ --dns-nameserver 129.241.0.200,129.241.0.201 \ --volume-driver cinder \ --docker-volume-size 20 \ --docker-storage-driver overlay2 \ --network-driver calico \ --master-flavor m1.small \ --flavor m1.small \ --image fedora-coreos-stable \ --labels keystone_auth_enabled=False,heat_container_agent_tag=ussuri-stable-1,kube_tag=v1.18.10 \ --public
kubernetes-template-ha
openstack coe cluster template create kubernetes-v1.18.10-ha \ --coe kubernetes \ --external-network ntnu-internal \ --dns-nameserver 129.241.0.200,129.241.0.201 \ --volume-driver cinder \ --docker-volume-size 20 \ --docker-storage-driver overlay2 \ --network-driver calico \ --master-flavor m1.small \ --flavor m1.small \ --image fedora-coreos-stable \ --labels keystone_auth_enabled=False,heat_container_agent_tag=ussuri-stable-1,kube_tag=v1.18.10 \ --master-lb-enabled \ --public
No changes in docker-swam-mode templates for ussuri.
Train
Note: There is a bug in that occurs in the mix of Fedora CoreOS 32, sytemd 242 and flannel, that is breaking inter-pod communication with flannel. Therefore, we use calico. Link
kubernetes-template
openstack coe cluster template create kubernetes-v1.17.11 \ --coe kubernetes \ --external-network ntnu-internal \ --dns-nameserver 129.241.0.200,129.241.0.201 \ --volume-driver cinder \ --docker-volume-size 20 \ --docker-storage-driver overlay2 \ --network-driver calico \ --master-flavor m1.small \ --flavor m1.small \ --image fedora-coreos-stable \ --labels keystone_auth_enabled=False,kube_tag=v1.17.11 \ --public
kubernetes-template-ha
openstack coe cluster template create kubernetes-v1.17.11-ha \ --coe kubernetes \ --external-network ntnu-internal \ --dns-nameserver 129.241.0.200,129.241.0.201 \ --volume-driver cinder \ --docker-volume-size 20 \ --docker-storage-driver overlay2 \ --network-driver calico \ --master-flavor m1.small \ --flavor m1.small \ --image fedora-coreos-stable \ --labels keystone_auth_enabled=False,kube_tag=v1.17.11 \ --master-lb-enabled \ --public
No changes in docker-swam-mode templates for train.
Stein
kubernetes-template
openstack coe cluster template create kubernetes-v1.15.12 \ --coe kubernetes \ --external-network ntnu-internal \ --dns-nameserver 129.241.0.200 \ --volume-driver cinder \ --docker-volume-size 20 \ --master-flavor m1.small \ --flavor m1.small \ --image fedora-atomic-latest \ --labels heat_container_agent_tag=stein-stable,keystone_auth_enabled=False,flannel_network_cidr=172.29.0.0/16,kube_tag=v1.15.12 \ --public
kubernetes-template-ha
openstack coe cluster template create kubernetes-v1.15.12-ha \ --coe kubernetes \ --external-network ntnu-internal \ --dns-nameserver 129.241.0.200 \ --volume-driver cinder \ --docker-volume-size 20 \ --master-flavor m1.small \ --flavor m1.small \ --image fedora-atomic-latest \ --labels heat_container_agent_tag=stein-stable,keystone_auth_enabled=False,flannel_network_cidr=172.29.0.0/16,kube_tag=v1.15.12 \ --master-lb-enabled \ --public
docker-swarm-mode-template
openstack coe cluster template create docker-swarm-mode \ --coe swarm-mode \ --external-network ntnu-internal \ --dns-nameserver 129.241.0.200 \ --docker-volume-size 20 \ --master-flavor m1.small \ --flavor m1.small \ --image fedora-atomic-latest \ --public
docker-swarm-mode-template-ha
openstack coe cluster template create docker-swarm-mode-ha \ --coe swarm-mode \ --external-network ntnu-internal \ --dns-nameserver 129.241.0.200 \ --docker-volume-size 20 \ --master-flavor m1.small \ --flavor m1.small \ --image fedora-atomic-latest \ --master-lb-enabled \ --public