In this thread we would like to inform our users of the progress within the MicroK8s project.
The theme of this sprint was: “Prepare for the v1.23 release”
We merged the support for worker only nodes in dqlite based clusters. This included:
Refactor the clustering commands in a pythonic way
Add tests for clustering worker nodes
Label nodes based on their role
Update our docs page
We added support for MicroK8s on M1 Mac
We reviewed and merged the following external contributions, thank you:
ingress for Kubernetes dashboard addon
upgrade keda to the latest version
Linkerd upgrade
upgrade metrics server
upgrade jaeger operator
Remove deprecated configuration from containerd
Updated the nginx ingress controller add-on
On strictly confined MicroK8s we now support editing manifests with microk8s kubectl edit. Try it with: snap install microk8s --channel=latest/edge/strict
For the charmed MicroK8s we landed two PRs to
configure SANs in MicroK8s units and
prevent breaking cluster by downgrading to older versions
Added a documentation page on NVIDIA DGX support
The upcoming released 1.23 will have the following changes on its default args:
k8s service profiling will be disabled
event-ttl will be set to 5min
insecure-port will be removed
Bug/usability fixes:
callback token removal so distributed ops do not try to reach departed nodes
the inspection script will detect missing modules on RPi on 21.10
kjackal
December 16, 2021, 2:51pm
2
The theme of this sprint was: “Release v1.23 and restructure our docs”
Released v1.23
Documentation updates we have landed, more to come.
Blog about MicroK8s on M1
Tested the strictly confined snap (install it from channel latest/edge/strict) with:
our LMA stack
our kubeflow bundle
The charmed MicroK8s has a new command to help users retrive the kubeconfig file
Bug/usability fixes:
Runc failing to stop long lasting containers
Release the 1.20 track to address dqlite missing library
kjackal
January 13, 2022, 11:40am
3
The theme of this sprint was: “Happy holidays and a happy new year!”
1 Like
kjackal
February 23, 2022, 9:33am
6
Most of this work is available on the latest/edge channel and will land on the latest/stable and 1.24/stable channels when K8s v1.24 is released.
Improve queue handling
Joule IndexError after removing node
Upgrade calico to 3.21.4
Build dqlite from fixed commits on all tracks
Imporve LXD detection and support on 1.21 and 1.22 tracks
Create a proposal for using go for the cluster agent. This will reduce our memory footprint.
Fix cluster.yaml permissions error in microk8s status
Reboot does not retain host-access address
Most of this work is available on the latest/edge channel and will land on the latest/stable and 1.24/stable channels when K8s v1.24 is released.
Move microk8s under the canonical github org
microk8s add-node has now a yaml and json output format
microk8s reset refactored with improved output
LXC profile imporved to work on the latest Ubuntu (21.10+)
Retry on error policy extended on Kine
Read only kubelet port 10255 will be closed by default
Mayastor addon prototype. Test it with mcirok8s enable mayastor on the latest/edge channel.
ArgoCD community addon. Give it a try with microk8s enable argocd again on the latest/edge channel.
Helm3 upgrade v3.8.0
microk8s config yields a url with https://none in it on nodes with multiple interfaces
2 Likes
Most of this work is available on the latest/edge channel and will land on the latest/stable and 1.24/stable channels when K8s v1.24 is released.
Fix kubelite patch for 1.23.5
Build sqlite with “SQLITE_ENABLE_DBSTAT_VTAB=1”
Introduce the microk8s enable community addon
Add contributors in readme
Fix git usage denials in strict
Update to the latest mayastor version
Push our manifest changes upstream
Etcd storage considerations
Fork dependencies into canonical org, tag images under cdkbot
Discontinue Kubeflow Addon from the 1.21 track
Copy API server auth arguments when clustering to fix RBAC issues
Most of this work is available on the latest/edge channel and will land on the latest/stable and 1.24/stable channels when K8s v1.24 is released.
Remove docker specific arguments for 1.24
Make sure kubelite patch apply to 1.24.0-alpha.3
Refactor release jenkins jobs
Unblock the arm64 tests
Cluster agent implemented in Go
Cluster-agent split to separate repository
Investigate CLI inconsistencies
Improve snap boot time after installation
Create a curl wrapper and use that for both strict and classic
Fix this annoying dqlite bind denial
Ensure account-control autoconnects
Core addons are used in classic and strict snaps without any patches
Error in MayastorPool creation
Not creating data image if it already exists
Correct hostpath PVC permission in multinode clusters
Upgrade coredns to v1.9.0
Upgrade keda to v2.6.1
Upgrade linkerd and fix its tests
Preparing for the next 6 moth cycle.
Dqlite version 1.10.0 with memory usage improvements
Fix ip counter in render csr template function so entries do not get overwritten
Road-test MicroK8s with Ubuntu Jammy 22.04
Test MicroK8s charm with Ubuntu Jammy
Set “rules of engagement” in microk8s github
Fix the bug of ignoring the skip-verify flag
Community addons for strict and classic are taken from the same branch
Release 1.24 and prepare for the next 6 months
Release 1.24
Usability fixes
Validate installer arguments
Fix inconsistent formatting in CLI help sections
Update issue and pull request templates
Fix microk8s dashboard-proxy in 1.24
Looking ahead
Spec out and size a bunch of potential work items for the next 6 months
Addons work
Upgrade nginx-ingress controller to 1.2.0
Mayastor for arm64
Bug fixes
Investigate the microk8s reset of statefulsets
Fix modprobe errors for calico
Fix deploments on LXC in 22.04
KubeCon EU was great, thank you all for visiting our booth.
Usability fixes
Add validations to addon add repo
Cleanup calico interfaces when removing microk8s
Cleanup leftover IPtable rules
Adding version command to microk8s
Strict confinment work
Handle install and configure denials
Image sideloading
Cluster agent API endpoint to import images
Benchmarking
Foundation work to setup a cluster
Addons work
Allow addons to provide microk8s.anything commands
Update Kubernetes Dashboard to 2.4
Bug fixes
Fix: dashboard access instructions for 1.24
Number of total issues this sprint: 11
Non-triaged issues: 2
Triaged issues: 9
Converted to bug report: 3
Converted to feature request: 0
Assesment provided: 6
In-progress issues: 9
Closed: 0
Initial spec for launch configurations
Schema versioning for launch configurations
CAPI: In-place upgrades
CAPI: Upgrade fixes
Initial work on MicroK8s with Fips
Launch configurations to enable dns by default
Basic MicroK8s configuration with launch configurations
Bug fix for calico offloading disable action
CoreDNS update to 1.10.0
Bug fix for the registry cleanup on CI/CD jobs
Bug fix for refresh-certs
Containerd 1.16.15 updates backported
Golang 1.19 update for 1.23 and 1.24
Improving AWS Appliance with SSH security group option
Community PR: Observabiltiy improvements
Community PR: Split tests in community addons
Community PR: Cilium for ARM
Community PR: Increase containerd timeout
Many thanks to our community/contributors for the feedback and PRs.
Number of total issues this sprint: 19
Non-triaged issues: 7
Triaged issues: 12
Converted to bug report: 0
Converted to feature request: 1
Assesment provided: 9
In-progress issues: 9
Closed: 3
CAPI: Tests for in-place upgrades
Tests for mixed version clustering
CAPI: Release v0.5.0
Configure fips enabled microk8s snap to use FIPS openssl
Build cluster-agent for fips
PR Review: Add EasyHAProxy
PR Review: Add Static HTTP Server Parking Addon
Fix failure for addons repo commands called without sudo
Fail MicroK8s installation on LXD deployments without the correct profile
Print deprecatrion warning for chained addons operations
Split and configure microk8s tests so they can be called individually
Add a healthcheck endpoint for cluster agent and healtcheck test for MicroK8s
Launch configurations: side-load images into containerd
Initial spec for CIS
CAPI: Second-day operations enable/disable addons
Many thanks to our community/contributors for the feedback and PRs.
Number of total issues this sprint: 7
Non-triaged issues: 2
Triaged issues: 5
Converted to bug report: 0
Converted to feature request: 0
Assesment provided: 5
In-progress issues: 0
Closed: 5
Launch configurations: Image sideloading
Launch configurations documentation
Initial spec for CIS
CAPI: Second-day operations enable/disable addons
CAPI: Snap-store proxy option
CAPI: Documentation
Initial spec for dual-stack networking
FIPS: Build containerd/runc
Review for Shifu PR
Pin helm chart versions for addons in the core repository
Close code gap between eksd and main tracks
Updating docs to not promote multi-addon operations
Update Calico to 3.25.0
Preperation for 1.25-eksd release
GitHub Actions backport workflow for MicroK8s repository
Many thanks to our community/contributors for the feedback and PRs.
Number of total issues this sprint: 11
Non-triaged issues: 3
Triaged issues: 4
Converted to bug report: 0
Converted to feature request: 0
Assesment provided: 4
In-progress issues: 0
Closed: 4
CAPI: Bug fix on worker leave
Update Mayastor to 2.0.0
Update Calico to 3.25.0
Backport action for MicroK8s repository
Kine unit tests and benchmark for Create
Kine unit tests and benchmark for Update
Kine unit tests and benchmark for Get
Kine unit tests and benchmark for Delete
Kine unit tests and benchmark for Watch
Kine unit tests and benchmark for Leases
Kine unit tests and benchmark for List
Community PR Review: Regenerate API Server Certificate
Community PR Review: Specifying image used by Multipass
Community PR Review: Fixes #3243
Statically linking containerd and runc
Metallb image repository update
TLS config fixes for dqlite
Nginx-ingress addon for community
EKS-D 1.25 Release
Many thanks to our community/contributors for the feedback and PRs.
Number of total issues this sprint: 18
Non-triaged issues: 1
Triaged issues: 9
Converted to bug report: 1
Converted to feature request: 1
Assesment provided: 7
In-progress issues: 0
Closed: 8
EKS-D 1.25 Release
CNI options documentation for MicroK8s
Bugfix MicroK8s status takes a long time when dqlite is not running
Bugfix Handle case where dqlite IP is unknown
Update go to 1.20 for 1.27 release
Testing 1.27 release candidate
CI fixes
Kine optimizations migration strategy
Kine testing with dqlite
Measuring CPU and memory utilization in Kine tests
Investigation Mayastor issues
Non-default CIDR guards
Clustering launch configurations
Finalizing launch configurations feature
Enable setting MinTLSVersion for cluster-agent
Many thanks to our community/contributors for the feedback and PRs.