Adventures in Eco-Linux - Part 03 - K3s external services

Well, that's annoying, and also unexpected. Turns out that when you setup K3s Automated Upgrades, it includes doing major upgrades to the built-in Traefik controller. This would be less annoying if I didn't run into several issues with breaking configuration changes, and if those issues weren't half buried under the amount of changes that happened. (To be fair the changes were well documented, but I had no idea how large the update was, so it was going back several versions)

The first issues that I ran into was the changes that Traefik made to its LetEncrypt resolver. These changes consist of a new structure for the configuration as documented here, which causes the controller to throw an error and ignore the configuration. I didn't notice the issue, except for the log messages that I came across while I debugging the next issue. The configuration changes aren't hard, and I quickly adjusted to the new layout, it was more the blindside way that it needed to be changed, and I was unaware of it due to the automatic upgrades.

The second issue that I ran into was that my external service, for this blog, wasn't resolving correctly and Traefik just returned a 404 when going to the blog. After some digging I was able to dig up that in Traefik V 2.4.10 Traefik switched from default-ly allowing ExternalServices to not, and needing you to configure that in the helm chart values. This was slightly confusing for several reasons, mostly because of the next issue.

Finally, the main issue I was focused on was that between the "previous" version of traefik, and the "new" version of Traefik, the way that External services are declared changed. Previously I had an Endpoint and a service that matched that. But now I need to specify the endpoint with in the service itself, which makes the link a lot more apparent but again, is an unexpected adjustment I had to make. 

Overall, I just got blindsided by not only the need for changes, but the sheer amount of changes that needed to be made. Yet I think i finally got it to the point of fixed and stable. Though we'll see how long that lasts.

This article was updated on April 8, 2025