After some delay in ensure the upgrade would be stable, we're now running 0.19.8! 🎉

The upgrade was pretty straightforward with only a minor hiccup around uploading the static assets for the frontend. If you encountered this issue, refreshing your browser should fetch the correct assets.

You can read the full release notes for 0.19.5 to 0.19.8 here.

Additionally, some old communities were removed. Most of them appeared to be unused and weren't really serving much of a purpose. While community creation is currently disabled, if you'd like to create one feel free to ping me with your idea and plan for moderation. Our goal is to ensure that we're providing some value to the Fediverse rather than being a host for spam or other low-quality content.

Let me know if you have any questions, otherwise enjoy!

It's not broken, posts and comments will eventually sync but we're up to a day behind. It makes it impossible to interact with any of these communities in a meaningful way.

I'm trying to log into my account on lemmus.org but it's asking me to use a password that's less than 60 characters, when the password I used when I signed up was well over that. Now I can't login with that password.

There were a few minor hiccups requiring some minor downtime, but we're now running 0.19.5! 🎉

You can read the full release notes here.

The primary downtime was due to upgrading our Postgres instance from 15 to 16 and the total duration was ~15 minutes. While this wasn't required, it was good to get it out of the way now for any future changes that may require it.

Additionally, we were able to finally migrate pict-rs from its internal sled DB to using postgres instead! This requirement was preventing the service from properly scaling as well as causing issues when the service became unhealthy.

With these updates taken care of, I've gone ahead and reserved some capacity in efforts to reduce our monthly costs. While they haven't risen much since we started, I figured it'd be good to lock in some savings now.

As always, let me know if you encounter any issues. Thanks!

Whenever I try to upload an image as a post or comment I get this error message:

{"data":{"msg": "IO error: Os { code: 12, kind: OutOfMemory, message: \"Cannot allocate memory\" }","files": null},"state":" success"}

Aside from some minimal downtime, we were able to update to 0.19.1 without much hassle! 🎉

This is the latest version that was released recently and contains some great, new features. You can view the release notes here.

Unfortunately, due to the nature of the upgrade this means that everyone will be required to log back in. Feel free to reach out if you happen to experience any issues with this or anything else related to the upgrade.

Additionally, I've gone ahead and disabled community creation for the time being. This is in part an effort to try to curate quality communities that provide value to the broader Fediverse. If you have an idea, feel free to forward your proposal and we can discuss.

Beyond that, there's some general improvements I'd like to tackle in my free time that will hopefully ensure we remain on good terms with the other instances.

Happ

Is it allowed/possible to create new communities on lemmus.org?

I want to keep bandwidth and storage costs down for lemmus as much as possible. Should I upload images to Imgur or other image-hosting websites instead?

When I click on the RSS button, it directs me to a "Page not Found" webpage.

It works fine in my lemmy.world alternative account.

Howdy!

As some of you may know, a vulnerability was discovered and exploited last night against a couple Lemmy servers. The admins were quick to respond, crowd-source solutions, and mitigate the damage. Patches have been deployed and the malicious content has been removed. For more details on the attack itself, see: Ruud's post on Lemmy.world

Unfortunately, due to the extent of the attack this required rotating our secret which forcibly logs out all users. This is for your protection even if we weren't directly attacked. The reason for this is because as part of the attack the exploit was harvesting any user's cookies that had viewed the content.

If you are a user on any other servers and have not been logged out, it's possible those accounts are vulnerable. I'd suggest reaching out to those admins to ensure they're taking the proper precautions.

We will continue to monitor the situation and proceed as necessary.

First off, apologies if you noticed any issues during the following upgrade. I tried to minimize the impact as much as possible but there were a few snags along the way. 😅

I finally got around to rebuilding everything using ARM instead of x86_64. This provides a nice performance boost as well as cost savings. Enough so that I was able to double our capacity for a nominal increase in price. Our DB is already over-provisioned so this should provide a nice buffer for the time being.

Additionally, while I was in there I took the time to split the API so that the batch jobs could be run separately. This allows me to run more than one API at a time for increased scalability.

Overall, it went well with little disruption and improves our stability for the future. See below for the technical details, otherwise enjoy what's left of the day. 🎉

::: spoiler Technical details

The two issues that came up were related to the CDN caching an error response and the ongoing battle with `pict

This is a general purpose instance for all to use. I decided to contribute to the Fediverse as a way of giving back after decades of using FOSS.

And for anyone curious, the name lemmus comes from the genus of Lemmings.

Since it is a new instance, please bear with any potential growing pains. I'm going to monitor the performance and scale accordingly, but let me know if you notice any issues. I'm hoping to balance cost/performance as much as possible.

Updates

• 2025-01-20 - Upgrade
• 2024-08-10 - Upgrade
• 2023-12-22 - Upgrade
• 2023-07-10 - Security
• 2023-07-04 - Instance