Looks like it works.

Edit still see some performance issues. Needs more troubleshooting

Update: Registrations re-opened We encountered a bug where people could not log in, see https://github.com/LemmyNet/lemmy/issues/3422#issuecomment-1616112264 . As a workaround we opened registrations.

Thanks

First of all, I would like to thank the Lemmy.world team and the 2 admins of other servers @stanford@discuss.as200950.com and @sunaurus@lemm.ee for their help! We did some thorough troubleshooting to get this working!

The upgrade

The upgrade itself isn’t too hard. Create a backup, and then change the image names in the docker-compose.yml and restart.

But, like the first 2 tries, after a few minutes the site started getting slow until it stopped responding. Then the troubleshooting started.

The solutions

What I had noticed previously, is that the lemmy container could reach around 1500% CPU usage, above that the site got slow. Which is weird, because the server has 64 threads, so 6400% should be the max. So we tried what @sunaurus@lemm.ee had suggested before: we created extra lemmy containers to spread the load. (And extra lemmy-ui containers). And used nginx to load balance between them.

Et voilà. That seems to work.

Also, as suggested by him, we start the lemmy containers with the scheduler disabled, and have 1 extra lemmy running with the scheduler enabled, unused for other stuff.

There will be room for improvement, and probably new bugs, but we’re very happy lemmy.world is now at 0.18.1-rc. This fixes a lot of bugs.

  • wason@lemmy.world
    2·
    1 year ago

    Browser still not working for me. The interface loads but there’s no content. Also can’t login on browser, after entering user and password and clicking login nothing happens.

    • 1024_Kibibytes@lemmy.worldEnglish
      0·
      1 year ago

      I had the same problem on lemm.ee when that admin upgraded it. In my case, it only happened when I was on Firefox on the desktop. It happened because I had Spanish installed as a display language.

      If you have more languages than just English installed in the browser, remove them, close the browser, re-open the browser and see if it works. @https://lemmy.world/u/ruud, If you see this, ask @https://lemm.ee/u/sunaurus what he did to fix the issue on the backend.

      I did a write-up on what I tried. My username is the same on lemmy.world as it is on lemm.ee.

      • wason@lemmy.worldEnglish
        1·
        1 year ago

        Thanks! That was it. I’m using Firefox on Android. Changed language to English (US) and it worked! @ruud@lemmy.world can you please check this issue? using a browser with a default language other than English will result in the page not loading correctly. Workaround is just setting the browser language to English. Thanks!