Firstly, I really do apologise!
CompuVerse has been down for a number of hours now, and I'm really sorry.
I'll be 100% transparent on this, the server ran out of disk space!
This sent it into a sort of "safe mode", which unfortunately took down CompuVerse.
I have migrated all image storage over to an external server with a large amount more storage.
However, even with this, just the text content and metadata for CompuVerse is still rather large.
I'm going to investigate solutions but am averse to running a DB server over mounted storage as this is very susceptible to latency and speeds.
By my approximations we have around 2 months' worth of disk space remaining now that Pictrs is removed. I'm looking for solutions in the meantime that will balance performance and cost effectively.
Image compression maybe coule be one solution to consider. However compressing even more already compressed images isn't easy.
A hug drawback would be loosing quality.
There is also the webp format, maybe. It is more efficient than JPG for the same quality.
However I am not sure if it is possible to automate the conversion to webp and if apps and browsers will support it.
Webp has been used for a pretty long time now on the Web, so most browsers should be able to support it. (webp can be lossy and lossless)
Using Webp lossless may allow to save a bit more space than just keeping the jpg/png images as is, while still keeping the quality of the original uploaded image.
Usung Webp lossy would degrade slightly the image compared to the original upload (quality degradation would depend on the chosen quality level for compression and the orignal image as JPG is already lossy). However it will same more space than using the lossless mode.
This would not be the only solution, and is only what I know, more research on the compression formats is needed.
With the downtimes and issues to solve that will come in the future, maybe it would be interesting to create a mastodon or similar fediverse compatible account to post about updates and issues for the server.
I've seen others mention how much storage Lemmy uses. Frankly their numbers seem staggering to me. Gigabytes per day? Of mostly text? That seems an unsustainable rate, ripe for optimization. I'm really hoping there will be something done to minimize that in the next couple of months.
If you end up needing donations, don't be afraid to ask. I can't speak for others, but I have no pr9boem paying for services I like to use.
The storage required for lemmy is indeed quite significant!
I have no doubt further optimisations could be done there, but at present it's an unfortunate truth that lemmy likes its storage!
So far it's eaten 21GB of database space in less than 2 months, and again, that's all text!
I'm a software developer and my largest production database I've ever had has only been around 100GB after around 15 years of usage.
Posts and messages from hundreds of thousands of users globally just take a lot of space I guess haha! (Though it would be nice if lemmy only cached remote posts for say, a day or a week, and then wiped the content from its local cache and called out to the remote server thereafter)
I'm very averse to asking for donations! I don't want anyone to have to pay to access CompuVerse, and donations, whilst greatly appreciated would feel wrong to take. Plus there's then further complications regarding how to receive said donations, any taxes involved etc. etc. which I quite frankly can't be bothered to deal with haha!
I really do want to avoid taking donations if at all possible :)
So every instance of Lemmy has a copy of every other instance, used for caching and faster access? That's a surprising design choice.
Does the data get copied to your server when one of the CompuVerse users views it, or does everything from all of Lemmy get copied without any interaction?