LLMs are surprisingly great at compressing images and audio, DeepMind researchers find
LLMs are surprisingly great at compressing images and audio, DeepMind researchers find
Despite being primarily trained on text, these models achieved remarkable compression rates on image and audio data.
![[News] LLMs are surprisingly great at compressing images and audio, DeepMind researchers find](https://lemmy.world/pictrs/image/d59413ab-6193-4712-95fd-b6d3447cb41e.png?format=webp&thumbnail=196)
You're viewing a single thread.
I wonder how consistent is the decompression and how much information is lost in the process.
i’d guess they could hyper optimise for “perceived difference” rather than data loss specifically… they do a pretty good job of generating something from nothing, so i’d say with enough data they’d probably generate a pretty reasonable facsimile of “standard” stuff
An LLM can't know what difference a person has perceived.
There have been a lot of studies done (and published) on what humans can and can't perceive. I wouldn't have much trouble believing that the LLM has access to them and can pattern match on the variables involved.
It's lossless: https://arxiv.org/pdf/2309.10668.pdf