Any RSS services with deduplication?
Any RSS services with deduplication?
I’m getting around to setting up and trying to use RSS for the first time. I like it so far, except for one thing, the time efficiency of it. When there is a new story picked up by all outlets I have to hit mark read 5+ times for near identical copy/pastes of the same story.
Currently using miniflux but wasn’t sure if there where any other solutions. Honestly almost has me considering just spending $5/mo for a paid service like Inoreader or Feedly since deduplication is a big feature they advertise. Main thing stopping me is the fact they don’t index sites without RSS that I use RSS-Bridge for such as AP News, and I’m hesitant to share my selfhosted RSS-Bridge URLs with a public site.
I thought AP news had an RSS feed
Nope, unfortunately a lot of places now a days either don’t, are dropping support for it, or just don’t have good options. They want you on dem apps $$.
Fortunately tools like RSS-Bridge and RSShub make it an easy fix.
I don't know about dedup, but, freshrss is pretty good for a self hosted solution.
Honestly FreshRSS is pretty trash. Don't understand why it's so popular.
This is 10x better https://github.com/ssddanbrown/rss
Eh,
When you have 50+ feeds, it has a lot of handy features.
Like... blacklisting posts with keywords/regex, tracking things in categories, etc... And- it has a TON of options for configuring things.
The ability to whitelist/blacklist certain posts is quite handy itself. For example- taking a feed like This one and being able to only grab the "update / releases", and ignore all of the sales, giveaways, and other crap.
The uh, configuration options for the reader you linked are pretty limited in comparison.
Although, it does look nice, its missing the features to boot.
I deal with this by subscribing to very few mainstream media sources since they typically report the same thing in unison with slight variation. The slight variation makes deduplication technically difficult. I use Nextcloud News, and maybe their future LLM models could accomplish this.