I'm working on a TL;DR bot for Lemmy, powered by GPT-3.5
It's coming along nicely, I hope I'll be able to release it in the next few days.
Screenshot:
How It Works:
I am a bot that generates summaries of Lemmy comments and posts.
Just mention me in a comment or post, and I will generate a summary for you.
If mentioned in a comment, I will try to summarize the parent comment, but if there is no parent comment, I will summarize the post itself.
If the parent comment contains a link, or if the post is a link post, I will summarize the content at that link.
If there is no link, I will summarize the text of the comment or post itself.
Extra Info in Comments:
Prompt Injection:
Of course it's really easy (but mostly harmless) to break it using prompt injection:
It will only be available in communities that explicitly allow it. I hope it will be useful, I'm generally very satisfied with the quality of the summaries.
I limited it to 100 summaries / day, which adds up to about $20 (USD) per month if the input is 3000 tokens long and the answer is 1000.
Using it for personal things (I buildt a personal assistant chatbot for myself) is very cheap. But if you use it in anything public, it can get expensive quickly.
Have you considered using a self-hosted instance of GPT4All? It's not as powerful, but for something like summarizing an article it could be plenty - And importantly, much, much cheaper.
This is a great idea! What if there's a post about, say, a movie review, then it includes a link to the movie's imdb or letterboxd. Would it summarized the link instead of the review?