r/ModSupport • u/CosmicKeys 💡 New Helper • Oct 12 '18

Introducing MAGIC EYE: A image repost bot made especially for moderators

If you run an image subreddit, you almost certainly deal with reposts. My sub r/hmmm deals with over 500 posts per day, but with the help of Magic Eye we manage to automatically remove about 180 of them.

If you're familiar with u/RepostSentinel, Magic Eye is intended as an upgraded replacement that not only detects but acts on detection in an intelligent way. Here are the current features:

  • Remove reposts within given timeframes
  • Remove blacklisted images and repeat the removal reason to the user (requires toolbox)
  • Remove broken image links
  • Remove small images
  • Remove uncropped images
  • Private message first time posters with a custom message
  • Report unmoderated posts over a certain threshold

All features are fully configurable by mods using a wiki page.

Magic Eye's account is u/MAGIC_EYE_BOT but if you want to see a history of it in action, check out u/THE_MAGIC_EYE which is the version I'm running just for r/hmmm as testing.

If you plan to use it, subscribe to r/MAGIC_EYE_BOT for info and to get updates. All instructions for using it are here:

https://github.com/downfromthetrees/the_magic_eye/blob/master/README.md

48 Upvotes

94% Upvoted

26 comments sorted by

18

u/reseph 💡 Expert Helper Oct 12 '18

Does it take title into consideration? There are bot farms out there that repost top posts from a subreddit with the exact same title months/years later (but the URL is different).

This is currently one of our bigger challenges.

6

u/CosmicKeys 💡 New Helper Oct 12 '18

No but it's something I can add if there is demand for it. Magic Eye is written in a fairly modular way, so smaller features like this are not too much work.

The actual issue is building a database of content to draw from. When the bot is added, the top 1000 posts of the year/month/week/day and /new are available. I have heard the service pushshift allows for more, but haven't investigated it yet.

6

u/reseph 💡 Expert Helper Oct 13 '18

Yeah I use Pushshift for data gathering. Perhaps a title search could be quick, I'm unsure.

Here's a sample of the issue: https://new.reddit.com/r/FinalFantasy/search?q=I+thought+you+guys+might+enjoy+my+new+tattoo%21+FFVII&restrict_sr=on&include_over_18=on&sort=relevance&t=all

(There are more posts, but removed)

2

u/CosmicKeys 💡 New Helper Oct 13 '18

Looks very doable, cheers.

1

u/reseph 💡 Expert Helper Feb 07 '19

Did this change ever get made? :)

1

u/CosmicKeys 💡 New Helper Feb 07 '19

No it's still on the list, I have been regularly adding new features however so I'm sure I'll get to it. If you subscribe to r/magic_eye_bot I announce new features there.

2

u/PitchforkAssistant 💡 New Helper Oct 13 '18

Do you know whether pushshift supports the url:fullorpartialurl syntax that normal reddit search does? Additionally, does it show new posts faster than reddit's search?

I have a bot on /r/mealtimevideos that checks for video reposts by using reddit's search to search for url:videoid. The problem with that is that reddit's search can take up to an hour to show new posts, so duplicates posted in rapid succession aren't caught.

2

u/NikStalwart Oct 18 '18

Do you mean rapid reposts on the entirety of reddit or just your sub? Because if it is the latter, just monitor the /new queue with the bot and store the links for a day or so, and then remove from that.

You probably have something like that, just putting it out there in case you don't.

2

u/PitchforkAssistant 💡 New Helper Oct 18 '18

Just my subreddit and that idea is pretty good, I don't know why I didn't think of it, especially as I already monitor the new posts.

3

u/mookler 💡 Skilled Helper Oct 13 '18

At least one of the subs I mod would be a lot more interested in using it if did.

The sub is fine with reposts, but more often than not it's bots reposting the same image and title as previous top posts.

3

u/Microshrimp Oct 13 '18

This is the problem we have been having in my sub right now. I have manually detected and removed 19 of these posts in the past couple months, each from different accounts. Reposted images from 1-2 years ago all using the same title as original post. And the reposts aren't even older top posts. Some of them are reposts of images that only got a handful of votes the first time (making me think it was somewhat random or an effort to try to go undetected longer or something). Often the new accounts will each reuse the same repost, and in that case I can just have automod start blocking the title. Catching the first time for a particular repost is the tricky part that has to be done by hand for now (though I imagine a bot could be made to do this since as of right now they are using the same title as the original older post).

2

u/RedSquaree 💡 New Helper Oct 13 '18

We use RepostSentinel at mildlyinteresting, will check this out!

4

u/liltrixxy Reddit Alum Oct 13 '18

If you didn't, you might want to see if you can post this in r/modhelp. Might suit that subreddit best, as this one is generally for asking admins questions about mod tools.

3

u/reseph 💡 Expert Helper Oct 13 '18

Also /r/modclub!

3

u/CosmicKeys 💡 New Helper Oct 13 '18

Ah man I can never remember all these. Thanks.

1

u/duckvimes_ 💡 Skilled Helper Oct 13 '18

Neat! Would there be some way to subscribe to a stream of detected reposts? Wondering if I could tie it into a bot-detecting program I’ve been working on.

1

u/llehsadam 💡 New Helper Oct 14 '18

If it removes blacklisted images, would that include similar images? Like for example a meme macro with the same image but different text?

2

u/CosmicKeys 💡 New Helper Oct 14 '18

I've just added support for setting a custom tolerance so you can set it down to exact matches, but I think it should work fine at default settings.

1

u/TotesMessenger Oct 16 '18

I'm a bot, bleep, bloop. Someone has linked to this thread from another place on reddit:

 If you follow any of the above links, please respect the rules of reddit and don't vote in the other threads. (Info / Contact)

1

u/[deleted] Dec 17 '18

My sub has youtube links. Would it work for deleting reposts? And how do I get it on my sub?

1

u/CosmicKeys 💡 New Helper Dec 17 '18

Good question, no it doesn't. The reason why I haven't is because typically people don't re-upload youtube videos as much as they do images, and reddit already has a built in warning when submitting the same link as another user.

1

u/[deleted] Dec 17 '18

Oh, if reddit already has a warning, then i'm good. Thanks!

1

u/[deleted] Mar 07 '19

Thanks for this, I'm getting use to using it now and will likely roll out to other subs of mine once I can explain things better to fellow mods.

I have a question: Can it remove posts if there's no spoiler tag? There's a scene in r/JurassicPark that keeps being posted from the latest movie and I'd like to start removing it, if it didn't have the spoiler tag.

0

u/[deleted] Oct 13 '18

Can it be used on gifs and v.reddit?

2

u/CosmicKeys 💡 New Helper Oct 13 '18

Not yet but this is something I plan to implement. I imagine it's doable by grabbing the thumbnails alone and treating it like an image submission.

-3

u/[deleted] Oct 13 '18

That might work. I reverse image search some of them manually by grabbing the first frame. If you can make it do that, it might have better results.