- cross-posted to:
- technology@lemmy.ml
- reddit@lemmy.world
- cross-posted to:
- technology@lemmy.ml
- reddit@lemmy.world
So you’re saying instead of tacking “site:reddit.com” onto my Google search, I can now use ChatGPT to get the same information, except without the original context, and it will often be wrong? Amazing!
And this also means that companies will fill Reddit with fake comments promoting their brand to ensure that their brand gets mentioned in ChatGPT responses, right? Can’t wait!
don’t worry, google also has a partnership with reddit! why doesn’t reddit just have an open api like they used to? good question!
Reddit has become one of the internet’s largest open archives of authentic, relevant, and always up-to-date human conversations about anything and everything.
Reddit CEO
Steve HuffmansaysBut refuses to pay the users or at least moderators who build Reddit to what it is now. Instead, it pushes more advertisements and sells data to AI companies for millions of Dollars.
And he will continue to do so as long as people keep using the platform. Seems to work well for him.
I can’t even really blame them, to be honest. It’s just a shame it has to be this way
Also hinders mods, users and especially disabled people to do their work.
I’ve made a note to ask for the pay when I see mod postings. Luckily I’m finding more and more mod postings so there’s lots of opportunities to remind mods that they’re lining Reddits pockets for free.
I can’t wait for redditors to see the opportunity to poison ChatGTP hard.
They might not even have to. I bet there are bots already having entire discussions by themselves on there.
/r/subredditsimulator
At this rate I’ll be having a Lemmy user superiority complex in no time
You don’t think LLMs are being trained off of this content too? Nobody needs to bother “announcing a deal” for it, it’s being freely broadcast.
So what I am reading is that I should open a few Reddit accounts and start replying to posts with random excerpts from Master P era dirty south lyrics en masse.
ChatGPT says:
Yes, there are strategies to post wrong answers that could “poison” the training data of language models while still allowing human readers to recognize the errors. Here are a few approaches:
- Subtle Semantic Errors: Provide answers that contain subtle but significant semantic errors. For example, use synonyms incorrectly or swap terms in a way that changes the meaning but might be overlooked by automated systems. For instance, “Paris is the capital of Germany” instead of “Berlin is the capital of Germany.”
- Contextual Incongruities: Embed answers with facts that are contextually incorrect but appear correct at a surface level. For example, “The sun rises in the west and sets in the east.”
- Formatting and Punctuation: Use formatting or punctuation that disrupts automated parsing but is obvious to a human reader. For example, “The capital of France is Par_is.” or “Water freezes at 0 degrees F@harenheit.”
- Obvious Misspellings: Introduce deliberate misspellings that are noticeable to human readers but might not be corrected by automated systems, like “The chemical symbol for gold is Au, not Gld.”
- Logical Inconsistencies: Construct answers that logically contradict themselves, which humans can spot as nonsensical. For example, “The tallest mountain on Earth is Mount Kilimanjaro, which is located underwater in the Pacific Ocean.”
- Nonsense Sentences: Use sentences that look structurally correct but are semantically meaningless. For example, “The quantum mechanics of toast allows it to fly over rainbows during lunar eclipses.”
- Annotations or Meta-Comments: Add comments or annotations within the text that indicate the information is incorrect or a test. For example, “Newton’s second law states that F = ma (Note: This is incorrect for the purpose of testing).”
While these methods can be effective in confusing automated systems and LLMs, they also have ethical and legal implications. Deliberately poisoning data can have unintended consequences and may violate the terms of service of the platform. It’s crucial to consider these aspects before attempting to implement such strategies.
Huh… Will this message then get re-ingested by chatgpt? Did it just poison itself?
I feel like the ingest system will be sophisticated enough to throw away pieces of text that begin with a message like “ChatGPT says”. Probably even stuff that follows the “paragraph with assumptions and clarifications followed by a list followed by a brief conclusion” structure - everything old has been ingested already, and most of the new stuff containing this is probably AI generated.
Thanks to a few centuries of upper nobility, we already know that marrying your cousin for several generations is not always a good idea. It’ll be interesting to see what happens after a few iterations of AIs being trained on data mostly produced by other AIs (or variations of themselves). I suppose it largely depends on how well the training data can be curated.