Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Brand Logo

agnos.is Forums

  1. Home
  2. Technology
  3. Cloudflare announces AI Labyrinth, which uses AI-generated content to confuse and waste the resources of AI Crawlers and bots that ignore “no crawl” directives.

Cloudflare announces AI Labyrinth, which uses AI-generated content to confuse and waste the resources of AI Crawlers and bots that ignore “no crawl” directives.

Scheduled Pinned Locked Moved Technology
technology
217 Posts 129 Posters 1.3k Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • H [email protected]

    My dude, they'll literally sell services to both sides of the market.

    D This user is from outside of this forum
    D This user is from outside of this forum
    [email protected]
    wrote on last edited by
    #88

    I...uh...frick.

    1 Reply Last reply
    0
    • L [email protected]

      The article says it's not poisoning the AI data, only providing valid facts. The scraper still gets content, just not the content it was aiming for.

      O This user is from outside of this forum
      O This user is from outside of this forum
      [email protected]
      wrote on last edited by
      #89

      Until the AI generating the content starts hallucinating.

      1 Reply Last reply
      0
      • tea@programming.devT [email protected]
        This post did not contain any content.
        ? Offline
        ? Offline
        Guest
        wrote on last edited by
        #90

        Why do I have the feeling that I will end up in that nightmare with my privacy focused and ad-free Browser setup. I already end up in captcha hell too often because of it.

        D 1 Reply Last reply
        0
        • A [email protected]

          We want names

          blackmist@feddit.ukB This user is from outside of this forum
          blackmist@feddit.ukB This user is from outside of this forum
          [email protected]
          wrote on last edited by
          #91

          https://www.404media.co/developer-creates-infinite-maze-to-trap-ai-crawlers-in/

          1 Reply Last reply
          0
          • F [email protected]

            Cloudflare kind of real for this. I love it.

            It makes perfect sense for them as a business, infinite automated traffic equals infinite costs and lower server stability, but at the same time how often do giant tech companies do things that make sense these days?

            O This user is from outside of this forum
            O This user is from outside of this forum
            [email protected]
            wrote on last edited by
            #92

            Kind of seems like they simply installed this dude's tarpit from a few months ago

            https://zadzmo.org/code/nepenthes/

            1 Reply Last reply
            0
            • O [email protected]

              So the web is a corporate war zone now and you can choose feudal protection or being attacked from all sides. What a time to be alive.

              T This user is from outside of this forum
              T This user is from outside of this forum
              [email protected]
              wrote on last edited by
              #93

              There is also the corpo verified id route. In order to avoid the onslaught of AI bots and all that comes with them you'll need to sacrifice freedom, anonymity, and privacy like a good little peasant to prove you aren't a bot.. and so will everyone else. You'll likely be forced to deal with whatever AI bots are forced upon you while within the walls but better an enemy you know I guess?

              1 Reply Last reply
              0
              • baltakatei@sopuli.xyzB [email protected]

                Relevant excerpt from part 11 of Anathem (2008) by Neal Stephenson:

                ::: spoiler Artificial Inanity
                Note: Reticulum=Internet, syndev=computer, crap~=spam

                “Early in the Reticulum—thousands of years ago—it became almost useless because it was cluttered with faulty, obsolete, or downright misleading information,” Sammann said.

                “Crap, you once called it,” I reminded him.

                “Yes—a technical term. So crap filtering became important. Businesses were built around it. Some of those businesses came up with a clever plan to make more money: they poisoned the well. They began to put crap on the Reticulum deliberately, forcing people to use their products to filter that crap back out. They created syndevs whose sole purpose was to spew crap into the Reticulum. But it had to be good crap.”

                “What is good crap?” Arsibalt asked in a politely incredulous tone.

                “Well, bad crap would be an unformatted document consisting of random letters. Good crap would be a beautifully typeset, well-written document that contained a hundred correct, verifiable sentences and one that was subtly false. It’s a lot harder to generate good crap. At first they had to hire humans to churn it out. They mostly did it by taking legitimate documents and inserting errors—swapping one name for another, say. But it didn’t really take off until the military got interested.”

                “As a tactic for planting misinformation in the enemy’s reticules, you mean,” Osa said. “This I know about. You are referring to the Artificial Inanity programs of the mid–First Millennium A.R.”

                “Exactly!” Sammann said. “Artificial Inanity systems of enormous sophistication and power were built for exactly the purpose Fraa Osa has mentioned. In no time at all, the praxis leaked to the commercial sector and spread to the Rampant Orphan Botnet Ecologies. Never mind. The point is that there was a sort of Dark Age on the Reticulum that lasted until my Ita forerunners were able to bring matters in hand.”

                “So, are Artificial Inanity systems still active in the Rampant Orphan Botnet Ecologies?” asked Arsibalt, utterly fascinated.

                “The ROBE evolved into something totally different early in the Second Millennium,” Sammann said dismissively.

                “What did it evolve into?” Jesry asked.

                “No one is sure,” Sammann said. “We only get hints when it finds ways to physically instantiate itself, which, fortunately, does not happen that often. But we digress. The functionality of Artificial Inanity still exists. You might say that those Ita who brought the Ret out of the Dark Age could only defeat it by co-opting it. So, to make a long story short, for every legitimate document floating around on the Reticulum, there are hundreds or thousands of bogus versions—bogons, as we call them.”

                “The only way to preserve the integrity of the defenses is to subject them to unceasing assault,” Osa said, and any idiot could guess he was quoting some old Vale aphorism.

                “Yes,” Sammann said, “and it works so well that, most of the time, the users of the Reticulum don’t know it’s there. Just as you are not aware of the millions of germs trying and failing to attack your body every moment of every day. However, the recent events, and the stresses posed by the Antiswarm, appear to have introduced the low-level bug that I spoke of.”

                “So the practical consequence for us,” Lio said, “is that—?”

                “Our cells on the ground may be having difficulty distinguishing between legitimate messages and bogons. And some of the messages that flash up on our screens may be bogons as well.”
                :::

                T This user is from outside of this forum
                T This user is from outside of this forum
                [email protected]
                wrote on last edited by
                #94

                Read Anathema last year, really enjoyed it!

                1 Reply Last reply
                0
                • tea@programming.devT [email protected]
                  This post did not contain any content.
                  C This user is from outside of this forum
                  C This user is from outside of this forum
                  [email protected]
                  wrote on last edited by
                  #95

                  I introduce to you, the Trace Buster Buster!

                  https://youtu.be/Iw3G80bplTg

                  If you've never seen the movie The Big Hit, it's great.

                  1 Reply Last reply
                  0
                  • ? Guest

                    So here's a little bit of lemmy lore for you. You're instance lemmy.ml is considered to be a tankie instance by some users. lemmy.dbzer0.com is an anarchist instance. The user you responded to probably made a generalisation based on this and assumed you were familiar with anarchist/communist/socialist/leftist discourse. From this comment I assume they were wrong.

                    So on behalf of no-one but myself: Hello! Welcome to Anarchism! The belief that authority should not exist. This belief comes from a lot of different places and wears a lot of different faces. Most short explanations aren't sufficient and long explanation bore most. If you don't mind a little learning here is a link: https://anarchistfaq.org/afaq/sectionA.html#seca1 and another one https://crimethinc.com/2016/09/28/feature-the-secret-is-to-begin-getting-started-further-resources-frequently-asked-questions#faq or if you like videos: https://youtu.be/lrTzjaXskUU.

                    Also a little bit about authority: people use authority to mean many things (this is even bought up in the video I linked above). But as far as anarchists are concerned (in general (no specific statement can be made about a group so vast)) authority is the act of coercing people to follow orders or commit involuntary acts. You're boss can coerce you to neglect your health by threatening to fire you. Your government can force you to obey gender roles by threatening to jail you. A rich person can make you do whatever demeaning thing they want by dangling money in front of you (for reference see mrbeast) because otherwise your landlord will kick you out. This is authority and it is wrong. Those in authority can make mistakes, become greedy and start to think they have the power to do whatever they want (mostly because they can). This leads to suffering. My meaning of life is to minimise suffering. Anarchy is the belief that no-one should hold power over others. That all leadership should be scrutinised. It rejects blind faith in single people and encourages to think for yourself so no-one can do you wrong. And if you can't be bothered, it encourages you to find people who genuinely care about you and let them stand up for you.

                    morrowind@lemmy.mlM This user is from outside of this forum
                    morrowind@lemmy.mlM This user is from outside of this forum
                    [email protected]
                    wrote on last edited by
                    #96

                    Thanks, I don't really care for generalizing instances and didn't really have a choice when I made my account.

                    But also your definition is impossibly broad as you well and I'm pretty sure not the general consensus. The video doesn't define it as such either.

                    For one thing, by your definition we can have absolutely no meaningful human relationships. I can explain this more later when I have time if you don't see what I mean

                    ? ? 2 Replies Last reply
                    0
                    • baltakatei@sopuli.xyzB [email protected]

                      Relevant excerpt from part 11 of Anathem (2008) by Neal Stephenson:

                      ::: spoiler Artificial Inanity
                      Note: Reticulum=Internet, syndev=computer, crap~=spam

                      “Early in the Reticulum—thousands of years ago—it became almost useless because it was cluttered with faulty, obsolete, or downright misleading information,” Sammann said.

                      “Crap, you once called it,” I reminded him.

                      “Yes—a technical term. So crap filtering became important. Businesses were built around it. Some of those businesses came up with a clever plan to make more money: they poisoned the well. They began to put crap on the Reticulum deliberately, forcing people to use their products to filter that crap back out. They created syndevs whose sole purpose was to spew crap into the Reticulum. But it had to be good crap.”

                      “What is good crap?” Arsibalt asked in a politely incredulous tone.

                      “Well, bad crap would be an unformatted document consisting of random letters. Good crap would be a beautifully typeset, well-written document that contained a hundred correct, verifiable sentences and one that was subtly false. It’s a lot harder to generate good crap. At first they had to hire humans to churn it out. They mostly did it by taking legitimate documents and inserting errors—swapping one name for another, say. But it didn’t really take off until the military got interested.”

                      “As a tactic for planting misinformation in the enemy’s reticules, you mean,” Osa said. “This I know about. You are referring to the Artificial Inanity programs of the mid–First Millennium A.R.”

                      “Exactly!” Sammann said. “Artificial Inanity systems of enormous sophistication and power were built for exactly the purpose Fraa Osa has mentioned. In no time at all, the praxis leaked to the commercial sector and spread to the Rampant Orphan Botnet Ecologies. Never mind. The point is that there was a sort of Dark Age on the Reticulum that lasted until my Ita forerunners were able to bring matters in hand.”

                      “So, are Artificial Inanity systems still active in the Rampant Orphan Botnet Ecologies?” asked Arsibalt, utterly fascinated.

                      “The ROBE evolved into something totally different early in the Second Millennium,” Sammann said dismissively.

                      “What did it evolve into?” Jesry asked.

                      “No one is sure,” Sammann said. “We only get hints when it finds ways to physically instantiate itself, which, fortunately, does not happen that often. But we digress. The functionality of Artificial Inanity still exists. You might say that those Ita who brought the Ret out of the Dark Age could only defeat it by co-opting it. So, to make a long story short, for every legitimate document floating around on the Reticulum, there are hundreds or thousands of bogus versions—bogons, as we call them.”

                      “The only way to preserve the integrity of the defenses is to subject them to unceasing assault,” Osa said, and any idiot could guess he was quoting some old Vale aphorism.

                      “Yes,” Sammann said, “and it works so well that, most of the time, the users of the Reticulum don’t know it’s there. Just as you are not aware of the millions of germs trying and failing to attack your body every moment of every day. However, the recent events, and the stresses posed by the Antiswarm, appear to have introduced the low-level bug that I spoke of.”

                      “So the practical consequence for us,” Lio said, “is that—?”

                      “Our cells on the ground may be having difficulty distinguishing between legitimate messages and bogons. And some of the messages that flash up on our screens may be bogons as well.”
                      :::

                      codexarcanum@lemmy.dbzer0.comC This user is from outside of this forum
                      codexarcanum@lemmy.dbzer0.comC This user is from outside of this forum
                      [email protected]
                      wrote on last edited by
                      #97

                      One of my favorite books! Great world building and quite thought provoking!

                      1 Reply Last reply
                      0
                      • M [email protected]

                        Be great if these reinforced facts.

                        Earth us an imperfect sphere.

                        Humans landed on moon.

                        Taiwan is an independent nation.

                        M This user is from outside of this forum
                        M This user is from outside of this forum
                        [email protected]
                        wrote on last edited by
                        #98

                        *imperfect oblate spheroid

                        M 1 Reply Last reply
                        0
                        • F [email protected]

                          Vote Blue No Matter Who

                          Any Democrat is Better than Any Republican

                          L This user is from outside of this forum
                          L This user is from outside of this forum
                          [email protected]
                          wrote on last edited by
                          #99

                          In my country blue is conservatives... But I agree with the sentiment! It worked for California, it can work for your country, let the Dems stop fearing they lose elections, give them comfortable margins and then massively support progressives who can bring in the good stuff, they won't have a chance if the party core thinks the very future of elections is on the line, but if they think they'll likely win anyway, you might just be able to push through a progressive candidate and end the Neoliberal decay.

                          F K 2 Replies Last reply
                          0
                          • L [email protected]

                            In my country blue is conservatives... But I agree with the sentiment! It worked for California, it can work for your country, let the Dems stop fearing they lose elections, give them comfortable margins and then massively support progressives who can bring in the good stuff, they won't have a chance if the party core thinks the very future of elections is on the line, but if they think they'll likely win anyway, you might just be able to push through a progressive candidate and end the Neoliberal decay.

                            F This user is from outside of this forum
                            F This user is from outside of this forum
                            [email protected]
                            wrote on last edited by
                            #100

                            It's so rare to get positive reinforcement like this, these days. Thank you.

                            1 Reply Last reply
                            0
                            • M [email protected]

                              *imperfect oblate spheroid

                              M This user is from outside of this forum
                              M This user is from outside of this forum
                              [email protected]
                              wrote on last edited by
                              #101

                              Thank you. I have updated my post.

                              1 Reply Last reply
                              0
                              • morrowind@lemmy.mlM [email protected]

                                Thanks, I don't really care for generalizing instances and didn't really have a choice when I made my account.

                                But also your definition is impossibly broad as you well and I'm pretty sure not the general consensus. The video doesn't define it as such either.

                                For one thing, by your definition we can have absolutely no meaningful human relationships. I can explain this more later when I have time if you don't see what I mean

                                ? Offline
                                ? Offline
                                Guest
                                wrote on last edited by
                                #102

                                sorry, assumed from combination of comment+instance.

                                you can totally have human relationships! you just try to base things on consent. it's hard to see from here, because everything is so steeped in fuckery, and it's like trying to imagine slack in a system where a thousand things are keeping the same thing under high tension, but it does tend to work when the forces of oppression briefly collapse.

                                'a paradise born in hell' by solnit goes into how it tends to emerge during disaster recovery, and how centralized authoritarian responses tend to... not help so much, if at all.

                                1 Reply Last reply
                                0
                                • morrowind@lemmy.mlM [email protected]

                                  I.. Don't think I've heard anyone claim authority shouldn't exist.

                                  ? Offline
                                  ? Offline
                                  Guest
                                  wrote on last edited by
                                  #103

                                  glad to offer you a new experience.

                                  1 Reply Last reply
                                  0
                                  • A [email protected]

                                    Not who you responded to but yeah I want to hear a drug fuelled rant I don't even care what topic

                                    ? Offline
                                    ? Offline
                                    Guest
                                    wrote on last edited by
                                    #104

                                    then don't ask for that version, dear. I did say 'by request'.

                                    A 1 Reply Last reply
                                    0
                                    • buelldozer@lemmy.todayB [email protected]

                                      and try to slam your site with like 200+ requests per second

                                      Your solution would do nothing to stop the crawlers that are operating 10ish rps. There's ones out there operating at a mere 2rps but when multiple companies are doing it at the same time 24x7x365 it adds up.

                                      Some incredibly talented people have been battling this since last year and your solution has been tried multiple times. It's not effective in all instances and can require a LOT of manual intervention and SysAdmin time.

                                      https://thelibre.news/foss-infrastructure-is-under-attack-by-ai-companies/

                                      ? Offline
                                      ? Offline
                                      Guest
                                      wrote on last edited by
                                      #105

                                      Yep. After you ban all the easy to spot ones you're still left with far too many hard to ID bots. At least if your site is popular and large.

                                      1 Reply Last reply
                                      0
                                      • D [email protected]

                                        the used market

                                        ? Offline
                                        ? Offline
                                        Guest
                                        wrote on last edited by
                                        #106

                                        so you're saying it's a niche toy you can get if you really want one, but nobody's pushing that shit on you, and if you never want to talk about one again in your life, you can probably do that?

                                        I would like if large language models were in this position. I don't think you understand the degree to which our productive capacity and infrastructure are committed to this technology. it's a lot. basically all the cutting edge computer chips being made are specialist chips for processing large (whatever) models, including the engineering to back it. that means everything else is bumped down a generation or five.

                                        then there's the amount of electricity being put towards these things-we are in a climate disaster, we do not have green energy, and these things are drawing in the high GW/low TW of energy.

                                        water is also a lot more precarious than a lot of people want to think about. these things are using lots and lots of good drinkable water to cool those specialist chips, then just being throws out, because I assume it's cheaper than cooling the hot water back down.

                                        if these things didn't ruin the internet, and were just something you ran on the beefy desktop you otherwise use for games, I wouldn't mind, but that's not where we are.

                                        1 Reply Last reply
                                        0
                                        • tea@programming.devT [email protected]
                                          This post did not contain any content.
                                          ? Offline
                                          ? Offline
                                          Guest
                                          wrote on last edited by
                                          #107

                                          And soon, the already AI-flooded net will be filled with so much nonsense that it becomes impossible for anyone to get some real work done. Sigh.

                                          C 1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups