Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Brand Logo

agnos.is Forums

  1. Home
  2. Technology
  3. Cloudflare announces AI Labyrinth, which uses AI-generated content to confuse and waste the resources of AI Crawlers and bots that ignore “no crawl” directives.

Cloudflare announces AI Labyrinth, which uses AI-generated content to confuse and waste the resources of AI Crawlers and bots that ignore “no crawl” directives.

Scheduled Pinned Locked Moved Technology
technology
217 Posts 129 Posters 1.3k Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • D [email protected]

    Surprised at the level of negativity here. Having had my sites repeatedly DDOSed offline by Claudebot and others scraping the same damned thing over and over again, thousands of times a second, I welcome any measures to help.

    A This user is from outside of this forum
    A This user is from outside of this forum
    [email protected]
    wrote on last edited by
    #126

    I think the negativity is around the unfortunate fact that solutions like this shouldn't be necessary.

    1 Reply Last reply
    0
    • gmtom@lemmy.worldG [email protected]

      "I used the AI to destroy the AI"

      C This user is from outside of this forum
      C This user is from outside of this forum
      [email protected]
      wrote on last edited by
      #127

      We had to kill the internet, to save the internet.

      A 1 Reply Last reply
      0
      • K [email protected]

        Burning 29 acres of rainforest a day to do nothing

        C This user is from outside of this forum
        C This user is from outside of this forum
        [email protected]
        wrote on last edited by
        #128

        Bitcoin?

        1 Reply Last reply
        0
        • ? Guest

          You have Thirteen hours in which to solve this labyrinth before your baby AI becomes one of us, forever.

          C This user is from outside of this forum
          C This user is from outside of this forum
          [email protected]
          wrote on last edited by
          #129

          While AI David Bowie sings you rock lullabies.

          1 Reply Last reply
          0
          • ? Guest

            And soon, the already AI-flooded net will be filled with so much nonsense that it becomes impossible for anyone to get some real work done. Sigh.

            C This user is from outside of this forum
            C This user is from outside of this forum
            [email protected]
            wrote on last edited by
            #130

            Some of us are only here to crank hog.

            1 Reply Last reply
            0
            • cilethesane@lemmy.caC [email protected]

              Because it's not AI, it's LLMs, and all LLMs do is guess what word most likely comes next in a sentence. That's why they are terrible at answering questions and do things like suggest adding glue to the cheese on your pizza because somewhere in the training data some idiot said that.

              The training data for LLMs come from the internet, and the internet is full of idiots.

              M This user is from outside of this forum
              M This user is from outside of this forum
              [email protected]
              wrote on last edited by
              #131

              That's what I do too with less accuracy and knowledge. I don't get why I have to hate this. Feels like a bunch of cavemen telling me to hate fire because it might burn the food

              cilethesane@lemmy.caC 1 Reply Last reply
              0
              • explodicle@sh.itjust.worksE [email protected]

                Because it only harms bots that ignore the "no crawl" directive, so your AI remains uncensored.

                M This user is from outside of this forum
                M This user is from outside of this forum
                [email protected]
                wrote on last edited by
                #132

                Good I ignore that too. I want to towards a world where information is shared. I can get behind the

                W E explodicle@sh.itjust.worksE 3 Replies Last reply
                0
                • tea@programming.devT [email protected]
                  This post did not contain any content.
                  C This user is from outside of this forum
                  C This user is from outside of this forum
                  [email protected]
                  wrote on last edited by
                  #133

                  Now that's an ai I can get behind

                  1 Reply Last reply
                  0
                  • C [email protected]

                    We had to kill the internet, to save the internet.

                    A This user is from outside of this forum
                    A This user is from outside of this forum
                    [email protected]
                    wrote on last edited by
                    #134

                    We have to kill the Internet, to save humanity.

                    1 Reply Last reply
                    0
                    • M [email protected]

                      Good I ignore that too. I want to towards a world where information is shared. I can get behind the

                      W This user is from outside of this forum
                      W This user is from outside of this forum
                      [email protected]
                      wrote on last edited by
                      #135

                      don't worry, information is still shared. but with people. not with capitalist pigs

                      M 1 Reply Last reply
                      0
                      • M [email protected]

                        Good I ignore that too. I want to towards a world where information is shared. I can get behind the

                        E This user is from outside of this forum
                        E This user is from outside of this forum
                        [email protected]
                        wrote on last edited by
                        #136

                        That's not what the no follow command means

                        1 Reply Last reply
                        0
                        • tea@programming.devT [email protected]
                          This post did not contain any content.
                          B This user is from outside of this forum
                          B This user is from outside of this forum
                          [email protected]
                          wrote on last edited by
                          #137

                          I guess this is what the first iteration of the Blackwall looks like.

                          owl@infosec.pubO 1 Reply Last reply
                          0
                          • F [email protected]

                            Vote Blue No Matter Who

                            Any Democrat is Better than Any Republican

                            T This user is from outside of this forum
                            T This user is from outside of this forum
                            [email protected]
                            wrote on last edited by
                            #138

                            Plenty of Democrats are voting to put trump nominees in office, plenty are voting on partisan spending bills. The CR vote should tip you off that any democrat is not better than any republican.... half of them are complicit too. 10 Senate Dems just financed this authoritarian takeover.

                            F 1 Reply Last reply
                            0
                            • ? Guest

                              nothing can be improved while capitalism or authority exist; all improvement will be seized and used to oppress.

                              quarterswede@lemmy.worldQ This user is from outside of this forum
                              quarterswede@lemmy.worldQ This user is from outside of this forum
                              [email protected]
                              wrote on last edited by
                              #139

                              The problem you aren’t recognizing is that, until humans are no longer driven by self preservation, there will always be oppression in any system. They all have and will continue to breakdown. It’s easy to blame capitalism but even socialist systems eventually cave under the weight of greed and power. We are the problem mon frère.

                              ? 1 Reply Last reply
                              0
                              • L [email protected]

                                The article says it's not poisoning the AI data, only providing valid facts. The scraper still gets content, just not the content it was aiming for.

                                X This user is from outside of this forum
                                X This user is from outside of this forum
                                [email protected]
                                wrote on last edited by
                                #140

                                Thank you for catching that. Even reading through again, I couldn't find it while skimming. With the mention of X2 and RSS, I assumed that paragraph would just be more technical description outside my knowledge. Instead, what I did hone in on was

                                "No real human would go four links deep into a maze of AI-generated nonsense."

                                Leading me to be pessimistic.

                                1 Reply Last reply
                                0
                                • ? Guest

                                  if you're dumb enough to trust a large language model because someone told you "iTs Ai!" no amount of facts will be of great utility to you.

                                  X This user is from outside of this forum
                                  X This user is from outside of this forum
                                  [email protected]
                                  wrote on last edited by
                                  #141

                                  That take would be more digest able if I wasn't stuck on the same planet as those people.

                                  ? 1 Reply Last reply
                                  0
                                  • dave@lemmy.nzD [email protected]

                                    In terms of Lemmy instances, if your instance is behind cloudflare and you turn on AI protection, federation breaks. So their tools are not very helpful for fighting the AI scraping.

                                    appoxo@lemmy.dbzer0.comA This user is from outside of this forum
                                    appoxo@lemmy.dbzer0.comA This user is from outside of this forum
                                    [email protected]
                                    wrote on last edited by
                                    #142

                                    Can't you configure exceptions for behaviours?

                                    1 Reply Last reply
                                    0
                                    • tea@programming.devT [email protected]
                                      This post did not contain any content.
                                      S This user is from outside of this forum
                                      S This user is from outside of this forum
                                      [email protected]
                                      wrote on last edited by
                                      #143

                                      I’m imagining a sci-fi spin on this where AI generators are used to keep AI crawlers in a loop, and they accidentally end up creating some unique AI culture or relationship in the process.

                                      1 Reply Last reply
                                      0
                                      • B [email protected]

                                        I guess this is what the first iteration of the Blackwall looks like.

                                        owl@infosec.pubO This user is from outside of this forum
                                        owl@infosec.pubO This user is from outside of this forum
                                        [email protected]
                                        wrote on last edited by
                                        #144

                                        Gotta say "AI Labyrinth" sounds almost as cool.

                                        1 Reply Last reply
                                        0
                                        • T [email protected]

                                          Plenty of Democrats are voting to put trump nominees in office, plenty are voting on partisan spending bills. The CR vote should tip you off that any democrat is not better than any republican.... half of them are complicit too. 10 Senate Dems just financed this authoritarian takeover.

                                          F This user is from outside of this forum
                                          F This user is from outside of this forum
                                          [email protected]
                                          wrote on last edited by
                                          #145

                                          Not a single Democrat voted to confirm Hegseth and 3 Republicans also didnt but he still got confirmed.

                                          Every single Democrat was present and voted no for the Budget which passed the House and it still passed.

                                          Even if 10 dems voted not to shutdown government and enter congressional recess, the CR only exists because Republicans wrote it and won't compromise.

                                          Any Democrat is Better than Any Republican.

                                          T 1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups