Tag: web – crawling

  • Perplexity is a bull’shit machine

    Perplexity is a bull’shit machine

    Hacker Robb Knight’s web-crawling app, ‘Perplexity Artificial Intelligence’, has been accused of violating the’Robots Exclusion Protocol’. Knight claimed his app would scrape websites it doesn’t want bots to visit, despite claiming that it won’t. WIRED’s Kate Knibbs said, “We’ve never seen anything like this in our lives.” Knight claimed that ‘Common Crawl’ was behind his…