Restrictions don't apply to current OpenAI models, but will affect future versions.
  • Tibert@compuverse.uk
    39·
    1 year ago

    Like it is useful… Open ai already got all the useful info out of the websites.

    Tho maybe for the sites generating new content it may have a use. But all the content before that is already lost to chatgpt.

  • On@kbin.social
    23·
    1 year ago

    Is it possible that they offloaded the scraping to a different company to avoid direct litigation now theyre out in the open? To say “we didn’t scrape your website, and you can’t prove it.”

    Like DDG, Ecosia, Qwant use Bing for their data Or how feds buy data from data brokers. Outsource the dirty job like every tech company does and shift the blame if caught doing something unlawful.

    It seems they are trying to garner some positive PR after they scraped through everything without anyone noticing.

    • 𝕽𝖚𝖆𝖎𝖉𝖍𝖗𝖎𝖌𝖍@midwest.social
      4·
      1 year ago

      I absolutely believe a lot of companies outsource simply because they don’t want to build an internal organ to do it. Even in government, despite what Conservatives believe, most organization heads are pretty focused on core competency and press to use outsourced resources. This latter also promoted by heavy lobbying by the companies selling the services.

      This is a situation of “never attribute to malice that which can be easily explained by stupidity.” Sure, some are motivated by malice or subterfuge, but most are probably just buying services because they have other things they’d rather focus on.

    • TehPers@beehaw.org
      1·
      1 year ago

      Why would they be concerned about litigation? As far as I know, scraping is completely legal in most/all countries (including the US, which I’m more familiar with and they’re headquartered out of), as long as you’re respecting copyright and correctly handling PII (which they claim to be making an effort on).

  • ashtrix@lemmy.ca
    20·
    1 year ago

    Yeah, it’s already too late. Why didn’t they provide this before they already scraped websites?

  • breaks.ʟᴏʟ@lemmy.studioEnglish
    17·
    1 year ago

    But for large website operators, the choice to block large language model (LLM) crawlers isn’t as easy as it may seem. Making some LLMs blind to certain website data will leave gaps of knowledge that could serve some sites very well (such as sites that don’t want to lose visitors if ChatGPT supplies their information for them), but it may also hurt others. For example, blocking content from future AI models could decrease a site’s or a brand’s cultural footprint if AI chatbots become a primary user interface in the future. As a thought experiment, imagine an online business declaring that it didn’t want its website indexed by Google in the year 2002—a self-defeating move when that was the most popular on-ramp for finding information online.

    Really curious how this will end up

    • axibzllmbo@beehaw.orgEnglish
      3·
      1 year ago

      That’s an interesting point that I hadn’t considered, the comparison to Google indexing in the early 2000’s may prove to be very apt with the number of people I’ve seen using chat GPT as a search engine.

  • abhibeckert@beehaw.org
    16·
    1 year ago

    I’d bet sites blocking ChatGPT will regret it when (not if) Bing starts using it for search engine relevance.

      • abhibeckert@beehaw.org
        2·
        1 year ago

        It was enough to make me try Bing… which lasted all of about ten seconds (one search) before I ran screaming for the hills back to Duck Duck Go.

        So no, I don’t think this can make people use Bing - that product has so many problems I’m not sure it will ever be good enough.

        Having said that - ChatGPT is really good at interpreting a user search term and equally good at understanding the contents of an arbitrary webpage. It’s a perfect tool to build a search engine around, and I can’t wait for someone more competent than Bing to do just that.

        • renard_roux@beehaw.org
          1·
          1 year ago

          It’s incredible just how bad Microsoft is at product design 😳

          Every time I visit with parents, or other older-gen acquaintances, I’m the go-to “help me fix this tiny issue with my [software]”, and invariably it will be Outlook or Word or some other flavor of Office software, and I just want to scream. Even just looking at that nightmare top bar in Word triggers nausea.

          I know I’m just not the target audience, and that there is some degree of obfuscation-by-design going on to enable their meaty underbelly of third party support companies (an entire fucking industry just to deal with their software, which in turn need certification, and so forth). It’s still difficult to understand how people can interact with the overwhelming horribleness of it all, day in and day out, and not go on a rage-fueled rampage.

          Slightly unrelated, if not tangential — I mentioned in a comment somewhere yesterday that I love MacOS, but I wouldn’t touch an iPhone with a ten foot pole.

          Look at my shiny iPhone! someone will say, and then shove it in your face. It’s the new 2023 edition!

          That’s nice, you’ll reply, but why are the icons so big?

          Well you see…

          Couldn’t you make them smaller, and increase the grid size a bit? 4x6 seems a bit wasteful.

          Yeah well the thing is…

          Why did you place all the apps at the top of the screen? Isn’t that where they’ll be the most difficult to reach on a screen that big? Move that app to the bottom of the screen, would you, just to try it out?

          Yes, uhm, that’s not compatible with Apple’s design principles. They’ve been the bleeding edge of mobile phones since the first iPhone, and I’m sure they know best!

          You know, now that you mention it, it does look almost identical to the original iPhone screen layout! Imagine that, being right on your first try! Very impressive. Oh well, no problem, I’m happy you enjoy your phone ❤️

          🤢

      • Sproux@lemmy.dbzer0.com
        0·
        1 year ago

        I started using it this year because its actually been giving me decent results unlike google. We’re…in a dark timeline

        • renard_roux@beehaw.org
          0·
          1 year ago

          Hmm. I have an incredibly strong aversion to everything Microsoft, so even giving Bing a chance is difficult. However, I must admit that I can recognize the part about Google not delivering. I even went so far as to tamper with the CSS recently just to make Google’s results slightly easier to parse.

          Maybe it’s time to try something new 🤔 I just wish the only viable alternative wasn’t made by Microsoft 😓🤢

          Dark timeline, indeed! 😔

  • dbilitated@aussie.zone
    15·
    1 year ago

    I’d rather like it if they train it on stuff I say. I want the AI of tomorrow to reflect my thoughts.

    seriously I would much prefer gold tier journalism and news sites let it crawl so when people use it to make choices in the future they’re guided to better choices.

    it is honestly so hard to know what will happen though, it’s so complicated it’s virtually guaranteed we’re not correctly anticipating the consequences of any of this. I’m not really even talking about the AI, I’m talking about the effects on society which are a lot more complex.