• Flying Squid@lemmy.world
    link
    fedilink
    arrow-up
    19
    arrow-down
    1
    ·
    2 months ago

    I knew it! I’ve been saying that it is!

    And the AI algorithms they’re using in real estate are doing the exact same thing. Mark my words.

    • henfredemars@infosec.pub
      link
      fedilink
      English
      arrow-up
      11
      ·
      2 months ago

      It’s just a method of shifting the blame And responsibility away from real people to try to avoid getting punished.

      • MajorHavoc@programming.dev
        link
        fedilink
        arrow-up
        4
        ·
        2 months ago

        It’s just a method of shifting the blame And responsibility away from real people to try to avoid getting punished.

        Yep. Biased AI works just fine when the goal is creation of an as-desperate-as-possible underclass.

        Only, it still doesn’t, because eventually even the ultra rich sponsor’s niece is equally dead - once the AI takes over doctoring and mis-recommemds a needless and dangerous surgery.

        • thevoidzero@lemmy.world
          link
          fedilink
          arrow-up
          4
          ·
          2 months ago

          Machine learning models in medicine has biases against darker skins for identifying diseases. So I’m guessing lot of that will be there too

  • huginn@feddit.it
    link
    fedilink
    arrow-up
    10
    ·
    2 months ago

    Quote from abstract:

    We find that the MTEs are biased, significantly favoring White-associated names in 85.1% of cases and female-associated names in only 11.1% of cases, with a minority of cases showing no statistically significant differences. Further analyses show that Black males are disadvantaged in up to 100% of cases, replicating real-world patterns of bias in employment settings, and validate three hypotheses of intersectionality. We also find an impact of document length as well as the corpus frequency of names in the selection of resumes.

    Pretty damning… And not surprising.

  • iAvicenna@lemmy.worldM
    link
    fedilink
    arrow-up
    7
    ·
    edit-2
    2 months ago

    “AI, don’t rank applicants based on race and gender”

    “Ok”

    *Proceeds to rank applicants based on how western and male looking their names are"

  • PunnyName@lemmy.world
    link
    fedilink
    arrow-up
    3
    arrow-down
    3
    ·
    2 months ago

    It’s not really AI, that’s why. It’s not even generative.

    It’s a scraper that uses already available information to then “learn”. But it doesn’t actually learn, or it would also scrape systemic and societal changes that many deem necessary to overcome these biases.

    • prototype_g2@lemmy.ml
      link
      fedilink
      arrow-up
      2
      arrow-down
      1
      ·
      2 months ago

      It’s not even generative

      It doesn’t need to be generative to be AI.

      It’s a scraper that uses already available information to then “learn”.

      That’s just every single “AI” product out there, that’s how they work: They scrape data from all over the internet, create a model that makes predictions based on that data. Chat-GPT doesn’t understand anything. It is simply a really complicated model which predicts what word is most likely to follow a given sequence of words. These “AI” aren’t inteligent, nor are they creative. They, by their very nature, stay as close as possible to the data they are given and never deviate, as a deviation would mean inaccuracy.

      From an historical point of view, the word “AI” simply means “cool new technology”. That’s what it has been used to describe, while people think that AI means “artificial person”, like we see in the movies. So we need to be careful while using this word, because it can mean so many thing to the point that it has little meaning.

  • What. A. Surprise.

    Algorithms fed by content primarily created by western white men tend to produce content that reflects the biases of western white men.

    No, let’s go a step farther because it doesn’t have a lot of content from, say, impoverished white men. So western white men of the middle class on up.

    No, let’s go a step farther because much of that content actually comes from techies or wannabe techies. So western white men of the middle class on up with a leaning toward interests in technology.