• Deestan@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    11 months ago

    A full 100% sounds weird. It means complete overlap with the ASD assessment which itself isn’t bulletproof. Weird like there were some mistakes in the data. E.g. all ASD pictures taken on the same day and getting a date timestamp, “ASD” written in the metadata or filename, or different light in different lab.

    I didn’t see any immediate problems in the published paper, but if these were my results I’d be to worried to publish it.

    • sosodev@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      ·
      11 months ago

      It sounds like the model is overfitting the training data. They say it scored 100% on the testing set of data which almost always indicates that the model has learned how to ace the training set but flops in the real world.

      I think we shouldn’t put much weight behind this news article. This is just more overblown hype for the sake of clicks.

  • vzq@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    2
    ·
    11 months ago

    False negatives is what freaks me out. Sorry bud, magic machine says you’re not really autistic. No adaptions or special school for you. Good luck out there.

      • Krzak@discuss.online
        link
        fedilink
        English
        arrow-up
        1
        ·
        11 months ago

        It’s easier to reason with a doctor than a computer. I can imagine you’d be in the system for good after such “evaluation” so it could mean slim chances of retesting

  • Bouchtroubouli@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    11 months ago

    Well, 100% accuracy after removing all the noise in the dataset …

    At least it proves that their method can separate two extremes. But what about the real life where 90% of the people are ?

  • bionicjoey@lemmy.ca
    link
    fedilink
    English
    arrow-up
    1
    ·
    11 months ago

    It worries me that this research came out of South Korea; A country which I’ve heard is particularly stigmatizing of neurodivergence

  • echo@lemmings.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    11 months ago

    I am highly skeptical. My guess is that both the article and the research are highly flawed.