this post was submitted on 19 Mar 2024
299 points (97.8% liked)

Technology

59569 readers
3825 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

The ChatGPT phrase “As of my last knowledge update” appears in several papers published by academic journals.

you are viewing a single comment's thread
view the rest of the comments
[–] FaceDeer@fedia.io 102 points 8 months ago (1 children)

This really just shines a light on a more significant underlying problem with scientific publication in general, that being that there's just way too much of it. "Publish or perish" is resulting in enormous pressure to churn out papers whether they're good or not.

[–] AtmaJnana@lemmy.world 21 points 8 months ago* (last edited 8 months ago) (2 children)

As an outsider with a researcher PhD in the family, I suspect its an issue of how the institutions measure success. How many papers? How many cites? Other metrics might work, but probably not as broadly. I assume they will also care about the size of your staff, how much grant money you get, patents held, etc.

I suspect that, short of a Nobel prize, it is difficult to objectively measure how one is advancing scientific progress (without a PhD committee to evaluate it.)

[–] FaceDeer@fedia.io 11 points 8 months ago

The saying "when a measure becomes a target it ceases to be a good measure" (Goodhart's Law) has been making the rounds online recently, this is a good example of that.

Ironically, this is a common problem faced when training AIs too.

[–] AnarchistArtificer@slrpnk.net 7 points 8 months ago (1 children)

Yeah, that's my sense too, as someone within low-level academia. Bibliometrics and other attempts to quantify research output have been big in the last few decades, but I think that they have made the problem worse if anything.

It's especially messy when we consider the kind of progress and contribution that Nobel prizes can't account for, like education and outreach. I really like how Dr Fatima explores this in her video How Science Pretends to be Meritocratic(duration: 37:04)

[–] PipedLinkBot@feddit.rocks 1 points 8 months ago

Here is an alternative Piped link(s):

How Science Pretends to be Meritocratic

Piped is a privacy-respecting open-source alternative frontend to YouTube.

I'm open-source; check me out at GitHub.