RT @KenCaldeira: @zerobuoyancy The proportion of publications that report micro-advances that would have been better placed in the Supporti…
RT @KenCaldeira: @zerobuoyancy The proportion of publications that report micro-advances that would have been better placed in the Supporti…
RT @KenCaldeira: @zerobuoyancy The proportion of publications that report micro-advances that would have been better placed in the Supporti…
@zerobuoyancy The proportion of publications that report micro-advances that would have been better placed in the Supporting Material of another paper has grown substantially. The MPU (Minimum Publishable Unit) is asymptotically approaching zero. https:/
@lessin Indeed. Should we start running through tenured folks and assess what mediocre scholarship really looks like?What inflated citations look like? When we really understand academia, we understand how laughably this opinion piece is cheddar bobbing...
@natalieben Again something similar from Oxford Academic in 2019. https://t.co/PvMQKpROWD
Pero esto es causa de lo anterior. Y no es un fenómeno exclusivamente español. https://t.co/SGAkQsKetU
@WC32507876 I just found this particular graph extremely bonkers but the paper in question has quite a few other interesting metrics in it (not what youre looking for tho i think) https://t.co/gWmCSQfG0F
@StewartalsopIII this is an interesting paper getting into details on publishing trends over tiem https://t.co/IkXwanIoxH https://t.co/ye2QREIQLD
RT @auntbeast: Over-optimization of academic publishing metrics: observing Goodhart’s Law in action https://t.co/X6O1Enf1Ib (One of the mos…
Over-optimization of academic publishing metrics: observing Goodhart’s Law in action https://t.co/X6O1Enf1Ib (One of the most important papers I've read in a while.)
RT @auntbeast: Over-optimization of academic publishing metrics: observing Goodhart’s Law in action https://t.co/cLdPiPykDj (I gotta admit,…
RT @auntbeast: Over-optimization of academic publishing metrics: observing Goodhart’s Law in action https://t.co/cLdPiPykDj (I gotta admit,…
Over-optimization of academic publishing metrics: observing Goodhart’s Law in action https://t.co/cLdPiPykDj (I gotta admit, as some who trained in the 1980s, I really don't get the obsession with metrics. Also, good paper.)
@a_m_mastroianni And # of published publications has grown exponentially over the period you mention: https://t.co/11kNt6dPy1 https://t.co/z9cd04JY94
論文の統計データで最もまとまっていると思われる論文の一つ。著者はMichael FireとCarlos Guestrin #Giant_dev https://t.co/ifHOoeMfNI https://t.co/GGPqR1g6Wr
@blob_watcher This is a nice study about how those metrics are being gamed. https://t.co/9S0W9tPLwt
'Impact' my butt. "Moreover, by analyzing properties of over 2600 research fields, we observed that citation-based metrics are not beneficial for comparing researchers in different fields, or even in the same department." https://t.co/clICKv4N0y https://t
@timgill924 Dr. Gill, this is yet another output, while you need to focus on increasing your impact! See the science: "... the number of publications has ceased to be a good metric as a result of longer author lists, shorter papers, and surging publicatio
Over-optimization of academic publishing metrics: observing Goodhart’s Law in action (2019) Michael Fire & @guestrin https://t.co/aScpesU27I @GigaScience
Scientists likely feel increased pressure to hype their results because productivity metrics have taken on a greater role in scientific advancement. @CT_Bergstrom https://t.co/OJMsOuehvM True even pre-pandemic https://t.co/NzcayYJ1pi
RT @SCEdmunds: Nandita also mentioning Goodhart’s Law: “when a measure becomes a target, it ceases to be a good measure.”. @GigaScience pu…
RT @SCEdmunds: Nandita also mentioning Goodhart’s Law: “when a measure becomes a target, it ceases to be a good measure.”. @GigaScience pu…
RT @deevybee: Yesterday when listening to https://t.co/Ic2rqjrSE8 I learned that this pithy version of Goodhart’s law was formulated by Mar…
RT @SCEdmunds: Nandita also mentioning Goodhart’s Law: “when a measure becomes a target, it ceases to be a good measure.”. @GigaScience pu…
Yesterday when listening to https://t.co/Ic2rqjrSE8 I learned that this pithy version of Goodhart’s law was formulated by Marilyn Strathern.
RT @SCEdmunds: Nandita also mentioning Goodhart’s Law: “when a measure becomes a target, it ceases to be a good measure.”. @GigaScience pu…
RT @SCEdmunds: Nandita also mentioning Goodhart’s Law: “when a measure becomes a target, it ceases to be a good measure.”. @GigaScience pu…
Nandita also mentioning Goodhart’s Law: “when a measure becomes a target, it ceases to be a good measure.”. @GigaScience published a paper looking at this in action: Over-optimization of academic publishing metrics https://t.co/JkFjDb19VR #WCRI2022
RT @DORAssessment: ⚡️2019 Flashback: "Academic papers have evolved in order to score a bullseye on target metrics." Revisit the article fro…
“citation-based metrics are not beneficial for comparing researchers in different fields, or even in the same department”
RT @DORAssessment: ⚡️2019 Flashback: "Academic papers have evolved in order to score a bullseye on target metrics." Revisit the article fro…
⚡️2019 Flashback: "Academic papers have evolved in order to score a bullseye on target metrics." Revisit the article from Michael Fire & @guestrin: https://t.co/8vnX5hzUqo
@jwoLondon @FILWD Also: I don't accept that researchers today are having 5-10x the number of good ideas as researchers 30 years ago. So I conclude that quality in some form must be diminishing. https://t.co/W2m6sJ1EHk
The number of published research papers is increasing exponentially. (The dip after 2014 is an artifact due to the fact that the dataset is from 2016). As a result, researchers have to be very efficient and selective when reading papers. https://t.co/vTEJ6
@WanderinAges @knrd_z Academics are responding to perverse incentives. Citation-based metrics propel them to publish higher frequencies of papers with ever lengthening lists of co-authors and accompanying references: https://t.co/44PZxX20Ee
RT @LettsGetSnakes: "these metrics have become targets and follow Goodhart’s Law, according to which, when a measure becomes a target, it c…
This has important implications, especially for early- and mid-cereer researchers and is consistent with the Reboot STEMM initiative https://t.co/4xslVCvmg0
"these metrics have become targets and follow Goodhart’s Law, according to which, when a measure becomes a target, it ceases to be a good measure” Over-optimization of academic publishing metrics: observing Goodhart’s Law in action https://t.co/Xrd98qQtdM
RT @KatjaEnberg: "Scientists likely feel increased pressure to hype their results because productivity metrics have taken on a greater role…
RT @KatjaEnberg: "Scientists likely feel increased pressure to hype their results because productivity metrics have taken on a greater role…
RT @KatjaEnberg: "Scientists likely feel increased pressure to hype their results because productivity metrics have taken on a greater role…
RT @KatjaEnberg: "Scientists likely feel increased pressure to hype their results because productivity metrics have taken on a greater role…
RT @KatjaEnberg: "Scientists likely feel increased pressure to hype their results because productivity metrics have taken on a greater role…
Now do the artist formerly known as “journalism”
@HansZauner @Lab_Journal sag ich doch https://t.co/vASz7SrsZv
Over-optimization of academic publishing metrics: observing Goodhart’s Law in action | GigaScience https://t.co/piLw386KW6 "Our study shows that the validity of citation-based measures is being compromised and their usefulness is lessening."
RT @gkalinkat: "Academic publishing has changed considerably; now we need to reconsider how we measure success" @GigaScience #AcademicTwit…
"Much of the present pathology of hype, hyperbole, and publication bias is associated with an overreliance on productivity metrics." https://t.co/EOwVRV496s 13/25
"Scientists likely feel increased pressure to hype their results because productivity metrics have taken on a greater role in scientific advancement." https://t.co/EOwVRV496s 5/25
RT @gkalinkat: "Academic publishing has changed considerably; now we need to reconsider how we measure success" @GigaScience #AcademicTwit…
"Academic publishing has changed considerably; now we need to reconsider how we measure success" @GigaScience #AcademicTwitter #OpenScience #openaccess https://t.co/Ptv5Qkgoba https://t.co/bbFOR9MTE4
paper here: https://t.co/c31PuCGn5Q
Goodhart’s Law in action: "Moreover, by analyzing properties of >2,600 research fields, we observed that citation-based metrics are not beneficial for comparing researchers in different fields, or even in the same department" https://t.co/AboAFtZ0Ft
Mean No. of authors #researchimpact #researchvisibility #researchtools https://t.co/bnlBe4Obn4 https://t.co/hG9JngUzJG
RT @aleebrahim: Over-optimization of academic publishing metrics: observing Goodhart’s Law in action #researchimpact #researchvisibility #…
Academic publishing has changed considerably; now we need to reconsider how we measure success. https://t.co/bnlBe4Obn4
Over-optimization of academic publishing metrics: observing Goodhart’s Law in action #researchimpact #researchvisibility #researchtools https://t.co/bnlBe4Obn4
RT @rubenarslan: Read this on how we've trained scientists to over-optimize their CVs for commonly used metrics of success (like citation c…
"Wenn ein Maß zum Ziel wird, ist es kein gutes Maß mehr". Wie sinnvoll ist der h-Index und andere Metriken? https://t.co/2WKLelkTTX
@magnusnordborg We are not fooling the system, but only ourselves. Playing the system makes it worse. Goodhart’s law in action: https://t.co/b1MN0QStnT. Plus, playing the metrics *does* reduce meritocracy: https://t.co/fnv2f9Lxk8.
RT @AlexKostyuk2: Over-optimization of academic publishing metrics - >120 million papers analyzed - >2,600 research fields...citation-base…
72.1% of all papers published in 2009 had no citations after 5 years
RT @AlexKostyuk2: Over-optimization of academic publishing metrics - >120 million papers analyzed - >2,600 research fields...citation-base…
RT @AlexKostyuk2: Over-optimization of academic publishing metrics - >120 million papers analyzed - >2,600 research fields...citation-base…
Over-optimization of academic publishing metrics - >120 million papers analyzed - >2,600 research fields...citation-based metrics are not beneficial for comparing researchers - a journal’s impact factor has ceased to be good metrics https://t.co/eZ3
RT @TAVAKOLI_: @R_F_G_ @sebastiendamart @DrmDauphine @Team_MLab @cercle_innov @Paris_Dauphine Votre constat est chiffré dans cet article qu…
RT @sebastiendamart: Excellent !! https://t.co/j6n68VWTwh
RT @sebastiendamart: Excellent !! https://t.co/j6n68VWTwh
Excellent !!
RT @TAVAKOLI_: @R_F_G_ @sebastiendamart @DrmDauphine @Team_MLab @cercle_innov @Paris_Dauphine Votre constat est chiffré dans cet article qu…
RT @TAVAKOLI_: @R_F_G_ @sebastiendamart @DrmDauphine @Team_MLab @cercle_innov @Paris_Dauphine Votre constat est chiffré dans cet article qu…
@R_F_G_ @sebastiendamart @DrmDauphine @Team_MLab @cercle_innov @Paris_Dauphine Votre constat est chiffré dans cet article qui a analysé un siècle de publication scientifique: https://t.co/I4K92OnqJI
No surprises here, really, but nevertheless interesting to see the pressures of the neoliberalization of the post-secondary sector on academic publishing (figures by Fire & Guestrin: https://t.co/8naxCdiIk8): https://t.co/gTiv6eu80Q
RT @mededdoc: Interesting paper @LaurenMaggio. Thanks for sharing @debsimpson3! Goodhart’s Law has always fascinated me... “when a m…
Interesting paper @LaurenMaggio. Thanks for sharing @debsimpson3! Goodhart’s Law has always fascinated me... “when a measure becomes a target, it ceases to be a good measure.” #MedEd | GigaScience | Oxford Academic https://t.co/b6nWLe1sKO
Until then we have this (And Michael is here with a poster too) https://t.co/QhboWnZ84x
RT @abc3d: “when a measure becomes a target, it ceases to be a good measure” https://t.co/6XdHHkffqq
“when a measure becomes a target, it ceases to be a good measure”
RT @davidmanheim: Not just Goodhart's law - this is a beautiful if unintended illustration of Shorrock's law of limits, which is that limit…
RT @davidmanheim: Not just Goodhart's law - this is a beautiful if unintended illustration of Shorrock's law of limits, which is that limit…
RT @davidmanheim: Not just Goodhart's law - this is a beautiful if unintended illustration of Shorrock's law of limits, which is that limit…
RT @davidmanheim: Not just Goodhart's law - this is a beautiful if unintended illustration of Shorrock's law of limits, which is that limit…
Not just Goodhart's law - this is a beautiful if unintended illustration of Shorrock's law of limits, which is that limits become targets. You can clearly see how journals started introducing different word limits, some at each 50-word mark, in the 1990s.
More #FOAMed from AfJEM: https://t.co/N8Hb5xZetJ
Over-optimization of academic publishing metrics: observing Goodhart’s Law in action Goodhart’s Law: “when a measure becomes a target, it ceases to be a good measure” https://t.co/60Mlvx9H1s 🔓 https://t.co/lpPh1dy3U5
RT @IMLahart: Over-optimization of academic publishing metrics. ”citation-based metrics are not beneficial for comparing researchers in dif…
Hallelujah