<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>research - Tessa AI</title>
	<atom:link href="https://tessaai.co/tag/research/feed/" rel="self" type="application/rss+xml" />
	<link>https://tessaai.co</link>
	<description>Trust the science. Then check it.</description>
	<lastBuildDate>Thu, 23 Oct 2025 19:25:48 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.3</generator>

<image>
	<url>https://i0.wp.com/tessaai.co/wp-content/uploads/2026/10/cropped-favicon-tessa-rev-512px-1.webp?fit=32%2C32&#038;ssl=1</url>
	<title>research - Tessa AI</title>
	<link>https://tessaai.co</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">257919076</site>	<item>
		<title>Tessa Finds “Butt Breathing” is Worth More Study</title>
		<link>https://tessaai.co/2025/10/24/tessa-finds-butt-breathing-is-worth-more-study/?utm_source=rss&#038;utm_medium=rss&#038;utm_campaign=tessa-finds-butt-breathing-is-worth-more-study</link>
					<comments>https://tessaai.co/2025/10/24/tessa-finds-butt-breathing-is-worth-more-study/#respond</comments>
		
		<dc:creator><![CDATA[Sage Osterfeld]]></dc:creator>
		<pubDate>Fri, 24 Oct 2025 16:00:30 +0000</pubDate>
				<category><![CDATA[Commentary & Opinion]]></category>
		<category><![CDATA[enteral ventilation]]></category>
		<category><![CDATA[ig noble]]></category>
		<category><![CDATA[research]]></category>
		<category><![CDATA[strange research]]></category>
		<category><![CDATA[tessa score]]></category>
		<guid isPermaLink="false">https://tessaai.co/?p=909</guid>

					<description><![CDATA[Tessa evaluated a paper on "butt breathing." Despite the strange topic winning an Ig Nobel prize, Tessa AI scored it 77/100, validating its scientific rigor.]]></description>
										<content:encoded><![CDATA[<div class="fusion-fullwidth fullwidth-box fusion-builder-row-1 fusion-flex-container nonhundred-percent-fullwidth non-hundred-percent-height-scrolling" style="--awb-border-radius-top-left:0px;--awb-border-radius-top-right:0px;--awb-border-radius-bottom-right:0px;--awb-border-radius-bottom-left:0px;--awb-flex-wrap:wrap;" ><div class="fusion-builder-row fusion-row fusion-flex-align-items-flex-start fusion-flex-content-wrap" style="max-width:1248px;margin-left: calc(-4% / 2 );margin-right: calc(-4% / 2 );"><div class="fusion-layout-column fusion_builder_column fusion-builder-column-0 fusion_builder_column_1_1 1_1 fusion-flex-column" style="--awb-bg-size:cover;--awb-width-large:100%;--awb-margin-top-large:0px;--awb-spacing-right-large:1.92%;--awb-margin-bottom-large:0px;--awb-spacing-left-large:1.92%;--awb-width-medium:100%;--awb-spacing-right-medium:1.92%;--awb-spacing-left-medium:1.92%;--awb-width-small:100%;--awb-spacing-right-small:1.92%;--awb-spacing-left-small:1.92%;"><div class="fusion-column-wrapper fusion-flex-justify-content-flex-start fusion-content-layout-column"><div class="fusion-text fusion-text-1"><h2 class="subhead">&#8220;Enteral Ventilation&#8221; was strange enough to get scientist&#8217;s attention. Turns out, they might be on to something</h2>
</div><div class="fusion-image-element awb-imageframe-style awb-imageframe-style-below awb-imageframe-style-1" style="--awb-margin-top:10px;--awb-margin-bottom:20px;--awb-caption-text-size:12px;--awb-caption-title-font-family:-apple-system, BlinkMacSystemFont, &#x27;Segoe UI&#x27;, Roboto, Oxygen-Sans, Ubuntu, Cantarell, &#x27;Helvetica Neue&#x27; ,sans-serif;--awb-caption-title-font-weight:700;--awb-caption-title-font-style:normal;--awb-caption-title-size:12px;--awb-caption-title-transform:var(--body_typography-text-transform);--awb-caption-title-line-height:var(--body_typography-line-height);--awb-caption-title-letter-spacing:var(--body_typography-letter-spacing);--awb-caption-text-font-family:-apple-system, BlinkMacSystemFont, &#x27;Segoe UI&#x27;, Roboto, Oxygen-Sans, Ubuntu, Cantarell, &#x27;Helvetica Neue&#x27; ,sans-serif;--awb-caption-text-font-style:normal;--awb-caption-text-font-weight:400;"><span class=" fusion-imageframe imageframe-none imageframe-1 hover-type-none" style="border:1px solid var(--awb-color3);"><img data-recalc-dims="1" fetchpriority="high" decoding="async" width="1024" height="640" alt="Visual abstract shows highlights of first human clinical trial to evaluate the safety of enteral ventilation concept developed by Takanori Takebe, MD, Ph.D., and colleagues. Credit: Med (2025). DOI: 10.1016/j.medj.2025.100887 | Source: https://pubmed.ncbi.nlm.nih.gov/35590139/" src="https://i0.wp.com/tessaai.co/wp-content/uploads/2025/10/ignobel-butt-breathing-1024-640.jpg?resize=1024%2C640&#038;ssl=1" class="img-responsive wp-image-910" srcset="https://i0.wp.com/tessaai.co/wp-content/uploads/2025/10/ignobel-butt-breathing-1024-640.jpg?resize=200%2C125&amp;ssl=1 200w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/10/ignobel-butt-breathing-1024-640.jpg?resize=300%2C188&amp;ssl=1 300w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/10/ignobel-butt-breathing-1024-640.jpg?resize=400%2C250&amp;ssl=1 400w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/10/ignobel-butt-breathing-1024-640.jpg?resize=600%2C375&amp;ssl=1 600w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/10/ignobel-butt-breathing-1024-640.jpg?resize=768%2C480&amp;ssl=1 768w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/10/ignobel-butt-breathing-1024-640.jpg?resize=800%2C500&amp;ssl=1 800w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/10/ignobel-butt-breathing-1024-640.jpg?fit=1024%2C640&amp;ssl=1 1024w" sizes="(max-width: 640px) 100vw, 1024px" /></span><div class="awb-imageframe-caption-container"><div class="awb-imageframe-caption"><p class="awb-imageframe-caption-text">Visual abstract shows highlights of first human clinical trial to evaluate the safety of enteral ventilation concept developed by Takanori Takebe, MD, Ph.D., and colleagues. Credit: Med (2025). DOI: 10.1016/j.medj.2025.100887 | Source: https://pubmed.ncbi.nlm.nih.gov/35590139/</p></div></div></div><div class="fusion-text fusion-text-2" style="--awb-margin-top:20px;"><p><span class="fusion-dropcap dropcap dropcap-boxed">I</span>n testing Tessa’s ability to accurately evaluate and score medical research, people run a lot of papers seeing if they can trip up the platform’s analysis. We’ve seen pay-to-publish studies from sketchy device manufacturers, self-citing paper mill junk, retracted works, and studies 100% manufactured by AI.</p>
<p>So you can imagine what the testing guys thought when they were asked to feed Tessa a paper noted on <a href="https://medicalxpress.com/news/2025-10-ignobel-butt-idea-closer-real.html" target="_blank" rel="noopener">Medicalxpress.com</a> that looked at enteral ventilation, aka “butt breathing.”</p>
<p>The study was weird enough that it garnered an <a href="https://improbable.com/ig/about-the-ig-nobel-prizes/">Ig Nobel Prize</a> (the “Igs”) in 2024 from the Annals of Improbable Research. The award highlights discoveries at are surprising but also make people laugh (and think). However, it was just a preliminary one, designed to determine whether enteral ventilation was safe rather than effective. But, it did reference one from 2021, <a href="https://www.cell.com/med/fulltext/S2666-6340(21)00153-7" target="_blank" rel="noopener"><em>Mammalian enteral ventilation ameliorates respiratory failure</em></a> which did test whether mammals are capable of breathing through their butts.</p>
<p>We gave that one to <a title="Tessa Platform" href="https://tessaai.co/tessa-platform/">Tessa</a>. The results lifted a few eyebrows.</p>
<h3><strong>The Paper Scored Well</strong></h3>
<p>First off, Tessa gave the paper an overall score of 77 out of 100 for trustworthiness, a very solid score—in the top 15% of papers. (Papers with a 90 or above are extremely rare, and Tessa has never given a 100.) A 77 indicates the science and methodologies are well-grounded and thorough and meet thresholds for transparency, explainability, and significance (<a href="https://tessaai.co/2025/04/17/how-to-restore-trust-in-medical-research/">T.E.S.</a>). It’s other factors such as cohort size, rigor, the authors’ or publication’s reputation, etc. that took away from its overall, but still very respectable, score.</p>
<p>More interesting, Tessa’s analysis of the work scored it quite highly. An 8 of 10 in the “Theoretical-to-Empirical” and a 9 of 10 in the “Known-to-Novel” categories. Numbers that high are unusual, which means it’s a foundational work definitely worthy of more study. In the words of one of our engineers, “mammalian butt breathing is legit.”</p>
<p>If there’s a takeaway from this, it’s that people talking out their a*ses might just be a figure of speech, but enteral ventilation is a real thing.</p>
<p>If you’re interested, you can read Tessa’s full analysis of the paper below.</p>
<div class="fusion-separator fusion-full-width-sep" style="align-self: center;margin-left: auto;margin-right: auto;margin-top:20px;margin-bottom:20px;width:100%;"><div class="fusion-separator-border sep-single sep-solid" style="--awb-height:20px;--awb-amount:20px;border-color:var(--awb-color3);border-top-width:1px;"></div></div>
<h2>Tessa Analysis Results</h2>
</div><div class="fusion-image-element" style="--awb-caption-title-font-family:var(--h2_typography-font-family);--awb-caption-title-font-weight:var(--h2_typography-font-weight);--awb-caption-title-font-style:var(--h2_typography-font-style);--awb-caption-title-size:var(--h2_typography-font-size);--awb-caption-title-transform:var(--h2_typography-text-transform);--awb-caption-title-line-height:var(--h2_typography-line-height);--awb-caption-title-letter-spacing:var(--h2_typography-letter-spacing);"><span class=" fusion-imageframe imageframe-none imageframe-2 hover-type-none" style="border:1px solid var(--awb-color3);"><img data-recalc-dims="1" decoding="async" width="988" height="291" alt="The Tessa analysis results showing that the paper received respectable 77 score" title="2025-10-24-ev-overall-score" src="https://i0.wp.com/tessaai.co/wp-content/uploads/2025/10/2025-10-24-ev-overall-score.jpg?resize=988%2C291&#038;ssl=1" class="img-responsive wp-image-911" srcset="https://i0.wp.com/tessaai.co/wp-content/uploads/2025/10/2025-10-24-ev-overall-score.jpg?resize=200%2C59&amp;ssl=1 200w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/10/2025-10-24-ev-overall-score.jpg?resize=300%2C88&amp;ssl=1 300w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/10/2025-10-24-ev-overall-score.jpg?resize=400%2C118&amp;ssl=1 400w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/10/2025-10-24-ev-overall-score.jpg?resize=600%2C177&amp;ssl=1 600w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/10/2025-10-24-ev-overall-score.jpg?resize=768%2C226&amp;ssl=1 768w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/10/2025-10-24-ev-overall-score.jpg?resize=800%2C236&amp;ssl=1 800w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/10/2025-10-24-ev-overall-score.jpg?fit=988%2C291&amp;ssl=1 988w" sizes="(max-width: 640px) 100vw, 988px" /></span></div><div class="fusion-image-element" style="--awb-caption-title-font-family:var(--h2_typography-font-family);--awb-caption-title-font-weight:var(--h2_typography-font-weight);--awb-caption-title-font-style:var(--h2_typography-font-style);--awb-caption-title-size:var(--h2_typography-font-size);--awb-caption-title-transform:var(--h2_typography-text-transform);--awb-caption-title-line-height:var(--h2_typography-line-height);--awb-caption-title-letter-spacing:var(--h2_typography-letter-spacing);"><span class=" fusion-imageframe imageframe-none imageframe-3 hover-type-none" style="border:1px solid var(--awb-color3);"><img data-recalc-dims="1" decoding="async" width="998" height="199" alt="A graphic showing the five Tessa subscores for the paper" title="2025-10-24-ev-subscores" src="https://i0.wp.com/tessaai.co/wp-content/uploads/2025/10/2025-10-24-ev-subscores.jpg?resize=998%2C199&#038;ssl=1" class="img-responsive wp-image-912" srcset="https://i0.wp.com/tessaai.co/wp-content/uploads/2025/10/2025-10-24-ev-subscores.jpg?resize=200%2C40&amp;ssl=1 200w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/10/2025-10-24-ev-subscores.jpg?resize=300%2C60&amp;ssl=1 300w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/10/2025-10-24-ev-subscores.jpg?resize=400%2C80&amp;ssl=1 400w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/10/2025-10-24-ev-subscores.jpg?resize=600%2C120&amp;ssl=1 600w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/10/2025-10-24-ev-subscores.jpg?resize=768%2C153&amp;ssl=1 768w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/10/2025-10-24-ev-subscores.jpg?resize=800%2C160&amp;ssl=1 800w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/10/2025-10-24-ev-subscores.jpg?fit=998%2C199&amp;ssl=1 998w" sizes="(max-width: 640px) 100vw, 998px" /></span></div><div class="fusion-text fusion-text-3"><h3><strong>Content Analysis</strong></h3>
<h4 style="margin: 16px 0 8px 0;"><strong>Research Question</strong></h4>
<p>Can the distal gut be repurposed as an accessory respiratory organ in mammals, delivering oxygen via the anus to alleviate systemic hypoxia and rescue respiratory failure?</p>
<div class="fusion-separator fusion-full-width-sep" style="align-self: center;margin-left: auto;margin-right: auto;margin-top:20px;width:100%;"></div>
<h4 style="margin: 24px 0 8px 0;"><strong>Main Contribution</strong></h4>
<p>The study demonstrates, for the first time, that enteral ventilation via the anus (EVA) using either oxygen gas or oxygen-saturated perfluorocarbon can achieve clinically meaningful systemic oxygenation in mice and pigs with respiratory failure, improving survival and physiological parameters without major adverse effects, and thus proposes a novel, adjunctive route for respiratory support.</p>
<div class="fusion-separator fusion-full-width-sep" style="align-self: center;margin-left: auto;margin-right: auto;margin-top:20px;width:100%;"></div>
<h4 style="margin: 16px 0 8px 0;"><strong>Theoretical to Empirical: <span style="font-size: 1,25rem; color: green;">0.80</span></strong></h4>
<p>The study is almost entirely data-driven: it reports controlled experiments in mice, rats and pigs, including survival curves, arterial/venous blood-gas measurements, behavioural tracking and histopathology (pp.4–8). Safety assays such as endotoxin quantification, serum chemistry and GC-MS for drug levels are also presented (pp.7–9). These multiple in-vivo experiments make the paper highly empirical. However, it stops at pre-clinical animal work—there are no human subjects or randomized clinical trials—so it does not reach the very top end of empiricity.</p>
<div class="fusion-separator fusion-full-width-sep" style="align-self: center;margin-left: auto;margin-right: auto;margin-top:20px;width:100%;"></div>
<h4 style="margin: 24px 0 8px 0;"><strong>Weak to Rigorous: <span style="font-size: 1,25rem; color: yellowgreen;">0.56</span></strong></h4>
<p>The paper presents a provocative proof-of-concept that mammalian distal gut can be repurposed for gas exchange. Across small-rodent and porcine models, both gas and liquid EVA increased systemic oxygenation and, in mice, markedly improved survival during lethal hypoxia. Strengths include multi-species validation, use of both functional (survival, behavior, SpO2) and biochemical (blood gases) endpoints, and an initial safety assessment. However, many experiments rely on very small sample sizes with limited randomization/blinding, short observation periods, and single time-point toxicity assays, which constrain statistical power and translational certainty. The requirement for mucosal abrasion in g-EVA limits clinical feasibility, while l-EVA efficacy, though encouraging, achieved modest PaO2 gains (~13 mm Hg) in pigs. Overall, the evidence supports feasibility but further studies with larger cohorts, longer follow-up, and disease-relevant models are needed to establish efficacy and safety.</p>
<div class="fusion-separator fusion-full-width-sep" style="align-self: center;margin-left: auto;margin-right: auto;margin-top:20px;width:100%;"></div>
<h4 style="margin: 24px 0 8px 0;"><strong>Known to Novel: <span style="font-size: 1,25rem; color: green;">0.90</span></strong></h4>
<p>Using the distal intestine as a functional respiratory organ in mammals had been largely speculative, with only scattered, historic or non-mammalian observations. This study is the first to show reproducible, lifesaving systemic oxygenation through enteral delivery of either oxygen gas or oxygen-saturated perfluorocarbon in two mammalian species, including a clinically relevant pig model, and to document safety data. It therefore opens an entirely new, previously unexplored route for respiratory support, representing a highly original research question and contribution.</p>
<h3><strong>Summary</strong></h3>
<p>Overall, the paper is scientifically sound and well executed. While the Authors&#8217; collective <em>h-index</em> and Journal&#8217;s impact score pulled the overall score slightly lower, the Methods/Quality score, which forms the bulk of the overall score, is quite strong. Moreover, the paper&#8217;s Authentic score shows that no AI was used to help create it. The Media Score (coverage and discussion of paper online) is solid. If the topic of enteral ventilation continues to draw positive attention, this score will likely rise.</p>
<p>The full text of this paper is available here: <a href="https://www.cell.com/med/fulltext/S2666-6340(21)00153-7" target="_blank" rel="noopener">https://www.cell.com/med/fulltext/S2666-6340(21)00153-7</a></p>
</div></div></div></div></div><p>The post <a href="https://tessaai.co/2025/10/24/tessa-finds-butt-breathing-is-worth-more-study/">Tessa Finds “Butt Breathing” is Worth More Study</a> first appeared on <a href="https://tessaai.co">Tessa AI</a>.</p>]]></content:encoded>
					
					<wfw:commentRss>https://tessaai.co/2025/10/24/tessa-finds-butt-breathing-is-worth-more-study/feed/</wfw:commentRss>
			<slash:comments>0</slash:comments>
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">909</post-id>	</item>
		<item>
		<title>How to Restore Trust in Medical Research</title>
		<link>https://tessaai.co/2025/04/17/how-to-restore-trust-in-medical-research/?utm_source=rss&#038;utm_medium=rss&#038;utm_campaign=how-to-restore-trust-in-medical-research</link>
					<comments>https://tessaai.co/2025/04/17/how-to-restore-trust-in-medical-research/#comments</comments>
		
		<dc:creator><![CDATA[Marc Toth]]></dc:creator>
		<pubDate>Thu, 17 Apr 2025 16:00:00 +0000</pubDate>
				<category><![CDATA[Commentary & Opinion]]></category>
		<category><![CDATA[explainability]]></category>
		<category><![CDATA[research]]></category>
		<category><![CDATA[science]]></category>
		<category><![CDATA[significance]]></category>
		<category><![CDATA[TES]]></category>
		<category><![CDATA[transparency]]></category>
		<category><![CDATA[trust]]></category>
		<category><![CDATA[truth]]></category>
		<guid isPermaLink="false">https://tessaai.co/?p=344</guid>

					<description><![CDATA[In part two of a series on restoring public trust to the world of scientific and medical research, I delve into the components of trustworthy information - TES]]></description>
										<content:encoded><![CDATA[<h2 class="subhead" style="font-size: 28px; font-family: 'Inter',Arial,Helvetica,sans-serif; line-height: 2.5rem;">The second of a two-part series on what needs to be done to restore public trust in the world of scientific research</h2>
<p><img data-recalc-dims="1" decoding="async" src="https://i0.wp.com/tessaai.co/wp-content/uploads/2025/04/blog-5-restoring-trust.jpg?resize=1024%2C768&#038;ssl=1" alt="a castle being restored to its former glory" width="1024" height="768" class="alignnone size-full wp-image-348" srcset="https://i0.wp.com/tessaai.co/wp-content/uploads/2025/04/blog-5-restoring-trust.jpg?resize=200%2C150&amp;ssl=1 200w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/04/blog-5-restoring-trust.jpg?resize=300%2C225&amp;ssl=1 300w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/04/blog-5-restoring-trust.jpg?resize=400%2C300&amp;ssl=1 400w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/04/blog-5-restoring-trust.jpg?resize=600%2C450&amp;ssl=1 600w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/04/blog-5-restoring-trust.jpg?resize=768%2C576&amp;ssl=1 768w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/04/blog-5-restoring-trust.jpg?resize=800%2C600&amp;ssl=1 800w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/04/blog-5-restoring-trust.jpg?fit=1024%2C768&amp;ssl=1 1024w" sizes="(max-width: 1024px) 100vw, 1024px" /></p>
<span class="fusion-dropcap dropcap" style="--awb-color:var(--awb-color7);">I</span>n <a href="https://tessaai.co/2025/03/20/the-erosion-of-trust-in-medical-research-a-crisis-decades-in-the-making/" title="The Erosion of Trust in Medical Research: A Crisis Decades in the Making">my previous post</a> I wrote about how the loss of trust in research and medicine is damaging the scientific world and hindering progress. In this post, I want to follow up with some thoughts on how we can help restore it.</p>
<h3>Defining trust</h3>
<p>Before I launch into how to restore trust, I should clarify what I am talking about when I use the word. Trust, simply put, is confidence in or reliance on the ability, faithfulness, or accuracy of someone or something.</p>
<p>While trust is often found in the company of “truth”, the two are not the same. “Truth” is <em>a result</em>, whereas “trust” is focused on the means and methods used to <em>arrive at a result</em>. It is an important distinction because in the world of scientific research we don’t always discover a truth, but we should always be able to determine the level of faithfulness and accuracy in the means and methods used to perform that research.</p>
<p>In other words, it needs to be trustworthy.</p>
<h3>Components of Trust</h3>
<p>Trust is a sort of cognitive shortcut that allows us to rely on something without a deep analysis of that thing. If it meets certain criteria, it can be trusted. Psychologists have studied the concept extensively and identified a number of cognitive and social factors that influence how people perceive someone or something as trustworthy (and vice versa). </p>
<p>Even if you have not studied the concept, you are still probably familiar with many of these factors (aka “heuristics”): source credibility or authority, bandwagon effect, perceived motive and intent, consistency and coherence, willingness to engage and revise, confirmation bias, etc. In all, there are around a dozen of these elements; too many for the purposes of this article.</p>
<p>Instead, I have borrowed a simplified framework for trust from computer science and neural networking where they have taken the various components of trust and put them into three interrelated conceptual buckets: Transparency, Explainability, and Significance (TES). </p>
<ul>
<li style="margin-bottom:20px;"><strong>Transparency</strong> can be summed up as “show your work.” In scientific research it is the clarity and fidelity of the methodologies and data sources, affiliations of the researchers, funding sources, a level of detail that allows others to repeat the research described, and so on.</li>
<li style="margin-bottom:20px;"><strong>Explainability</strong> is the consistency and coherence of the information and the ability to support it if it contradicts other information. It also factors in elements like the level of uncertainty, the ability to address questions and criticisms, and details that help shed light on how the conclusions were reached.</li>
<li><strong>Significance</strong> is a measure of the relative importance of both the components and results of a piece of research. Components include the type and nature of study, the reputation of the authors, institutions and publications, etc. It also factors in peer review commentary, recency, citations, and other elements that help determine the overall impact of the information.</li>
</ul>
<p>Each component of TES has many interrelated sub-components so the weighting of each element varies based on the information being analyzed. However, placed on a scale of 0 to 100, the closer each component is to 100, the more “trustworthy” it is (though scientific skepticism makes it extremely unlikely that anything or anyone could ever have a perfect 100 across all three categories).</p>
<h3>Restoring Trust in Science</h3>
<p>In my previous post I identified a number of areas where the scientific research and medical communities had significant failures in each area of TES, leading to an erosion of public trust in science. Whether it was a failure to disclose financial incentives (transparency), the repeated use of fraudulent data (explainability), or the resistance of highly regarded scientists in acknowledging their inaccuracies or errors (significance), or all of them collectively, the damage done has been significant and as such, will take some time to repair.</p>
<p>The good news is the scientific community is more aware of these problems than ever, and many groups are now working on a variety of solutions, both traditional and technological. The quickest fixes lie in a return to the scientific principles of transparency (especially funding sources), open analysis, and a willingness to address conflicting or contrary information in a timely manner.</p>
<p>Longer term the solutions will most likely be technological. Open access and pre-publishing platforms have turned the research spigot wide open, doubling the amount of available research in medicine alone every two months. Parsing and processing that volume of information will require methods faster and more robust than the traditional, more measured and time-consuming methods of peer review and journal publication.</p>
<p>Not surprisingly, AI is playing a large role in attempting to get more control over the research deluge with numerous tech firms devising innovative and useful ways to search, process and digest information. Other organizations like <a href="https://retractionwatch.com/">RetractionWatch</a> are doing important work in surfacing corrections and retractions in the pursuit of scientific progress.</p>
<p>For our part, here at Siensmetrica, we are focused on applying deep data science and multi-vector analysis to identify and score research based on TES principles. Our aim is not to supplant the rigors of the scientific method, but to provide scientists and medical professionals with an objective way to assess the trustworthiness of a piece of research—a tool for guiding further exploration. The goal is not to always be right, but to be transparent and consistent so that we can restore belief in a system which, though not always perfect, can be relied upon to be heading in the right direction.</p>
<p>If we are successful, “trust the science” will be the gold standard once again.</p><p>The post <a href="https://tessaai.co/2025/04/17/how-to-restore-trust-in-medical-research/">How to Restore Trust in Medical Research</a> first appeared on <a href="https://tessaai.co">Tessa AI</a>.</p>]]></content:encoded>
					
					<wfw:commentRss>https://tessaai.co/2025/04/17/how-to-restore-trust-in-medical-research/feed/</wfw:commentRss>
			<slash:comments>3</slash:comments>
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">344</post-id>	</item>
		<item>
		<title>The Erosion of Trust in Medical Research: A Crisis Decades in the Making</title>
		<link>https://tessaai.co/2025/03/20/the-erosion-of-trust-in-medical-research-a-crisis-decades-in-the-making/?utm_source=rss&#038;utm_medium=rss&#038;utm_campaign=the-erosion-of-trust-in-medical-research-a-crisis-decades-in-the-making</link>
					<comments>https://tessaai.co/2025/03/20/the-erosion-of-trust-in-medical-research-a-crisis-decades-in-the-making/#comments</comments>
		
		<dc:creator><![CDATA[Marc Toth]]></dc:creator>
		<pubDate>Thu, 20 Mar 2025 06:00:39 +0000</pubDate>
				<category><![CDATA[Commentary & Opinion]]></category>
		<category><![CDATA[medical research]]></category>
		<category><![CDATA[research]]></category>
		<category><![CDATA[TES]]></category>
		<category><![CDATA[trust]]></category>
		<guid isPermaLink="false">https://tessaai.co/?p=333</guid>

					<description><![CDATA["Follow the Science" used to be shorthand for trustworthy information, but not so much anymore. The scientific community needs to take steps to restore it.]]></description>
										<content:encoded><![CDATA[<h2 class="subhead" style="font-size: 28px; font-family: 'Inter',Arial,Helvetica,sans-serif; line-height: 2.5rem;">&#8220;Follow the Science&#8221; used to be shorthand for trustworthy information, but not so much anymore. The scientific community needs to take steps to restore that trust</h2>
<p><img data-recalc-dims="1" decoding="async" src="https://i0.wp.com/tessaai.co/wp-content/uploads/2025/03/b4-eroding-trust-1024x768-1.jpg?resize=1024%2C768&#038;ssl=1" alt="decorative photo" width="1024" height="768" class="alignnone size-full wp-image-335" srcset="https://i0.wp.com/tessaai.co/wp-content/uploads/2025/03/b4-eroding-trust-1024x768-1.jpg?resize=200%2C150&amp;ssl=1 200w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/03/b4-eroding-trust-1024x768-1.jpg?resize=300%2C225&amp;ssl=1 300w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/03/b4-eroding-trust-1024x768-1.jpg?resize=400%2C300&amp;ssl=1 400w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/03/b4-eroding-trust-1024x768-1.jpg?resize=600%2C450&amp;ssl=1 600w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/03/b4-eroding-trust-1024x768-1.jpg?resize=768%2C576&amp;ssl=1 768w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/03/b4-eroding-trust-1024x768-1.jpg?resize=800%2C600&amp;ssl=1 800w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/03/b4-eroding-trust-1024x768-1.jpg?fit=1024%2C768&amp;ssl=1 1024w" sizes="(max-width: 1024px) 100vw, 1024px" /></p>
<p style="margin-top:20px;">For decades, the phrase &#8220;follow the science&#8221; conveyed a sense of unwavering trust. It implied confidence in a system dedicated to advancing human health through rigorous inquiry. However, recent events have revealed significant fractures in this trust, exposing systemic issues that threaten both public confidence and the very progress of scientific discovery.</p>
<p>The scandal surrounding Alzheimer&#8217;s research serves as a stark example. As reported in <em><a href="https://www.chronicle.com/article/a-scandal-in-alzheimers-research-shows-how-science-can-go-astray" rel="noopener" target="_blank">The Chronicle of Higher Education</a></em>, a substantial portion of foundational research over the past two decades was based on manipulated or fraudulent data. This deception led to the misallocation of tens of millions of research dollars, wasted the efforts of numerous scientists, and, most critically, delayed the pursuit of effective treatments and a cure. The implications are profound: how many lives could have been improved, or even saved, had research not been misdirected by fraudulent findings?</p>
<p>This crisis of trust extends beyond Alzheimer&#8217;s research. The decline in public confidence in medical institutions and scientific integrity is widespread. During his <a href="https://x.com/AVPac_US/status/1897702804719910999" rel="noopener" target="_blank">recent Senate confirmation hearing</a> for FDA commissioner, Dr. Marty Makary of Johns Hopkins University highlighted this alarming trend:</p>
<blockquote><p>“Trust in doctors and hospitals is currently in a critical state. It was 71% in 2019… now it’s down to 40%. That’s a 31-point drop in my profession. This is a significant problem. If we develop a cure for pancreatic cancer but only 40% of the public is willing to accept it due to distrust, the medication’s effectiveness is essentially reduced to 40%.”</p></blockquote>
<p>Dr. Makary’s statement underscores the real-world consequences of a public that questions the integrity of medical research. If individuals decline treatment or doubt the validity of scientific findings, even groundbreaking discoveries lose their potential impact.</p>
<p>A central factor in this crisis is the influence of financial incentives in research. Whether it’s the pursuit of lucrative grants, the pressure to publish impactful findings, or the financial interests of pharmaceutical companies, the incentives for scientists are not always aligned with the pursuit of objective truth. This misalignment has contributed to instances of manipulated studies, suppressed data, and an overall erosion of faith in the scientific establishment.</p>
<p>It is essential to distinguish between scientific truth and public trust. Science is an iterative process, and current understandings may evolve as new evidence emerges. This is inherent to scientific progress. However, public trust should remain steadfast. The expectation is not that scientists will always be correct, but that they will be transparent and honest in their pursuit of knowledge. When financial incentives, personal ambitions, or institutional pressures supersede the unbiased search for truth, trust inevitably deteriorates.</p>
<p>This decline in trust does not imply that science is irreparable, nor does it suggest that all research is flawed. It does, however, indicate a deep-seated problem that requires attention. Fortunately, awareness of these shortcomings is growing within the scientific community, and efforts to address them are underway.</p>
<p>In the <a href="https://tessaai.co/2025/04/17/how-to-restore-trust-in-medical-research/" title="How to Restore Trust in Medical Research">second part of this series</a>, I will explore potential solutions to rebuild trust in medical research—how transparency, accountability, and systemic reforms can restore confidence in a field that, at its best, has the power to transform lives. For now, the reality remains: trust in medical research has been compromised, and without decisive action, the consequences will be felt for generations.</p><p>The post <a href="https://tessaai.co/2025/03/20/the-erosion-of-trust-in-medical-research-a-crisis-decades-in-the-making/">The Erosion of Trust in Medical Research: A Crisis Decades in the Making</a> first appeared on <a href="https://tessaai.co">Tessa AI</a>.</p>]]></content:encoded>
					
					<wfw:commentRss>https://tessaai.co/2025/03/20/the-erosion-of-trust-in-medical-research-a-crisis-decades-in-the-making/feed/</wfw:commentRss>
			<slash:comments>2</slash:comments>
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">333</post-id>	</item>
		<item>
		<title>The Growing Problem with Bogus Research</title>
		<link>https://tessaai.co/2025/02/26/the-growing-problem-with-bogus-research/?utm_source=rss&#038;utm_medium=rss&#038;utm_campaign=the-growing-problem-with-bogus-research</link>
					<comments>https://tessaai.co/2025/02/26/the-growing-problem-with-bogus-research/#respond</comments>
		
		<dc:creator><![CDATA[Marc Toth]]></dc:creator>
		<pubDate>Wed, 26 Feb 2025 18:12:05 +0000</pubDate>
				<category><![CDATA[Commentary & Opinion]]></category>
		<category><![CDATA[bogus research]]></category>
		<category><![CDATA[fake research]]></category>
		<category><![CDATA[gaming the system]]></category>
		<category><![CDATA[research]]></category>
		<category><![CDATA[scientific papers]]></category>
		<guid isPermaLink="false">https://tessaai.co/?p=259</guid>

					<description><![CDATA[The system is broken. We need to do something about the hundreds of thousands of published fake scientific papers undermining research advances.]]></description>
										<content:encoded><![CDATA[<h2 class="subhead" style="font-size: 28px; font-family: 'Inter',Arial,Helvetica,sans-serif; line-height: 2.5rem;">We need to do something about the hundreds of thousands of published fake scientific papers undermining research advances</h2>
<div id="attachment_263" style="width: 1034px" class="wp-caption alignnone"><img data-recalc-dims="1" decoding="async" aria-describedby="caption-attachment-263" src="https://i0.wp.com/tessaai.co/wp-content/uploads/2025/02/bogus-research-lab-1024x768-1.jpg?resize=1024%2C768&#038;ssl=1" alt="A man in a lab coat in a laundry room looking through a microscope" width="1024" height="768" class="size-full wp-image-263" srcset="https://i0.wp.com/tessaai.co/wp-content/uploads/2025/02/bogus-research-lab-1024x768-1.jpg?resize=200%2C150&amp;ssl=1 200w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/02/bogus-research-lab-1024x768-1.jpg?resize=300%2C225&amp;ssl=1 300w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/02/bogus-research-lab-1024x768-1.jpg?resize=400%2C300&amp;ssl=1 400w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/02/bogus-research-lab-1024x768-1.jpg?resize=600%2C450&amp;ssl=1 600w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/02/bogus-research-lab-1024x768-1.jpg?resize=768%2C576&amp;ssl=1 768w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/02/bogus-research-lab-1024x768-1.jpg?resize=800%2C600&amp;ssl=1 800w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/02/bogus-research-lab-1024x768-1.jpg?fit=1024%2C768&amp;ssl=1 1024w" sizes="(max-width: 1024px) 100vw, 1024px" /><p id="caption-attachment-263" class="wp-caption-text">A growing amount of research isn&#8217;t research at all</p></div>
<p>While many of the changes to scientific research publishing over the past decade have been positive, <a href="https://tessaai.co/2024/10/24/medical-research-publishing-needs-new-metrics/">as I’ve noted before</a>, there are plenty of people willing to game the system for their own advantage. We were reminded of this a few weeks ago when an <a href="https://theconversation.com/bogus-scientific-papers-are-enriching-fraudsters-and-slowing-lifesaving-medical-research-248291" rel="noopener" target="_blank">article published in <em>The Conversation</em></a> highlighted the fact that while some 55,000 scientific papers have been <a href="https://gitlab.com/crossref/retraction-watch-data">officially retracted to date</a>, hundreds of thousands of bogus papers are still in circulation. These papers distort scientific literature, making it harder for legitimate researchers to find accurate, reliable information.</p>
<p><img data-recalc-dims="1" decoding="async" src="https://i0.wp.com/tessaai.co/wp-content/uploads/2025/02/blog3-retraction-graph.png?resize=624%2C476&#038;ssl=1" alt="A graph showing the number of retracted scientific papers" width="624" height="476" class="alignnone size-full wp-image-260" srcset="https://i0.wp.com/tessaai.co/wp-content/uploads/2025/02/blog3-retraction-graph.png?resize=200%2C153&amp;ssl=1 200w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/02/blog3-retraction-graph.png?resize=300%2C229&amp;ssl=1 300w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/02/blog3-retraction-graph.png?resize=400%2C305&amp;ssl=1 400w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/02/blog3-retraction-graph.png?resize=600%2C458&amp;ssl=1 600w, https://i0.wp.com/tessaai.co/wp-content/uploads/2025/02/blog3-retraction-graph.png?fit=624%2C476&amp;ssl=1 624w" sizes="(max-width: 624px) 100vw, 624px" /></p>
<h3>Root Causes: Flaws in Academic Publishing</h3>
<p>As <em>The Conversation</em> article notes, among the main problems are “paper mills.” Supposed scientific journals that are in fact shadowy commercial operations profiting from the wholesale publication of fraudulent scholarly research. Paper mills operate on a “pay-to-play” model where the journal makes money by charging authors to publish their research. The more papers published, the more the journal profits, and a rigorous review process interferes with that. So, rather than the standard (read: slow and detailed) process, these publishers manipulate it, sometimes through peer review rings or fabricating reviewers, other times by outright bribery of editors:</p>
<blockquote><p>Some publishers may try to pick reviewers they deem more likely to accept papers, because rejecting a manuscript can mean losing out on thousands of dollars in publication fees. Worse, some corrupt scientists form peer review rings. Paper mills may create fake peer reviewers. Others may bribe editors or plant agents on journal editorial boards&#8230;</p></blockquote>
<p>Fake research is particularly harmful in fields like medicine and cancer research where misleading data can delay life-saving treatments. Scientists often unknowingly base their work on fraudulent findings, wasting time and resources. Even when fraud is detected (often by independent researchers and amateur sleuths), journals are slow to retract problematic papers, further contaminating the academic record.</p>
<h3>Searching for Solutions</h3>
<p>A number of researchers and organizations are attempting to tackle the bogus research problem through the use of technology. The <a href="https://www.cochranelibrary.com/" rel="noopener" target="_blank">Cochrane Collaboration</a> is developing tools to detect and automatically exclude fraudulent research. Technology firms like <a href="https://www.scitility.com/argos" rel="noopener" target="_blank">Argos</a>, <a href="https://www.morressier.com/company/morressiers-guide-to-research-integrity" rel="noopener" target="_blank">Morressier</a>, <a href="https://research-signals.com/" rel="noopener" target="_blank">Signals</a>, and Clear Skies’ <a href="https://clear-skies.co.uk/">Papermill Alarm</a> are all working on systems to help verify research integrity including AI-driven tools that can screen millions of papers for fraudulent patterns.</p>
<p>Of course, the problem with paper mills won’t go away until the financial incentives do, which will require a re-ordering of an industry model that currently generates billions of dollars every year. With <a href="https://stm-assoc.org/document/stm-global-brief-2021-economics-and-market-size-2/" rel="noopener" target="_blank">more than 50,000 journals</a> accepting money to publish papers, this is no small undertaking and unlikely to happen any time in the near future.<br />
The article’s author’s note, however, a good step in the right direction would be to mandate greater openness and transparency in the publication and peer review process. Journals should make all peer review reports openly available, even for the research they decline to publish. Additionally, as vigorous peer review is critical to the recognition of valuable research, it should be recognized as a scholarly contribution on par with the original article.</p>
<p>A final measure should be to force publishers to act more swiftly when fraudulent research is exposed. Many will resist this as it can affect the journal&#8217;s reputation, but those who embrace it will also enjoy a higher standing in the scientific community, and perhaps benefit financially from it.</p>
<h3>A Long Way to Go</h3>
<p>While the problem of bogus research—and those who game the system to their advantage—isn’t about to go away soon, if the scientific community can come together and start demanding greater transparency and scrutiny in research publishing, we all will benefit.</p>
<p>Once we have a handle on separating the real from the fake, we can get down to the next task which is identifying the trustworthy and valuable information in a rising sea of scientific research. That’s when the real breakthroughs begin.</p><p>The post <a href="https://tessaai.co/2025/02/26/the-growing-problem-with-bogus-research/">The Growing Problem with Bogus Research</a> first appeared on <a href="https://tessaai.co">Tessa AI</a>.</p>]]></content:encoded>
					
					<wfw:commentRss>https://tessaai.co/2025/02/26/the-growing-problem-with-bogus-research/feed/</wfw:commentRss>
			<slash:comments>0</slash:comments>
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">259</post-id>	</item>
		<item>
		<title>Medical Research Publishing Needs New Metrics</title>
		<link>https://tessaai.co/2024/10/24/medical-research-publishing-needs-new-metrics/?utm_source=rss&#038;utm_medium=rss&#038;utm_campaign=medical-research-publishing-needs-new-metrics</link>
					<comments>https://tessaai.co/2024/10/24/medical-research-publishing-needs-new-metrics/#comments</comments>
		
		<dc:creator><![CDATA[Marc Toth]]></dc:creator>
		<pubDate>Thu, 24 Oct 2024 06:00:57 +0000</pubDate>
				<category><![CDATA[Commentary & Opinion]]></category>
		<category><![CDATA[explainability]]></category>
		<category><![CDATA[metrics]]></category>
		<category><![CDATA[research]]></category>
		<category><![CDATA[significance]]></category>
		<category><![CDATA[TES]]></category>
		<category><![CDATA[trust]]></category>
		<guid isPermaLink="false">https://tessaai.co/?p=140</guid>

					<description><![CDATA[Open access &amp; preprint are overwhelming medical research; we need a more trustworthy, explainable and significant way to separate the high quality data from low quality data]]></description>
										<content:encoded><![CDATA[<div class="fusion-fullwidth fullwidth-box fusion-builder-row-2 fusion-flex-container has-pattern-background has-mask-background nonhundred-percent-fullwidth non-hundred-percent-height-scrolling awb-cv-auto" style="--awb-border-radius-top-left:0px;--awb-border-radius-top-right:0px;--awb-border-radius-bottom-right:0px;--awb-border-radius-bottom-left:0px;--awb-padding-right:0px;--awb-padding-left:0px;--awb-flex-wrap:wrap;" ><div class="fusion-builder-row fusion-row fusion-flex-align-items-flex-start fusion-flex-content-wrap" style="max-width:1248px;margin-left: calc(-4% / 2 );margin-right: calc(-4% / 2 );"><div class="fusion-layout-column fusion_builder_column fusion-builder-column-1 fusion_builder_column_1_1 1_1 fusion-flex-column" style="--awb-bg-size:cover;--awb-width-large:100%;--awb-margin-top-large:0px;--awb-spacing-right-large:1.92%;--awb-margin-bottom-large:0px;--awb-spacing-left-large:1.92%;--awb-width-medium:100%;--awb-spacing-right-medium:1.92%;--awb-spacing-left-medium:1.92%;--awb-width-small:100%;--awb-spacing-right-small:1.92%;--awb-spacing-left-small:1.92%;"><div class="fusion-column-wrapper fusion-flex-justify-content-flex-start fusion-content-layout-column"><div class="fusion-text fusion-text-4"><h2 style="font-size: 28px; font-family: 'Inter',Arial,Helvetica,sans-serif; line-height: 2.5rem;">Open access and preprint articles are overwhelming the industry with research; we need a more trustworthy, explainable and significant way to separate the high quality data from low quality data</h2>
<p><img data-recalc-dims="1" decoding="async" class="alignnone size-large wp-image-142" src="https://i0.wp.com/tessaai.co/wp-content/uploads/2024/10/paper-stacks-2000x1500-1.jpg?resize=1024%2C768&#038;ssl=1" alt="Stacks of papers on a shelf" width="1024" height="768" srcset="https://i0.wp.com/tessaai.co/wp-content/uploads/2024/10/paper-stacks-2000x1500-1.jpg?resize=200%2C150&amp;ssl=1 200w, https://i0.wp.com/tessaai.co/wp-content/uploads/2024/10/paper-stacks-2000x1500-1.jpg?resize=300%2C225&amp;ssl=1 300w, https://i0.wp.com/tessaai.co/wp-content/uploads/2024/10/paper-stacks-2000x1500-1.jpg?resize=400%2C300&amp;ssl=1 400w, https://i0.wp.com/tessaai.co/wp-content/uploads/2024/10/paper-stacks-2000x1500-1.jpg?resize=600%2C450&amp;ssl=1 600w, https://i0.wp.com/tessaai.co/wp-content/uploads/2024/10/paper-stacks-2000x1500-1.jpg?resize=768%2C576&amp;ssl=1 768w, https://i0.wp.com/tessaai.co/wp-content/uploads/2024/10/paper-stacks-2000x1500-1.jpg?resize=800%2C600&amp;ssl=1 800w, https://i0.wp.com/tessaai.co/wp-content/uploads/2024/10/paper-stacks-2000x1500-1.jpg?resize=1024%2C768&amp;ssl=1 1024w, https://i0.wp.com/tessaai.co/wp-content/uploads/2024/10/paper-stacks-2000x1500-1.jpg?resize=1200%2C900&amp;ssl=1 1200w, https://i0.wp.com/tessaai.co/wp-content/uploads/2024/10/paper-stacks-2000x1500-1.jpg?resize=1536%2C1152&amp;ssl=1 1536w, https://i0.wp.com/tessaai.co/wp-content/uploads/2024/10/paper-stacks-2000x1500-1.jpg?fit=2000%2C1500&amp;ssl=1 2000w" sizes="(max-width: 1024px) 100vw, 1024px" /></p>
<p style="margin-top: 30px;">I have been in the healthcare field for a couple of decades now; long enough to see a lot of changes. Faxes replaced by email, paper replaced by electronic healthcare records, office consults replaced by smartphone apps. But nowhere has there been as much change as in medical and scientific research publishing.</p>
<p>As recently as 2009 research publishing was mostly the purview of a relatively small group of academic publishers controlling the majority of journals. As gatekeepers of information, the lifeblood of science, these journals were able to generate substantial revenues through both fees to subscribe to more prestigious publications, and fees to publish (known as author publishing charges or APCs) in lower impact partner publications.</p>
<h3>The Rise of Open Access</h3>
<p>Things began to change in 2004. The U.S. National Institutes of Health (NIH) Public Access Policy mandated open access to research they funded, and Europe’s Plan S soon followed suit. Digital publishing and Internet access made widespread electronic distribution possible; open access and preprint publishing platforms soon followed, opening the research access floodgates.</p>
<p>In <a href="https://link.springer.com/article/10.1007/s11606-023-08307-z" target="_blank" rel="noopener">The Changing Medical Publishing Industry: Economics, Expansion, and Equity</a>, a paper published by a group of physicians in the Journal of General Internal Medicine (JGIM) in July of 2023, the authors note the number of open access journals over the past 20 years has risen from near zero to over 16,000.</p>
</div><div class="fusion-text fusion-text-5 fusion-text-no-margin" style="--awb-margin-top:20px;--awb-margin-bottom:20px;"><div style="border: 1px solid #e5e5e5; padding: 20px 20px 20px 20px;">
<div id="attachment_192" style="width: 1034px" class="wp-caption alignnone"><img data-recalc-dims="1" decoding="async" aria-describedby="caption-attachment-192" class="size-large wp-image-192" src="https://i0.wp.com/tessaai.co/wp-content/uploads/2024/10/post1-num-open-access-journals.png?resize=1024%2C680&#038;ssl=1" alt="A chart showing the growth of open access journals since 2000" width="1024" height="680" srcset="https://i0.wp.com/tessaai.co/wp-content/uploads/2024/10/post1-num-open-access-journals.png?resize=200%2C133&amp;ssl=1 200w, https://i0.wp.com/tessaai.co/wp-content/uploads/2024/10/post1-num-open-access-journals.png?resize=300%2C199&amp;ssl=1 300w, https://i0.wp.com/tessaai.co/wp-content/uploads/2024/10/post1-num-open-access-journals.png?resize=400%2C266&amp;ssl=1 400w, https://i0.wp.com/tessaai.co/wp-content/uploads/2024/10/post1-num-open-access-journals.png?resize=600%2C399&amp;ssl=1 600w, https://i0.wp.com/tessaai.co/wp-content/uploads/2024/10/post1-num-open-access-journals.png?resize=768%2C510&amp;ssl=1 768w, https://i0.wp.com/tessaai.co/wp-content/uploads/2024/10/post1-num-open-access-journals.png?resize=800%2C532&amp;ssl=1 800w, https://i0.wp.com/tessaai.co/wp-content/uploads/2024/10/post1-num-open-access-journals.png?resize=1024%2C680&amp;ssl=1 1024w, https://i0.wp.com/tessaai.co/wp-content/uploads/2024/10/post1-num-open-access-journals.png?resize=1200%2C797&amp;ssl=1 1200w, https://i0.wp.com/tessaai.co/wp-content/uploads/2024/10/post1-num-open-access-journals.png?fit=1508%2C1002&amp;ssl=1 1508w" sizes="(max-width: 1024px) 100vw, 1024px" /><p id="caption-attachment-192" class="wp-caption-text">Source: The Changing Medical Publishing Industry: Economics, Expansion, and Equity, Springer.com</p></div>
</div>
</div><div class="fusion-text fusion-text-6"><p>The authors note that we are only beginning to understand the opportunities, and consequences, today.</p>
<blockquote>
<p>…open access will result in wider dissemination, and preprint platforms with faster communication of science&#8230; However, consumers of research may have more difficulty assessing the validity of conclusions from the increased number of research reports&#8230; Rapid expansion of published research brings with it the risks of prioritizing quantity over quality of medical research. This poses risks to patients if clinical decisions are influenced by shoddy science.</p>
</blockquote>
<h3>Identifying Quality Among Quantity</h3>
<p>Of course, quantity over quality has always been an issue in scientific research, which is why there are checks like conflict disclosures, statements of limitations, the <a href="https://en.wikipedia.org/wiki/H-index" target="_blank" rel="noopener"><em>h</em>-index</a>, and peer review. But even with these, sheer volume and velocity of newly published research, and the opaque nature of peer review makes the task of identifying valuable knowledge in a rising sea of information extremely difficult. The JGIM paper’s authors note that current methods are better than nothing, but still a far from a complete solution:</p>
<blockquote>
<p>“…peer review remains an important part of the scientific method. We acknowledge that the empiric benefits of peer review remain debatable, and it may not filter high-quality from low-quality research as well as we like to believe. However, we believe it is better than an alternative system in which there is no formal process for peer input and constructive critique.&#8221;</p>
</blockquote>
<p>The writers go on to suggest that newer open models including engagement via comments on preprint platforms and community peer review via systems like <a href="https://pubpeer.com/" target="_blank" rel="noopener">PubPeer</a> have potential. However, my own experience with healthcare providers, researchers and other consumers of this information, indicates that inputs like these will probably fall short. They’re labor-intensive and, more importantly, as we’ve seen in other open discussion platforms, subject to manipulation by bad actors and robots. As a result, for the Open Access research model to succeed, new models for vetting and valuing research will also be required.</p>
<h3>Developing New Metrics for Research Quality</h3>
<p>One of the biggest problems with open access and preprint literature is also one of the oldest: “information overload.” <a href="https://oxfordre.com/politics/display/10.1093/acrefore/9780190228637.001.0001/acrefore-9780190228637-e-1360" target="_blank" rel="noopener">Researchers at Oxford University define this</a> as:</p>
<blockquote>
<p>&#8230;the situation that arises when there is so much relevant and potentially useful information available that it becomes a hindrance rather than a help.</p>
</blockquote>
<p>They note that this overload creates a condition creatively called <em>data smog</em>, which is a cloudy, unhealthy, perception of what information is actually available and whether it is of value. Anyone who has ever done a web search on a topic that seems fairly specific and straightforward only to be presented with a million results knows the data smog effect and the skepticism in <em>any</em> results it leads to.</p>
<p>Commercial search engines like Google have developed sophisticated models that do a pretty good job at identifying and presenting relevant information in search. Unfortunately, people have developed techniques in “search engine optimization” (SEO), to game search results in such a way that unless you are a sophisticated search engine user familiar with the commands and parameters for creating highly specific search queries, you are still likely to be showered with mostly irrelevant information.</p>
<p>The question is then, if a near-trillion-dollar search engine giant can’t create a reliable method for identifying and presenting high quality, trustworthy information, how is a frontier community like open access academic publishing supposed to?</p>
<h3>Trust, Explainability, and Significance</h3>
<p>Fortunately, we have examples of how this might be accomplished from applications in other scientific fields. Researchers are leveraging advances in data science, neural networking, machine learning, and to a lesser degree, artificial intelligence to successfully identify solutions for extremely complex problems. Rather than relying on Boolean parameters like AND, IF and NOT, they are using multi-modal analysis of vast quantities of information to develop models that identify and present the most promising data. Computer scientists working in these areas often refer to three very human terms—<strong>Trust, Explainability, and Significance (TES)</strong>—as the underpinnings of how they assist human beings in identifying high quality information in an otherwise limitless ocean of data.</p>
<p>TES is already being used to explore new avenues of research and help make incredible advances in a range of highly complex fields from molecular chemistry to financial market behavior analysis. Significantly, these fields have an open access history that is more agile and mature, but no less complex, than that of medical research publishing. As a result, leveraging TES-based technologies for both the discovery of high-quality information, and assisting human beings in confident decision-making based on it, offers considerable promise in healthcare research and clinical decision-making.</p>
<p>Traditional methods for establishing the validity and value of research will still have value in an open access, open distribution publishing model. But, without some means of separating the high quality from the low in an industry that is doubling the amount of available information every three months, information overload will grow, and confidence will fall. Incorporating <strong>Trust, Explainability, and Significance</strong> concepts into medical research exploration and search technologies offers a way to confidently advance and accelerate medical knowledge and improve healthcare delivery and outcomes.</p>
</div></div></div></div></div><p>The post <a href="https://tessaai.co/2024/10/24/medical-research-publishing-needs-new-metrics/">Medical Research Publishing Needs New Metrics</a> first appeared on <a href="https://tessaai.co">Tessa AI</a>.</p>]]></content:encoded>
					
					<wfw:commentRss>https://tessaai.co/2024/10/24/medical-research-publishing-needs-new-metrics/feed/</wfw:commentRss>
			<slash:comments>1</slash:comments>
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">140</post-id>	</item>
	</channel>
</rss>
