Symbolic illustration of open science and collaborative research.

Open Science Revolution: How Resource Sharing is Transforming Research

"Unveiling the power of reproducibility and collaborative knowledge in modern scientific journals."


The landscape of scientific research is evolving, emphasizing the dissemination of generalizable knowledge applicable across diverse settings. A pivotal landmark has been achieved, celebrating the acceptance of the 1,000th article. This milestone underscores the rise of new informatics subspecialties, the initiation of targeted funding, and the significant involvement of patients in their healthcare journey and related research.

The demand for skilled informatics professionals is outpacing the training capacity, resulting in heightened responsibilities for those in the field. The dedication exhibited by associate editors, editorial board members, and reviewers is critical in maintaining high-quality standards. Recognizing and properly crediting reviewers' contributions in evaluations for appointments and promotions is essential, especially as their roles continue to expand.

Scientific publishing is undergoing a transformative shift, with informatics playing a crucial role. Promoting resource sharing is vital for advancing discoveries for current and future scientists. The ability to reproduce scientific findings is now facilitated through the creation of repositories that index, preserve, and share the essential components of analytical processes. Journals are publishing key algorithms and findings, while repositories are indexing ingredients (data and software) and 'recipes' to ensure result reproducibility.

AI Search Multiple angles on this topic

Openness and Reproducibility

Concerns about the low reproducibility of many scientific findings have prompted scientists, journals, and funders to consider open science as a way to improve research reliability and robustness. Open science is associated with openness in methods, materials, data, and research communities. However, inadequate access to the data needed to rerun experiments or analyses remains a major concern throughout science. Research on open production, open distribution, and open consumption also shows that researchers use different data-sharing practices in relation to their methodological approaches.

The Power of Collaboration: Overcoming Challenges in Reproducibility

Symbolic illustration of open science and collaborative research.

The convergence of technology and policy is enabling greater access to data and software environments, thereby fostering team science that transcends institutional boundaries. When combined with incentives that value sharing and acknowledging contributions to team science, these advancements can potentially accelerate discoveries beyond what was previously imagined. It's important for journal publishers, editors, reviewers, authors, and owners to consider their roles in facilitating novel, reproducible, and sustainable knowledge for the audience.

While traditional articles remain relevant, the increasing volume of data necessitates a process where the most relevant materials are carefully curated and disseminated to target audiences. Many informatics journal articles should include data, software, and systems to reproduce the science and facilitate new analyses. Identifying reviewers with the necessary expertise and time poses a significant challenge, often exceeding their expected duties. However, the informatics community is uniquely positioned to address this need.

  • Data Accessibility: Improving access to data and software to enhance collaboration.
  • Reviewer Expertise: Leveraging the expertise within the informatics community for result verification.
  • Standardization: Applying standards to ensure analyses are comparable and reproducible.
AI Search Multiple angles on this topic

Data Sharing and Reproducibility

Clinical research informatics for big data and precision medicine describes data sharing as increasingly important for improving reproducibility. The source reports that publishers and scientists have increasingly recognized this importance. This recognition links shared research data with efforts to make scientific findings more reproducible.

The Journal’s Responsibility

A scientific journal’s role is to disseminate generalizable knowledge. That knowledge should be applicable to new settings and should advance science. Resource sharing and reproducibility therefore matter because research claims must be useful beyond the setting in which they were originally produced.

Plans are in place to maintain a leading position in innovative informatics publishing. The continuous publication of articles on new software systems, data analyses, and novel approaches helps organize and evaluate data for new insights. By promoting the reproducibility and reuse of algorithms, software, data, workflows, and knowledge, JAMIA is leading advancements in systems evaluation and knowledge dissemination. Addressing these challenges will drive scientific advancement and improve healthcare outcomes.

Embracing the Future of Scientific Discovery

JAMIA continues to emphasize reproducibility and the use of standards. The journal addresses the fundamental dependence on biomedical and healthcare data standards. Guest editors Richesson and Chute highlight how the selected articles contribute to our field.

AI Search Multiple angles on this topic

Transparency Beyond Sharing

Problems with experimental reproducibility affect every field of science, although opinions about their causes and possible solutions vary among fields. Good, reproducible science involves more than simply sharing work, but open science practices can promote reproducibility, accessibility, and the democratization of science. Transparency throughout the research process can help researchers, the public, and external decisionmakers trust scientific work.

A Global Open Science Assessment

UNESCO reports that a growing number of countries are developing paths toward more open, inclusive, and accessible science systems. Its Open Science Outlook 2023 is described as the first global assessment of the state of open science, based on the priorities, values, and principles of the 2021 UNESCO Recommendation on Open Science. The assessment seeks metrics, indicators, and methodologies for describing open science through both qualitative and quantitative measures.

Evidence and Uneven Effectiveness

Evidence indicates that reproducibility remains a substantial challenge across scientific disciplines. Replication projects frequently report lower-than-expected replication success, smaller effect sizes than originally published, incomplete reporting, and limited access to underlying data and analytical code. Although various open science practices have been proposed to improve reproducibility and replicability, the available evidence does not show that every practice is effective.

Stories of Trustworthy Science

The Horizon Europe-funded OSIRIS project, or Open Science to Increase Reproducibility in Science, developed Ten Tales of Reproducibility. The collection brings together ten real-world stories about individuals and institutions working to make reproducible science a reality. Related case studies describe approaches and current best practices for achieving computational reproducibility and serve as the foundation for studying those approaches.

This collective effort promises to reshape scientific research, accelerate discovery, and ultimately improve healthcare outcomes. The integration of technology, collaborative practices, and standardized approaches will pave the way for groundbreaking advancements.

Readers are encouraged to embrace this new era, engage with the content, and join the movement toward enhancing reproducibility and expanding the utilization of resources showcased in this journal. Together, the path can be forged toward more transparent, efficient, and impactful scientific endeavors.

The editorial at a glance, in its own terms

Durationabout 4.5 years[1]
Times cited1[1]

What the editorial's approach adds up to

The editorial frames a journal as more than a venue for publishing conclusions: it can connect findings with the materials and analytical processes needed to examine and reuse them.[1]

That model depends on access in practice. Reviewers need working versions of some software and data to check quality and verify results, even when public sharing is not possible.[1]

Constraints the evidence points to

  • Proprietary software and data that cannot be public limit openness; the editorial instead emphasizes access for reviewers to assess and verify work.[1]

What implementation would need to establish

  • Do repositories’ indexing and preservation translate into reusable analytical workflows across new analyses, as the editorial hopes?[1]
  • How should journals recognize expanded reviewer work when assessing appointments, promotions, and standing in the field?[1]

Sources

  1. A journal's role in resource sharing and reproducibility (Oxford University Press (OUP), 2015)

About this Article -

Written with AI assistance from published research, and reviewed by the Mystum team. See our About page for more information.

This article is based on research published under:

DOI-LINK: 10.1093/jamia/ocv057, Alternate LINK

Title: A Journal'S Role In Resource Sharing And Reproducibility

Subject: Health Informatics

Journal: Journal of the American Medical Informatics Association

Publisher: Oxford University Press (OUP)

Authors: Lucila Ohno-Machado

Published: 2015-05-01

Everything You Need To Know

1

What is resource sharing and why is it important?

Resource sharing is the practice of making research resources, such as data and software, openly available. This is significant because it accelerates scientific discoveries by allowing researchers to build upon each other's work. Increased collaboration and knowledge sharing can lead to faster advancements in fields such as biomedical and healthcare informatics. The journal JAMIA promotes resource sharing, leading advancements in systems evaluation and knowledge dissemination.

2

What does reproducibility mean in the context of scientific research?

Reproducibility in scientific research means that the results of a study can be independently verified by other researchers. This is crucial for ensuring the reliability and validity of scientific findings. The article emphasizes the importance of reproducibility by promoting the use of repositories to index, preserve, and share the essential components of analytical processes. Journals like JAMIA play a key role by publishing key algorithms and findings along with indexing data and software to ensure result reproducibility.

3

What is the role of journals like JAMIA in the context of open science?

The role of journals like JAMIA is evolving to promote open science practices. These journals are now focused on disseminating not only the findings of research but also the methods and resources used to achieve those findings. This includes publishing key algorithms, data, and software, enabling other researchers to reproduce and build upon the published work. By doing so, journals facilitate collaboration and accelerate the pace of discovery in informatics.

4

What are the key challenges in scientific publishing?

The key challenges in scientific publishing, as presented in the text, include ensuring data accessibility, identifying reviewers with the necessary expertise, and standardizing analysis methods. Improving access to data and software enhances collaboration. The informatics community is uniquely positioned to overcome these challenges. Standardization of analyses is also important to ensure that different studies can be compared. Addressing these challenges will drive scientific advancement and improve healthcare outcomes.

5

How is informatics changing scientific research?

Informatics plays a crucial role in the transformation of scientific research. The increasing volume of data requires careful curation and dissemination. Informatics professionals are essential for developing and applying standards to ensure analyses are comparable and reproducible. JAMIA emphasizes reproducibility, data standards, and promoting the use of standards. Guest editors Richesson and Chute highlight how the selected articles contribute to our field.

Newsletter Subscribe

Subscribe to get the latest articles and insights directly in your inbox.