Beyond Likes and Shares: How Altmetrics are Reshaping Research Impact
"Discover how altmetrics offer a faster, broader view of scholarly influence, complementing traditional citation metrics in today's digital world."
In today's rapidly evolving digital landscape, the way we measure the impact of scholarly work is undergoing a significant transformation. Traditionally, citations have been the gold standard for assessing the influence of research. However, in a world where information spreads at lightning speed through social media, blogs, and online platforms, a more dynamic and immediate measure is needed. This is where altmetrics come into play.
Altmetrics, short for alternative metrics, offer a complementary approach to traditional citation metrics. They capture the broader impact of research by tracking mentions, shares, and discussions across a variety of online sources. This includes social media platforms like Twitter and Facebook, news outlets, blogs, policy documents, and online reference managers like Mendeley and CiteULike. By analyzing this data, altmetrics provide a more comprehensive and timely understanding of how research is being received and used in the real world.
The rise of altmetrics reflects the growing importance of online engagement in scholarly communication. Researchers are increasingly using social media and other online tools to share their work, connect with colleagues, and engage with the public. This shift towards open science and online collaboration has created a wealth of data that can be used to measure the impact of research in new and innovative ways. Altmetrics offer a powerful lens for understanding this evolving landscape and for assessing the true influence of scholarly work in the digital age.
Altmetrics as a Growing Movement
Altmetrics is both a website and a broader movement in research assessment, encompassing the analysis of diverse online signals of scholarly attention. Rather than relying solely on traditional citation counts, altmetrics track how research is referenced and discussed across websites, blogs, social media, and other digital platforms. This approach aligns with initiatives like the Declaration on Research Assessment, which advocates for reforming how research output is evaluated. The movement represents a shift toward capturing a wider spectrum of engagement with scholarly work beyond formal academic citations.
Complementary Metrics with Qualitative Caveats
Altmetrics have emerged as a complementary tool to traditional citation-based metrics in the assessment of scholarly impact, providing convenient approaches for researchers and institutions to monitor how their work is received. However, a critical limitation is that altmetrics capture attention regardless of its valence — positive, negative, and neutral attention are all measured identically. Only a qualitative assessment of altmetrics scores and the underlying commentary can reveal whether the attention is beneficial to an author. This means that standard altmetrics scores alone can be misleading, and some scholars have criticized the approach as being ill-conceived and limited in its utility for rigorous evaluation.
Early Cross-Disciplinary Analysis
A foundational study in altmetrics research carried out a cross-disciplinary analysis of the presence of alternative metrics in scientific publications, using the web-based tool Impact Story to collect metrics for 20,000 random publications. This early work represented one of the first large-scale efforts to systematically assess how altmetrics data could be gathered and applied across different fields of research. The study provided an initial evidence base for evaluating the maturity and viability of altmetrics as a tool for bibliometric and performance analysis, helping to lay groundwork for subsequent research in the area.
Altmetrics vs. Traditional Citation Metrics: A New Perspective
Traditional citation metrics, such as the Journal Impact Factor, have long been the cornerstone of research evaluation. These metrics primarily focus on the number of citations a publication receives in other scholarly works. While citations remain a valuable indicator of research influence, they often lag behind the actual impact and may not capture the full scope of how research is being used and discussed in society.
- Social Media Mentions: Tracking mentions and shares on platforms like Twitter, Facebook, and LinkedIn.
- News Coverage: Monitoring mentions in news outlets and media reports.
- Blog Posts: Identifying discussions and commentary on research in blogs.
- Policy Documents: Tracking citations in policy documents and government reports.
Tracking Online Attention Across Platforms
Altmetric, a leading altmetrics provider, tracks and captures a wide range of online attention to published research across social media, news outlets, policy documents, and other digital sources, collating this activity to help monitor and showcase the attention surrounding research. Holmberg's book "Altmetrics for Information Professionals" reviews current research and discusses possible future trends, presenting methods to measure and aggregate altmetrics according to the level or type of impact they represent. For librarians and information professionals, staying current with altmetrics research, experimenting with altmetrics tools, and engaging in early altmetrics education are increasingly important strategies. Industry observers have also noted growing calls from scholarly publishing stakeholders for metrics to be used responsibly alongside evolving practices such as open peer review.
Manipulation, Gaming, and Fundamental Critiques
Despite its promise, altmetrics has faced significant criticism, with some scholars arguing it is ill-conceived and limited in its use for evaluating, promoting, and disseminating research. A major concern is that altmetrics can be gamed and manipulated through artificial inflation of metrics, undermining their reliability as indicators of genuine research impact. Multiple analyses have explored the values and limits of altmetrics, noting that while they can play a role within institutional research assessment, they carry inherent vulnerabilities that must be acknowledged. These criticisms highlight the tension between the appeal of real-time, broad-coverage metrics and the risks of misuse in high-stakes evaluation contexts.
Altmetrics Versus Citation Impact
Research comparing citations and altmetrics has concluded that altmetrics could reflect an alternative dimension of research performance, one that is perhaps close to science popularization and networking abilities but far from traditional citation impact. This distinction suggests that altmetrics and citations are measuring fundamentally different phenomena rather than one serving as a simple proxy for the other. The comparison between platforms such as PlumX and Altmetric further reveals coverage gaps in data sources and categories, with each tool capturing different slices of online attention. Understanding these differences is essential for researchers and evaluators choosing which metrics to apply in a given context.
The Future of Research Impact: Embracing Altmetrics
As the digital landscape continues to evolve, altmetrics are poised to play an increasingly important role in research evaluation. By providing a more immediate, comprehensive, and nuanced understanding of research impact, altmetrics can help researchers, institutions, and policymakers make more informed decisions about funding, promotion, and research dissemination. Embracing altmetrics is not about replacing traditional citation metrics but rather about complementing them to gain a more complete picture of the impact of scholarly work in the 21st century.
Competing Manifestos in Research Evaluation
The field of quantitative science evaluation has seen competing visions crystallize in key documents, most notably the Altmetrics Manifesto and the Leiden Manifesto, which have been comparatively analyzed as representing distinct approaches to assessing scholarly impact. Jason Priem's Altmetrics Manifesto highlighted the limitations and slowness of traditional peer review and citation-based evaluation, arguing that the speed at which altmetrics data are available could enable real-time recommendation and collaborative filtering systems. The tension between these two manifestos reflects a broader debate about whether research evaluation should prioritize speed and breadth of attention metrics or depth and rigor of expert judgment. Both perspectives acknowledge the need for responsible use of metrics, even as they differ on which types of evidence should carry weight.
An Exciting but Uncertain Future
At an altmetrics workshop reported by WIRED, participants from academia, the startup world, the publishing industry, and non-profits gathered to figure out how altmetrics would evolve, with the collective assessment that the future is exciting but still uncertain. Holmberg's work on altmetrics for information professionals reviews possible future trends and presents frameworks for measuring and aggregating altmetrics according to the level or type of impact they represent. Despite growing interest, practical questions remain about how altmetrics data are being incorporated into real institutional decisions such as tenure evaluations, with some observers noting limited concrete examples of their use in actual tenure decisions. Impact Story, originally known as Total-Impact, represents one effort to refine altmetrics tools, having rebranded and improved its user interface to better serve researchers.
The Gap Between Promise and Societal Impact
An overview of studies exploring whether altmetrics point to the broader impact of research found that while altmetrics were intended to measure impacts in informal communication channels, they do not necessarily measure broader impacts or meaningful dissemination. Research on altmetrics and grey literature suggests that altmetrics could be interesting for tracking non-traditional scholarly outputs, since they were introduced as new online tools designed to create new filters for research visibility. However, scholars continue to debate whether altmetrics truly capture societal impact or merely reflect online chatter that may not translate into real-world outcomes. This gap between the promise of measuring broader societal relevance and the reality of what altmetrics data actually represent remains one of the most significant systemic challenges facing the field.
From Online Attention to Clinical and Policy Influence
Altmetric has begun tracking mentions of research in clinical guidelines, representing a meaningful step toward measuring real-world research impact beyond traditional academic metrics. This application demonstrates how altmetrics can bridge the gap between scholarly publication and practical implementation in healthcare settings. In the UK's Research Excellence Framework, quantitative indicators have been deemed not currently feasible as a replacement for narrative impact case studies, underscoring the ongoing importance of human judgment in assessing research impact. The ability to track how research is discussed and applied across news outlets, policy documents, and clinical guidelines offers what practitioners describe as a real-time pulse of research impact that citations alone cannot provide.