Linking to Data - Effect on Citation Rates in Astronomy

Is there a difference in citation rates between articles that were published with links to data and articles that were not? Besides being interesting from a purely academic point of view, this question is also highly relevant for the process of furthering science. Data sharing not only helps the process of verification of claims, but also the discovery of new findings in archival data. However, linking to data still is a far cry away from being a “practice”, especially where it comes to authors providing these links during the writing and submission process. You need to have both a willingness and a publication mechanism in order to create such a practice. Showing that articles with links to data get higher citation rates might increase the willingness of scientists to take the extra steps of linking data sources to their publications. In this presentation we will show this is indeed the case: articles with links to data result in higher citation rates than articles without such links. The ADS is funded by NASA Grant NNX09AB39G.

💡 Research Summary

The paper investigates whether the presence of links to online data (“D” links) in astronomical journal articles correlates with higher citation rates. Using the NASA‑funded Astrophysics Data System (ADS) as a data source, the authors selected articles published between 1995 and 2000 in four major journals (The Astrophysical Journal, The Astronomical Journal, Monthly Notices of the Royal Astronomical Society, and Astronomy & Astrophysics). To control for subject matter, they identified the 50 most frequently used keywords among articles that already contain data links and required that any article included in the analysis share at least three of those keywords. This filtering produced a corpus of 3,814 articles with data links (designated Dd) and 7,218 articles without data links (Dn).

For a fair comparison, a random subset of 3,814 articles was drawn from the Dn pool, matching the sample size of the Dd group. Citation counts were extracted for each article at two, four, and ten years after publication. The authors normalized citation totals by the overall citation count of the entire dataset, allowing direct comparison of citation accumulation trajectories. Box‑plot visualizations (Figure 1) show that the median citation count for Dd articles is higher at both the two‑year (median = 10 vs. 8) and four‑year (median = 17 vs. 13) marks. Normalized citation curves (Figure 2) and cumulative citation distributions (Figure 3) further demonstrate that, on average, Dd articles accrue about 20 % more citations over a ten‑year period than their non‑linked counterparts.

Statistical significance was assessed via regression analysis on the full dataset. The presence of a data link was found to be a positive predictor of citation count with a p‑value < 0.05, confirming the 20 % increase at the 95 % confidence level. The authors also examined potential confounding factors: both groups have comparable rates of e‑print availability (≈20 %), similar frequencies of object‑information links (NED, SIMBAD), and no evidence that data centers preferentially attached links to inherently more citable papers. These checks support the interpretation that the observed citation advantage is genuinely associated with the data‑linking practice.

The discussion places the findings in a broader context. Prior work has shown that e‑printing can boost citations, but the effect of data linking appears comparable or slightly larger in astronomy. In the medical literature, publicly available data have been linked to a 69 % citation increase, suggesting that the magnitude of the effect varies across disciplines but the direction is consistent. The authors argue that the 20 % citation boost observed here provides a concrete incentive for researchers to invest the additional effort required to make their data discoverable through formal links.

Policy implications are emphasized. By demonstrating a measurable scholarly benefit, the study supports initiatives that embed data‑linking mechanisms into journal submission workflows, encourage data‑center collaborations, and perhaps even formalize data linking as a requirement for publication. Such measures could accelerate the cultural shift toward routine data sharing, improve reproducibility, and enable new science that leverages archival datasets. In summary, the paper provides robust empirical evidence that linking to online data enhances the long‑term impact of astronomical research, offering both a practical incentive for authors and a strategic argument for publishers and funding agencies to promote open data practices.