Categorizing Influential Authors Using Penalty Areas

The concept of h-index has been proposed to easily assess a researcher’s performance with a single two-dimensional number. However, by using only this single number, we lose significant information about the distribution of the number of citations per article of an author’s publication list. Two authors with the same h-index may have totally different distributions of the number of citations per article. One may have a very long “tail” in the citation curve, i.e. he may have published a great number of articles, which did not receive relatively many citations. Another researcher may have a short tail, i.e. almost all his publications got a relatively large number of citations. In this article, we study an author’s citation curve and we define some areas appearing in this curve. These areas are used to further evaluate authors’ research performance from quantitative and qualitative point of view. We call these areas as “penalty” ones, since the greater they are, the more an author’s performance is penalized. Moreover, we use these areas to establish new metrics aiming at categorizing researchers in two distinct categories: “influential” ones vs. “mass producers”.

💡 Research Summary

The paper addresses a well‑known limitation of the h‑index: it collapses a researcher’s entire citation profile into a single number, thereby ignoring the distribution of citations across all publications. Two researchers with identical h‑indices can have vastly different citation curves—one may have a short “tail” (few low‑cited papers) while another may have a long tail (many low‑cited papers). To capture this nuance, the authors introduce two new “penalty” areas on the citation curve.

The first, the Tail‑Complement Penalty Area (TC‑area), quantifies the deficit of citations in the tail relative to the h‑index. For each paper i in the tail (citations C_i < h), the shortfall (h − C_i) is summed, yielding C_TC = h·(p − h) − C_T, where p is the total number of papers and C_T is the total citations in the tail. A larger TC‑area reflects a longer tail and therefore a greater penalty.

The second, the Ideal‑Complement Penalty Area (IC‑area), measures how far the whole publication set falls short of the ideal square p × p (where every paper would have p citations). It sums (p − C_i) over all papers with C_i < p, producing C_IC. This area includes the TC‑area but is independent of the h‑index, thus capturing overall productivity shortfalls.

Based on these areas the authors define two new metrics. The Penalty‑Index based on the TC‑area (PT) is:
PT = κ·h² + ε·C_E − σ·C_TC,
where C_E is the excess‑citation area (citations above h in the core). With κ = ε = σ = 1, PT reduces to h² + C_E − C_TC. Positive PT indicates an “influential” researcher, negative PT a “mass‑producer”.

A second metric, the Penalty‑Index incorporating the IC‑area (PI), adds the ideal‑complement penalty:
PI = κ·h² + ε·C_E + τ·C_T − ι·C_IC,
again with all coefficients set to 1 in the experiments. Because C_IC is typically large, PI is rarely positive, reinforcing the idea that most scholars incur a penalty when their citation profile deviates from the ideal.

The empirical study uses three datasets extracted via the Microsoft Academic Search API, all within computer science: (1) “Random” – 500 randomly chosen authors with ≥10 papers; (2) “Productive” – 500 authors with the highest publication counts; (3) “Top‑h” – 500 authors with the highest h‑indices. For each author the authors compute p, total citations C, h, the m‑index (Hirsch’s career‑stage metric), and the new PT and PI values.

Illustrative examples show the discriminative power of PT. Authors A and B both have h = 10, identical total citations and excess area, but A has p = 13 (short tail) while B has p = 24 (long tail). Their PT scores are +144 and –227 respectively, correctly classifying A as influential and B as a mass‑producer. A real‑world sample of five authors further demonstrates the range of PT values, from –2505 (Sun Yong, 319 papers) to +717 (Wang Mingyi, 48 papers).

Distribution plots reveal that PT and PI rankings are largely independent of h‑index or total citation rankings. In the “Productive” set many authors rank high by h‑index yet receive negative PT because of extensive low‑cited output. Conversely, some authors with modest h‑indices achieve positive PT due to compact, well‑cited portfolios.

The authors discuss the flexibility of the weighting parameters (κ, ε, σ, ι). While the paper adopts unit weights for simplicity, they acknowledge that domain‑specific citation cultures or career stages could motivate different weight choices, potentially refining the classification.

In conclusion, the paper proposes a novel, quantitative way to incorporate the shape of the citation curve into researcher evaluation. By penalizing long tails and overall deviation from an ideal citation square, the PT and PI indices complement traditional metrics, enabling a more nuanced distinction between truly influential scholars and prolific but low‑impact “mass producers”. This approach could inform hiring, promotion, and funding decisions where a balanced view of both productivity and impact is essential.