22  PubPeer Comments

22.1 What it checks

The ref_pubpeer module cross-references the paper’s cited references against PubPeer, a platform for post-publication peer review. If a paper you cite has comments on PubPeer, that may be worth knowing — comments can range from minor clarifications to serious concerns about the work.

The module reports which cited references have PubPeer comments, how many, and a link, so you can read the discussion and judge its relevance yourself.

Statcheck comments on PubPeer are ignored. Statcheck automatically posted comments on tens of thousands of psychology articles, so including them would flag almost every cited paper and drown out substantive human comments.

Note

This module makes live network calls to PubPeer (matching references by DOI). You need an internet connection to run the code below.

22.2 Running the module

demopaper() cites a reference that has PubPeer comments.

paper <- demopaper()
mo <- module_run(paper, "ref_pubpeer")
mo$traffic_light
#> [1] "info"
mo$summary_text
#> [1] "You cited 1 reference with comments in PubPeer."

The table lists each matched reference, the number of comments, and a link:

mo$table[, c("doi", "total_comments", "url")] |>
  knitr::kable()
doi total_comments url
10.1177/0956797614520714 3 https://pubpeer.com/publications/3FA648ECECB88454C91804F09E2E56

22.3 Running on many papers

mo <- module_run(psychsci[1:10], "ref_pubpeer")
mo$summary_table

22.4 Interpreting the result

A green/empty result means none of the cited references had PubPeer comments. A flagged result does not mean a citation is bad — it means there is a discussion you may want to read. Follow the url to the PubPeer thread and judge the comments in context.

22.5 Options

ref_pubpeer takes only the paper argument.

22.6 Notes

In the Shiny app, querying PubPeer is an opt-in checkbox, because it sends the cited DOIs to an external service.