Line of inquiry
Inquiring lines›What determines when language mode…›What systematic behavioral limitat…›this line of inquiry
Can peer review policies effectively enforce restrictions on LLM use?
A broader line of inquiry — a family of 37 specific questions the research asks around this. Follow one into its inquiring-line page, or move sideways to a related line below.
Questions in this line of inquiry 37
Specific inquiring lines the field asks around this — ordered from the most general framing down to the most specific angle.
- How effective are journal policies restricting LLM use in peer review?
- Do reviewer rules about LLM use in peer review actually get followed?
- Can peer review policies actually prevent LLM use when compliance is hard to monitor?
- Can rules against undisclosed LLM use change reviewer behavior without enforcement?
- Do peer reviewers actually follow policies that ban or limit their LLM use?
- Do peer review policies banning LLM use actually change reviewer behavior and decisions?
- Do stricter AI policies actually change how reviewers score manuscripts?
- Why do reviewers ignore LLM use policies they are assigned?
- Do conference policies banning LLM use actually reduce AI involvement in reviews?
- Can researchers detect individual papers modified by LLMs reliably?
- How does LLM-modified writing narrow linguistic diversity in peer review?
- What happens when conferences enforce bans or limits on reviewer LLM use?
- Can reviewer-author matching by LLM use amplify biases in acceptance decisions?
- Do humans and LLMs agree on novelty assessment in research?
- Can readers reliably distinguish LLM-generated research writing from human writing?
- Can text-based algorithms reliably detect LLM assistance in scientific abstracts?
- Do LLM adopters actually cite more diverse and younger research?
- Can watermark-based detection measure true prevalence of LLM use in peer review?
- Does rhetorical robustness across multiple LLM models predict stable scientific review?
- Can researchers prevent their expectations from shaping LLM outputs?
- How much do LLM reviewers shift scores based on rhetorical framing alone?
- How much does rhetorical framing shift LLM reviewer scores independent of content?
- Did LLM use in scientific writing plateau after the initial surge?
- Does verification become the real bottleneck in LLM-assisted authorship?
- What quality differences exist between flagged and unflagged peer reviews?
- Why do peer review policies often fail to change actual review scores?
- Do metareviewers and regular reviewers use LLMs differently in peer review?
- Can LLM-generated reference reviews detect machine-written peer review submissions?
- How does framing critical topics shape LLM review scores?
- How do LLM reviewer scores respond when rewriting is applied recursively or jointly?
- Did reviewers successfully circumvent ICML's hidden-instruction watermark detection method?
- What mechanisms drive rating compression in fully LLM-generated peer reviews?
- Why does disclosure of LLM authorship change reader trust and preference?
- Why do computer science papers show more LLM modification than other fields?
- Do readers who prefer LLM-edited abstracts check the substance or just clarity?
- How much noncompliance occurred under ICML's limited-LLM-use policy versus the no-LLM rule?
- What concerns does widespread LLM use raise for scientific independence?