2026-10-12T11:21:06Z https://api.figshare.com/v2/oai

oai:figshare.com:article/33974665 2026-09-23T17:21:35Z category_7 category_19 category_21 category_64 category_106 category_132 portal_5 item_type_3 month_year_09_2026

<p>Codebook for primary data set.</p> Jan-Ole Hesselberg (21453807) Pål Ulleberg (522303) Øystein Sørensen (4767861) Knut Inge Fostervold (11509353) Sigrid Hegna Ingvaldsen (15359171) Ida Svege (11509356) Medicine Pharmacology Biotechnology Cancer Science Policy Infectious Diseases general panel membership average iccs ranged human judgment rather structured review formats stable reviewer tendencies reviewer age composition moderate across funders substantially improve reliability systematic reviewer characteristics including reviewer similarity depth review procedures matter expertise rather examines factors associated slightly lower disagreement reviewer similarity review depth specific rather review roles multiple factors four funders reliability persist rater reliability lower disagreement application characteristics yet concerns variability arose temporal trends specific ambiguity reviewers selected reviewers disagree residual level research area registered report rater agreement program features primarily due leveraging data level ambiguity inherent variability greater responsibility grant evaluations expert reviews clearer criteria assessments conducted also associated absolute magnitude 1 percent <p>Codebook describing the data in the primary data set used as the starting point for the analysis script (see <a href="http://www.plosone.org/article/info:doi/10.1371/journal.pone.0356108#pone.0356108.s005" target="_blank">S2 File</a>).</p> <p>(XLSX)</p> 2026-09-23T17:21:34Z Dataset Dataset 10.1371/journal.pone.0356108.s001 https://figshare.com/articles/dataset/_p_Codebook_for_primary_data_set_p_/33974665 CC BY 4.0