contentvalidR: Tools for Substantive and Content Validity Pretesting

Provides quantitative tools for substantive and content-oriented scale pretesting. Implements item-sort indices from Anderson and Gerbing (1991) <doi:10.1037/0021-9010.76.5.732>, exact item-sort inference following Howard and Melloy (2016) <doi:10.1007/s10869-015-9404-y>, empirical interpretation benchmarks from Colquitt et al. (2019) <doi:10.1037/apl0000406>, and the construct-rating procedure of Hinkin and Tracey (1999) <doi:10.1177/109442819922004> with HTC/HTD indices and repeated-measures item screening. The expert-panel workflow combines Aiken's V with score confidence intervals, Lawshe content validity ratios with exact inference, content validity indices with modified kappa and score intervals, item-objective congruence, and panel-level agreement using Krippendorff's alpha as described by Hayes and Krippendorff (2007) <doi:10.1080/19312450709336664>. Also provides judge and rater heterogeneity analysis following the generalizability-theory treatment of content-validity ratings in Crocker, Llabre and Miller (1988) <doi:10.1111/j.1745-3984.1988.tb00309.x>, content-domain coverage and expert-perceived content structure following Sireci and Geisinger (1992) <doi:10.1177/014662169201600102>, comparison across successive pretest rounds, and exact expert-panel planning. Where published methods compete, users choose among them through arguments with evidence-based defaults. User-facing workflows emphasize interpretable summaries and transparent review recommendations rather than isolated coefficients.

Version: 0.4.0
Depends: R (≥ 4.0.0)
Imports: stats
Suggests: irr, knitr, rmarkdown, testthat (≥ 3.0.0)
Published: 2026-09-28
DOI: 10.32614/CRAN.package.contentvalidR (may not be active yet)
Author: Joshua Uhalt [aut, cre]
Maintainer: Joshua Uhalt <Josh.Uhalt at gmail.com>
BugReports: https://github.com/JUhalt/contentvalidR/issues
License: GPL-3
URL: https://github.com/JUhalt/contentvalidR, https://juhalt.github.io/contentvalidR/
NeedsCompilation: no
Language: en-US
Citation: contentvalidR citation info
Materials: README, NEWS
CRAN checks: contentvalidR results

Documentation:

Reference manual: contentvalidR.html , contentvalidR.pdf
Vignettes: Construct-Rating Content Validation: Hinkin-Tracey to Colquitt (source, R code)
Design & Reporting Guide (source, R code)
Expert-Panel Content Validation: Relevance, Essentiality, and Congruence (source, R code)
Getting Started with contentvalidR (source, R code)
From Content Validity to Empirical Validation (source, R code)
Item-Sort Content Validation: Anderson-Gerbing to Howard-Melloy to Colquitt (source, R code)
How to Read contentvalidR Output (source, R code)
Manuscript-Ready Reporting Examples (source, R code)

Downloads:

Package source: contentvalidR_0.4.0.tar.gz
Windows binaries: r-devel: not available, r-release: not available, r-oldrel: contentvalidR_0.4.0.zip
macOS binaries: r-release (arm64): not available, r-oldrel (arm64): contentvalidR_0.4.0.tgz, r-release (x86_64): contentvalidR_0.4.0.tgz, r-oldrel (x86_64): contentvalidR_0.4.0.tgz

Linking:

Please use the canonical form https://CRAN.R-project.org/package=contentvalidR to link to this page.