MASEMiner:面向元分析结构方程建模的AI辅助数据提取工具
MASEMiner – AI-Assisted Data Extraction for Meta-Analytic Structural Equation Modeling
研究者发布开源工具 MASEMiner,用大语言模型和视觉语言模型从原始研究中提取元分析结构方程建模(MASEM)所需的相关与效应量数据,可在本地运行或通过网页界面使用。
Meta-analytic structural equation modeling (MASEM) synthesizes multivariate evidence across studies, allowing researchers to examine theory-driven path models, including mediated and predictive effects, and to evaluate the dimensional structure of psychological and behavioral measures. A major bottleneck is the labor-intensive extraction of statistical information from primary studies. Large language models and vision-language models offer new opportunities for extracting such heterogeneous statistics from textual and visual document content. Building on these capabilities, we introduce MASEMiner, an open-source application for AI-assisted extraction and verification of data required for MASEM that can be run locally or accessed through a hosted web interface. MASEMiner supports the extraction of directly reported correlations and related effect sizes as well as indirect information (i.e., factor loadings and factor correlations) used to reconstruct correlation matrices for MASEM. We evaluated MASEMiner in four use cases against human-coded reference databases from published meta-analyses, using separate study sets for prompt development and evaluation. Factor loadings were extracted with near-perfect accuracy (sensitivity ≥ 0.92, precision ≥ 0.98), whereas directly reported effect sizes were recovered completely (sensitivity = 1.00) but with lower precision (0.54–0.69) due to overextraction. In a verification study with four coders, automated extraction plus human verification reduced coding time on average by 42% relative to manual extraction at comparable accuracy. MASEMiner thus supports a human-in-the-loop workflow that reduces manual coding effort while preserving transparency and reproducibility in research synthesis.
来源:PsyArXiv 预印本 · osf.io