Ezgi Çavuş, Metadata-Guided Generation of Domain-Specific Peer Reviews with LLMs
This thesis presents a framework to enhance the quality of LLM-assisted academic peer review by addressing the lack of domain-specific evaluation criteria. While general review guidelines cover broad concerns, they often miss methodological nuances. The proposed system extracts review questions from past OpenReview evaluations and aligns them with new submissions using structured metadata such as methodology, datasets, and evaluation metrics. Experiments show that the framework improves review specificity, reduces hallucinated content, and enhances interpretability—providing more explainable and relevant automated reviews compared to baseline models.
Date: 21.08.2025 / 14:00 Place: A-212









