human study

Measuring Psychological Depth in Language Models

Outstanding Paper Award, EMNLP 2024 (top 0.25% of submissions). A literary-theory-grounded scale for measuring the psychological impact of LLM-generated stories on readers.

Human-in-the-Loop Synthetic Text Data Inspection with Provenance Tracking

Data augmentation techniques apply transformations to existing texts to generate additional data. The transformations may produce low-quality texts, where the meaning of the text is changed and the text may even be mangled beyond human comprehension. …