Shah, Mishra and Silpasuwanchai study whether attributed agreeableness across 275 synthetic personas is associated with the tendency of thirteen open models, from 0.6B to 20B, to accept user-stated opinions. Each model scores the same personas with forty adapted NEO-IPIP items and answers 4,950 opinion prompts across 33 categories, first as a generic assistant and then under each persona. Responses are reduced to agreement 1, disagreement 0, or partial .5. Analysis combines correlations, regression, and high-versus-low comparisons over 275 persona means per model.
The reported pattern is real within that design: nine of thirteen models show a positive association between their own agreeableness scores and agreement rates. Llama 3.1 8B reaches r=.868 and OLMo 3 7B r=.853. The headline effect size, however, has a material contradiction: the abstract and introduction claim Cohen's d=2.33 for SmolLM3, while the tables assign it d=.455 and the study-wide maximum is d=1.282 for OLMo. No public result artifact resolves the discrepancy.
The baseline comparison changes the interpretation. Adopting a persona lowers agreement for most models: Llama falls from .36 to .05, SmolLM3 from .41 to .17, and Phi-4 Mini from .36 to .14. Gemma 3 1B is the clear exception, rising from .37 to .59; Yi and GPT-OSS barely change. The study therefore primarily finds variation among personas within each model, not a general increase in acquiescence caused by persona use.
The decisive limitation is construct validity. The appendix explicitly says prompts are subjective opinions rather than verifiable claims. Accepting a debatable stance is not necessarily lying, deception, or sacrificing factual accuracy. There are no truth labels, independent references, matched neutral phrasings, or evaluation of reasons. Trait-Truthfulness Gap merely multiplies the agreement shift by measured agreeableness; its unvalidated plus-or-minus .1 deception and truth zones do not turn subjective agreement into factuality.
Measurement also does not isolate agreeableness. The same model interprets and scores each persona and generates the outcome, creating shared-method variance. Personas simultaneously vary in occupation, ideology, ethics, and style, dimensions overlapping the prompt topics. There are no human or external ratings, reliability estimates, factor structure, measurement invariance, or randomized single-trait manipulation. The six tests are also two dependent analysis families over the same observations rather than six independent replications; multiplicity is uncontrolled and the median split discards information.
The manual-validation claim is unsupported. The paper points to Appendix D, but that appendix only gives deterministic extraction rules and reports no sample, annotators, agreement, or accuracy. ACL's official checklist says no human annotators were used. The repository releases code and complete inputs, 275 personas, 4,950 prompts, and the questionnaire, but not generations, matrices, breakdowns, figures, or hypothesis-test JSON that Appendix E says are available. The Hugging Face raw files exist, although its Viewer fails and the card describes inputs as results. This is a large study of persona-conditioned agreement sensitivity, not evidence of truth, deception, human personality, or an isolated causal effect of agreeableness.