The study examines which demographics five LLMs invent when given only EPQR-A questions and answers and asked to write a biography with age, gender, sexual orientation, race, religion, occupation, politics, and location. The generators are GPT-3.5, GPT-4o, Claude 3.5 Sonnet, Llama 3.2-3B, and Llama 3.1-70B. The starting point is not a human sample: it consists of 826 EPQR-A response sets previously simulated by gpt-4o-2024-05-13 at temperature 1, themselves based on the sex and age of 826 Spanish university students, 655 women and 171 men, with mean ages near 19. Only answered items, not demographic labels, are passed to the new model.
For each model the authors generate ten Base populations and five MaxN and MaxP populations. MaxN changes answers to maximize Neuroticism; MaxP does the same for Psychoticism. This is 20 populations × 826 profiles × 5 models, or 82,600 persona narratives before later assessments. A single “representative” population per condition and model, selected because trial variation was considered small, but without a published selection rule, retakes EPQR-A; Base populations also answer BFI-44. The study compares scores, accuracy, MAE/RMSE, EPQR-A–BFI correlations, and Cronbach's alpha.
Base distributions show strong but model-specific stereotypes. GPT-3.5 generates 90.82% women; Claude 87.84%; Llama 3.2-3B 100% men; Llama 3.1-70B 77.94% men; GPT-4o produces 25.71% women, 44.75% men, and 29.18% non-binary personas. GPT-4o produces 29.93% LGBTQ+ personas, whereas GPT-3.5 and Llama 3.2-3B are approximately zero and Claude is 3.22%. Racially, GPT-4o is 98.98% White, GPT-3.5 88.59%, Llama 3.2-3B 100%, Llama 3.1-70B 99.08%, and Claude 62.03% White/34.82% Asian. Ages cluster at 28–32 rather than near the source sample's age of 19; locations are major US cities except London and occupations tend to require higher education.
The broad “WEIRD” label reasonably describes the Western, urban, educated, and racially narrow defaults in much of the output, but there is no complete target population against which representativeness is estimated. Only sex and age are known for the source human sample, and the 826 input profiles are synthetic responses rather than observations from that population. There are no real reference distributions for race, religion, politics, location, or sexual orientation. The percentages therefore demonstrate model defaults and generative associations, not statistical bias calculated against a representative target. The paper acknowledges in Limitations that human-derived questionnaires and comparisons with other generation methods are needed.
The most important safety result occurs under MaxP and is very large for two models. GPT-4o moves from 29.18% to 88.76% non-binary and from 29.93% to 94.12% LGBTQ+; Claude moves from 3.22% to 96.66% non-binary and from 3.22% to 99.08% LGBTQ+. Progressive labels also rise sharply. The pattern is not universal: GPT-3.5 remains at 0.31% for both categories, Llama 3.2-3B at 0%, and Llama 3.1-70B at 0.38% non-binary/3.00% LGBTQ+. The paper correctly states that this does not imply any real-world association and frames it as possible stereotyping or pathologizing inference.
The mechanism does not isolate a latent psychological trait. The prompt supplies all 24 questions and answers and asks the model to infer a biography. Maximizing P changes six answers whose content directly concerns rules, drugs, marriage, cheating, exploitation, and conventional conduct; examples show the biography paraphrasing those items. The MaxP contrast therefore activates both a psychometric label and explicit semantic cues that the model associates with identity and politics. The finding demonstrates a dangerous generator association under that textual pattern, but not that human “Psychoticism” causes or predicts gender or orientation. EPQR-A P is also not clinical psychosis and has low reliability in several reported results.
The main tables and prose do not always use the same result snapshot. The prose assigns GPT-4o 29.27±1.70% non-binary versus 29.18±1.76 in Table 1, and 29.96±1.52% LGBTQ+ versus 29.93±1.63. It gives Claude 35.16±1.72% Asian versus 34.82±1.43. More materially, it reports conservative shares of 42.68% and 33.16% for Llama 3.2-3B and Llama 3.1-70B, while Table 2 gives 32.56% and 42.93%. These divergences make the exact run supporting the narrative unclear.
Demographic difference tests compare ten Base means and five MaxN/MaxP means through two-sided t-tests. Proportions are compositional, the same 826 inputs are reused across conditions, and many categories, models, and contrasts are tested; there is no documented multiplicity correction, dependence treatment, seed, generator temperature, or assumption diagnostic. Low between-trial standard deviation can indicate a consistent stereotyped default rather than representativeness. Aggregation also changes interpretation: “non-binary” includes gender-fluid and non-conforming; “LGBTQ+” combines gay, lesbian, bisexual, pansexual, queer, asexual, and demisexual; “Centre” includes independent/moderate; “Progressive” uses a broad synonym set; and distinct religions are collapsed into “Other.”
Apparent personality fidelity is largely a closed loop. A narrative is generated from the same 24 items, then the same model answers those items again while role-playing the narrative. The paper explicitly shows semantic copies: “rarely stays in the background” mirrors item 15 and “always practicing what they preach” mirrors item 24. GPT-4o reaches Base accuracy of 97.68% for E, 93.04% for N, 98.20% for P, and 99.23% for L. This is evidence of textual preservation from the prompt, not a deep psychological construct.
BFI provides some vocabulary-level generalization: EPQR-A/BFI correlations are 0.94–0.99 for E and 0.70–0.93 for N. Yet the same model creates both narrative and answers, dimensions are explicitly verbalized, and large cross-loadings appear, EPQR-P with BFI-O is 0.50–0.71 and EPQR-E with BFI-A reaches 0.86, without formal comparison to human coefficients. The origin of the BFI “Input” row is also unexplained even though the stated input is EPQR-A responses. High alpha can reflect determinism and redundancy; P falls to 0.18–0.68 under MaxP, L for Llama 3.2-3B to 0.01–0.27, and Claude MaxN N is undefined because there is no variance. The random control deliberately destroys inter-item covariance by sampling item marginals independently, so its near-zero alpha is not a strong neutral baseline for “coherent personality.”
The public reproducibility artifact is unavailable at audit time. The paper links anonymous.4open.science/r/the_personality_trap-F487/README.md, but the server returns HTTP 410 and no equivalent public repository was found. Some model names and costs remain documented, but code, generated data, seeds, decoding parameters, logs, the “representative” sample rule, exact tests, multiplicity handling, and executable Claude/Llama versions are missing. The official record confirms only a 26-page arXiv v1 preprint, not a venue or peer review.
The work convincingly identifies a representational risk: some models connect a MaxP answer pattern to marginalized identities at extreme rates. This is a useful warning for persona-generator design and auditing. It does not validate synthetic populations as human substitutes, demonstrate real psychological correlations, or show that models “reproduce” human demography without an appropriate reference.