The paper proposes controlling styles described as personality traits through an intervention in the internal activations of an 8-billion-parameter Llama 3 model. The authors assemble 179 labels said to come from HEXACO, the Big Five, lexical analysis, synonyms, and antonyms. For each label they apply a system prompt prescribing the target behavior to 1,500 Alpaca instructions and compare it with a neutral condition. They extract Layer 18 activations and define a trait direction as the difference between the two condition means. The exact checkpoint, also described as uncensored, is not identified, and token position, pooling, generation parameters, direction normalization, and train/evaluation partitioning are not specified.
The intervention neither fine-tunes the model nor permanently changes its weights. In the stated equation, the current projection of an activation onto the trait direction is removed and replaced with the mean projection observed in trait-conditioned examples, multiplied by a factor α. The authors identify 1.3–1.4 as a useful α range through empirical observation: lower values allegedly yield small changes and higher values incoherent text. They publish no sweep, personality metric, effect sizes, or aggregate results supporting that range. The behavioral demonstration is mainly a table with five responses, baseline, shy, passionate, narcissistic, and paranoid, to one market-strategy question. There is no blinded evaluation, human rating, psychometric questionnaire, held-out prompt set, prompt-only baseline, or general-capability measurement.
The remainder explores the geometry of the 179 directions. It displays PCA, t-SNE, and UMAP projections for a random sample of 100 labels, runs k-means with 20 groups on the original vectors, studies principal-component reconstruction, and visually compares a greedy basis selection with random vector sets. Seeds, reduction hyperparameters, the rationale and stability of k, repeated runs, confidence intervals, and complete numerical results are not reported. The clusters mix ordinary traits with clinical diagnoses, paraphilias, crimes, affective states, and moral judgments. One group contains, among other labels, pedophilic, murderous, and psychopathic; another places autistic alongside organized, perfectionist, and rigid thinker. Proximity in reduced spaces is interpreted as a possible pathway or precursor to harmful behavior, but the geometry of prompt-induced activations cannot establish psychological or clinical causality.
The paper shows screenshots of two interfaces: base-personality selection and modular design using principal-component sliders. The authors withhold them for safety reasons. They also link no code, data, complete prompt or trait list, checkpoint, demo, or reproducible results. Proposed applications in games, artificial companions, customer service, and education are not evaluated. The ethics section recognizes risks of manipulation, apparent empathy, concealed limitations, and toxic generation, but its concrete mitigation is limited to urging responsible use; no safeguard is tested.
The defensible contribution is an exploratory demonstration that a mean-difference direction at Layer 18 can visibly change the style of some responses from an incompletely identified model. It does not show that the direction represents a stable personality construct, that the effect generalizes, that model capabilities are preserved, or that the clusters reflect internal psychological structure. The statement that Llama 3 8B has 31 layers conflicts with Meta's official configuration, which declares 32 transformer blocks; the authors may be referring to zero-based indices 0–31, but the paper says 31 layers in total. With no artifacts or quantitative evaluation, the method's efficacy, robustness, reproducibility, and safety cannot be estimated.