This preprint examines whether political discourse in r/politics changed around ChatGPT's public launch on November 30, 2022. It separates ideological polarization, movement away from a neutral point in language, from affective polarization, hostility and toxicity, and proposes a dual result: after launch, language from initially liberal and conservative authors moved modestly away from the center, while hostility scores in particular declined. The distinction between ideological content and tone is the paper's main contribution; its central limitation is that it observes a date and linguistic proxies, not actual ChatGPT use by each author or for each comment.
The declared dataset contains 6,882,091 posts and comments from 334,002 authors. It covers three months before and after launch and compares that window with the same calendar months one year earlier in a difference-in-differences design. To reduce entry effects, the sample retains people who commented at least once between June and December 2021. Main regressions use comment observations, author fixed effects, and author-clustered errors; author-day results are also shown and author-month analyses are cited. The PDF displays a six-week event study on each side and claims shifted-date placebos, but full results sit in an unavailable supplement.
Political orientation is estimated with a bag-of-words dictionary derived from the 2021 Congressional Record. Each comment receives a score from -1 to 1: negative is interpreted as liberal, positive as conservative, and zero as neutral. Authors are 59.4% neutral, 15.7% liberal, and 24.9% conservative; by comments the shares are 17.9%, 31.6%, and 50.5%. The dictionary, coefficients, and validation for Reddit language are absent from the public artifact. The score therefore measures vocabulary associated with congressional speakers and topics, not political belief, partisan identity, or behavior directly.
At comment level, the post-November-by-treated interaction is -0.0030 for liberal authors, -0.0003 for neutral authors, and +0.0026 for conservative authors. At author-day level it is -0.0038, -0.0004, and +0.0033. The authors interpret the opposite signs as greater polarization and state that the change moves a median comment toward the most extreme 30%, an equivalence deferred to an unavailable supplementary figure. Groups nearest the center show small or nonsignificant movement. These estimates document a temporal association under the paper's metric; by themselves they do not isolate ChatGPT from news, composition, moderation, platform changes, or other concurrent shocks.
To study who drives the change, the paper labels the top 10% by selection-period comment count, 20 or more, as active and everyone else inactive. After launch, the so-called inactive group writes roughly 2.9-3.1 more words per comment, shows a larger fall in log perplexity, and falls by about 0.01 in Human Score. Its slant movement is also larger: -0.0082 for liberals and +0.0072 for conservatives, compared with -0.0022 and +0.0019 among active users. These are linguistic changes compatible with generative assistance, but length, perplexity, and a classifier do not observe which tool was used. Calling roughly 90% of the distribution inactive also combines highly heterogeneous behavior.
The sycophancy mechanism depends on classifying individual comments as human or ChatGPT. The paper calls Human Score an OpenAI ChatGPT detector and labels scores below 30% human as ChatGPT. Its reference 22, however, is Solaiman et al. (2019): the RoBERTa GPT-2 output detector trained to distinguish WebText from GPT-2 1.5B generations before ChatGPT existed. The model card cautions against treating it as a reliable ChatGPT detector. The preprint does not name the exact checkpoint or report Reddit validation, a confusion matrix, calibration, or sensitivity to misclassification. Figure 4 shows replies labeled ChatGPT aligning more with parent-content slant; this is compatible with echoing or adaptation, but it does not establish that ChatGPT generated those replies or that sycophancy is the causal mechanism.
On affect, hostility declines in all four groups: -0.0042 and -0.0016 for active and inactive liberals, and -0.0049 and -0.0014 for conservatives. All four toxicity estimates are negative, from -0.0017 to -0.0025, but only active liberal and active conservative coefficients receive significance marks; both inactive estimates do not. Table 6B is also mislabeled, repeating liberal-active and column number (5) four times. Emotion results are deferred to a missing supplementary table. Hostility and toxicity are indicators of textual civility, not direct measures of animus toward the opposing party, the standard construct of affective polarization.
The prior-year difference-in-differences comparison improves on a simple before-after contrast, but the published equation contains author rather than date fixed effects. Because exposure changes for everyone at one time, common temporal shocks and serial dependence remain; clustering only by author may not capture this uncertainty. The cited placebos rule out some alternative dates, not every co-occurring event. There is no preregistration. The official record identifies a v1 preprint and reports no peer-review status.
Public reproducibility is low. The PDF repeatedly cites an SI Appendix for the dictionary, methods, robustness checks, figures, and Tables S1-S7, but arXiv serves only the 19-page main PDF; even the source endpoint returns the same PDF. No code, data, dictionary, checkpoint, perplexity model, derived outputs, or scripts were located. This review therefore preserves reported coefficients but does not present them as independently reproduced.
The faithful conclusion is narrower than the abstract: in an observational comparison of early r/politics activity, measured language from liberal and conservative groups moved slightly away from zero after launch, while hostility and some toxicity measures declined. This opens a valuable question about whether generative assistants can separate topical extremity from civil tone. It does not demonstrate individual ChatGPT use, causality, sycophancy as the mechanism, changed beliefs or voting, a general decline in affective polarization, or that AI improves democratic discourse. The evidence is suggestive and needs a validated detector, complete supplement, public data/code, and stronger causal identification.