PCSI Gender Intervention Study TESS Analyses
Descriptive Statistics
Full Sample Together
## pcsi2Data[, c("gender_identify_cis", "gender_identify_trans", "gender_comp", "autonomy_geniden", "legislation", "trust_scientists")]
##
## 6 Variables 1563 Observations
## --------------------------------------------------------------------------------
## gender_identify_cis
## n missing distinct Info Mean Gmd .05 .10
## 1480 83 131 0.97 53.96 46.07 6 12
## .25 .50 .75 .90 .95
## 26 36 60 122 180
##
## lowest : 0 1 3 4 6, highest: 220 221 222 225 227
## --------------------------------------------------------------------------------
## gender_identify_trans
## n missing distinct Info Mean Gmd .05 .10
## 1496 67 150 0.984 84.84 69.16 13 24
## .25 .50 .75 .90 .95
## 36 60 130 192 216
##
## lowest : 0 1 3 4 5, highest: 222 223 225 226 227
## --------------------------------------------------------------------------------
## gender_comp
## n missing distinct Info Mean Gmd .05 .10
## 1452 111 180 0.892 30.24 56.72 -12.9 0.0
## .25 .50 .75 .90 .95
## 0.0 0.0 48.0 120.0 164.7
##
## lowest : -211 -203 -191 -168 -156, highest: 209 210 214 215 226
## --------------------------------------------------------------------------------
## autonomy_geniden
## n missing distinct Info Mean Gmd .05 .10
## 1540 23 19 0.994 4.399 1.998 1.000 1.667
## .25 .50 .75 .90 .95
## 3.333 4.333 6.000 7.000 7.000
##
## lowest : 1.00000 1.33333 1.66667 2.00000 2.33333
## highest: 5.66667 6.00000 6.33333 6.66667 7.00000
##
## 1 (112, 0.073), 1.33333333333333 (29, 0.019), 1.66666666666667 (21, 0.014), 2
## (45, 0.029), 2.33333333333333 (38, 0.025), 2.66666666666667 (32, 0.021), 3 (92,
## 0.060), 3.33333333333333 (73, 0.047), 3.66666666666667 (75, 0.049), 4 (172,
## 0.112), 4.33333333333333 (100, 0.065), 4.66666666666667 (97, 0.063), 5 (138,
## 0.090), 5.33333333333333 (70, 0.045), 5.66666666666667 (43, 0.028), 6 (116,
## 0.075), 6.33333333333333 (63, 0.041), 6.66666666666667 (42, 0.027), 7 (182,
## 0.118)
## --------------------------------------------------------------------------------
## legislation
## n missing distinct Info Mean Gmd .05 .10
## 1545 18 37 0.995 4.913 1.84 2.000 2.667
## .25 .50 .75 .90 .95
## 3.833 5.000 6.333 7.000 7.000
##
## lowest : 1.00000 1.16667 1.33333 1.50000 1.66667
## highest: 6.33333 6.50000 6.66667 6.83333 7.00000
## --------------------------------------------------------------------------------
## trust_scientists
## n missing distinct Info Mean Gmd
## 1547 16 7 0.966 4.546 1.919
##
## lowest : 1 2 3 4 5, highest: 3 4 5 6 7
##
## Value 1 2 3 4 5 6 7
## Frequency 125 97 139 363 280 357 186
## Proportion 0.081 0.063 0.090 0.235 0.181 0.231 0.120
## --------------------------------------------------------------------------------Descriptives by Condition
##
## Descriptive statistics by group
## group: Control
## vars n mean sd median trimmed mad min max range
## gender_identify_cis 1 751 59.66 52.81 45.00 50.01 31.13 0 227 227
## gender_identify_trans 2 757 108.89 63.59 108.00 106.61 71.16 0 227 227
## gender_comp 3 738 48.69 68.26 24.00 41.95 35.58 -191 226 417
## autonomy_geniden 4 779 4.38 1.81 4.33 4.47 1.98 1 7 6
## legislation 5 786 4.90 1.65 5.00 5.02 1.98 1 7 6
## trust_scientists 6 784 4.53 1.73 5.00 4.64 1.48 1 7 6
## skew kurtosis se
## gender_identify_cis 1.62 2.05 1.93
## gender_identify_trans 0.27 -1.09 2.31
## gender_comp 0.58 0.33 2.51
## autonomy_geniden -0.30 -0.83 0.06
## legislation -0.39 -0.75 0.06
## trust_scientists -0.47 -0.61 0.06
## ------------------------------------------------------------
## group: Experiment
## vars n mean sd median trimmed mad min max range
## gender_identify_cis 1 729 48.09 44.55 36.00 38.71 4.45 0 227 227
## gender_identify_trans 2 739 60.21 53.65 36.00 49.41 7.41 0 227 227
## gender_comp 3 714 11.18 40.10 0.00 4.36 0.00 -211 205 416
## autonomy_geniden 4 761 4.42 1.70 4.33 4.49 1.98 1 7 6
## legislation 5 759 4.92 1.59 5.00 5.03 1.73 1 7 6
## trust_scientists 6 763 4.56 1.71 5.00 4.67 1.48 1 7 6
## skew kurtosis se
## gender_identify_cis 2.53 6.37 1.65
## gender_identify_trans 1.82 2.35 1.97
## gender_comp 1.77 9.77 1.50
## autonomy_geniden -0.26 -0.67 0.06
## legislation -0.39 -0.77 0.06
## trust_scientists -0.52 -0.52 0.06Manipulation Check
“As a manipulation check, we will first conduct an independent samples t-test to determine whether perceptions of the age at which transgender youth can identify their gender relative to cisgender youth differs by condition using the age difference score outlined above as the dependent variable.”
Non-weighted
| Test statistic | df | P value | Alternative hypothesis |
|---|---|---|---|
| 12.82 | 1199 | 2.501e-35 * * * | two.sided |
| mean in group Control | mean in group Experiment |
|---|---|
| 48.69 | 11.18 |
Weighted
test: Two Sample Weighted T-Test (Welch)
coefficients:
t.value df p.value -17.65 1451 0 additional:
Difference Mean.x Mean.y Std. Err -28.34 1.502 29.84 1.605
Serial Mediation Model
“Next, we will test a serial mediation model in which both the perceived gender development age gap and autonomy support mediate the relationship between condition and support for anti-transgender legislation, such that condition will influence the perceived gender development age gap, which will influence autonomy support, and then finally support for anti-trans legislation.”
Non-weighted
## lavaan 0.6.15 ended normally after 26 iterations
##
## Estimator ML
## Optimization method NLMINB
## Number of model parameters 9
##
## Used Total
## Number of observations 1422 1563
##
## Model Test User Model:
##
## Test statistic 59.738
## Degrees of freedom 3
## P-value (Chi-square) 0.000
##
## Model Test Baseline Model:
##
## Test statistic 1488.349
## Degrees of freedom 6
## P-value 0.000
##
## User Model versus Baseline Model:
##
## Comparative Fit Index (CFI) 0.962
## Tucker-Lewis Index (TLI) 0.923
##
## Loglikelihood and Information Criteria:
##
## Loglikelihood user model (H0) -12630.926
## Loglikelihood unrestricted model (H1) -12601.057
##
## Akaike (AIC) 25279.851
## Bayesian (BIC) 25327.189
## Sample-size adjusted Bayesian (SABIC) 25298.600
##
## Root Mean Square Error of Approximation:
##
## RMSEA 0.115
## 90 Percent confidence interval - lower 0.091
## 90 Percent confidence interval - upper 0.142
## P-value H_0: RMSEA <= 0.050 0.000
## P-value H_0: RMSEA >= 0.080 0.991
##
## Standardized Root Mean Square Residual:
##
## SRMR 0.040
##
## Parameter Estimates:
##
## Standard errors Bootstrap
## Number of requested bootstrap draws 5000
## Number of successful bootstrap draws 5000
##
## Regressions:
## Estimate Std.Err z-value P(>|z|) ci.lower ci.upper
## gender_comp ~
## conditin (a1) -37.726 3.055 -12.349 0.000 -43.723 -31.848
## autonomy_geniden ~
## gndr_cmp (d21) -0.008 0.001 -9.956 0.000 -0.009 -0.006
## legislation ~
## atnmy_gn (b2) -0.697 0.015 -46.256 0.000 -0.727 -0.668
## Std.lv Std.all
##
## -37.726 -0.318
##
## -0.008 -0.263
##
## -0.697 -0.750
##
## Intercepts:
## Estimate Std.Err z-value P(>|z|) ci.lower ci.upper
## .gender_comp 86.587 5.454 15.876 0.000 76.004 97.307
## .autonomy_gendn 4.661 0.053 87.754 0.000 4.555 4.767
## .legislation 7.980 0.064 124.928 0.000 7.858 8.106
## Std.lv Std.all
## 86.587 1.461
## 4.661 2.664
## 7.980 4.905
##
## Variances:
## Estimate Std.Err z-value P(>|z|) ci.lower ci.upper
## .gender_comp 3157.015 173.204 18.227 0.000 2826.241 3491.660
## .autonomy_gendn 2.850 0.090 31.755 0.000 2.671 3.021
## .legislation 1.158 0.045 25.916 0.000 1.071 1.245
## Std.lv Std.all
## 3157.015 0.899
## 2.850 0.931
## 1.158 0.438
##
## R-Square:
## Estimate
## gender_comp 0.101
## autonomy_gendn 0.069
## legislation 0.562
##
## Defined Parameters:
## Estimate Std.Err z-value P(>|z|) ci.lower ci.upper
## ind_eff -0.204 0.028 -7.360 0.000 -0.261 -0.153
## Std.lv Std.all
## -0.204 -0.063## lhs op rhs mi epc sepc.lv sepc.all sepc.nox
## 14 gender_comp ~ legislation 57.223 10.177 10.177 0.279 0.279
## 17 legislation ~ gender_comp 40.044 0.003 0.003 0.115 0.115
## 15 autonomy_geniden ~ legislation 40.043 1.002 1.002 0.932 0.932
## 13 gender_comp ~ autonomy_geniden 9.712 -8.644 -8.644 -0.255 -0.255
## 16 autonomy_geniden ~ condition 9.712 -0.294 -0.294 -0.084 -0.168Weighted
## lavaan 0.6.15 ended normally after 25 iterations
##
## Estimator ML
## Optimization method NLMINB
## Number of model parameters 9
##
## Used Total
## Number of observations 1422 1563
## Sampling weights variable weights
##
## Model Test User Model:
## Standard Scaled
## Test Statistic 61.407 31.270
## Degrees of freedom 3 3
## P-value (Chi-square) 0.000 0.000
## Scaling correction factor 1.964
## Yuan-Bentler correction (Mplus variant)
##
## Model Test Baseline Model:
##
## Test statistic 1338.359 572.177
## Degrees of freedom 6 6
## P-value 0.000 0.000
## Scaling correction factor 2.339
##
## User Model versus Baseline Model:
##
## Comparative Fit Index (CFI) 0.956 0.950
## Tucker-Lewis Index (TLI) 0.912 0.900
##
## Robust Comparative Fit Index (CFI) 0.958
## Robust Tucker-Lewis Index (TLI) 0.916
##
## Loglikelihood and Information Criteria:
##
## Loglikelihood user model (H0) -12683.904 -12683.904
## Scaling correction factor 2.214
## for the MLR correction
## Loglikelihood unrestricted model (H1) -12653.200 -12653.200
## Scaling correction factor 2.151
## for the MLR correction
##
## Akaike (AIC) 25385.808 25385.808
## Bayesian (BIC) 25433.146 25433.146
## Sample-size adjusted Bayesian (SABIC) 25404.556 25404.556
##
## Root Mean Square Error of Approximation:
##
## RMSEA 0.117 0.081
## 90 Percent confidence interval - lower 0.093 0.064
## 90 Percent confidence interval - upper 0.143 0.100
## P-value H_0: RMSEA <= 0.050 0.000 0.002
## P-value H_0: RMSEA >= 0.080 0.993 0.575
##
## Robust RMSEA 0.114
## 90 Percent confidence interval - lower 0.080
## 90 Percent confidence interval - upper 0.152
## P-value H_0: Robust RMSEA <= 0.050 0.001
## P-value H_0: Robust RMSEA >= 0.080 0.950
##
## Standardized Root Mean Square Residual:
##
## SRMR 0.039 0.039
##
## Parameter Estimates:
##
## Standard errors Sandwich
## Information bread Observed
## Observed information based on Hessian
##
## Regressions:
## Estimate Std.Err z-value P(>|z|) ci.lower ci.upper
## gender_comp ~
## conditin (a1) -35.336 4.296 -8.226 0.000 -43.755 -26.916
## autonomy_geniden ~
## gndr_cmp (d21) -0.006 0.001 -6.525 0.000 -0.008 -0.004
## legislation ~
## atnmy_gn (b2) -0.668 0.022 -30.383 0.000 -0.711 -0.625
## Std.lv Std.all
##
## -35.336 -0.288
##
## -0.006 -0.225
##
## -0.668 -0.729
##
## Intercepts:
## Estimate Std.Err z-value P(>|z|) ci.lower ci.upper
## .gender_comp 83.210 7.700 10.807 0.000 68.119 98.302
## .autonomy_gendn 4.526 0.072 62.645 0.000 4.384 4.667
## .legislation 7.893 0.094 84.084 0.000 7.709 8.076
## Std.lv Std.all
## 83.210 1.355
## 4.526 2.634
## 7.893 5.017
##
## Variances:
## Estimate Std.Err z-value P(>|z|) ci.lower ci.upper
## .gender_comp 3458.625 291.014 11.885 0.000 2888.249 4029.002
## .autonomy_gendn 2.803 0.118 23.690 0.000 2.571 3.035
## .legislation 1.158 0.068 17.070 0.000 1.025 1.291
## Std.lv Std.all
## 3458.625 0.917
## 2.803 0.949
## 1.158 0.468
##
## R-Square:
## Estimate
## gender_comp 0.083
## autonomy_gendn 0.051
## legislation 0.532
##
## Defined Parameters:
## Estimate Std.Err z-value P(>|z|) ci.lower ci.upper
## ind_eff -0.149 0.031 -4.756 0.000 -0.210 -0.087
## Std.lv Std.all
## -0.149 -0.047## lhs op rhs mi epc sepc.lv sepc.all sepc.nox
## 14 gender_comp ~ legislation 56.219 10.641 10.641 0.273 0.273
## 15 autonomy_geniden ~ legislation 39.528 1.152 1.152 1.055 1.055
## 17 legislation ~ gender_comp 39.528 0.003 0.003 0.117 0.117
## 21 condition ~ legislation 8.869 0.026 0.026 0.082 0.082
## 16 autonomy_geniden ~ condition 5.196 -0.211 -0.211 -0.061 -0.123Secondary Analyses
Additional Moderation Models
“We will measure a secondary dependent variable which will be used for additional analyses (see below). We will measure participants’ trust in scientists on a single-item scale in which participants will be asked to indicate on a scale from 1 (strongly distrust) to 7 (strongly trust) how much they trust or distrust scientists as a source of information about gender development (adapted from Hmielowski et al., 2014).”
“In addition to our planned serial mediation model, we will also test two moderation models. As described above, we expect participants who receive the intervention (relative to those who do not) will show a reduced age gap in their perception of gender identity development. We further predict that this effect will be greater for participants who express more trust in scientists, as has been the case in previous work examining motivated reasoning about scientific findings (Drummond & Fischhoff, 2017).”.
“Additionally, because transgender rights are a highly politicized topic (Hatch et al., 2022), we expect the predicted effect will be greater among more highly educated liberal participants, in line with research from other similarly politicized domains (e.g., global warming; Drummond & Fischhoff, 2017). Thus, we will test moderation by these variables through two linear regression models (one model with condition and trust in scientists and another with condition, political ideology, and education).”
Moderation by trust in scientists
Non-weighted
| term | estimate | std.error | statistic | p.value |
|---|---|---|---|---|
| (Intercept) | 50.2563 | 4.2177 | 11.9156 | 0.0000 |
| condition1 | -23.4851 | 4.2177 | -5.5683 | 0.0000 |
| trust_scientists | -4.4168 | 0.8597 | -5.1375 | 0.0000 |
| condition1:trust_scientists | 0.9885 | 0.8597 | 1.1498 | 0.2504 |
| r.squared | adj.r.squared | sigma | statistic | p.value | df | logLik | AIC | BIC | deviance | df.residual | nobs |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.1201 | 0.1182 | 55.5897 | 65.3108 | 0 | 3 | -7827.19 | 15664.4 | 15690.7 | 4437551 | 1436 | 1440 |
Weighted
| term | estimate | std.error | statistic | p.value |
|---|---|---|---|---|
| (Intercept) | 46.7758 | 4.4034 | 10.6226 | 0.0000 |
| condition1 | -14.9555 | 4.4034 | -3.3963 | 0.0007 |
| trust_scientists | -3.7260 | 0.9098 | -4.0954 | 0.0000 |
| condition1:trust_scientists | -0.5108 | 0.9098 | -0.5615 | 0.5746 |
| r.squared | adj.r.squared | sigma | statistic | p.value | df | logLik | AIC | BIC | deviance | df.residual | nobs |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.0912 | 0.0893 | 58.2123 | 48.0086 | 0 | 3 | -8151.79 | 16313.6 | 16339.9 | 4866137 | 1436 | 1440 |
Moderation by political ideology and education
A higher score in political ideology is more conservative
1 Very liberal 2 Somewhat liberal 3 Moderate 4 Somewhat conservative 5 Very conservative
Less than high school is the reference level for education
Non-weighted
##
## Less than HS HS graduate or equivalent
## 60 278
## Some college/ associates degree Bachelor's degree
## 618 338
## Post grad study/professional degree
## 269| term | estimate | std.error | statistic | p.value |
|---|---|---|---|---|
| (Intercept) | 14.5013 | 6.4332 | 2.2541 | 0.0243 |
| condition1 | -16.7280 | 6.4332 | -2.6003 | 0.0094 |
| pol_ideology_missing | 4.8176 | 2.0547 | 2.3447 | 0.0192 |
| education_factor1 | -11.7953 | 14.5171 | -0.8125 | 0.4166 |
| education_factor2 | -8.0771 | 5.3722 | -1.5035 | 0.1329 |
| education_factor3 | -6.1683 | 3.2342 | -1.9072 | 0.0567 |
| education_factor4 | -4.7703 | 2.3189 | -2.0571 | 0.0399 |
| condition1:pol_ideology_missing | -0.2635 | 2.0547 | -0.1282 | 0.8980 |
| condition1:education_factor1 | 26.7706 | 14.5171 | 1.8441 | 0.0654 |
| condition1:education_factor2 | 10.6964 | 5.3722 | 1.9911 | 0.0467 |
| condition1:education_factor3 | 6.4658 | 3.2342 | 1.9992 | 0.0458 |
| condition1:education_factor4 | 2.4490 | 2.3189 | 1.0561 | 0.2911 |
| pol_ideology_missing:education_factor1 | 4.3549 | 4.5971 | 0.9473 | 0.3436 |
| pol_ideology_missing:education_factor2 | 3.1209 | 1.6934 | 1.8429 | 0.0655 |
| pol_ideology_missing:education_factor3 | 2.0300 | 1.0359 | 1.9596 | 0.0502 |
| pol_ideology_missing:education_factor4 | 1.1234 | 0.7772 | 1.4454 | 0.1486 |
| condition1:pol_ideology_missing:education_factor1 | -8.0585 | 4.5971 | -1.7529 | 0.0798 |
| condition1:pol_ideology_missing:education_factor2 | -4.3794 | 1.6934 | -2.5861 | 0.0098 |
| condition1:pol_ideology_missing:education_factor3 | -2.6485 | 1.0359 | -2.5566 | 0.0107 |
| condition1:pol_ideology_missing:education_factor4 | -0.5600 | 0.7772 | -0.7206 | 0.4713 |
| r.squared | adj.r.squared | sigma | statistic | p.value | df | logLik | AIC | BIC | deviance | df.residual | nobs |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.1508 | 0.1395 | 54.7193 | 13.2752 | 0 | 19 | -7796.39 | 15634.8 | 15745.5 | 4251765 | 1420 | 1440 |
Weighted
##
## Less than HS HS graduate or equivalent
## 60 278
## Some college/ associates degree Bachelor's degree
## 618 338
## Post grad study/professional degree
## 269| term | estimate | std.error | statistic | p.value |
|---|---|---|---|---|
| (Intercept) | 13.7927 | 5.0004 | 2.7583 | 0.0059 |
| condition1 | -17.7661 | 5.0004 | -3.5529 | 0.0004 |
| pol_ideology_missing | 5.0144 | 1.5962 | 3.1414 | 0.0017 |
| education_factor1 | -15.5407 | 9.3323 | -1.6652 | 0.0961 |
| education_factor2 | -7.3790 | 4.0292 | -1.8314 | 0.0673 |
| education_factor3 | -7.1820 | 3.0418 | -2.3611 | 0.0184 |
| education_factor4 | -8.5175 | 2.4234 | -3.5147 | 0.0005 |
| condition1:pol_ideology_missing | 0.4934 | 1.5962 | 0.3091 | 0.7573 |
| condition1:education_factor1 | 33.2714 | 9.3323 | 3.5652 | 0.0004 |
| condition1:education_factor2 | 9.2536 | 4.0292 | 2.2966 | 0.0218 |
| condition1:education_factor3 | 8.0456 | 3.0418 | 2.6450 | 0.0083 |
| condition1:education_factor4 | 4.7931 | 2.4234 | 1.9779 | 0.0481 |
| pol_ideology_missing:education_factor1 | 5.5357 | 2.9484 | 1.8776 | 0.0606 |
| pol_ideology_missing:education_factor2 | 2.6329 | 1.2557 | 2.0968 | 0.0362 |
| pol_ideology_missing:education_factor3 | 2.5997 | 0.9664 | 2.6901 | 0.0072 |
| pol_ideology_missing:education_factor4 | 1.9927 | 0.8032 | 2.4809 | 0.0132 |
| condition1:pol_ideology_missing:education_factor1 | -10.3234 | 2.9484 | -3.5014 | 0.0005 |
| condition1:pol_ideology_missing:education_factor2 | -3.8792 | 1.2557 | -3.0893 | 0.0020 |
| condition1:pol_ideology_missing:education_factor3 | -2.8665 | 0.9664 | -2.9662 | 0.0031 |
| condition1:pol_ideology_missing:education_factor4 | -0.7636 | 0.8032 | -0.9507 | 0.3419 |
| r.squared | adj.r.squared | sigma | statistic | p.value | df | logLik | AIC | BIC | deviance | df.residual | nobs |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.1341 | 0.1225 | 56.6333 | 11.572 | 0 | 19 | -8102.94 | 16247.9 | 16358.6 | 4554406 | 1420 | 1440 |
Exploring the three-way interactions
intercept for condition=control & education_factor=“Less than HS”
## (Intercept)
## 13.7927intercept for condition=experiment & education_factor=“Less than HS”
## (Intercept)
## -3.9734intercept for condition=control & education_factor=“HS graduate or equivalent”
## (Intercept)
## -1.74803intercept for condition=experiment & education_factor=“HS graduate or equivalent”
## (Intercept)
## 13.7574intercept for condition=control & education_factor=“Some college/ associates degree”
## (Intercept)
## 6.41365intercept for condition=experiment & education_factor=“Some college/ associates degree”
## (Intercept)
## -2.09882intercept for condition=control & education_factor=“Bachelor’s degree”
## (Intercept)
## 6.61063intercept for condition=experiment & education_factor=“Bachelor’s degree”
## (Intercept)
## -3.10987intercept for condition=control & education_factor=“Post grad study/professional degree”
## (Intercept)
## 5.27513intercept for condition=experiment & education_factor=“Post grad study/professional degree”
## (Intercept)
## -7.69781
Moderated mediation model
“Secondary analyses will also include a moderated mediation model to determine if this model is a better fit than our planned serial mediation model. Specifically, we will also test a moderated mediation model where the relation between the perceived gender development age gap and autonomy support varies by condition.”
Non-weighted
## lavaan 0.6.15 ended normally after 35 iterations
##
## Estimator ML
## Optimization method NLMINB
## Number of model parameters 9
##
## Used Total
## Number of observations 1422 1563
##
## Model Test User Model:
##
## Test statistic 12.057
## Degrees of freedom 2
## P-value (Chi-square) 0.002
##
## Model Test Baseline Model:
##
## Test statistic 1342.157
## Degrees of freedom 7
## P-value 0.000
##
## User Model versus Baseline Model:
##
## Comparative Fit Index (CFI) 0.992
## Tucker-Lewis Index (TLI) 0.974
##
## Loglikelihood and Information Criteria:
##
## Loglikelihood user model (H0) -4857.736
## Loglikelihood unrestricted model (H1) -4851.708
##
## Akaike (AIC) 9733.472
## Bayesian (BIC) 9780.811
## Sample-size adjusted Bayesian (SABIC) 9752.221
##
## Root Mean Square Error of Approximation:
##
## RMSEA 0.059
## 90 Percent confidence interval - lower 0.030
## 90 Percent confidence interval - upper 0.094
## P-value H_0: RMSEA <= 0.050 0.261
## P-value H_0: RMSEA >= 0.080 0.177
##
## Standardized Root Mean Square Residual:
##
## SRMR 0.011
##
## Parameter Estimates:
##
## Standard errors Bootstrap
## Number of requested bootstrap draws 5000
## Number of successful bootstrap draws 5000
##
## Regressions:
## Estimate Std.Err z-value P(>|z|) ci.lower ci.upper
## autonomy_geniden ~
## gndr_cX (a_m1) 0.003 0.002 1.610 0.107 -0.001 0.007
## conditn (a_m2) -0.359 0.107 -3.370 0.001 -0.570 -0.152
## gndr_cm (a_m3) -0.012 0.003 -4.888 0.000 -0.018 -0.007
## legislation ~
## gndr_cm (b1) 0.003 0.000 6.676 0.000 0.002 0.004
## atnmy_g (bM) -0.669 0.016 -40.611 0.000 -0.700 -0.637
## Std.lv Std.all
##
## 0.003 0.136
## -0.359 -0.103
## -0.012 -0.423
##
## 0.003 0.115
## -0.669 -0.720
##
## Intercepts:
## Estimate Std.Err z-value P(>|z|) ci.lower ci.upper
## .autonomy_gendn 5.228 0.179 29.272 0.000 4.883 5.580
## .legislation 7.760 0.077 100.481 0.000 7.605 7.911
## Std.lv Std.all
## 5.228 2.988
## 7.760 4.770
##
## Variances:
## Estimate Std.Err z-value P(>|z|) ci.lower ci.upper
## .autonomy_gendn 2.825 0.091 31.134 0.000 2.642 2.997
## .legislation 1.125 0.042 26.878 0.000 1.041 1.207
## Std.lv Std.all
## 2.825 0.923
## 1.125 0.425
##
## R-Square:
## Estimate
## autonomy_gendn 0.077
## legislation 0.575
##
## Defined Parameters:
## Estimate Std.Err z-value P(>|z|) ci.lower ci.upper
## MedMod_ab -0.002 0.001 -1.604 0.109 -0.005 0.000
## Std.lv Std.all
## -0.002 -0.098## lhs op rhs mi epc sepc.lv sepc.all sepc.nox
## 20 autonomy_geniden ~ legislation 12.004 1.544 1.544 1.435 1.435
## 28 condition ~ legislation 10.119 0.032 0.032 0.106 0.106
## 22 legislation ~ condition 9.342 0.182 0.182 0.056 0.112
## 32 gender_comp ~ legislation 3.208 0.800 0.800 0.022 0.022
## 24 gender_compXcond ~ legislation 2.241 -0.846 -0.846 -0.018 -0.018Weighted
## lavaan 0.6.15 ended normally after 42 iterations
##
## Estimator ML
## Optimization method NLMINB
## Number of model parameters 9
##
## Used Total
## Number of observations 1422 1563
## Sampling weights variable weights
##
## Model Test User Model:
## Standard Scaled
## Test Statistic 20.114 10.240
## Degrees of freedom 2 2
## P-value (Chi-square) 0.000 0.006
## Scaling correction factor 1.964
## Yuan-Bentler correction (Mplus variant)
##
## Model Test Baseline Model:
##
## Test statistic 1225.395 572.215
## Degrees of freedom 7 7
## P-value 0.000 0.000
## Scaling correction factor 2.141
##
## User Model versus Baseline Model:
##
## Comparative Fit Index (CFI) 0.985 0.985
## Tucker-Lewis Index (TLI) 0.948 0.949
##
## Robust Comparative Fit Index (CFI) 0.987
## Robust Tucker-Lewis Index (TLI) 0.953
##
## Loglikelihood and Information Criteria:
##
## Loglikelihood user model (H0) -4846.900 -4846.900
## Scaling correction factor 1.893
## for the MLR correction
## Loglikelihood unrestricted model (H1) -4836.843 -4836.843
## Scaling correction factor 1.906
## for the MLR correction
##
## Akaike (AIC) 9711.800 9711.800
## Bayesian (BIC) 9759.138 9759.138
## Sample-size adjusted Bayesian (SABIC) 9730.549 9730.549
##
## Root Mean Square Error of Approximation:
##
## RMSEA 0.080 0.054
## 90 Percent confidence interval - lower 0.051 0.032
## 90 Percent confidence interval - upper 0.113 0.078
## P-value H_0: RMSEA <= 0.050 0.047 0.349
## P-value H_0: RMSEA >= 0.080 0.541 0.038
##
## Robust RMSEA 0.075
## 90 Percent confidence interval - lower 0.034
## 90 Percent confidence interval - upper 0.124
## P-value H_0: Robust RMSEA <= 0.050 0.138
## P-value H_0: Robust RMSEA >= 0.080 0.497
##
## Standardized Root Mean Square Residual:
##
## SRMR 0.015 0.015
##
## Parameter Estimates:
##
## Standard errors Sandwich
## Information bread Observed
## Observed information based on Hessian
##
## Regressions:
## Estimate Std.Err z-value P(>|z|) ci.lower ci.upper
## autonomy_geniden ~
## gndr_cX (a_m1) 0.004 0.002 1.730 0.084 -0.001 0.009
## conditn (a_m2) -0.303 0.146 -2.080 0.038 -0.589 -0.017
## gndr_cm (a_m3) -0.012 0.003 -3.837 0.000 -0.018 -0.006
## legislation ~
## gndr_cm (b1) 0.003 0.001 4.812 0.000 0.002 0.004
## atnmy_g (bM) -0.644 0.023 -28.291 0.000 -0.688 -0.599
## Std.lv Std.all
##
## 0.004 0.191
## -0.303 -0.088
## -0.012 -0.429
##
## 0.003 0.117
## -0.644 -0.703
##
## Intercepts:
## Estimate Std.Err z-value P(>|z|) ci.lower ci.upper
## .autonomy_gendn 5.005 0.238 21.028 0.000 4.539 5.472
## .legislation 7.698 0.104 74.043 0.000 7.494 7.901
## Std.lv Std.all
## 5.005 2.913
## 7.698 4.893
##
## Variances:
## Estimate Std.Err z-value P(>|z|) ci.lower ci.upper
## .autonomy_gendn 2.781 0.120 23.270 0.000 2.547 3.015
## .legislation 1.126 0.068 16.447 0.000 0.992 1.260
## Std.lv Std.all
## 2.781 0.942
## 1.126 0.455
##
## R-Square:
## Estimate
## autonomy_gendn 0.058
## legislation 0.545
##
## Defined Parameters:
## Estimate Std.Err z-value P(>|z|) ci.lower ci.upper
## MedMod_ab -0.003 0.002 -1.722 0.085 -0.006 0.000
## Std.lv Std.all
## -0.003 -0.134## lhs op rhs mi epc sepc.lv sepc.all sepc.nox
## 20 autonomy_geniden ~ legislation 17.532 1.978 1.978 1.811 1.811
## 28 condition ~ legislation 17.309 0.043 0.043 0.136 0.136
## 22 legislation ~ condition 16.023 0.236 0.236 0.075 0.150
## 32 gender_comp ~ legislation 4.831 1.052 1.052 0.027 0.027
## 24 gender_compXcond ~ legislation 3.388 -1.143 -1.143 -0.022 -0.022Testing for direct effects of condition
“We will also conduct two separate independent samples t-test to determine whether there is a direct effect of condition on support for youth’s gender identity autonomy and support for anti-trans legislation, respectively.”
Gender identity autonomy
Non-weighted
| Test statistic | df | P value | Alternative hypothesis |
|---|---|---|---|
| -0.4239 | 1536 | 0.6717 | two.sided |
| mean in group Control | mean in group Experiment |
|---|---|
| 4.38 | 4.418 |
Weighted
test: Two Sample Weighted T-Test (Welch)
coefficients:
t.value df p.value -61.69 1799 0 additional:
Difference Mean.x Mean.y Std. Err -2.809 1.504 4.313 0.04553
Support for anti-trans legislation
Non-weighted
| Test statistic | df | P value | Alternative hypothesis |
|---|---|---|---|
| -0.2672 | 1543 | 0.7893 | two.sided |
| mean in group Control | mean in group Experiment |
|---|---|
| 4.902 | 4.924 |
Weighted
test: Two Sample Weighted T-Test (Welch)
coefficients:
t.value df p.value -84.49 1860 0 additional:
Difference Mean.x Mean.y Std. Err -3.514 1.502 5.017 0.04159
Testing for order effects
“Last, we will conduct an independent samples t-test to test for order effects on participants’ age gap in their perceptions of gender identity development for participants who are first asked about gender development of cisgender people compared to gender development of transgender people.”
Planned analyses
Non-weighted
| Test statistic | df | P value | Alternative hypothesis |
|---|---|---|---|
| 5.599 | 1436 | 0.00000002578 * * * | two.sided |
| mean in group Cis first | mean in group Trans first |
|---|---|
| 38.45 | 21.33 |
| Test statistic | df | P value | Alternative hypothesis |
|---|---|---|---|
| -3.436 | 1357 | 0.0006085 * * * | two.sided |
| mean in group Cis first | mean in group Trans first |
|---|---|
| 49.76 | 58.63 |
| Test statistic | df | P value | Alternative hypothesis |
|---|---|---|---|
| 2.085 | 1493 | 0.03723 * | two.sided |
| mean in group Cis first | mean in group Trans first |
|---|---|
| 88.21 | 81.36 |
Weighted
test: Two Sample Weighted T-Test (Welch)
coefficients:
t.value df p.value NA 1451 NA additional:
Difference Mean.x Mean.y Std. Err NA NA 29.84 1.605
test: Two Sample Weighted T-Test (Welch)
coefficients:
t.value df p.value NA 1479 NA additional:
Difference Mean.x Mean.y Std. Err NA NA 54.42 1.302
test: Two Sample Weighted T-Test (Welch)
coefficients:
t.value df p.value NA 1495 NA additional:
Difference Mean.x Mean.y Std. Err NA NA 85.45 1.651
2x2 model with the perceptions of gender identity regression on order and condition
## Anova Table (Type III tests)
##
## Response: pcsi2Data$gender_comp
## Sum Sq Df F value
## (Intercept) 1261435 1 411.97
## pcsi2Data$condition 489843 1 159.98
## pcsi2Data$gender_identify_order 96828 1 31.62
## pcsi2Data$condition:pcsi2Data$gender_identify_order 47917 1 15.65
## Residuals 4433679 1448
## Pr(>F)
## (Intercept) < 0.0000000000000002 ***
## pcsi2Data$condition < 0.0000000000000002 ***
## pcsi2Data$gender_identify_order 0.0000000224 ***
## pcsi2Data$condition:pcsi2Data$gender_identify_order 0.0000799239 ***
## Residuals
## ---
## Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1## eta.sq eta.sq.part
## pcsi2Data$condition 0.09621689 0.0994905
## pcsi2Data$gender_identify_order 0.01901935 0.0213725
## pcsi2Data$condition:pcsi2Data$gender_identify_order 0.00941213 0.0106921## Tukey multiple comparisons of means
## 95% family-wise confidence level
##
## Fit: aov(formula = pcsi2Data$gender_comp ~ pcsi2Data$condition * pcsi2Data$gender_identify_order)
##
## $`pcsi2Data$condition`
## diff lwr upr p adj
## Experiment-Control -37.5063 -43.2042 -31.8084 0
##
## $`pcsi2Data$gender_identify_order`
## diff lwr upr p adj
## Trans first-Cis first -16.5212 -22.2232 -10.8192 0
##
## $`pcsi2Data$condition:pcsi2Data$gender_identify_order`
## diff lwr upr
## Experiment:Cis first-Control:Cis first -48.27680 -58.63441 -37.9192
## Control:Trans first-Control:Cis first -27.85212 -38.34701 -17.3572
## Experiment:Trans first-Control:Cis first -53.12511 -63.62000 -42.6302
## Control:Trans first-Experiment:Cis first 20.42467 9.76876 31.0806
## Experiment:Trans first-Experiment:Cis first -4.84831 -15.50423 5.8076
## Experiment:Trans first-Control:Trans first -25.27299 -36.06238 -14.4836
## p adj
## Experiment:Cis first-Control:Cis first 0.000000
## Control:Trans first-Control:Cis first 0.000000
## Experiment:Trans first-Control:Cis first 0.000000
## Control:Trans first-Experiment:Cis first 0.000005
## Experiment:Trans first-Experiment:Cis first 0.645780
## Experiment:Trans first-Control:Trans first 0.000000| condition | gender_identify_order | mean | sd | n | sem |
|---|---|---|---|---|---|
| Control | Cis first | 61.82 | 71.05 | 414 | 3.492 |
| Control | Trans first | 33.97 | 61.85 | 378 | 3.181 |
| Experiment | Cis first | 13.54 | 41.89 | 392 | 2.116 |
| Experiment | Trans first | 8.695 | 38.03 | 379 | 1.954 |