4b. FIMI DV operationalisation

NoteWhere am I in the pipeline?
  • Inputs: S1-S4 wrangled item-level files in data/wrangled_data/, plus the canonical FIMI item identity map in R/roadmap_helpers.R::fimi_item_map() and the audit mapping files outputs/item_mapping_overview.csv / outputs/item_mapping_master_long.csv.
  • This page: FIMI DV operationalisation (Stage 4 owner page). Rebuilds the FIMI dependent-variable evidence end-to-end: S1 15-item pool to S2+ 8-item battery, S2/S3/S4 Full/Russian/Chinese/Short DV measurement checks, and the reproducible short-form selection across S2-S4.
  • Hands off to: 4c FIMI prediction for structural prediction using the resulting criterion definitions; 4d Deployment and invariance for predictor-scale deployment; 3d Study 4 for S4 country-level modelling.

Overview

This page rebuilds the FIMI dependent-variable (DV) operationalisation from the item level. The FIMI news battery is the criterion the DisInforMeter scale predicts; it is not part of the predictor scale. The working rule is:

  1. Full FIMI is primary. It is the full administered news battery in each FIMI wave: 15 items in S1 and 8 items in S2/S3/S4.
  2. Russian-origin and Chinese-origin FIMI are planned source-specific DVs. They test whether the criterion behaves the same when the news content comes from Russian versus Chinese sources.
  3. Short FIMI is the source-balanced four-item DV. The canonical short criterion is the shortest source-balanced subset that preserves the Full FIMI signal across S2-S4.

The page has three deliverables: (a) an ex-post audit of how much of the S1 15-item criterion is retained by the S2+ 8-item battery, (b) measurement and invariance checks for Full/Russian/Chinese/Short FIMI in S2-S4, and (c) a reproducible short-scale search over all S2+ item subsets that documents the selected Short FIMI criterion.

Item identity and source composition

Table 1: Canonical FIMI news-item identity. Canonical IDs 1-8 are retained in S2/S3/S4; IDs 9-15 are S1-only.
Canonical ID S1 name S2+ name Origin Retained in S2+ Content
1 news3 news1 Russian yes Zelensky bought £20m UK mansion
2 news4 news2 Russian yes France asked Russia not to touch French military
3 news7 news3 Russian yes 2026 Milan–Cortina Olympics will be openly LGBT+
4 news8 news4 Russian yes Ukrainian army wants 'tolerance mentor' at front
5 news9 news5 Russian yes Kyiv invites gays to join LGBT+ brigades
6 news12 news6 Chinese yes Li-Meng Yan is a 'known rumour-maker'
7 news14 news7 Chinese yes CGTN: China–Vietnam friendship
8 news15 news8 Chinese yes Li Hongzhi: extremist religious leader
9 news1 - Russian no Russian hackers vs Finnish Parliament
10 news2 - Russian no Ukraine + Poland: joint drone production
11 news5 - Russian no Global Times: US the exploiter
12 news6 - Russian no Lenin / Kyiv electrification
13 news10 - Russian no KillNet vs NATO on gay dating site
14 news11 - Russian no Bremerhaven: Islamic family / LGBT+
15 news13 - Russian no USA running human experiments on Thai border
Figure 1: FIMI item identity and source composition across the four FIMI waves. Filled cells mark items included in the wave’s Full FIMI battery.

From S1 15 items to the S2+ 8-item battery

The S1 battery is the only wave that fielded all 15 FIMI items. The S2+ battery kept eight items: all three Chinese-origin items plus five Russian-origin items. The analyses below do not pretend to recover the historical fieldwork decision perfectly; they audit whether the retained eight items preserve the S1 full-score variance, whether the seven dropped items add distinctive psychometric information, and how the retained set ranks against all possible 8-item subsets.

Parallel analysis suggests that the number of factors =  3  and the number of components =  NA 
Table 2: S1 15-item FIMI battery: EFA/PCA diagnostics
Statistic Value
Items 15
N 681
Overall KMO (MSA) 0.950
Bartlett chi-square 5 489.4
Bartlett df 105
Bartlett p <0.001
Parallel-analysis factors 3
Velicer MAP minimum 1
First PCA eigenvalue 7.691
First PCA variance 51.3%
Figure 2: PCA scree for the S1 15-item FIMI battery.
Table 3: S1 full, retained, dropped, and source-specific FIMI scores. Scores are row means; correlations are Pearson pairwise-complete correlations.
Scale Items alpha omega r with Full 15 r with retained 8
Full S1 FIMI 15 0.930 0.932 1.000 0.969
Retained S2+ eight-item core in S1 8 0.888 0.891 0.969 1.000
S1-only seven-item remainder 7 0.848 0.851 0.961 0.864
S1 Russian-origin FIMI 12 0.909 0.910 0.992 0.948
S1 Chinese-origin FIMI 3 0.819 0.823 0.884 0.905
Figure 3: S1 item-level diagnostics for retained versus S1-only FIMI items. Corrected item-total correlations use the remaining 14 news items as the criterion.
Table 4: All 6,435 possible S1 eight-item subsets were ranked against the S1 Full 15 row-mean score. The actual S2+ retained set is shown even if it is not in the top 10.
Row type Canonical IDs S1 items Russian Chinese alpha r with Full 15 Rank by r Mean &#124;inter-item r&#124;
Top 10 by r with Full 15 1,3,4,6,8,9,11,14 news1,news11,news12,news15,news3,news5,news7,news8 6 2 0.875 0.981 1 0.472
Top 10 by r with Full 15 2,5,6,7,10,11,13,14 news10,news11,news12,news14,news2,news4,news5,news9 6 2 0.870 0.981 2 0.463
Top 10 by r with Full 15 2,5,7,10,11,12,13,15 news10,news13,news14,news2,news4,news5,news6,news9 7 1 0.868 0.981 3 0.457
Top 10 by r with Full 15 1,3,4,6,8,9,12,14 news1,news11,news12,news15,news3,news6,news7,news8 6 2 0.871 0.981 4 0.463
Top 10 by r with Full 15 1,3,4,6,8,9,13,14 news1,news10,news11,news12,news15,news3,news7,news8 6 2 0.874 0.981 5 0.470
Top 10 by r with Full 15 2,5,7,10,12,13,14,15 news10,news11,news13,news14,news2,news4,news6,news9 7 1 0.868 0.981 6 0.456
Top 10 by r with Full 15 2,5,7,8,10,13,14,15 news10,news11,news13,news14,news15,news2,news4,news9 6 2 0.875 0.980 7 0.475
Top 10 by r with Full 15 2,5,6,7,10,11,13,15 news10,news12,news13,news14,news2,news4,news5,news9 6 2 0.875 0.980 8 0.472
Top 10 by r with Full 15 2,5,7,8,10,12,14,15 news11,news13,news14,news15,news2,news4,news6,news9 6 2 0.871 0.980 9 0.468
Top 10 by r with Full 15 2,5,6,8,10,12,14,15 news11,news12,news13,news15,news2,news4,news6,news9 6 2 0.872 0.980 10 0.468
Actual S2+ retained set 1,2,3,4,5,6,7,8 news12,news14,news15,news3,news4,news7,news8,news9 5 3 0.888 0.969 4406 0.502

The retained S2+ core correlates 0.969 with the S1 Full 15 score and ranks 4406 / 6435 among all possible 8-item subsets by this criterion. Its distinctive design feature is not raw maximisation of S1 internal consistency; it is source coverage: all three Chinese-origin items are retained while the Russian-origin set is compressed from twelve items to five.

Full, Russian, Chinese, and Short FIMI in S2/S3/S4

For S2, S3, and S4 the item names are aligned (news1-news8), so Full, Russian-origin, Chinese-origin, and the canonical Short FIMI can be evaluated under exactly the same item definitions. This section treats them as measurement models first and scores second.

Table 5: S2-S4 FIMI DV reliability and single-factor CFA diagnostics. Three-item Chinese-origin models are saturated or near-saturated within group, so global fit indices are less informative than loadings and cross-study invariance.
Study Version Items N alpha omega AVE CFI RMSEA SRMR min lambda median lambda
S2 Full FIMI 8 582 0.779 0.786 0.319 0.824 0.128 0.064 0.357 0.574
S2 Russian-origin FIMI 5 582 0.742 0.748 0.378 0.902 0.146 0.049 0.472 0.629
S2 Chinese-origin FIMI 3 582 0.638 0.656 0.396 1.000 0.000 0.000 0.484 0.624
S2 Short FIMI 4 582 0.688 0.690 0.359 0.922 0.158 0.041 0.525 0.594
S3 Full FIMI 8 782 0.548 0.559 0.144 0.844 0.059 0.042 0.223 0.351
S3 Russian-origin FIMI 5 782 0.471 0.487 0.172 0.948 0.049 0.026 0.217 0.443
S3 Chinese-origin FIMI 3 782 0.361 0.379 0.187 1.000 0.000 0.000 0.206 0.469
S3 Short FIMI 4 782 0.398 0.411 0.158 1.000 0.000 0.010 0.247 0.369
S4 Full FIMI 8 8,040 0.690 0.694 0.226 0.930 0.057 0.031 0.318 0.465
S4 Russian-origin FIMI 5 8,040 0.654 0.659 0.284 0.970 0.060 0.021 0.398 0.548
S4 Chinese-origin FIMI 3 8,040 0.418 0.433 0.213 1.000 0.000 0.000 0.307 0.441
S4 Short FIMI 4 8,040 0.529 0.532 0.226 0.989 0.038 0.012 0.357 0.485
Figure 4: Standardised loadings from single-factor FIMI DV CFA models in S2-S4.
Figure 5: Score correlations among Full, Russian-origin, Chinese-origin, and Short FIMI in S2-S4.

Cross-study invariance for the FIMI DV

Table 6: S2/S3/S4 FIMI DV measurement-invariance ladder. Delta rules: |Delta CFI|
Version Level Converged CFI RMSEA SRMR Delta CFI Delta RMSEA Decision
Chinese-origin FIMI Configural yes 1.000 0.000 0.000 - - baseline
Chinese-origin FIMI Metric yes 0.982 0.042 0.011 -0.018 0.042 inspect
Chinese-origin FIMI Scalar yes 0.978 0.033 0.013 -0.004 -0.009 acceptable delta
Full FIMI Configural yes 0.913 0.064 0.034 - - baseline
Full FIMI Metric yes 0.911 0.058 0.035 -0.003 -0.005 acceptable delta
Full FIMI Scalar yes 0.874 0.063 0.042 -0.037 0.005 inspect
Russian-origin FIMI Configural yes 0.962 0.068 0.023 - - baseline
Russian-origin FIMI Metric yes 0.958 0.057 0.026 -0.004 -0.010 acceptable delta
Russian-origin FIMI Scalar yes 0.900 0.076 0.038 -0.058 0.019 inspect
Short FIMI Configural yes 0.979 0.052 0.014 - - baseline
Short FIMI Metric yes 0.970 0.044 0.017 -0.009 -0.008 acceptable delta
Short FIMI Scalar yes 0.965 0.039 0.019 -0.005 -0.005 acceptable delta

Selecting the canonical Short FIMI DV from S2-S4

The short-form search below enumerates every 2-, 3-, 4-, 5-, and 6-item subset of the S2+ eight-item battery and scores each subset in S2, S3, and S4. The selection rule is deliberately explicit:

  • The subset must include at least one Russian-origin and one Chinese-origin item.
  • The subset should be as short as possible.
  • Within that length, prefer high minimum correlation with Full FIMI across S2/S3/S4, then balanced correlation with both source-specific DVs, then internal consistency.

Because the Chinese-origin score is empirically less interchangeable with Full/Russian FIMI, the source-balance constraint is substantive, not cosmetic. An all-Russian short score can track Full FIMI well, but it cannot test whether Chinese-origin receptivity is preserved.

Table 7: Canonical Short FIMI DV. The selected set is the shortest source-balanced subset meeting the tracking rule.
Candidate k Items Canonical IDs Russian Chinese mean r with Full min r with Full mean r with Russian mean r with Chinese mean alpha
Selected Short FIMI DV 4 news2,news5,news7,news8 2,5,7,8 2 2 0.892 0.860 0.769 0.728 0.538
Table 8: Top five source-balanced short-form candidates at each length. Rankings use the declared decision score after the source-balance filter.
k Items Canonical IDs Russian Chinese mean r Full min r Full min source r mean alpha Decision score
2 news5,news8 5,8 1 1 0.759 0.682 0.638 0.349 0.870
2 news2,news8 2,8 1 1 0.751 0.678 0.623 0.368 0.861
2 news2,news7 2,7 1 1 0.742 0.691 0.581 0.330 0.841
2 news4,news8 4,8 1 1 0.734 0.675 0.596 0.381 0.839
2 news5,news7 5,7 1 1 0.736 0.668 0.591 0.371 0.839
3 news2,news5,news8 2,5,8 2 1 0.845 0.793 0.594 0.487 0.940
3 news2,news5,news6 2,5,6 2 1 0.835 0.788 0.631 0.418 0.935
3 news4,news5,news8 4,5,8 2 1 0.831 0.777 0.617 0.499 0.932
3 news2,news4,news8 2,4,8 2 1 0.830 0.780 0.606 0.496 0.929
3 news2,news7,news8 2,7,8 1 2 0.824 0.790 0.641 0.447 0.928
4 news2,news5,news7,news8 2,5,7,8 2 2 0.892 0.860 0.728 0.538 1.003
4 news2,news5,news6,news7 2,5,6,7 2 2 0.888 0.854 0.741 0.492 0.999
4 news1,news4,news7,news8 1,4,7,8 2 2 0.880 0.855 0.742 0.503 0.992
4 news2,news5,news6,news8 2,5,6,8 2 2 0.882 0.838 0.722 0.524 0.991
4 news2,news4,news7,news8 2,4,7,8 2 2 0.876 0.858 0.734 0.549 0.989
5 news2,news4,news5,news6,news8 2,4,5,6,8 3 2 0.923 0.887 0.747 0.593 1.025
5 news2,news3,news5,news6,news8 2,3,5,6,8 3 2 0.926 0.901 0.733 0.546 1.024
5 news2,news4,news5,news6,news7 2,4,5,6,7 3 2 0.923 0.897 0.729 0.580 1.022
5 news1,news3,news4,news6,news8 1,3,4,6,8 3 2 0.922 0.891 0.749 0.512 1.021
5 news2,news3,news5,news6,news7 2,3,5,6,7 3 2 0.927 0.901 0.715 0.532 1.021
6 news2,news3,news5,news6,news7,news8 2,3,5,6,7,8 3 3 0.956 0.939 0.798 0.592 1.054
6 news1,news2,news3,news6,news7,news8 1,2,3,6,7,8 3 3 0.952 0.935 0.797 0.575 1.049
6 news2,news4,news5,news6,news7,news8 2,4,5,6,7,8 3 3 0.950 0.933 0.785 0.629 1.048
6 news1,news2,news5,news6,news7,news8 1,2,5,6,7,8 3 3 0.948 0.932 0.794 0.619 1.047
6 news1,news3,news5,news6,news7,news8 1,3,5,6,7,8 3 3 0.949 0.931 0.790 0.579 1.046
Figure 6: Short-form candidate trade-off: length versus minimum correlation with Full FIMI across S2-S4. Source-balanced candidates include at least one Russian-origin and one Chinese-origin item.
Table 9: Canonical Short FIMI DV diagnostics by study.
Study Candidate Items r Full r Russian r Chinese alpha
S2 Selected Short FIMI DV news2,news5,news7,news8 0.927 0.827 0.765 0.688
S3 Selected Short FIMI DV news2,news5,news7,news8 0.860 0.699 0.699 0.398
S4 Selected Short FIMI DV news2,news5,news7,news8 0.890 0.781 0.721 0.529

The canonical Short FIMI DV is news2,news5,news7,news8 (canonical IDs 2,5,7,8). It has 2 Russian-origin and 2 Chinese-origin items, a mean correlation of 0.892 with Full FIMI, and a worst-wave correlation of 0.860 across S2-S4.

Synthesis

The evidence supports three changes to the project convention.

  1. Full FIMI remains the primary DV. It is the most information-rich criterion and the one all S1-S4 FIMI waves can define.
  2. Russian-origin and Chinese-origin FIMI should be reported as planned source-specific DVs in S2-S4. Their score correlations are positive but not identical, and the Chinese-origin score is consistently the more distinctive criterion.
  3. Short FIMI is the four-item source-balanced DV. The data-driven short DV above is the shortest source-balanced candidate that preserves the full-battery signal across S2-S4.

Downstream prediction pages should use: Full FIMI as the named primary criterion; Russian-origin and Chinese-origin FIMI for source-specific sensitivity; and the recommended source-balanced short DV when a short criterion is required.