VAA stance vector
Each answer is encoded from 0.00 to 1.00 in the statement order of the selected wave.
A compact guide to the data, coordinates, and transformation models behind the project.
Learn how issue responses become a three-dimensional European political-space estimate.
A coordinate system for comparing actors by issue positions rather than party names or slogans.
A questionnaire infrastructure where citizens, parties, or models answer policy statements.
An expert-survey infrastructure that places European parties on comparable ideological dimensions.
Language models can answer VAA statements, letting their expressed positions be projected into CHES space.
Political competition is often described using words such as left, right, liberal, conservative, green, nationalist, pro-EU, or Eurosceptic. Those labels are useful, but they compress many issue positions into a few categories. A political coordinate system makes the compression explicit. Each actor receives numeric positions on dimensions that summarize recurring patterns in policy conflict.
In European party politics, three dimensions are especially useful for this project. lrgen captures general left-right orientation. lrecon captures economic left-right conflict, such as redistribution, public spending, market regulation, and welfare. galtan captures the cultural dimension between Green/Alternative/Libertarian and Traditional/Authoritarian/Nationalist politics.
A coordinate is not a moral judgment and not an essence. It is an instrument reading. If two actors land near each other, they are similar with respect to the instrument's dimensions and data sources. If they are far apart, they differ in the patterns the instrument has learned to represent.
The three CHES dimensions as one cube. The coloured axes cross at 0.5, the midpoint of the rescaled coordinate system. Drag to rotate.
A Voting Advice Application, or VAA, is an online tool that asks users to respond to political issue statements. The application compares those answers with party or candidate positions on the same statements, then presents proximity scores, rankings, or spatial maps. VAAs became widespread in Europe because multiparty systems and coalition politics make party choice harder to reduce to a binary left-right decision.
EU Profiler and euandi are flagship transnational VAAs for European Parliament elections. They use policy statements that are meant to be salient, divisive, and comparable across countries. Users usually answer on a Likert-style agreement scale: completely disagree, disagree, neutral, agree, completely agree, often with a no-opinion option in the public application.
For this project, the VAA side matters because it gives a structured prompt interface. A human, a party, or an LLM can answer the same statements. Those answers become numeric features, using a five-point coding:
The project uses three European Parliament VAA waves. The feature space is not identical in every year: 2009 and 2014 use 30 statement features, while 2019 uses 22. That is why the repository releases separate transformation models for each year.
Reference parties and statement features per wave. The shorter 2019 questionnaire is one reason each wave keeps its own model.
The Chapel Hill Expert Surveys estimate party positions in Europe using expert judgments. Across repeated waves, CHES supplies comparable measurements for party families, countries, and policy dimensions. This makes it a research infrastructure: it is not a one-off poll, but a repeated map of elite-level party positioning.
CHES matters here because it provides the target coordinate system. The transformation models learn how VAA statement answers correspond to CHES party coordinates. The output coordinates are rescaled to the unit interval [0,1] for visual and computational consistency.
A broad ideological summary dimension. It combines many political cues and should be read as an aggregate placement, not a single issue stance.
A dimension for market regulation, redistribution, welfare, austerity, taxation, labor protection, and public spending.
A cultural dimension contrasting Green/Alternative/Libertarian politics with Traditional/Authoritarian/Nationalist politics.
The paper's central claim is that an LLM's political position should be modeled as a context-conditioned distribution, not as one fixed point. The VAA-CHES instrument makes that claim measurable. A model can answer VAA statements under different prompt registers, paraphrases, languages, reasoning conditions, debates, or argumentative roles. Each answer set becomes a coordinate.
Once many coordinates are collected, the question changes. Instead of asking "where is this model politically?", the study asks: how far does it move under context, how stable is its projection, and how large is its aggregate envelope compared with European party diversity?
This is why the project can report both local plasticity and global compression. Local context can move model coordinates substantially. Yet the pooled model cohort can still occupy a small ideological volume relative to the European party reference set.
The repository releases three serialized transformation models: ideology_model_2009.pkl, ideology_model_2014.pkl, and ideology_model_2019.pkl. Each is a complete scikit-learn pipeline: preprocessing and prediction are stored together, so users should not manually normalize inputs before inference.
The training data are cleaned by dropping observations where any of the three CHES targets are missing. The feature matrix contains the remaining numeric VAA features after removing identifiers such as CHESS, YEAR, and the target variables. The target vector is three-dimensional: lrgen, lrecon, and galtan.
Each answer is encoded from 0.00 to 1.00 in the statement order of the selected wave.
Stored feature means and scales turn raw stance values into standardized inputs.
Bootstrap samples train separate regressors, which reduces estimator variance.
One regularized linear model is fitted for each CHES target coordinate.
The ensemble average returns lrgen, lrecon, galtan.
Preprocessing and prediction ship inside the same serialized object, so inference is a single call on unscaled features.
Each trial is scored by negative mean squared error over 50 validation fits, and the winning configuration is refitted on the full cleaned dataset.
Standardization converts each feature from a raw stance value to a z-like scaled input. This is necessary because VAA features can have different empirical means and variances across parties. The fitted means and scales are stored inside the exported model and were also extracted into the browser-side model files used by the public test.
ElasticNet is used because political indicators are often correlated. It combines L1 and L2 regularization, allowing the model to reduce overfitting, keep coefficients stable on small datasets, and shrink less useful features toward zero. Multi-output regression then exposes three predictions at once: one for each CHES dimension.
Bagging adds robustness. Multiple bootstrap samples are drawn from the training data. Each sample trains a full multi-output ElasticNet model. The final prediction is the average of the ensemble. Hyperparameters are optimized independently for each CHES release using 100 Optuna trials and repeated 5-fold cross-validation with 10 repetitions.
Rows missing any CHES target are dropped before training.
Sampled with replacement, then fitted on all three targets.
A different draw produces a slightly different estimate.
Repetition removes the dependence on any single sample.
The final coordinate is the mean of the bootstrap estimators.
Fitted scaler and ensemble are saved together for reuse.
The ensemble size is itself a tuned hyperparameter: 38 members for 2009, 30 for 2014, and 50 for 2019.
Every wave was tuned separately over 100 Optuna trials. The tuned settings differ, but all three land in the same regime: light regularization, a near-even L1/L2 mix, and a few dozen ensemble members.
Errors are reported on the rescaled [0,1] coordinate scale, so an RMSE near 0.12 means a typical miss of roughly a tenth of the full width of a CHES dimension.
Cross-validated MSE comes from repeated 5-fold validation during tuning; RMSE, MAE, and R² are measured on the full cleaned dataset after the final refit, so they describe fit rather than out-of-sample accuracy.
The values locate an answer pattern relative to a European party-position instrument. They are most useful when comparing actors, prompts, years, or conditions.
The coordinate system is grounded in European VAA and CHES data. It should not be read as a universal map of politics everywhere.
Statement selection, party coding, expert judgment, scaling, and model choice all shape the final projection.
For LLM-Ideoplasticity, the primary measurement is not only where a model lands, but how its position moves under context.
From a computer-science perspective, the VAA-CHES instrument is a representation pipeline. Natural-language political statements are converted into categorical stances. Categorical stances become numeric features. Numeric features are transformed by a learned model into coordinates. Coordinates are then used to study geometry: displacement, dispersion, hull volume, centroid distance, and temporal drift.
LLMs sit at the unusual middle of this pipeline. They are language systems, so they can produce natural-language justifications. But they can also be forced into structured stance choices, making their outputs comparable to survey responses. This means political behavior can be measured as a distribution over elicitation contexts rather than as a single static survey answer.
The bridge is therefore bidirectional. Political science supplies theory, dimensions, and reference data. Computer science supplies model instrumentation, prompt perturbation, representation learning, and geometric analysis. LLMs become both subjects of measurement and interfaces for translating language into structured political signals.
Register, paraphrase, language, debate, reasoning, role.
A natural-language stance with its justification.
Judged as CD, D, N, A, or CA.
A structured feature vector in the selected wave.
The regression instrument maps answers to coordinates.
Displacement, dispersion, hull volume, drift.
Repeating the path under controlled changes of context is what turns a single reading into a distribution.
These links point to the data infrastructures, survey documentation, and readings behind the method.
| Topic | Reference | Use |
|---|---|---|
| CHES | CHES Europe data infrastructure | Party-position data and expert-survey context. |
| EU&I / euandi | EU&I overview | Transnational VAA background and public questionnaire framing. |
| EUI VAA project | Research and impact through VAAs | How VAAs produce scientific data for European political research. |
| CHES trend file | Jolly et al., 1999-2019 trend file | Longitudinal party-position infrastructure. |
| CHES 2024 | 2024 CHES survey note | Recent wave and expanded country/party coverage. |
| VAA ethics | Trustworthy-AI assessment of European VAAs | Normative and transparency concerns around advice systems. |
| Project models | Released transformation model README | Architecture, training, inference, and software details. |
| Project paper | LLM-Ideoplasticity on arXiv | Full empirical framework and results. |
Ready to see a projected coordinate?