PROJECTS

Research systems, inspected in detail.

Each project is presented with its problem, method, evidence boundary, and primary source.

01
Research · Transformers

CausalInformationFlowinTransformerResidualStreams

Causal experiments using activation patching, intervention, probing, and ablation to study how specialist attention heads interact through GPT-2's shared residual stream.

InterpretabilityGPT-2Causal Analysis
Residual-stream causal map showing dominant routed paths, secondary paths, and the direct-path intervention site across transformer layers
Paper overview

A causal study of trajectory-conditioned semantics and dynamic computational pathways in GPT-2 Small.

Methodology

Activation patching, targeted intervention, linear probing, ablation, and topology analysis are used to trace information through the shared residual stream.

Measured results

The public preprint reports its measured results and limitations. The primary paper remains the source of record for every quantitative claim.

Interactive implementation / visualization

AXON visualizes sparse-autoencoder feature activations token by token. It is an implementation artifact of this research, not a separate research claim.

02
Research System · Reasoning

LEMMA

A neuro-symbolic mathematical reasoning system combining transformer-guided proposal generation, Monte Carlo Tree Search, symbolic rules, and verifiable state transitions.

ReasoningMCTSNeuro-Symbolic
LEMMA guided-search tree showing transformer proposals, Monte Carlo Tree Search expansion, symbolic verification, pruned candidates, and verified solutions
Problem

Mathematical reasoning needs broad search while every accepted transformation must remain explicit and verifiable.

Transformer proposals

A learned proposal mechanism prioritizes promising next transformations without replacing symbolic validation.

MCTS and symbolic rules

Monte Carlo Tree Search explores candidate paths over an extensible rule system.

Verification loop

Each state transition is checked symbolically before it can advance the reasoning trace.

03
Open Source · Simulation

GS-DroneGym

Photorealistic aerial-agent simulation combining 6-DOF drone dynamics, Gaussian Splatting rendering, waypoint supervision, and synthetic VLA trajectory generation.

SimulationVLA3DGS
GS-DroneGym research graphic showing behavior-cloning loss, synthetic dataset composition, and the closed-loop aerial-agent environment
Simulator overview

A drone-first environment for embodied-learning research and reproducible trajectory generation.

Dynamics and rendering

Six-degree-of-freedom dynamics run against Gaussian Splatting scenes to narrow the visual gap between simulation and reconstructed environments.

Observation and action flow

Episodes align observations, state, language, waypoints, and safety annotations along a shared trajectory.

Dataset and adapters

The pipeline exports synthetic episodes and supports benchmark-oriented data adapters described in the public repository.

04
Experimental System · Model Behaviour

Activation-spaceinterventionsforfrozenlanguagemodels

An experimental framework for SAE-guided activation intervention and causal-control tests in frozen language models.

ExperimentalSAECausal Control
BrainPatch activation-space intervention experiment diagram showing the frozen-model pipeline, feature 727 and random-control comparisons, and the measured behavior shifts
Experimental framework

The system edits selected activation-space features in a frozen model and measures downstream behaviour.

SAE-based intervention

Sparse-autoencoder features provide intervention targets without updating model parameters.

Causal-control methodology

Controlled comparisons test whether an activation edit produces the intended behavioural transfer.

Negative result

The experiment did not validate reliable behavioural steering. That failure boundary is preserved as part of the evidence.