Winfree Oscillatory Neural Network

Jiawen Dai3     Yue Song1,2

1 Shanghai Qi Zhi Institute    2 Tsinghua University    3 Shanghai Jiao Tong University

We introduce Winfree Oscillatory Neural Networks (WONN), a dynamical neural architecture that evolves neural representations as phase oscillators on the toroidal phase space \((S^1)^d\). Generalized Winfree synchronization dynamics organize oscillators into structured collective states, enabling scalable computation for image recognition and structured reasoning.

WONN teaser

Preliminaries : From Winfree Dynamics to WONN

Each oscillator has a phase \( \theta_i \), a natural frequency \( \omega_i \), and coupling coefficients \( K_{ij} \) or \( c_{ij} \). The central distinction is whether interactions depend on pairwise phase differences or on separable sensitivity--influence functions.

Winfree Dynamics
\[ \dot{\theta}_i = \omega_i + \frac{\kappa}{N} S(\theta_i) \sum_{j=1}^{N} I(\theta_j), \qquad i = 1,\ldots,N . \]
A receiving oscillator responds through its sensitivity \(S(\theta_i)\) to the aggregated influence \(I(\theta_j)\) from other oscillators.
Kuramoto Dynamics
\[ \dot{\theta}_i = \omega_i + \gamma \sum_{j=1}^{N} K_{ij} \sin(\theta_j - \theta_i). \]
Interactions depend only on relative phase differences \( \theta_j - \theta_i \), giving a phase-shift invariant synchronization model.
Symmetry Breaking
\[ \dot{\theta}_i = \omega_i + \gamma \sum_{j=1}^{N} K_{ij} \left[ \sin(\theta_j - \theta_i) + q \sin(\theta_j + \theta_i) \right]. \]
The extra \(q\)-term breaks global phase-shift symmetry and allows interactions to depend on absolute phase configurations.
Separable Form
\[ q = 1: \qquad \dot{\theta}_i = \omega_i + 2\gamma \cos\theta_i \sum_{j=1}^{N} K_{ij}\sin\theta_j . \]
This recovers a Winfree-style decomposition with \(S(\theta_i)=\cos\theta_i\) and \(I(\theta_j)=\sin\theta_j\).
Geometric Structure
\[ \Theta = (\theta_1,\ldots,\theta_d) \in \mathcal{M} := \mathbb{T}^{d} \simeq (S^1)^d, \qquad T_{\Theta}\mathcal{M} \simeq \mathbb{R}^{d}. \]
WONN represents neural states as phase variables on a toroidal manifold, with updates locally computed in the tangent space.

Key message. Kuramoto dynamics is governed by relative phase differences, whereas Winfree dynamics separates a receiving oscillator's sensitivity \(S(\theta_i)\) from neighboring oscillators' influence \(I(\theta_j)\). WONN turns this principle into a learnable neural architecture on \((S^1)^d\).

Methods

Winfree Oscillatory Neural Architecture

Winfree Oscillatory Neural Network architecture

Overview of the Winfree Oscillatory Neural Network. WONN initializes phase and frequency states, repeatedly applies Winfree dynamics, and updates both states through layer transitions.

WONN encodes the input into an initial frequency state \( \Omega_{\mathrm{init}} \), while the phase state \( \Theta_{\mathrm{init}} \) is randomly initialized. Each Winfree dynamics layer performs \(T\) parameter-shared recurrent updates, followed by a layer-transition update of both phase and frequency states. Through iterative synchronization, WONN evolves structured oscillatory representations before prediction.

At the core of WONN is a discretized Winfree evolution. For each layer \(l\), we perform \(T\) recurrent updates:

\[ \theta_i^{(l,t+1)} = \theta_i^{(l,t)} + \gamma \left[ \omega_i^{(l)} + S\!\left(\theta_i^{(l,t)}\right) \sum_j c_{ij}\, I\!\left(\theta_j^{(l,t)}\right) \right], \qquad t = 1,\ldots,T . \]

Here \( \theta_i^{(l,t)} \) denotes the phase of oscillator \(i\) at recurrent step \(t\) in layer \(l\), \( \omega_i^{(l)} \) is its natural frequency, \(S\) is a sensitivity function, \(I\) is an influence function, and \(c_{ij}\) is the coupling coefficient between oscillators \(i\) and \(j\). The recurrent steps share parameters within each layer, so the network behaves as a controlled dynamical system over phase variables rather than as a purely feed-forward stack.

Hierarchical Sensitivity–Influence Interaction Mechanism

Hierarchical sensitivity-influence interaction
Illustration of S and I

Winfree dynamics differs from Kuramoto-type phase interaction by separating the response of the receiving oscillator from the signal emitted by its neighbors. In WONN, the receiving side is modeled by the sensitivity function \(S\), while the sending side is modeled by the influence function \(I\). This separation allows the interaction to depend not only on relative phase differences, but also on the absolute phase configuration of the oscillatory representation.

To capture structured spatial interactions, WONN partitions oscillators into local groups \( \mathcal{G}_{p,q} \). Each group aggregates local phase states into a shared group-level influence signal:

\[ I_{p,q}^{\mathrm{patch}} = I_{\mathrm{patch}} \left( \{ \theta_{i,j} \}_{(i,j)\in \mathcal{G}_{p,q}} \right). \]

This mechanism induces hierarchical synchronization: oscillators coordinate within local groups, while group-level influence signals communicate across larger spatial regions. The coupling \(c_{ij}\) can be instantiated by local convolution or global attention, allowing WONN to interpolate between local oscillatory computation and long-range synchronization.

Image Experimental Results

WONN is evaluated on CIFAR-10/100 and ImageNet-100/1K. The tables report accuracy and parameter count, comparing WONN with standard convolutional, transformer, and synchrony-based baselines.

CIFAR-10 / CIFAR-100

Accuracy is reported as mean ± std over three seeds.

Model CIFAR-10 Acc. Params CIFAR-100 Acc. Params
ResNet-1893.48 ± 0.1611.17M70.53 ± 0.1011.22M
ResNet-5094.22 ± 0.1423.52M73.54 ± 0.4123.71M
ViT-T90.34 ± 0.185.36M67.59 ± 0.445.38M
ViT-S93.43 ± 0.2921.34M71.18 ± 0.6221.38M
ViT-B92.04 ± 0.2585.15M71.05 ± 0.4085.22M
AKOrNattn93.66 ± 0.174.60M72.03 ± 0.344.62M
\(S(\theta_i)\)&\(I(\theta_i)\) as MLPs
WONN (Ch = 128 → 128)94.55 ± 0.093.08M73.77 ± 0.403.09M
WONN (Ch = 64 → 256)95.12 ± 0.047.54M75.12 ± 0.497.56M
WONN (Ch = 256 → 256)95.24 ± 0.1212.02M76.20 ± 0.4512.04M
\(S(\theta_i)\)&\(I(\theta_i)\) as trigonometric functions
WONN (Ch = 128 → 128)94.50 ± 0.152.98M74.48 ± 0.163.00M
WONN (Ch = 64 → 256)95.08 ± 0.077.40M75.81 ± 0.337.43M
WONN (Ch = 256 → 256)95.26 ± 0.0511.84M76.17 ± 0.5211.86M

ViT baselines use additional regularization such as CutMix and label smoothing.

Reasoning Experimental Results

On structured reasoning tasks, WONN uses oscillatory dynamics to form coherent solutions over time. We report Maze-hard pathfinding and Sudoku solving results.

Maze-hard Pathfinding

Energy Voting selects the lowest-energy solution among 32 sampled trajectories.

Model Accuracy Parameters
LLMs
DeepSeek R10.0671B
Claude 3.7 8K0.0?
O3-mini-high0.0?
Recurrent models
HRM74.527M
TRM-Att (dihedral augmented)85.37M
TRM-MLP (dihedral augmented)0.019M
Other synchrony-based model
AKOrNattn36.21M
WONN76.20.396M
WONN (Energy Voting)80.10.396M

Experimental Analysis

Beyond final accuracy, WONN exposes interpretable dynamics: candidate paths synchronize over recurrent steps, phase distributions organize into two complementary modes, and interaction energy provides a useful diagnostic.

Synchronous Pathfinding on Maze-hard

WONN Maze-hard path probability evolution, example 1
Example 1
WONN Maze-hard path probability evolution, example 2
Example 2
WONN Maze-hard path probability evolution, example 3
Example 3

WONN initially activates multiple diffuse path fragments. As the oscillatory dynamics evolve, compatible fragments synchronize into a coherent path while inconsistent candidates are suppressed.

HRM Maze-hard path probability evolution
HRM path probability evolution on Example 1

Comparison with HRM on the same Maze-hard instance

For the first WONN example above, we visualize the first 12 H-block updates of HRM as evolution steps. HRM remains largely inactive during the early stages, begins to generate irregular predictions around \(T=4\), and subsequently undergoes an abrupt transition around \(T=6\) that recovers most of the correct path. The remaining steps only introduce minor refinements. This abrupt, insight-like behavior contrasts sharply with the progressive path formation exhibited by WONN.

Two-Peak Phase Distribution

Phase modes reveal complementary visual structures.

Two-peak phase distribution in WONN

Observation

WONN exhibits a characteristic two-peak phase distribution.

Interpretation

The two synchronized phase modes capture complementary object structures.

Effect

Coarse global regions are separated from fine local details and boundaries.

Peak 1 weighted map layer dynamics
First dominant phase peak
Peak 2 weighted map layer dynamics
Second dominant phase peak

Layer-wise evolution of the weighted maps associated with the two dominant phase peaks in WONN on image recognition. Left: weighted map corresponding to the first dominant phase peak. Right: weighted map corresponding to the second dominant phase peak. Here \(L\) denotes the layer index and \(T\) denotes the Winfree dynamics step within that layer. Panels are arranged according to the actual forward trajectory, from \(L1T1\) to \(L6T3\). Across layers, the phase-weighted responses are progressively refreshed and reorganized, evolving from weak local activations toward more coherent global semantic structures through the recurrent synchronization dynamics.

BibTeX

If you find our work useful, please consider citing our paper:

@article{dai2026winfree,
  title={Winfree Oscillatory Neural Network},
  author={Jiawen Dai and Yue Song},
  journal={arXiv preprint arXiv:2605.20922},
  year={2026},
  eprint={2605.20922},
  archivePrefix={arXiv},
  primaryClass={cs.LG},
  url={https://arxiv.org/abs/2605.20922}
}