UPDF AI

OmniGene-4: A Unified Bio-Language MoE Model with Router-Level Interpretability

Liang Wang

2026 · DOI: 10.64898/2026.05.12.724542
bioRxiv · 0 Citations

TLDR

The final OmniGene-4 adds a dual-head architecture: a generation head plus two per-residue classification heads (3Di, DSSP) trained jointly under a 0.5/0.5 loss split, providing direct interpretability of where biological specialization is acquired.