OmniGene-4: A Unified Bio-Language MoE Model with Router-Level Interpretability
OmniGene-4: A Unified Bio-Language MoE Model with Router-Level Interpretability
Liang Wang
2026 · DOI: 10.64898/2026.05.12.724542
bioRxiv · 0 Citations
TLDR
The final OmniGene-4 adds a dual-head architecture: a generation head plus two per-residue classification heads (3Di, DSSP) trained jointly under a 0.5/0.5 loss split, providing direct interpretability of where biological specialization is acquired.
