ENLighten: Lighten the Transformer, Enable Efficient Optical Acceleration

Photonic computing has emerged as a promising substrate for accelerating the dense linear-algebra operations at the heart of AI, yet adoption for large Transformer models remains in its infancy. We identify two bottlenecks: (1) costly electro–optic conversions and data-movement overheads that erode energy efficiency as model sizes scale; (2) a mismatch between limited on-chip photonic resources and Transformer scale, which forces frequent reuse of photonic tensor cores and dilutes throughput gains. To address these challenges, we introduce a hardware–software co-design framework. First, we propose $\mathtt{\text{Lighten}}$, a PTC-aware compression flow that post-hoc decomposes each Transformer weight matrix into a low-rank component plus a structured-sparse component aligned to photonic tensor-core granularity, without lengthy retraining. Second, we present $\mathtt{\text{ENLighten}}$, a reconfigurable photonic accelerator with dynamically adaptive tensor cores, driven by broadband light redistribution, enabling fine-grained sparsity support and full power gating of inactive parts. On ImageNet, $\mathtt{\text{Lighten}}$ prunes a Base-scale Vision Transformer by 50% with $\approx$1% accuracy drop after only 3 epochs (about 1 hour) of fine-tuning. Deployed on $\mathtt{\text{ENLighten}}$, it achieves a $2.5\times$ improvement in energy–delay product over the state-of-the-art photonic Transformer accelerator.