Joint Probabilistic and Geometric Constellation Shaping for Complexity-Constrained Direct Detection Optical Systems

We evaluate joint probabilistic and geometric constellation shaping via reinforcement learning for complexity-constrained joint equalization and demodulation of direct detection optical signals. We demonstrate the proposed technique in a simulated 56 GBd, 2.2 km C-band direct-detection system, demonstrating its effectiveness for complexity-constrained receivers.