Elliptic curves of high rank and the Riemann zeta function on the one line

We describe some experiments that show a connection between elliptic curves of high rank and the Riemann zeta function on the one line. We also discuss a couple of statistics involving $L$-functions where the zeta function on the one line plays a prominent role.