I went into sport mode as a last ditch effort which is what worked. I hit RTH when sticks were doing nothing.
Only then did I look down and see it was in ATTI mode.
Regarding looking at the screen, I was focused on keeping my eyes on the Mavic and not looking at the screen until it flew out of site. I was using the Litchi app, not DJI GO 4.