I’ve lost WiFi access, to the LocalDeck, a few times but it has always connected via USB, to ESPHome, to put a new firmware on it. I tend to use the Deck’s side connector. I appreciate this doesn’t answer your question, just sharing my experience with USB.
Does your host OS see the deck ok when connected with USB?