Swimming in self-inflicted confusion

I jokingly asked today if I could join the many, many thousands of people who are continuing to work from home, even though it’s no longer legally required. It was only sent as a joke, but I think Gavin may have taken me seriously – I got a long e-mail from him explaining why it’s impossible for a manager to effectively be part of the team running three holiday centres without that manager being onsite.
Now I’m in a real dilemma. I don’t know whether to own up about it being a joke. I’m worried I might risk embarrassing him, or risk embarrassing myself, or risk making it sound like I WAS serious but now I’m trying to back down after reading his reply. He’s had a busy week dealing with half his management team isolating at home and now he has me adding to his woes with some silly attempt at humour. Have I blotted my copybook with him? Is he now sitting in his office berating me and regretting appointing me in the first place? Will this affect my ability to work with him and be taken seriously as we move forward with our working relationship? I’m still in a period of probation, for Christ’s sake, and here I am possibly sabotaging my own position by hitting ‘send’ before thinking things through.
God, why do I do these things to myself????

RC 12-8-21