For me, anyway, they/them is in its own category, where they aren’t my pronouns, but I have no issue with someone using them for me. I wouldn’t get upset unless someone is blatantly trying to use it to misgender me for whatever reason. In your situation, if it makes you feel more comfy to use gender neutral pronouns for me, I’m fine with it.
I’m headed back into the office today after having had COVID last week. Yaaaaaaaay