"It doesn't seem fair"

I have been referred to the mental health community connectors twice before, once a couple of years ago and then more recently this year. 

They put me in touch with a male worker, and I politely asked for a female worker, and each time I received a letter back telling me that I am refusing the service. 

All I want is a female worker. They know my medical history and why I need this support from a female and it doesn't seem fair to me. 

I've got to go through this process again and it feels like I am going to get refused.