cps blackmail rights not mine

Contacted my caseworker to find out if giving my mother temp custody of my child in her best interest would i have any problem from them to have visitation since I'm getting it not with her caregiver was informed that if it was done i would not be allowed to finish thr program with them and if i was ever caught with my child she would be removed from my and all family permanently. The caregiver has decided she wants to keep my daughter if for any reason i can't get her back i just found out she has relatives in our cps office Can they keep my child away forever for putting her in a place that i feel is best my mom had her for 6 weeks with no concerns from cps I moved her at the demand of my husband's family not due to problems