Can I use an FSA for out of network doctors?

FSAs are not usually tied to any specific network of providers like your fully-insured medical plans, so most likely. With that being said, you should always check on eligibility with your FSA benefits administrator, whose information can either be found on the back of an FSA debit-card or by speaking with your HR department.