It is possible that he can gain some visitation rights, it all depends on a variety of factors, one of them being the particular Judge that gets assigned to the case. On the flip side you could also ask the Court to terminate his parental rights due to neglect/abandonment. Every Judge has a different standard for this also. His rights would need to be terminated for your husband to adopt unless the bio father consented to the adoption. The wishes of your daughter may matter, depending on her age/maturity. This is again a discetional thing.
I would recommend scheduling a consultation with a family law attorney to discuss your options. You may want to file to terminate his rights before he files a complaint for custody.