Yes the police can arrest you months after they recover contraband. Often times if the investigation is ongoing it could be many many months. Since your attorney has made contact with them they will usually contact him and tell them they have an arrest warrant for you and allow him to turn you in. If they have a search warrant they can enter your house again. My guess is that the next thing will be the arrest warrant. Stay in touch with your attorney and continue to seek his or her counsel.