That depends on whether the H1 visa holder, your spouse, is still in good standing vis a vis the H1 visa he or she holds.
NYC EXPERIENCED IMMIGRATION ATTORNEYS www.myattorneyusa.com; email: email@example.com; Phone: (866) 456-8654; Fax: 212-964-0440; Cell: 212-202-0325. The information contained in this answer is provided for informational purposes only, and should not be construed as legal advice on any subject matter.
I agree with my colleague that it depends on on the status of your spouse's visa. I also think it's important to make sure that you never do anything to endanger your status, so I would check with an immigration attorney. Take all the paperwork related to this and your spouse's visa and explain what you'd like to do.
Please remember this is not official legal advice, and this is no way establishes an attorney-client relationship. For a free 15 minute phone consultation please call 972-638-7207.
Is the H-1 administrative process pending at a US Consul? If so, I doubt that they'll give you an H-4.
Talk to the lawyer(s) involved (your company's for sure ... and possibly your husband's company's immigration lawyer).
Whatever you do do NOT talk to non-attorneys in HR.
PROFESSOR OF IMMIGRATION LAW for over 10 years -- This blog posting is offered for informational purposes only. It does not constitute an attorney-client relationship. Also, keep in mind that this is an INTERNET BLOG. You should not rely on anything you read here to make decisions which impact on your life. Meet with an attorney, via Skype, or in person, to obtain competent personal and professional guidance.