should I divorce my husband of 12 years?

My husband just told me that he does not believe in Jesus but he does believe in God. I have a prob w/ this especially since I've been led to believe he christian and that are marriage was based on biblical principles. i'm confused because I feel like were not equaly yoked. He said he doesn't believe the silly stories in the bible but we used to study it together all the time.