You can't carry the worship of false idols and expect good things to happen in your future.  But it's not always easy to completely understand why that has to happen.  God gives direction and will help you move beyond the past.