What can I do if my landlady hares me and my family again?

I gave my landlady a notice of 30 days according to current lease that I will move out by August 1st 2010, My original lease expires by 31st Jan 2010, But unfortunately the new apartment is not ready yet until another week, although I signed the new lease with the new landlord. I spoke to the landlady nicely and requested her to give us a week and we will pay a week's rent also but she refused and said we have to vacate the house by 31st August midnight, or she will charge me $100 per day. But while me, my wife and my 11 weeks old son were sleeping, at 12:10 am on 1st August 2010, she banged my door hard several times, when I went to ask, she said open the door I need to talk, I said I cant open the door at this time but I am listening what do you have to say, she said you have to leave right now. I said sorry, we will talk tomorrow. she came back and started banging again after few minutes. I had to call the police. Police came and told her that she cant kick us out, go to civil court on Monday. I just asked police to tell her to stop haring us, but they said its just civil issue. Please advise what can I do if she hares me and my family again?