@jnb2
Your family is right DO NOT take him back
Change the locks-if you rent contact your management office. In things like this, they are usually high priority.
See if family can help watch the little one while you work OR talk to your employers and see if you can bring little one with you...