I cannot forget him. But I have to let him go.?

Just make sure he pays support and gets visitation so you can have a break to have time for yourself. I am so sorry you are going through this pain! It will ease with time. I bet he will cheat on that other woman because history usually repeats itself.