scratamus

I"m in need of advice or just the honest truth....here's the situation:

I'm in a relationship with a man who has two children with another woman. I have two children of my own from a previous relationship also. My boyfriend and I live almost 7 hours away from each other and hardly ever get to see each other, and even when we do, we almost never get time to ourselves with four little boys running around needing attention. We have the opportunity to see each other alone for four days (we haven't seen each other in two months because of scheduling and kids' school), but at the expense of losing time with our own children. We're willing to lose a few days with our own kids to spend time together and work on strengthening our relationship. Both our exes are hanging this over our heads claiming that, to us, sex is more important than our children..which is total bullshit and not the case whatsoever. I don't see anything wrong with taking a few days every 6 months for some alone time when the rest of the time is spent on the kids. They are our top priorities. Basically, I just want an outside opinion on this. Are we being selfish? Are the exes overreacting? Are they totally justified in saying it's wrong of us? Is there a better way? Please help to shed some light on this situation because it's starting to affect both of us negatively and all I want is to have a great visit with the man I love without jealous exes trying to ruin a good thing and make us feel guilty for wanting to be together. What do you think?