You cannot be with someone just because you dont want to hurt him. You have your own happiness to think about.
Have you ever noticed how when youre happy time seems to pass by fast while when youre miserable it goes real slow Life would have been a blink with you whether it lasted a millennium or a month.