For the former Goldman Sachs employee, breaking up was hard to do