Did it feel to you that when Jo left, a part of the Doctor left? If you can’t quite believe that, you may want towatch this video.
She is sad, but he may be even more sad. As he goes away, you can indeed feel the many years he has had, fall all over him. Like a father who has seen too many of his children grow up and go away.