Last week, Prince Harry traveled back to the United Kingdom for the first time in over a year to attend the funeral of his grandfather Prince Philip, who died earlier this month at the age of 99. Now, it’s been revealed that Harry “didn’t go see” his nephews and niece Prince George, Princess Charlotte, and Prince Philip during his time in the U.K.

“Harry didn’t get to see [Prince] George, [Princess] Charlotte and [Prince] Louis in the U.K.,” a source told US Weekly. “Aside from the day of Philip’s funeral (which George, Charlotte and Louis didn’t attend) and meeting privately with the queen, he was in isolation at Frogmore [Cottage].”

Harry’s wife Meghan Markle could not attend the funeral because she is currently about six months pregnant with her second child, and doctors told her that she is “too far along to fly and it’s recommended she rest in the final months.”

Harry raised some eyebrows when he flew back to California on Tuesday, choosing not to stay one more day for the Queen’s 95th birthday on Wednesday. Page Six reported that the “conflicted” Harry decided that it was more important to travel home to California to see his pregnant wife.

This birthday was a difficult one for the Queen, as it comes less than two weeks after she lost her husband of 73 years.

“I have, on the occasion of my 95th birthday today, received many messages of good wishes, which I very much appreciate. While as a family we are in a period of great sadness, it has been a comfort to us all to see and to hear the tributes paid to my husband, from those within the United Kingdom, the Commonwealth and around the world,” she said in a statement to mark her birthday.

“My family and I would like to thank you for all the support and kindness shown to us in recent days,” the Queen added. “We have been deeply touched, and continue to be reminded that Philip had such an extraordinary impact on countless people throughout his life.”

Meghan is reportedly very happy and relieved to have Harry home.

“Even though Harry and Meghan were in constant contact during the trip, Meghan is over the moon to have Harry back home,” a source told US Weekly.

The insider added that Meghan and Harry’s 23 month-old son Archie had the cutest reaction when Harry got home.

“Archie got super excited when he saw his daddy again!” the source said. “He couldn’t stop smiling.”