Oh, you got the time and the characters right, and in fact Rommel felt secure enough about the weather to grant himself a brief leave. He however was quite concerned about the Normandy area, and felt Calais was too obvious a target for the Allies to consider. von Rundstedt, who felt slighted by Rommel's appointment with extraordinary authority to the Western Defenses, and feared Rommel was being groomed to succeed him as Commander in Chief West, neither liked nor trusted Rommel ... a sentiment reciprocated by The Field Marshal. It was on von Rundstedt's orders that Rommel was arrested, and suicided, in connection with von Staufenberg's abortive July 20 assassination plot and coup attempt.
I happen to be a big military history buff, BTW ... while Shirer is indispensible, my WWII reference material alone consists of hundreds of volumes, including actual War Diaries of many units involved, and numerous vanity-published memoirs from both principals and mere players ... and trust me, you don't even want to get me started on The American Civil War, or ANYTHING involving the USMC of any period!