The 60 year old jetted off to America last year (09) to take on a role as Field's love interest in the third season of the programme.
But his wife Georgina, who he wed in 2007, wasn't pleased when she realised the extent of his part.
He tells Britain's Daily Mirror, "Last year I was in America doing Brothers & Sisters and I had a lot of bed scenes with Sally Field.
"Georgina wasn't happy and I said, 'Darling, this is what I do for a living.' Now I hide the scripts!"