In January 1990, Norman Fowler resigned from the Cabinet as Employment Secretary. In his letter he wrote: “I have a young family and for the next years I should like to devote more time to them while they are still so young.” Fowler later claimed that he was the first politician to give this reason for leaving office.
The site phrases.org.uk describes the expression as “A euphemistic way of describing being made redundant.”