John Frey-Lloyd, ULC Minister