Edward D. Avery, ULC Minister