You should choose a diameter that allows plenty of room within the duct to allow the cable or cables to be drawn through smoothly.