The Namibian Agricultural Union (NAU) says the next three years will be challenging in rebuilding the livestock sector after a devastating drought.