Alex Hall and his wife are parents again ... "We're so excited to welcome our baby girl into the world and to begin this new chapter as a family of four," the couple tells PEOPLE.

The HGTV star's romance with Larocca first made headlines in January when a source revealed they had been seeing each other ...