Auditors: Lack of timely inspections, follow-ups to complaints meant bad actors were able to get away with violating regulations.