While reps for Usher and Foster were not immediately available for comment, one source says Usher was with his wife and new child Tuesday at an Atlanta hospital, and the family is expected to head home on Wednesday.