“Natalie and I are thrilled to announce the arrival of our newest family member, Wilhelmina Jane Hanson,” Taylor tells PEOPLE exclusively. “She arrived on Tuesday, Oct. 2, and was welcomed by more love than could fit in the room.”

Taylor, 29 — who is one third of the band Hanson with his brothers Isaac and Zac — and Natalie, 28, told PEOPLE in April that they were expecting again, and announced in July that baby on the way was a girl.