Hoa Binh Province was created in June 22, 1886 following the decree of Tonkin with the name Muong Province, splitting Muong majority areas from Hung Hoa Province, Son Tay Province, Ha Noi Province and Ninh Binh Province. Its name derives from the Sino-Vietnamese 和平, meaning "peace."
The province was administered from Chợ Bờ (in Đa Bac) hence it was also known as Cho Bo Province, until it November of the same year, it was relocated to Phuong Lam district (today in Bat Bat district, Ha Tay province). In April 1888 it was renamed to Phuong Lam Province, by the French colonial authorities.
On March 18, 1891 the Governor-General of French Indochina decreed that the name of the province would change to Hoa Binh Province with six districts: Luong Son, Ky Son, Lac Son, Lac Thuy, Mai Chau and Đa Bac.