The fire broke out shortly before 2 a.m. Sunday and damaged most of the building, which was built in 1856. Perry and his wife, who were in Europe at the time of the fire, have not lived in the building for some seven months as it has undergone remodeling.
Bot the State Fire Marshal's Office and the Bureau of Alcohol, Tobacco and Firearms (ATF) are investigating the blaze, which took more than four hours to get under control.
There was no word yet on how much financial damage was caused by the fire. The renovation project before the fire was estimated to cost $10 million.