He lived in a Spanish-styled mansion on South Lake Shore Drive in Carol
Beach in Kenosha, Wisconsin. Boxer
Joe Louis often trained there,
arriving by Chicago North Shore and Milwaukee interurban trains at the
Tobin Road station. In the summer of 1954, a year before his death by
suicide, Fisher's mansion was destroyed by a massive "northeaster"
storm off Lake Michigan, although the empty shell of the house remained
for some years thereafter.