The maximum security prison where they filmed the exterior shot of Hank's prison is actually the Monroe Correctional Complex located in Monroe, WA. They seem to have thought of everything when they were out there filming exteriors in Washington. As you see in the recent shots above and below, they've added several new buildings to the complex that were not the at the time of filming.
Once again, all interior scenes of the jail were shot on sets built in Los Angeles.