The Penn Yan Historic District is a 65 acre area in Penn Yan with 281 structures, 210 of which are contributing. It includes a broad range of architecturally significant resources that document the village's development from the 1820s to 1929. It includes representative examples of residential, commercial, indstrial, civic and ecclesiastical structures. Highlights include the Birkett Mills, the Chronicle Building, Knapp Hotel, and the Castner House. Located within the boundaries of the district is the separately listed U.S. Post Office building constructed in 1912-1913. It was listed on the National Register of Historic Places in 1985.