Rushville is a village of about 650 people located mostly in the Town of Potter, with a small portion in the Town of Gorham. Elisha Gilbert was the first settler in Rushville. Rushville was originally called Federal Hollow, named after the Federalist Party as most of it's first settlers were from Massachusettes. The general store there is still called Federal Hollow Staples. Marcus Whitman, the famous Oregon Trail missionary, was born in Rushville on September 4, 1802.