The town stands on the edge of the first plateau of the Jura region, with limestone cliffs rising to its east and south, and a steephead valley leading to the village of Vaux-sur-Poligny to the east. On the cliffs to the east is a notable cave, known as "Le Trou de la Lune" (the Moonhole); on the cliffs to the south is a large cross, the "Croix du Dan". A network of hiking trails surrounds the town and provide routes to both these viewpoints, and the GR 59long distance footpath runs through the town.
First Empire general Jean-Pierre Travot was born in Poligny; a statue in his honour stands in the principal square of the town, the Place des Déportés, and a road is named after him.