Harper's Ferry changed hands several times during the US Civil War, each time due to military maneuvers and possibly combat.
Some places in the Shenandoah Valley are alleged to have changed hands dozens of times during the US Civil War - Winchester and Front Royale if I remember correctly. Naturally it would take a bit of research to check how many times those places actually changed hands. And more research to see how many times there was at least a skirmish when the place changed hands.
From the beginning of the Civil War until the Union forces permanently reoccupied the town on July 8, 1864, the Harpers Ferry changed hands fourteen times. During the times that it escaped control from either army, the inhabitants of Harpers Ferry remained subject to frequent reconnaissance missions and guerrilla raids. Although no major battle was fought at Harpers Ferry after Stonewall Jackson’s attack on the garrison in 1862, by the end of the Civil War the town was devastated by repeated attempts from both Union and Confederate forces to control the vital transportation hub. Shortly after the war, Harpers Ferry resident Jessie E. Johnson spoke to the instability of Harpers Ferry, writing that “When the Union army came they called the citizens Rebels – when the Confederates came they called them Yankees.”
https://www.civilwar.org/learn/articles/10-facts-harpers-ferry1
Located in the Shenandoah Valley, Winchester was the most contested town in the Confederacy during the American Civil War (1861–1865), changing hands more than seventy times and earning its reputation (in the words of a British observer) as the shuttlecock of the Confederacy. Three major battles were fought within town limits and four others nearby.
https://www.encyclopediavirginia.org/Winchester_During_the_Civil_War2