In 1890, the United States Board on Geographic Names declared that all city names ending in "burgh" should drop the final "h." But in 1911, after protests from citizens, the board said Pittsburgh, Pa., could keep the extra letter.
Source: Carnegie Library of Pittsburgh