TradeHill (shut down twice due to regulatory issues, now dead) was the first US exchange, but I think that Coinbase will be the first to be properly licensed in the states it operates in, as opposed to just FinCEN.