The Confederacy existed from 1861 to 1865, and Atlanta was never the capital of the confederation. Montgomery was its first capital, but by the summer of the first year it didn't suit most people of the Confederacy anymore. The weather was extremely hot and the mosquitoes were very annoying. Everybody was just happy to hear the offer from the newly seceded Virginians: they were ready to make their own capital the seat of the Confederacy. Richmond became the capital. When the city fell to the Federal Army, the government traveled to Danville, which remained the capital of the Confederate states only for 8 days.

More Info: www.civilwar.org