Guantanamo Bay Naval Base is located on 45 square miles (120 km2) of land and water at Guantánamo Bay, Cuba, which the United States leased for use as a coaling and naval station in the Cuban–American Treaty of 1903 (for $2,000 until 1934, for $4,085 since 1938 until now). The base is on the shore of Guantánamo Bay at the southeastern end of Cuba. It is the oldest overseas U.S. Naval Base.

This might be interesting:

Many modern countries have military bases abroad, which allows them to conduct expeditionary warfare and influence important military events. Such bases can be used as intelligence and communication support or as staging areas. Numerous military conflicts have resulted in a lot of overseas bases being established by different countries.

More Info: en.wikipedia.org