The history of postal service of the United States began with the delivery of stampless letters, whose cost was borne by the receiving person, later also encompassed pre-paid letters carried by private mail carriers and provisional post offices, and culminated in a system of universal prepayment that required all letters to bear nationally issued adhesive postage stamps.

In the earliest days, ship captains arriving in port with stampless mail would advertise in the local newspaper names of those having mail and for them to come collect and pay for it, if not already paid for by the sender. Postal delivery in the United States was a matter of haphazard local organization until after the Revolutionary War, when eventually a national postal system was established. Stampless letters, paid for by the receiver, and private postal systems, were gradually phased out after the introduction of adhesive postage stamps, first issued by the U.S. government post office July 1, 1847, in the denominations of five and ten cents, with the use of stamps made mandatory in 1855.

The issue and use of adhesive postage stamps continued during the 19th century primarily for first class mail. Each of these stamps generally bore the face or bust of an American president or another historically important statesman. However, once the Post Office realized during the 1890s that it could increase revenues by selling stamps as "collectibles,"it began issuing commemorative stamps.

More Info: en.m.wikipedia.