Gift tax has a few components:
1. Only the person GIVING the gift is taxed. The person receiving the gift is NOT taxed.
2. Each year 14,000 of gifts are tax free. If you are married filing jointly this doubles to 28,000.
3. Once you go over the 14,000 threshold in a year, you still have a lifetime credit of 5,300,000ish. If you use up 500,000 in one year, the next year (and all other years after that) you have 4,700,000 to play with.
Basically it's designed so that the average person will never have to pay taxes on gifts.