What is a Paladin’s Holy Symbol for?

As with all Paladins, mine has a holy symbol. What is its purpose? Does it being inscribed on my sword hilt have any bearing?