TESV:Skyrim - Way of the Pugilist

This guide for the Elderscrolls V: Skyrim, and how to use Unarmed Hand-to-Hand combat to defeat your enemies. First things first, you may want to work on these Skyrim Skill Perk trees.

Light Armor
Heavy Armor
Enchanting
Smithing

Now, since the Core game without any Mods (Vanilla Skyrim) doesn't have a "Hand-to-Hand" or "Unarmed" Skill Perk tree; the trick is to work on the Heavy Armor tree until you unlock the "Fist of Steel" skill perk. While not really researched to extent, I believe that the Glove or Gauntlets Armor weight is also the Base Damage dealt; the Gauntlets also deal an average of x2.0 damage for Sneak Attacks. The Light Armor "Gloves of the Pugilist", is the only item in the Vanilla Skyrim that has the "Fortify Unarmed" Enchantment on it. Which gives an additional 10 Damage to Unarmed Attacks.

Reference Links:
TES Wikia - Light Armor (Skyrim)
TES Wikia - Heavy Armor (Skyrim) 
TES Wikia - Enchanting (Skyrim)
TES Wikia - Smithing (Skyrim)
TES Wikia - Gloves of the Pugilist (Skyrim) 

Useful Mods:
Skyrim Nexus - Craft Temper Smelt by E2B2