To upgrade a weapon from common to uncommon, or from uncommon to rare, you need to have their respective smithing stones and access to a Smithing Table.