Character Map UWP makes it easy to insert these wherever you want. You can search for any character or icon using its unicode, making it even easier to jump to an icon.

Unicode is a massive, sprawling effort that pairs a number to every unique character in a language, every punctuation mark, every math symbol, and much more.