The World’s Rarest Gemstone - one would assume white, colorless diamonds are on our planet. However, the rarest gems, and the most valuable diamonds, are the natural fancy colored which are the rarest gemstones in the world, particularly fancy vivid hues in yellow, green, blue, pink, purple and red