Possible Clues:

• Golden pepper shortly providing yellow pigment
• Tennessee person occasionally paid, dropping sulphur all over yellow ore
• Source of arsenic, or allspice, mostly