The vet will want to make sure of what exactly it is before they can tell you if it could be left there or not.
My dog had one right on her neck, next to her throat. They did a biopsy and it was just hair and other junk, like a pimple. Because of where it was, they wanted to keep an eye on it. When I noticed her having trouble swallowing, we took her in and had it removed.