Better ways for sampling a colour for vector fill?

Hi all, I use vector shapes a lot, and manipulate their colours quite often. Changing a colour for vector shape already takes wayy too many clicks, but changing it to another colour sampled from the image seems to be really terrible. Colour sampler (P) does not seem to work when a palette is open. Fill tool seems to work only for raster data. The only way I found around this is to add a custom swatch to a palette and then pick it back from vector fill editing palette. Maybe you found some more usable procedure?