What the heck is eating my kale?!

Collect them in a pail of soapy water to kill them. Another treatment for a minor population of cabbage worms is neem oil. It won't kill the insects directly, but it will prevent them from feeding on your plants.