What is the origin of 'stick to your knitting'?

The term stick to your knitting means sticking or clinging to what is familiar to you, related to you instead of going in to diversity, continue to be with what you have started.