Do I give up

I have been taking photos for a couple of years, not all that I take are good but I always thought there where a few good ones. Freinds of mine have been very appreciative of my work and one in particular got me a paid gig to take photos for a presentation to a government department which she said went down wonderfully. Then I come across other people, some are other hobby photographers who cant seem to say a kind word about any of my work can only pick faults with it. It has left me wondering a few times whether I am wasting my time with photography as a hobby. I get a lot of enjoyment getting out and about to take the pics and the process them so should i just continue and keep the pictures to myself. My life revolves around my job, my kids, my dog and what little social life I can muster up so there is not much else for me to enjoy.