Blog traffic is not driven by new traffic; it is driven by return traffic. One week you may have lots of new visitors, and the following weeks you may have very few at all. Your repeat viewers are the ones who are supposed to make up the bulk of your traffic. And, if you are smart then you can retain more per week than you lose, and hopefully, grow your readership slow and organically.