are you giving some Referrer to the visits or are they direct on the website ? for what i can remember google value a lot traffic coming from various social networks or otherwebsite already high ranked.
try giving Referrer to the visits and it would help a lot if your website seo is well set