If the downfall is observed recently then also consider that there may be Google's core update behind this. And if it's a core update then it is not necessary that the recently earned backlinks are wrong or any content of your website is wrong, it could also be other's content getting rewarded...