Sign up now!
  1. MMOMakeMoneyOnline
    1. Newbie Guide
    2. Introductions
    3. MMOMakeMoneyOnline Lounge
    4. Forum Suggestions & Feedback
    5. Dispute Resolution
    6. Free Review Copies For Marketplace Approvals
  2. The Marketplace
    1. Content / Copywriting
    2. Hosting
    3. Images, logos & videos
    4. Misc
    5. Proxies For Sale
    6. SEO - Link building
    7. SEO - Other
    8. SEO - Packages
    9. Social Media
    10. Social Media - Panels
    11. Web Design
  3. Making Money
    1. Affiliate Programs
    2. Hire a Freelancer
    3. Making Money
    4. Pay Per Click
    5. Site Flipping

Is there any free scrape package/too etc in python which can crawle a wordpress site and skip the ad block

Davin kARIN

Davin kARIN

New member
Joined
Dec 13, 2024
Messages
1
Points
0
I want to keep the orignal html , only remove the ad block
Is there any existing solution for this purpose?
 
N

Ni enow

New member
Joined
Dec 13, 2024
Messages
1
Points
0
Not sure of a pre built library... Newspaper is ok from Python but it hasn't been updated in years so YMMV.

Most WordPress sites don't disable access to the wp-json V2 API so if you want to get rid of a lot of website fluff be and make less requests to the server, just put
wp-json/wp/v2/posts (or pages)
At the end of the homepage URL and you'll be able to see everything. You can read more about it following the WordPress WP Json API documentation.

Hope this helps.
 
Top