Menu
Home
Forums
New posts
Search forums
What's new
New posts
New media
New media comments
New profile posts
Latest activity
Media
New media
New comments
Search media
Members
Current visitors
New profile posts
Search profile posts
Account Upgrades
Advertise
Marketplace
Money
PerfectMoney
Log in
Register
What's new
Search
Search
Search titles only
By:
New posts
Search forums
Menu
Log in
Register
Home
Forums
Programming & Web Design
Programming
General Programming Chat
Is there any free scrape package/too etc in python which can crawle a wordpress site and skip the ad block
JavaScript is disabled. For a better experience, please enable JavaScript in your browser before proceeding.
You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an
alternative browser
.
Reply to thread
Message
<blockquote data-quote="Ni enow" data-source="post: 20622" data-attributes="member: 8611"><p>Not sure of a pre built library... Newspaper is ok from Python but it hasn't been updated in years so YMMV.</p><p></p><p>Most WordPress sites don't disable access to the wp-json V2 API so if you want to get rid of a lot of website fluff be and make less requests to the server, just put</p><p>wp-json/wp/v2/posts (or pages)</p><p>At the end of the homepage URL and you'll be able to see everything. You can read more about it following the WordPress WP Json API documentation.</p><p></p><p>Hope this helps.</p></blockquote><p></p>
[QUOTE="Ni enow, post: 20622, member: 8611"] Not sure of a pre built library... Newspaper is ok from Python but it hasn't been updated in years so YMMV. Most WordPress sites don't disable access to the wp-json V2 API so if you want to get rid of a lot of website fluff be and make less requests to the server, just put wp-json/wp/v2/posts (or pages) At the end of the homepage URL and you'll be able to see everything. You can read more about it following the WordPress WP Json API documentation. Hope this helps. [/QUOTE]
Name
Verification
Post reply
Home
Forums
Programming & Web Design
Programming
General Programming Chat
Is there any free scrape package/too etc in python which can crawle a wordpress site and skip the ad block
Top
