Menu
Home
Forums
New posts
Search forums
What's new
New posts
New media
New media comments
New profile posts
Latest activity
Media
New media
New comments
Search media
Members
Current visitors
New profile posts
Search profile posts
Account Upgrades
Advertise
Marketplace
Money
PerfectMoney
Log in
Register
What's new
Search
Search
Search titles only
By:
New posts
Search forums
Menu
Log in
Register
Home
Forums
Programming & Web Design
Scripting
Other Scripting Languages
[Python] My Indexing Service Worker Script - Open Source & Methode Reveal [No Support, all DIY]
JavaScript is disabled. For a better experience, please enable JavaScript in your browser before proceeding.
You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an
alternative browser
.
Reply to thread
Message
<blockquote data-quote="Aurelie Zemlak" data-source="post: 4256" data-attributes="member: 79"><p>I worked on my own indexing service until January, using a somewhat (I guess) unusual method, but stopped development on the project. The beta is basically still running, but is not being developed further.</p><p>Since this method will no longer work as from 12/23, as Google is discontinuing the API required for it, I have decided to open source the code of my worker (i.e. the script that does the actual work in the backend).</p><p>The method is relatively simple and perhaps also good to know for people without coding knowledge:</p><p>We abuse the mobile Friendly Test. Wich is also a great way, to uncloak sites <img src="data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7" class="smilie smilie--sprite smilie--sprite2" alt=";)" title="Wink ;)" loading="lazy" data-shortname=";)" /></p><p>We can do this via the Google Webmaster API - a simple API key is also sufficient, so no annoying authentication fuss when generating accounts if you want to scale. The API sends a legitimate Google bot by in real time, so to speak, which also prepares the page for the index (I cross-checked Google cache times).</p><p></p><p>Searchconsole API keys have a request limit, but no IP limit - so you can create some for yourself.</p><p></p><p>The whole thing serves more as training material that is not directly executable because the whole database structure is missing - but anyone with programming knowledge can adapt it for themselves and use the functions they need.</p><p></p><p>I won't give much support here either - I'll just throw the whole thing into the room and leave it to you to play around with <img src="data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7" class="smilie smilie--sprite smilie--sprite2" alt=";)" title="Wink ;)" loading="lazy" data-shortname=";)" /></p></blockquote><p></p>
[QUOTE="Aurelie Zemlak, post: 4256, member: 79"] I worked on my own indexing service until January, using a somewhat (I guess) unusual method, but stopped development on the project. The beta is basically still running, but is not being developed further. Since this method will no longer work as from 12/23, as Google is discontinuing the API required for it, I have decided to open source the code of my worker (i.e. the script that does the actual work in the backend). The method is relatively simple and perhaps also good to know for people without coding knowledge: We abuse the mobile Friendly Test. Wich is also a great way, to uncloak sites ;) We can do this via the Google Webmaster API - a simple API key is also sufficient, so no annoying authentication fuss when generating accounts if you want to scale. The API sends a legitimate Google bot by in real time, so to speak, which also prepares the page for the index (I cross-checked Google cache times). Searchconsole API keys have a request limit, but no IP limit - so you can create some for yourself. The whole thing serves more as training material that is not directly executable because the whole database structure is missing - but anyone with programming knowledge can adapt it for themselves and use the functions they need. I won't give much support here either - I'll just throw the whole thing into the room and leave it to you to play around with ;) [/QUOTE]
Name
Verification
Post reply
Home
Forums
Programming & Web Design
Scripting
Other Scripting Languages
[Python] My Indexing Service Worker Script - Open Source & Methode Reveal [No Support, all DIY]
Top