Wednesday, July 31, 2019

Changelog 2019-07-31 - Two Fixes

Fixed Amazon Regex

Amazon changed their website so the regex needed to be updated. The new regex is much more efficient than before so Amazon scraping should see some mild improvements in overall runtime.

Addeed Dryscrape Request Headers

Dryscrape requests never used headers previously. Headers are useful for tricking websites into believing a request is a legit request. Amazon started giving the scraper a captcha when I made too many requests at once (testing the above fix) so I added some headers to the request in order for the requests to go through properly.




1 comment:

  1. Casino: Slots, Table Games, Poker, and Table Games - JD
    Join 안양 출장안마 The Slots 천안 출장마사지 Lounge today and 광주 출장샵 play all your favorite casino 목포 출장샵 games like 원주 출장안마 blackjack, roulette, craps, craps, and more.

    ReplyDelete

Hot Cash Give Away Jan 2021

  Hey everyone! Time for another round of Hot Cash codes! Hot Cash ends soon so be sure to use these ASAP! Comment below with the codes you ...