Changelog 2019-04-28 - One Fix

Target links should now all load properly

Previously seen links from Target were missing an important factor (lower case A before a series of numbers in the URL) which prevented the pages from loading properly. New URLs has the change but previously seen ones did not. This change edited the database to update previously seen URLs so they will get posted properly. 

Changelog 2019-04-26 - One Fix

Target should no longer post about 'coming soon' items

Fixed an issue where Target would post if an item was listed but not in stock (e.g. "coming soon" or "check stores" rather than "add to cart" listed on the button).

This was made possible due to RegEx improvements which should also fix the issue where non-Funko products were being pushed to @FunkoRelease by @FunkoShopTarget.

Changelog 2019-04-24 - Three Fixes

Amazon posting is less sensitive to URL changes

Amazon has a lot of extra information in their URLs that do not make then good unique identifiers. However, each URL contains an ASIN which is unique. Uniqueness is now determined by ASIN rather than URL, and URLs are now reconstructed from the ASIN. This decreases the bot thinking that it saw a new item when it really just saw a previously seen item with a new URL. 

Target should stop alerting on non-Funko products

An improvement to the regex for scraping Target’s site should decrease the amount of non-Funko products being found. However, this RegExr decreases performance and needs to be improved. 

Target and Amazon will now be more reliably scraped

A change to the get request to include more relevant headers will more reliably trick the server into thinking we are a legit request and return thefull HTML more reliably.