Many sites do not have API and hence the need to screenscrape. It is probably against their interests to have an API, being the type of organisation that wants to control the type of interaction others (especially customers) have with it rather than encourage more (even if it will benefit them in the long term).
Also, if they did, it would reduce much of the value of the price comparison sites by reducing the barrier to entry (allowing more competitor services to the market) and hence they may not want it either (rarely see a comparison site in any sector ask for APIs).
Electronic harvesting is against the rules of many big sites out there (sadly), so is it wrong comparison sites do not abide the terms and conditions of others to fix something that is broken and add value to people?
If they paid these sites a fee to compensate, would that be good or bad? (as basically it boils down to money, and one party not happy another makes money "off its back", so to speak)
Also, if they did, it would reduce much of the value of the price comparison sites by reducing the barrier to entry (allowing more competitor services to the market) and hence they may not want it either (rarely see a comparison site in any sector ask for APIs).
Electronic harvesting is against the rules of many big sites out there (sadly), so is it wrong comparison sites do not abide the terms and conditions of others to fix something that is broken and add value to people?
If they paid these sites a fee to compensate, would that be good or bad? (as basically it boils down to money, and one party not happy another makes money "off its back", so to speak)