Feeds, API’s and data processing

We actively work with many clients who need to process data from third parties, or interact with third party systems using Rest API’s, CSV / XML / Excel feeds or JSON feeds amongst various others.

Working with third parties, or processing various data automatously is an ever increasing requirement for businesses looking to streamline features and services not only for a respective customer but also for internal business processes.

We have many years experience working on many projects requiring such work, from simply pulling feeds of data, talking with an API for various tasks, to scraping data from third parties in an effort to make administration quicker, easier and more automatous.

Specialist APIs

We have worked with various specialist APIs, these APIs are for specific industries and for specific uses.

• twenty7tec FINPLAN Home; CRM system for mortgage advisors, allowing them to streamline enquiries management.
• twenty7tec sourcing API; A sophisticated mortgage sourcing API for searching, filtering and organising mortgage rates from all the top mortgage lenders.
• Akamai; CDN services.
• Amazon AWS / SP-API; A set of APIs from Amazon for processing and managing Amazon orders and product listings.
• HMRC; HM Revenue & Customs in the UK offer various APIs in REST and XML.
• Rightmove; APIs for managing the sale / rent of properties.

Gadget recycling comparison APIs

As part of our device recycling system, we have integrated various feeds/APIs from various price comparison engines, this includes generating pricing feeds in CSV / XLS format and also interacting with Rest APIs to fetch / update order data.

Some of the comparison engines we interact with are below:

• Compare & Recycle
• Compare My Mobile
• On Recycle
• Sell Any Mobile
• Sell My Gadget
• Sell My Mobile
• Sell My Phone

Scraping websites

Scraping is the process of fetching raw data (real webpages) from a website and then pulling out and organising the data required in an intelligent manor; usually a last resort in cases where there is no feed or API.

We have worked on various projects for our clients whereby we responsibly scrape data from competitors such as product lists, pricing and more, usually for internal business use for competing or for consolidation and monitoring of product catalogs and more.

We build feeds to be efficient and not to abuse or overload our targets server resources, by fetching data efficiently, over a period of time and only when necessary.

Feeds

Fetching and processing feeds from various companies for the purposes of product catalogues, some of the businesses we have worked with are below:

• Portwest Workwear; product feeds
• Sealey; product feeds
• BTC activewear; product feeds

Payment processors

Ofcourse a very critical part of any website that needs to process payments to or from customers, such as ecommerce sites; payment processors can be notoriously complex to deal with and require attention to detail due to the nature of their usage, we have worked with various payment processors such as:

• Authorize.net (Accept Hosted)
• PayPal (IPN, PayPal Express)
• Stripe
• WorldPay
• Forte