Skip Navigation LinksHome > Expertise > Software Systems > Custom Web Crawlers

Custom Web Crawlers

Massive data sets with our automated web crawlers and document classifiers using the world-wide web as a data source

Custom Web Crawlers

The World Wide Web represents a data source previously unrivalled in human existence and the volume of information available is a common question for speculation. Regardless of the answer the ability to discover and retrieve useful information from an ever changing landscape is of great value.

We have expertise in writing custom web crawlers to target the acquisition of specific information areas. We also have experience with creating web crawlers which mimic human internet behaviour and their typical pathways for finding information upon the World Wide Web.

Examples of Shore Tech Systems' work

  • DP

    Distributed Image Processing

    Sys Consulting Ltd

    Sys Consulting Limited turned to Shore Tech Systems to integrate a specialist signal processing library with a public web site. The solution was designed in three discrete sections. Firstly to distribute the processing both within the software and across hardware; secondly to write a web service for the solution built upon a Service Orientated Architecture (SOA); and thirdly to compose a software solution to allow for MatLab processing.

    Read More about Distributed Image Processing
  • rota

    Rota Management System

    University Of East Anglia Students Union

    Shore Tech Systems provides a subscription based rota system for the University of East Anglia Students Union to enable the online management of rota time scheduling for over 100 employees. The system has been in use for over 12 months with future expansion planned to more departments as well as new functionality including a mobile portal and SMS gateway integration.

    Read More about Rota Management System