It is basically a web scrapping application. It crawls data from more than 4000 web links and saves data in the local database.
Ø Responsibilies
1. Project setup
2. Creating a generic environment (functions) that works in most of the cases
3. Using dom parsers to traverse the source html of the sources
etc.
Ø Team Size: 1
Ø Technology: PHP, MySql, Php simple dom parser