Using Python module Scrapy, the data from the URL entered is crawled through based on the given keywords and flags those which supports offensive crimes (cyberbullying, pornography, child and women abuse etc).
This is done by saving the sentences, which contain certain keywords, in a CSV file and is then updated using sentimental analysis by checking whether the lines are offensive or not. The updated CSV file, containing the URL, offensive sentences, and frequency of keyword, can be manually verified by the admin.
A portal providing provision for the government is created, to view the reported sites and also for the public to report sites. These websites are then observed and necessary action is taken accordingly.