🕌 A learner's initiative to share his experiences during learning True Islam with you.
Musannaf Ibn Abi Shaybah is a Hadith Book which contains 40k+ Hadiths, We had sources for OCR-based data for this and others books, but no structured data.
At Daily Islam, out of many responsibilities, I had the responsibility of a Data Scientist, somewhat I was Swiss-army-knife for Tech!
I've done:
- Develop a crawler, and scraping tool to scrape more than 25 books.
- Analyze data programmatically and visually to find patterns for each different book and customize the Node.js program I've developed.
- Make sure not to miss any Hadith unorganized, concatenated.
- Make sure data is organized into the right categories (Kitab, Chapter).
- Make sure not to include any unwanted OCR texts.
- Output data in JSON formats and seeding them in Daily Islam's Backend.
Aa'lim / Maulana Collaborator: Md Abu Musa Abdullah