Engineering Projects
Web Scraping & Pipelines
Scalable Multi-Source E-Commerce Scraper
Engineered distributed crawling spiders extracting 500K+ daily product prices, variant inventories, and ratings across platforms like Amazon, Zepto, and Blinkit.
Python
Scrapy
Playwright
Redis
MySQL
Automation & Security
Anti-Bot Evasion & Dynamic Browser Engine
Built robust headless automation bypassing Cloudflare Turnstile, perimeter TLS fingerprinting, and dynamic JavaScript rendering using customized Playwright context pools.
Playwright
curl_cffi
Docker
Python
Data Engineering
Automated ETL & Missing Data Alert System
Created automated data cleaning pipelines using Pandas and Celery workers to detect catalog schema drifts, generating automated email alerts for pipeline failures.
Python
Pandas
Celery
MongoDB
Linux