Professional Experience
Python Developer (E1)
Trailytics AI • Gurugram, Haryana, India (Remote)- Architected and deployed scalable web scraping solutions processing 500K+ records daily using Python, Scrapy, and Selenium, improving data acquisition efficiency by 40%.
- Designed and implemented distributed scraping systems using multi-threading and asynchronous operations, reducing data extraction time by 60% while maintaining 99.5% data accuracy.
- Built robust error-handling and retry mechanisms to manage rate limiting, CAPTCHA, and dynamic content, achieving a 95% success rate on complex, anti-bot-protected websites.
- Optimized database queries and indexing strategies in MongoDB and MySQL, reducing query execution time by 70% and improving overall system performance.
Python Developer
Xbyte Technolab Pvt. Ltd. • Ahmedabad, Gujarat, India- Engineered end-to-end ETL pipelines extracting data from 100+ sources, including e-commerce websites, social media platforms, and APIs, processing 2M+ records monthly.
- Implemented automated data validation and cleaning workflows using Pandas and NumPy, improving data quality by 85% and reducing manual intervention by 90%.
- Developed custom web scraping frameworks to handle JavaScript-heavy SPAs using Playwright and Selenium, successfully bypassing advanced anti-scraping mechanisms.
- Collaborated with cross-functional teams to translate business requirements into technical specifications, delivering 15+ data extraction projects on time and within budget.
- Monitored and optimized scraper performance, improving execution speed, reducing server load, and ensuring consistent data delivery.
Crawl & Extraction Domains
E-commerce
Healthcare
News & Articles
Restaurant
Automotive Websites
Travel & Hotel Booking