I have scraped different websites with different levels of complexities developed with different technologies. I have scraped terabytes of data from sites like but not limited to: Amazon.com, Jumia.co.ke, Yelp.com, Yellowpages.com, Twitter.com, Linkedin.com, Ebay.com, Tripadvisor.com, Reddit.com and Alibaba.com for contact lists, lead generation, market research, product listing and for machine learning projects like sentiment analysis.
I bring on expertise in automated web scraping of extremely difficult to obtain data, websites using obfuscated protocols and authentication, including those using ‘scraping protection’ services and sites that simply put – no-one else can scrape.
– Languages: Python, PHP
– Frameworks/Libraries: Scrapy, Pandas, Requests, Selenium, Bs4, Django, Laravel
– Database: PostgreSQL, MySQL, MongoDB, neo4j
– Web Scraping Tools and Services : import.io, Captchas(2Captcha and AntiCaptcha Services), Storm Proxy, Crawlera API, etc