Web Scraping Specialist

Job Summary

To support a specialized technical team, the full-time Web Scraping Specialist will lead efforts in data gathering and analysis, optimize scraping processes, and ensure high-quality public web data accessibility while working remotely with a 6-hour overlap with EST.

Key Responsibilities:

• Write, test, and refine high-performance code to extract data from various online sources
• Manage complex data retrieval tasks, including pagination and dynamic content handling
• Clean and format extracted data to meet rigorous quality standards for analysis

Required Qualifications:

• Demonstrated ability to extract data from complex websites with a portfolio of past projects
• Advanced skills in Python or JavaScript, with experience in libraries like BeautifulSoup, Scrapy, or Selenium
• Strong knowledge of asynchronous programming and distributed scraping architectures
• In-depth knowledge of HTML, CSS, JavaScript, and the Document Object Model (DOM)
• Experience with NoSQL databases, including the design of efficient storage solutions