Job Summary
A litigation finance company is in need of a Remote Software Engineer.
Individual must be able to fulfill the following responsibilities:
- Help to design and implement the data crawling architecture and a large-scale crawling system
- Develop not just large-scale scraping tools and APIs but also data integrity, health and monitoring systems
- Design, implement, and maintain various components of our data infrastructure
Applicants must meet the following qualifications:
- Annual Company Retreat
- 2+ years experience with Python for data wrangling and cleaning
- Advanced experience with SQL
- Proficiency in crawling and scraping using any libraries such as Scrapy, BeautifulSoup, Selenium
- Experience extracting data from multiple disparate sources including Web, PDF, and spreadsheets
- Productionized experience with techniques and tools for crawling, extracting and processing data