Posted 4 months ago
RealAdvisor is looking to hire a remote Data Acquisition Engineer to join the team!
Skills & Requirements:
- Basic knowledge of Web Scraping and its associated challenges. - Good knowledge of JavaScript, NodeJS, PostgreSQL, HTML and CSS. - Firm understanding of working with proxies, HTTP (status codes, authentication, etc.) - Understanding and analysis of web APIs. - Ability to work and develop with Rest APIs.ย - Knowledge of docker, RegEx, google cloud platform is an added benefit. - Skills related to front end are a plus.
Essential duties and responsibilities:
- To make sure all the scrapers are stable with accurate data and are up to date with the target portals. - Write scripts to crawl and parse target websites as and when required. - Continuous improvement of content quality and expansion of content coverage. - Collaborate with other teammates to improve current workflow. - Participate in Data challenges that we encounter day to day and help fix them.ย