Remote Developer & Coding Jobs

Discover top remote jobs for frontend and backend developers—Ruby, React, PHP, Python, and more.

Signup for our free daily newsletter to get notified of new remote developer jobs.

Unsubscribe at anytime. Privacy policy

Posted 10 months ago

\nAbout the Job:\n\nScrapinghub is looking for software engineers to join our Professional Services team to work on web crawler development with Scrapy, our flagship open source project.\n\nAre you interested in building web crawlers harnessing the Scrapinghub platform, which powers crawls of over 3 billion pages a month?\n\nDo you like working in a company with a strong open source foundation?\n\nScrapinghub helps companies, ranging from Fortune 500 enterprises to up and coming early stage startups, turn web content into useful data with a cloud-based web crawling platform, off-the-shelf datasets, and turn-key web scraping services.\n\nJob Responsibilities:\n\n\n* Design, develop and maintain Scrapy web crawlers\n\n* Leverage the Scrapinghub platform and our open source projects to perform distributed information extraction, retrieval and data processing\n\n* Identify and resolve performance and scalability issues with distributed crawling at scale\n\n* Help identify, debug and fix problems with open source projects, including Scrapy\n\n\n\n\nScrapinghub’s platform and Professional Services offerings have been growing tremendously over the past couple of years but there are a lot of big projects waiting in the pipeline, and in this role you would be a key part of that process. Here’s what we’re looking for:\n\n\n\n\n\nAbout you:\n\n\n* 2+ years of software development experience.\n\n* Solid Python knowledge.\n\n* Familiarity with Linux/UNIX, HTTP, HTML, Javascript and Networking.\n\n* Good communication in written & spoken English.\n\n* Availability to work full time.\n\n\n\n\nBonus points for:\n\n\n* Scrapy experience is a big plus.\n\n* Familiarity with techniques and tools for crawling, extracting and processing data (e.g. Scrapy, NLTK, pandas, scikit-learn, mapreduce, nosql, etc).\n\n\n\n\nHiring Process:\n\nStage 1: Technical trial project\n\nStage 2: Interview with HR Representative \n\nStage 3: Technical Interview