Posted over 5 years ago

Sr. Developer with web crawling and/or indexing experience REMOTE FREELANCE AND CONTRACT CONTRACT PART-TIME Gun.io was borne to connect talented F/OSS developers with discerning and quality-focused software companies. Today, our ambitions are much greater. We’re creating a new framework for all knowledge work. Why is this role amazing? You’ll work as a Professional Freelancer (what’s that mean?) in Gun.io’s amazing community. Each Gun.ioclient has been vetted for their ability to maintain 6month engagements and pay US market rates. What’s the project? General: Gun.io’s client is a Seattle-based startup building a mobile-first search engine for Track and Field rankings. Their mission is to provide free, accessible, and accurate information to their diverse and global community. They are looking for an experienced developer with a background in web crawling and/or indexing in order to build a corpus of Track and Field performance results from a set of focused web crawls. Tasks will involve building and/or deploying web crawler according to established archival best practices as well as metadata extraction and storage to be easily queried for later retrieval. Geography: Open to freelancers from any time zone, but must available to check in on a daily basis. Client time zone is USA Pacific (UTC -7). Work Schedule: The job is part-time (5-20 hrs/week) and based around 2-week long agile sprints. Gun.io works extremely hard to secure stable, long-term relationships with our clients. Every role on every team works together to secure more work together. What starts as a short project always has the opportunity to grow if we perform with excellence. Start & Duration: Starts as soon as you’re ready and is ongoing. What’s the process? In keeping with our promise to only provide elite Professional Freelancers, Gun.io’s vetting process is stringent and includes: a credential check, three interviews, and live reference checks. However, you will only need to complete that vetting process for your first Gun.io project. Afterwards, you’ll have the opportunity to seamlessly move on and off freelance projects. Candidates who pass Gun.io’s internal vetting will be given an opportunity to directly engage and interview with Gun.io’s clients. Must-have Expertise in implementing high-performance and production scale web crawlers Prior experience with configuring AWS services (S3, EC2, SQS, Lambda, Cloudformation) Nice-to-have Familiarity with metadata and archival standards (dcmi, rdf, warc) Experience with metadata extraction and topic modeling with tools like Apache Tika Experience using tools like CommonCrawl Experience with open source crawlers such as Apache Nutch, Heretrix By now, you know our reputation on HackerNews, Reddit, and other spots for taking care of our community. Join up and get serious about your career. “One of the best teams I’ve ever worked with.” “There’s visible, constant improvement; it’s not just lip service.” “You guys paid for my Jeep Wrangler.” “Working with Gun.io has, for the first time, allowed me to fit work into my life instead of life into my work.”