At TCGplayer, we provide eCommerce and software services that connect the collectible gaming industry. We’re best known for being the top online marketplace and price resource for trading card games like Magic: The Gathering, Yu-Gi-Oh! and Pokémon. We also provide services to local game stores across the country to help them grow their businesses. Our order fulfillment program helps local game stores streamline shipping for their online orders, saving them time and money.

The Engineering Team at TCGplayer creates and maintains a suite of products in support of our role as the leading online marketplace for trading card games and collectibles. We build applications and technologies that connect thousands of businesses with customers across the collectible gaming industry, powering sales through physical stores, websites, mobile apps and the TCGplayer Marketplace. 

The Senior Data Engineer is responsible for overseeing junior data engineering activities and aiding in building the business’ data collection systems and processing pipelines. The role of the Senior Data Engineer is responsible for building and maintaining optimized and highly available data pipelines that facilitate deeper analysis and reporting by the Data and Analytics department.

The Senior Data Engineer builds data processing frameworks that handle the business’s growing database. He works with senior data science leadership as well as other Data and Analytics teams in leveraging data with reporting and scientific tools, for example, Tableau, and Spark. The Senior Data Engineer strives to continuously develop new and improved data engineering capabilities.

• Integrating data solutions with the current platform to ingest data into appropriate data structures (RDBMS vs Redis vs kafka vs dynamo vs others)
• Leverage big data technologies to aggregate and analyze user behavior data (perhaps Redshift, Tableau, and all the modelling tools in between)
• Take a data-driven approach when designing and testing search and recommendation relevance models
• Monitor data platforms and web services for data integrity and system reliability
• Work with other teams to create microservice applications and API interfaces (accent on proper DB design, injection and retrieval of data)
• Designing and building robust and efficient data pipelines which support recommender systems, search engine indexing, and a variety of web services

• Strive to gain a deeper understanding of customer behaviors and sales trends in order to deliver actionable insights
• Provide technical expertise on large scale distributed systems, data collection and storage, and information retrieval (reliability, localization, distribution, scalability, etc)
• Implement and maintain data streams

• Strong verbal and written communication skills
• Experience designing and implementing MapReduce or Spark jobs
• Experience working with a variety of SQL and NoSQL data storage solutions

• Relevant Bachelor’s Degree and 7 years of relevant industry or academic experience, or Relevant Master's Degree plus 4 years of relevant industry or academic experience, or 11 years of practical experience.
• Programing language expertise in C#
• Mastery of at least one NoSQL repository (DynamoDB, MongoDB, redis)
• Expert with at least one Queueing technology such as (SQS, S3, Kafka, Rabbit MQ)
• Fluent with Visual Studio
• Expert with SQL, and RDBMS Technologies such as (MS SQL Server, Oracle, PostGres)
• Expert working with AWS Technologies like EC2, Kinesis, S3, Lambda, etc
• Expert understanding of Elastic Search technologies

• Experience with (Clojure, Go, java)
• Expert understanding of .NET architectures (ASP, Core, MVC, Entity Framework)
• Fluent with a monitoring technology (New Relic, Data Dog, Scalyr)
• Fluent with AWS API Gateway

The role involves the following physical demands on a regular basis:

• Mobility to work in a standard office setting and use standard office equipment, including a computer
• Sitting or standing for an extended period of time, up to 8 hours per day
• Ability to use vision to read computer screen and read printed materials
• Frequently required to stand, talk and hear

• Ability to work in an open office environment

The physical demands and work environment characteristics described here are representative of those an employee encounters while performing the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

This job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee. Duties, responsibilities and activities may change or new ones may be assigned at any time with or without notice.

TCGplayer is an Equal Opportunity Employer and does not discriminate against any employee for employment because of race, color, sex, age, national origin, religion, sexual orientation, gender identity, status as a veteran, and basis of disability or any other federal, state or local protected class.