Posted almost 5 years ago

Senior Data Engineer

Service Research

Overview of the Position

The Service Research team is tasked with finding new ways we can use advanced analytics to help Marketing and Operations run the business and meet organizational goals. This is accomplished by engaging with our business partners to develop solutions to direct and/or generate contact, optimize customer interactions and expenses, tie service methods to policy actions and claim level events, as well as predict future behaviors.

The Senior Data Engineer on this team is responsible for ingestion, extraction, cleaning, integrity testing, integration, and mapping of data across multiple data assets within The Hartford. The data engineer will work with Data Scientists, business partners, enterprise data and technology teams to understand, build, and troubleshoot issues with data pipelines for downstream analytics use cases. SQL expertise is a must for data extraction from data warehouses, data marts, and operational databases. Familiarly with systems like Hadoop, and Linux and scripting languages like Python is preferred. The engineer should have a deep understanding of query optimization to link data across tables and policy, claims and accounting systems.

Responsibilities

• Understand sources of data within The Hartford, and work with SME’s to describe and understand data lineage and suitability for a use case.
• Understand data classification, and adhere to the information protection and privacy restrictions on data.
• Create summary statistics/reports from data warehouses, marts, and operational data stores.
• Extract data from source systems, and data warehouses, and deliver in a pre-defined format using standard database query and parsing tools.
• Work with The Hartford information protection group to get approvals and adhere to the processes for data privacy and loss prevention.
• Understand ways to link or compare information already in our systems with new information.
• Perform preliminary exploratory analysis to evaluate nulls, duplicates and other issues with data sources (internal or external).
• Work with data scientists to understand the requirements and propose and identify data sources and alternatives.
• Produce code artifacts and documentation for reproducibility, preferably utilizing Github, and hand-off to other data science teams.
• Propose ways to improve and standardize processes to enable new data and capability assessment and to enable pivoting to new projects.
• Maintain a Hadoop environment for the Service Research.

• 5 years of data analysis, manipulation and development and ideally 1-3 years of experience in the insurance or a related industry
• Candidates must have the technical skills to transform, manipulate and store data, the analytical skills to relate the data to the business processes that generates it and the communication skills to disseminate information regarding the availability, quality, and other characteristics of the data to a diverse audience.
• Experience accessing and retrieving data from disparate large data sources
• Experience with data modeling, data warehousing tools and databases (e.g. Python, R, Hadoop, SAS, Spark/PySpark, ETL, Big Data, ORACLE, and Hive)
• Ability to analyze source systems and provide business solutions
• Determine business solutions and translate into actionable steps
• Experience in creating and tuning SQL Queries
• Experience with software engineering concepts such as object oriented programing.
• Self-starter with a willingness to become a data expert.
• Demonstrate a passion to both learn new skills and lead discovery of the data research
• Results oriented with the ability to multi-task and adjust priorities when necessary
• Ability to work both independently and in a team environment with internal customers
• Bachelor degree or equivalent experience in related field required
• Ability to articulate and train technical concepts regarding data to a both data scientist and to customers

Behaviors at the Hartford