The Data Engineer role at Commonwealth Care Alliance (CCA) is a heavy technical and architect role that designs, contributes to, and maintains data pipelines and systems that support clinical point of care and business decisions. This role is highly collaborative with other data-focused departments at CCA including Analytics, Actuarial, and Finance. This role is a “forward-deployed” engineer that is expected to engage with and continually build a greater understanding of the clinical and operational context.

The Data Engineer must understand existing data, infrastructure, and transactional systems to design the appropriate usage of existing data assets or the development of new data assets, including large structured and unstructured data. The Data Engineer must automate robust workflows to efficiently perform extract, load, transform, modeling, and computational tasks in continuous integration and continuous delivery pattern. The Data Engineer will also support and contribute to rapid prototyping and deployment of analytics, model training, and model deployment. This role will report to the Director of Data Strategy, Mgmt. and Sol. at CCA.

• Engage with stakeholders on pre-defined projects
• You will be responsible to understand the business requirements and architect robust data platform on cloud technologies

• Build scalable and robust data model/infrastructure
• Help managing enterprise data platform

• Dealing with data governance, such as documentation, data integrity/quality and data security
• Build data pipelines (ETL, validation, automation, monitoring and logging...) that enable analysts and other stakeholders across the organization for data-focused product and data-driven business decisions
• Work closely with product managers and engineers to design, implement, test and continually improve scalable applications and services running on Azure
• Make changes on the existing data system to optimize and improve accuracy of the data process
• Give instruction or/and help stakeholder on the best practice to pull and use data
• Create scalable and actionable solutions, in the form of analytics, reports and dashboards for stakeholders to solve business and technical problems through ad-hoc requests

• Write andrevise technical documents and blogs, including design, development and application
• Complete data engineering projects under supervision and guidance

• You will be responsible to understand the business requirements and architect robust data platform on cloud technologies
• You will be responsible for creating reusable and scalable data pipelines
• You will be responsible for development and deployment of new data platforms
• You will be responsible for deploying AI algorithms into the data platform to run predictive analytics at scale
• Help the Data Engineering team produce high-quality code that allows us to put solutions into production
• Collaborate with IT Architect and IT Security and Privacy teams to architect and deploy data pipeline solutions that are secure and performant
• Day to day management and reliability of data pipelines deployed securely on the public cloud
• Executes quality excellence through standards, best practices, and continuous improvements

Education Required:

• Master's degree + 5 year of equivalent work experience (STEM major or related field preferred)
• OR bachelor's degree + 8 years of equivalent work experience (STEM major or related field preferred)

Experience Required:

• Experience in design and develop code, scripts, and data pipelines that leverage structured and unstructured data
• Strong foundation in data engineering principles and an architectural best practice
• Experience in architecting solution on public cloud (preferably Azure)
• Experience in instituting data architecture best practices (i.e. dimensional modeling, ETL pipeline, large scale distributed ETL pipelines)
• Extensive experience of database query languages (i.e. SQL or equivalent), database design, optimizing queries, internals knowledge of query planning
• Experience in authoring or reviewing system design documents for enterprise solutions

Knowledge, Skills & Abilities Required:

Technical Skills:

• SQL, Oracle and Python
• ETL tool (Informatica, Talend)
• BI tool (Looker, Tableau, PowerBI ...)
• Git-based version control systems
• Strong knowledge of data modeling and mapping
• Good understanding of different dimensional modeling techniques such as Star vs SnowFlake Schemas

Soft skills:

• Be organized and flexible
• Take initiative to own projects
• Strong analytical skills
• Strong verbal and written communicational skills
• Be able to work with interdisciplinary teams
• Be able to explain technical concepts/results to non-technical audiences
• Passion for creating work that is well-documented and reproducible
• Ability to work with short iteration times in agile mode as well as the ability to carry out projects in a self-directed manner
• Healthcare: passion for working at a healthcare organization

Preferred Skills and Experience:

• Experience with R
• Experience in healthcare or health insurance organization
• Experience with clinical claims and health record data
• Experience building data pipelines in the cloud under the constraints of HIPAA
• Publication or presentation of innovation in data science, machine learning or related area
• Experience with Azure cloud and data services (cosmos, synapse, datafactory, databricks etc.)
• Understanding of infrastructure (including hosting, container based deployments and storage architectures) would be advantageous