Senior Data Engineer

Job Summary

Seeking a full-time Senior Data & ML Engineer with expertise in healthcare claims data, the role involves designing YAML rules schemas, managing feature engineering pipelines in Databricks, and overseeing model monitoring and deployment in a remote environment.

Key responsibilities

• Design and validate YAML rules schemas related to medical necessity and coding intensity
• Develop and manage feature engineering pipelines and rules validation frameworks in Databricks
• Monitor model performance and implement CI/CD processes for data pipeline and model deployment

Required qualifications

• 3-5 years of production experience with Databricks and Snowflake
• Proficiency in Python and SQL, with experience in UDFs and stored procedures
• Experience with Databricks Feature Store and MLflow for model tracking
• Familiarity with building rule engines or feature pipelines
• Databricks Certified Associate Data and ML Engineer certification preferred