Lead MLOps Engineer

Job Summary

Leading the charge in innovative software development, the full-time Lead MLOps Engineer will manage performance, quality, and production-readiness of projects on Databricks, focusing on data foundations, application performance, and MLOps while working remotely.

Key responsibilities

• Design and operate medallion architecture with a focus on data quality and Delta Lake tuning
• Optimize application performance by identifying and resolving bottlenecks in Spark queries and Databricks cluster configurations
• Oversee the full lifecycle of machine learning models, including deployment automation and drift detection

Required qualifications

• At least one year of experience running Databricks in production and designing medallion architecture
• Proven experience maintaining machine learning models in production, including handling incidents and performance degradation
• Hands-on experience with MLflow 3.0 for model lifecycle management
• Strong understanding of FinOps principles, specifically tracking and optimizing Databricks costs
• Experience in building systems for data lineage and observability, with automated ticketing for upstream issues