Databricks Platform Engineer
Remote (Candidates must reside in the Atlanta, GA area for occasional onsite meetings)
Job Summary
STAFFXPERT LLC is seeking a Databricks Platform Engineer on behalf of our client in Atlanta, GA. This role is responsible for designing, implementing, and maintaining a scalable Databricks platform within a cloud-native environment. The ideal candidate will work closely with cross-functional teams—including data engineers, data scientists, and business stakeholders—to deliver secure, reliable, and high-performing analytics and machine learning solutions.
This position focuses on optimizing Databricks workspaces, implementing governance frameworks, and enabling efficient data and ML workflows across the platform.
Key Responsibilities
• Administer and manage Databricks accounts and workspaces, ensuring strong governance, security, and compliance.
• Design and implement automation solutions for workspace configuration and platform administration.
• Build and maintain data pipelines using Databricks tools such as Autoloader, Delta Live Tables, and Workflows.
• Implement and support MLOps practices, including model lifecycle management using MLflow, Model Registry, and serving endpoints.
• Monitor and optimize platform performance, reliability, and cost efficiency.
• Collaborate with cross-functional teams to translate business requirements into scalable data and ML solutions.
• Provide technical leadership and mentorship on Databricks best practices and platform capabilities.
• Ensure the platform supports secure, scalable, and high-performance data and machine learning workloads.
• Stay updated with emerging features and advancements in Databricks, AI/ML, and cloud technologies.
Required Qualifications
• Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.
• 5+ years of experience with Databricks platform administration, including account and workspace management.
• Hands-on experience with Databricks data pipeline development using Autoloader, Delta Live Tables, and Workflows.
• Experience implementing MLOps frameworks using MLflow, Model Registry, and model serving endpoints.
• Experience working with large-scale distributed data environments across major cloud platforms such as Azure, AWS, or GCP.
• Familiarity with Databricks SQL tools, including queries and dashboards.
• Knowledge of enterprise data governance and security practices, including Unity Catalog architecture.
• Experience working with Azure services such as Entra ID, Data Factory, Key Vault, or similar cloud services.
• Strong communication skills with the ability to explain technical concepts to both technical and non-technical stakeholders.
• Ability to attend occasional onsite meetings in the Atlanta, GA area.
Preferred Qualifications
• Experience with Azure networking concepts, including VNet injection.
• Relevant Databricks or cloud platform certifications.
• Microsoft Azure administration or cloud infrastructure certifications.
• Master’s degree in a related field.