Senior Databricks Developer (m/f/d/v)

Infopulse, a part of Tietoevry Create, is looking for a skilled and experienced Senior Databricks Developer to join our growing team. Our customer is one of the Big Four companies providing audit, tax, consulting, and financial advisory services

Areas of Responsibility

• Lead the migration of data assets and workloads from legacy Databricks environments to Databricks Unity Catalog
• Design, develop, and maintain scalable ETL processes using Databricks, PySpark (Scala or Python), and other relevant technologies
• Ensure seamless data integration and compliance with data governance standards during the migration process
• Optimize and troubleshoot complex SQL queries for data extraction, transformation, and loading within the new Databricks UC framework
• Collaborate with cross-functional teams to understand migration requirements and deliver high-quality data solutions
• Monitor the performance, reliability, and scalability of the new Databricks Unity Catalog environment post-migration
• Provide administrative support and configuration management for the Databricks platform, ensuring best practices in security and data governance

Qualifications

• 3+ years of experience in Databricks development, including significant experience with Databricks administration
• Proven track record of successfully migrating data environments to Databricks Unity Catalog or similar platforms
• Strong experience with PySpark (Scala or Python) for data pipeline creation and optimization
• Proficiency in SQL, with advanced skills in query optimization and performance tuning
• Familiarity with Azure Data Factory and other cloud-based ETL tools
• Solid understanding of data warehousing concepts, data governance, and best practices in a cloud environment
• Strong problem-solving abilities and attention to detail, especially in migration scenarios
• Excellent communication skills, with the ability to work collaboratively with technical and non-technical stakeholders