Senior Data Engineer

<strong>About the role</strong> <br>Join a dynamic team modernising data platforms and driving real transformation. As the Senior Data Engineer, you will work across the full development lifecycle of a newly established Retail Data Platform, supporting new feature development, optimisations, and technical improvements. You'll collaborate closely with platform operations, data engineering teams, and retail business stakeholders to deliver innovative solutions powered by Databricks on AWS.<br><br> <strong>Key responsibilities:</strong><br> <ul> <li>Assist with development and enhancement of the Retail Data Platform.</li> <li>Provide technical leadership across design, development, and operationalisation activities.</li> <li>Build metadata-driven development pipelines using Databricks and Python.</li> <li>Configure and maintain Databricks clusters, catalogues, schemas, and security models.</li> <li>Conduct performance analysis and optimisation to enhance user experience.</li> <li>Implement and maintain CI/CD pipelines for automated deployments.</li> <li>Collaborate with stakeholders to define and deliver data solutions.</li> <li>Prepare, maintain, and review technical documentation and best practices.</li> <li>Actively participate in agile ceremonies and sprint planning sessions.</li> </ul> <strong>Skills &amp; Experience:</strong><br> <ul> <li>8+ years in data-related roles, with at least 5 years working with Databricks.</li> <li>Strong Python and PySpark programming skills.</li> <li>Expertise in data warehouse optimisation and Spark SQL performance tuning.</li> <li>Experience working with APIs for data ingestion and sharing (REST, SOAP, GraphQL).</li> <li>Strong CI/CD pipeline development and deployment experience.</li> </ul> <br>To apply, please click the '<strong>Apply</strong>' button to submit the most recent copy of your resume and cover letter. For more information please contact&nbsp;jordan.fox@blackroc.co<br><br>At BLACKROC Recruitment, we are committed to fostering diversity, equity, and inclusion.<br>&nbsp;&nbsp;<br>We welcome applications from individuals of diverse backgrounds, including those with lived experiences.<br>&nbsp;&nbsp;<br>If you require any adjustments during the recruitment process, please don&rsquo;t hesitate to reach out to the above-mentioned BLACKROC Consultant.