Data Engineer

LOCATION: Glasgow Pacific Quay or Salford Dock House or Newcastle-upon-Tyne Broadcasting Centre or Belfast Broadcasting House or Cardiff Central Square. 1 day a week Hybrid PROPOSED SALARY RANGE: £63,000 - £73,000 depending on relevant skills, knowledge and experience. The expected salary range for this role reflects internal benchmarking and external market insights., Senior Data Engineer is a hybrid technical/analytical role providing the opportunity to play a key role in analysing a rich seam of broadcast metadata stretching back over 100 years. As a Senior Data Engineer in the AT&S Data Platform team, you will serve as a data subject matter expert, anchor and visionary for our next-generation media metadata platform - Media Content Catalogue. You will be involved with the design, scaling, and optimisation of this modern, cloud-scale lakehouse built on Apache Spark, AWS Glue, and Apache Iceberg/Parquet, transforming complex broadcast & archival media metadata into structured, aggregated, unified, high-performance data assets. In this role, you will bridge the gap between data analysis & design and hands-on execution, ensuring our data ecosystem delivers the low-latency querying, strict schema evolution, and robust transactional consistency required to power real-time broadcasting insights and downstream archival and media reuse applications. WHY JOIN THE TEAM Our team uses many of the latest technologies in cloud data engineering, inspires experimentation & innovation and has autonomy. We are a highly productive, multi-disciplinary team working in a modern, agile way. You will be working on great projects and will be surrounded by a team of like-minded technology professionals from whom you can learn and grow. This is an environment where we love to share ideas and challenge the traditional with our goal of taking the BBC on the journey to be a digital-first organisation. Data engineering is a rapidly evolving field, so we offer regular training and development opportunities including 10% time to allow for self-improvement, learning, experimentation and innovation. We have a focus on good quality management to help enable, guide and empower others. We promote a healthy work-life balance with opportunities for flexible working hours., As a Senior Data Engineer in the AT&S Data Platform team, you'll help analyse a wide variety of media metadata sources and contribute to the design, build, and maintenance of a cutting-edge cloud data lake which unites the BBC's multitude of media metadata sources, empowering the search, discovery and broadcast re-use workflows of the future. You'll work with engineers, data analysts, and product managers to deliver reliable and scalable solutions that underpin the BBC's archive content discovery and reuse lifecycle for many years to come. The role focuses on: - Developing high-quality data schemas, code, tests, documentation and scripts; ensuring they are understandable, maintainable, observable and minimise risk. - Develop shared data schemas and contracts for interoperation with upstream and downstream BBC metadata and search systems - Participate in the team's software development methodologies, such as pairing, code and documentation review, and continuous delivery. Learning about new technologies and techniques and assess their applicability and usefulness to our products and our users. - Help troubleshoot and resolve issues throughout the data life cycle - Participate in the team's agile planning and delivery processes - Contribute to engineering best practices, testing, and deployment pipelines

Demonstrable experience of delivering data-powered applications in production - Hands-on experience with modern cloud data analysis & engineering (we use SQL, Python, AWS Glue, Apache Iceberg, Apache Parquet, Apache Spark) - Experience of modern data transformation pipeline tools such as dbt or SQLMesh - Working experience of data modelling (e.g. Entity-Relationship) - Experience of managing data quality, for example Great Expectations, AWS Glue Data Quality DESIRABLE: - Knowledge of broadcast media metadata and encoding formats - Experience of next generation data tooling such as DuckDB, Polars etc

BBC Group and Public Services, Broadcasting House, Portland Place, London, United Kingdom, W1A 1AA. BBC Studios Distribution Limited, company no: 01420028, registered address: 1 Television Centre, 101 Wood Lane, London, United Kingdom W12 7FA. × Cookie Consent Manager When you visit any website, it may store or retrieve information on your browser, mostly in the form of cookies. Because we respect your right to privacy, you can choose not to allow some types of cookies. However, blocking some types of cookies may impact your experience of the site and the services we are able to offer. Required Cookies These cookies are required to use this website and can't be turned off. Required Cookies Show More Details Required Cookies Provider Description Enabled SAP as service provider We use the following session cookies, which are all required to enable the website to function:

• "route" is used for session stickiness
• "careerSiteCompanyId" is used to send the request to the correct data centre
• "JSESSIONID" is placed on the visitor's device during the session so the server can identify the visitor
• "Load balancer cookie" (actual cookie name may vary) prevents a visitor from bouncing from one instance to another
  
  This job description is a written statement of the essential characteristics of the job, with its principal accountabilities, incorporating a note of the skills, knowledge and experience required for a satisfactory level of performance. This is not intended to be a complete, detailed account of all aspects of the duties involved.
Please note: If you were to be offered this role, the BBC will conduct Employment screening checks which include Reference checks; Eligibility to work checks; and if applicable to the role, Safeguarding and Adverse media/Social media checks. Any offer made is conditional on these checks being satisfactory. Before your start date, you may need to disclose any unspent convictions or police charges, in line with our Recruitment policy. This allows us to discuss any support you may need and assess any risks. Failure to disclose may result in the withdrawal of your offer. For any general queries, please contact: We are unable to accept applications via CV and only applications made online will be considered. Please click on the APPLY NOW button to proceed with your application. Redeployment The BBC is committed to redeploying employees seeking suitable alternative employment within the BBC and they will be given priority consideration ahead of other applicants. Priority consideration means for those employees seeking redeployment their application will be considered alongside anyone else at risk of redundancy, prior to any individuals being considered who are not at risk. Information at a Glance This is your BBC At the BBC you can create and innovate in an inclusive environment while contributing to some of the world's best loved content, and the BBC's mission to inform, educate and entertain. Life at BBC Here you will benefit from:
• Fair pay and flexible benefits including a competitive salary package, a flexible 35-hour working week, 25 days annual leave with the option to buy an extra 5 days, a defined pension scheme and discounted dental, health care and gym.
• Excellent career and professional development.
• Support in your working life, including flexible working which you can discuss with us at any point during the application, selection or offer.
• A values-based organisation where the way we do things is important as what we do.
Benefits may vary if you are joining on an FTC basis or on an orchestra conditions contract. Learn more about life at the BBC and our values in our candidate pack. You belong We have a working environment where we value and respect every individual's unique contribution, so all our employees feel that they can belong, thrive and achieve their full potential. We want to attract the broadest range of talented people to join us. The more diverse our workforce, the better able we are to respond to and reflect our audiences in all their diversity. We welcome applications from individuals, regardless of age, gender, ethnicity, disability, sexual orientation, gender identity, socio-economic background, religion and/or belief. Find out more about diversity, inclusion and belonging in our strategy below. Disability confident