Sr Data Engineer

Job Description

Description CME Group is the worlds leading and most diverse derivatives marketplace. But who we are goes deeper than that. Here, you can impact markets worldwide. Transform industries. And build a career shaping tomorrow. We invest in your success andyou own it, all while working alongside a team of leading experts who inspire you in ways big and small. Joining our company gives you the opportunity to make a difference in global financial markets every day, whether you work on our industry-leading technologyand risk management services, our benchmark products or in a corporate services area that helps us serve our customers better. Were small enough for you and your contributions to be known. But big enough for your ideas to make an impact. The pace is dynamic,the work is unlike any other firm in the business, and the possibilities are endless. Problem solvers, difference makers, trailblazers. Those are our people. And were looking for more. To learn more about what a career at CME Group can offer you, visit usat www.wherefuturesaremade.com . The selected candidate will join the CME Engineering and Execution team in Belfast as a Senior Data Engineer, initially in the Enterprise Data Flow Team. This individual is responsible for leading the technical delivery ofsystems that must achieve a unique blend of low latency performance, big data scalability, and rock-solid reliability and integrity, all while undergoing rapid release cycles. Achieving these goals will require an understanding both the underlying technologyand the development, testing, and deployment lifecycle of the applications. The candidate must be able to solve problems creatively, communicate effectively, and possess the ability to lead others to achieve the critical mission of the team. Although initiallyworking in the EDF Team space, the engineering and execution team also develop a variety of trading and post-trade solutions, supporting our exchange and clearing business. Internal mobility and flexibility are a key part to our agile approach to technologydelivery. The successful candidate, throughout their career, will form a key part in driving our success across technology, and will find opportunities to work in a variety of projects and technologies, beyond their initial team and specialism. Principal AccountabilitiesHands on with detailed design and architecture plans for complex, large scale efforts within a multi-cloud environment. Creation and maintenance of data pipeline architectures Assists with system design, working with the various teams to build fit for purposeplatforms. Works ahead - ensuring the architecture is responsive to evolving needs. A team player - Assists the teams as required to achieve delivery milestones Utilizes the expertise of the team to develop architecture through consensus and team approach.Works with the enterprise architecture team, to gain an understanding of the evolving enterprise, to make efficient decisions on application architecture, and priorities. Applies expert knowledge of cloud technologies, java language, DBMS and middle-ware technologiesin independently designing and developing key services. Participates in code reviews, proactively identifying and mitigating potential issues and defects. Defines key metrics driving code optimization and re-factoring. Understand the data and how it worksto help develop functional solutions Works with analysts to interpret high level requirements for complex, large scale initiatives and decomposing them into independent stories and sub-tasks for the team. Contributes to continuous improvement efforts by identifyingand championing practical means of reducing time to market while maintaining high quality products (i.e. - process improvements/automation opportunities). Embraces and enforces CME Group SDLC and information security standards. Essential Criteria Bachelorsdegree (with honours) or equivalent/better strongly preferred, but substantial relevant experience could substitute Experience in AWS big data services Experience building data pipelines Experience in python, Java, Scala Experience architecting enterprisesoftware applications Experience in developing and automating solutions directly related to Continuous Integration/ Continuous Delivery and infrastructure automation Desirable Criteria AWS Data Analytics or AWS Certified Big Data Specialty qualification Experiencecoding in a story-driven, agile environment Experience working in the Big Data space handling both real time and batch Experience in the Hadoop ecosystem using EMR, Map Reduce and/or Spark Experience in terraform Prior experience working in financial services/exchangespace Prior experience working with BDD methodologies and automated acceptance criteria Prior experience using Confluence, JIRA, or other Atlassian tools For EU Residents, the Candidate Privacy Policy can be found here.