Mid-Level Data Engineer

Job Description

First Page Footer (date) Job Title: Mid-level Data Engineer Location: Remote Position: Full-time Department: Annalect Engineering Position Overview Annalect is currently seeking a data engineer to join our technology team. In this role, you will build Annalectproducts which sit atop our Big Data infrastructure and utilize our componentized design system. Were looking for people who have a shared passion for technology, design & development, data, and fusing these disciplines together to build cool things. In thisrole, you will work on one or more software and data products in the Annalect Engineering Team. You will participate in technical architecture, design and development of software products as well as research and evaluation of new technical solutions. Key Responsibilities:* Designing, building, testing and deploying scalable, reusable and maintainable applications that handle large amounts of data * Write at-scale ETL processes in Python, Spark, and other technologies * Perform code reviews and provide leadership and guidanceto junior developers * Ability to learn and teach new technologies Required Skills * Curiosity in learning the business requirements that are driving the engineering requirements * Interest in new technologies and eager to bring those technologies and outof the box ideas to the team * 4+ years of development experience on web applications using Python, Ruby, Java, or C# * 8+ years of SQL experience. * Intellectual curiosity and drive; self-starters will thrive in this position * Passion for Technology: Excitementfor new technology, bleeding edge applications, and a positive attitude towards solving real world challenges Additional Skills * BS, MS or PhD in Computer Science, Engineering, or equivalent real-world experience (Youve learned something / somehow to beable to claim you are an engineer) * Significant experience with Python, C++, or other popular language * Experience with big data and/or infrastructure. Bonus for having experience in setting up Petabytes of data so they can be easily accessed. Understandingof data organization, ie partitioning, clustering, file sizes, file formats. Data cataloging with Hive/Hive metastore or Glue or something similar. * Experience working with classical relational databases. * Experience with Hadoop, Hive, Spark, or other dataprocessing tools (Lots of time will be spent building and optimizing transformations) * Experience building scalable data pipelines (Airflow experience a plus) * Significant experience working with AWS and/or GCP Header (title) annalect.com 2 * Proven abilityto independently execute projects from concept to implementation to launch and to maintain a live product * Interest or experience in ML technologies (TensorFlow, PyTorch or SageMaker, BigQueryML) Perks of working at Annalect * Culture. We have an incrediblyfun, collaborative and friendly environment, and often host social and learning activities such as game night, speaker series, and so much more! * Generous vacation policy. Paid time off (PTO) includes vacation days, personal days, and a Summer Friday program.* Extended time off around the holiday season. Our office is closed between Xmas and New Year to encourage our hardworking employees time to rest, recharge and celebrate the season with family and friends. * As part of Omnicom, we have the backing and resourcesof a global billion-dollar company, but also have the flexibility and pace of a "startup" - we move fast, break things, and innovate. Flexible Working We are committed to supporting and helping Annalectuals have a great work/life balance and a positive attitudeto well-being. As part of this we have a flexible and hybrid working model as a core part of how we operate. We believe flexible & hybrid working can increases individual motivation, improves performance and productivity, and reduces stress as well as helpingmanage wellbeing generally. We will work with you to implement the best flexible working solution for you without compromising team performance and client delivery. Diversity At Annalect, we are focused on equality and believe deeply in diversity & inclusionof race, gender, sexual orientation, religion, ethnicity, national origin and all the other fascinating characteristics that make us different. We welcome remarkable people from a broad range of backgrounds who bring their diverse attitudes, opinions, andbeliefs into a culture where you are treated with respect and can be comfortable at work just being you. Embracing our differences results in a stimulating and inspiring environment will lead to everyone viewing the world, our work and each other with fresheyes. We are keen to encourage applicants from people from all walks of life and we want you to be at your best throughout the recruitment process, please discuss any specific adjustments with a member of the Annalect People team.