WorldWide Promotions team is looking for an outstanding Data Engineer!
As a Data Engineer, you will be working in one of the world's largest and most complex data warehouse environments. You will design, implement and support scalable data infrastructure solutions to integrate with multi heterogeneous data sources, aggregate and retrieve data in a fast and safe mode, curate data that can be used in reporting, analysis, machine learning models and ad-hoc data requests. You will be exposed to cutting edge AWS big data technologies. You should have excellent business and communication skills to be able to work with business owners and Tech leaders to gather infrastructure requirements, design data infrastructure, build up data pipelines and data-sets to meet business needs. You stay abreast of emerging technologies, investigating and implementing where appropriate.
Key job responsibilities
- Design and develop the pipelines required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, Python and AWS big data technologies.
- Oversee and continually improve production operations, including optimizing data delivery, re-designing infrastructure for greater scalability, code deployments, bug fixes and overall release management and coordination.
- Establish and maintain best practices for the design, development and support of data integration solutions, including documentation.
- Work closely with Product teams, Data Scientists, Software developers and Business Intelligence Engineer to explore new data sources and deliver the data.
- Able to read, write, and debug data processing and orchestration code written in Python/Scala etc following best coding standards (e.g. version controlled, code reviewed, etc.)
About the team
The WW Promotions Execution and Experience Data & Science team is responsible for all data products needed to provide the best promotions to our customers. We support product and business teams with dashboards for quick decisions, ranking models to prioritize the best offers, and a comprehensive data-warehouse for deep dive analysis.
- Experience as a Data Engineer or in a similar role
- Experience with data modeling, warehousing and building ETL pipelines
- Experience with Apache Spark / Elastic Map Reduce
- Experience with SQL
- Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
- Experience working on and delivering end to end projects independently
Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make recruiting decisions based on your experience and skills. We value your passion to discover, invent, simplify and build. Protecting your privacy and the security of your data is a longstanding top priority for Amazon. Please consult our Privacy Notice (https://www.amazon.jobs/en/privacy_page) to know more about how we collect, use and transfer the personal data of our candidates.
m/w/d