Senior Data Engineer - Artificial Intelligence Group

Senior Data Engineer - Artificial Intelligence Group Bloomberg’s Engineering AI department has 300+ AI practitioners building highly sought after products and features that often require novel innovations. We are investing in AI to build better search, discovery, and workflow solutions using technologies such as transformers, gradient boosted decision trees, large language models, and dense vector databases. We are expanding our group and seeking highly skilled individuals who will be responsible for contributing to the team (or teams) of Machine Learning (ML) and Software Engineers that are bringing innovative solutions to AI-driven customer-facing products. At Bloomberg, we believe in fostering a transparent and efficient financial marketplace. Our business is built on technology that makes news, research, financial data, and analytics on over 35 million financial instruments searchable, discoverable, and actionable across the global capital markets. Bloomberg has been building Artificial Intelligence applications that offer solutions to these problems with high accuracy and low latency since 2009. We build AI systems to help process and organize the ever-increasing volume of structured and unstructured information needed to make informed decisions. Our use of AI uncovers signals, helps us produce analytics about financial instruments in all asset classes, and delivers clarity when our clients need it most. We are looking for skilled Senior Data Engineers to join our team if you have a strong background in software development and a passion for data science. You will work with us on building technologies and tools to ensure the correctness of our search datasets, to protect our clients’ personally identifiable information, and to enable key stakeholders to derive insights for the purposes of informing their decisions on the future development of Bloomberg’s Search products. Join the AI Group as a Senior Data Engineer and you will have the opportunity to: Develop and maintain a productionized logging system that produces verifiably correct datasets to support both online Business Intelligence applications as well as offline ML Model training and evaluation pipelines. Implement reusable, efficient, maintainable, and testable code that works on different platforms and scales to billions of data points for the purposes of sessionization, ingestion, and metrics computation. Work with application and product teams to define data needs and SLAs, then implement a data model using idiomatic schema designs tailored to the dataset’s intended use case. Design and implement metrics measuring various aspects of the Bloomberg search experience and create Business Intelligence dashboards to help subject matter experts continuously monitor quality, extract actionable insights, and identify new feature development opportunities. We are looking for a Senior Data Engineer with: 4+ years of experience working with Python and at least one other object-oriented programming language (C/C++, Java, etc.). A degree in Computer Science, Engineering, Mathematics, or similar field of study or equivalent work experience. An understanding of Computer Science fundamentals such as data structures and algorithms and a data oriented approach to problem-solving. Excellent communication skills and the ability to collaborate with engineering peers as well as non-engineering stakeholders. A proven track record building ETL pipelines leveraging technologies such as Kafka Streams, Kafka Connect, Flink, or Spark Streaming. Prior experience building or extending data lakes, using various storage, cataloging, and retrieval technologies such as S3, HDFS, Hadoop, HBase, Hive, Trino, Presto, Cassandra, Spark. Familiarity with workflow orchestration technology, such as Argo, Airflow, or Oozie. Bloomberg is an equal opportunity employer and we value diversity at our company. We do not discriminate on the basis of age, ancestry, color, gender identity or expression, genetic predisposition or carrier status, marital status, national or ethnic origin, race, religion or belief, sex, sexual orientation, sexual and other reproductive health decisions, parental or caring status, physical or mental disability, pregnancy or parental leave, protected veteran status, status as a victim of domestic violence, or any other classification protected by applicable law. Bloomberg is a disability inclusive employer. Please let us know if you require any reasonable adjustments to be made for the recruitment process. If you would prefer to discuss this confidentially, please email AMER_recruit@bloomberg.net (Americas), EMEA_recruit@bloomberg.net (Europe, the Middle East and Africa), or APAC_recruit@bloomberg.net (Asia-Pacific), based on the region you are submitting an application for. We give back to the technology community and you can read more about our outreach at: http://www.techatbloomberg.com/a i