Manager - Data Engineer

Role Description

We are in the process of leading a Digital Transformation across our Americas Division as we continue to modernize our technology, focus on our data-driven approach, grow, and plan for the future. As a result of this expansion, we are seeking experienced software Data engineers spread across Charlotte (NC), Jersey City (N.J) and India, with 10+ years of relevant experience to support the design and development of a strategic data platform for client’s Capital Markets and Securities Group.

Role Objectives

• These roles will be part of the Data Strategy team spanning across the client Capital Markets and securities teams, Americas Division’s broker-dealer and swap-dealer entities.
• These roles will be involved in the active development of the data platform in close coordination with the team, beginning with the establishment of a reference data system for securities and pricing data, and later moving to other data domains.
• The consulting team will need to follow internal developments standards to contribute to the overall agenda of the Data Strategy team.
• The implementation of this strategic platform on client’s Azure Cloud Platform will require solutions and know-how as listed in the qualifications below.

Qualifications and Skills

• 10+ years of experience in software development using Python, PySpark and its frameworks.
• Proven experience as a Data Engineer with experience in Azure cloud.
• Experience implementing solutions using -
  • Azure cloud services
  • Azure Data Factory
  • Azure Lake Gen 2
  • Azure Databases
  • Azure Data Fabric
  • API Gateway management
  • Azure Functions
• Well versed with Azure Databricks
• Strong SQL skills with RDMS or noSQL databases
• Experience with developing API’s using FastAPI or similar frameworks in Python
• Familiarity with the DevOps lifecycle (git, Jenkins, etc.), CI/CD processes
• Good understanding of ETL/ELT processes
• Experience in financial services industry, financial instruments, asset classes and market data are a plus.