Sr. Data Engineer
Virtuel
Numéro de demande 26974
21 août 2024
Basic Functions
- 8+ Years of experience in coding languages such as Python & PySpark
- Minimum 8 years of experience in using Azure Cloud Services such Synapse & Data Bricks & Data Factory
- Must possess OOP’s concepts and will require converting Python code written for analytical models to more stable, reliable & performant/efficient Python/PySpark code using OOP’s
- Produce scalable and flexible, high-quality code that satisfies both functional and non-functional requirements.
- Develop, deploy, test, and maintain technical assets in a highly secure and integrated enterprise computing environment.
- Responsible for participating in architecture, data modeling, and overall design sessions.
- Co-ordinate with development & business teams to ensure the smooth execution of the project.
- Collaborate/communicate with on-site project team and business users as required.
Essential Functions
- Strong problem solving and analytical skills and the ability to “roll up your sleeves” and work to create timely solutions and resolutions, to validate, verify, communicate, and resolve application issues.
- Strong Knowledge of databricks
- Knowledge of working on US healthcare claims data.
- Adhere to SDLC
- Ability to work on multiple product features simultaneously.
- Quick learner with ability to understand product’s functionality end to end.
- Opportunity to try out bleeding edge technologies to provide POC, which will be evaluated and put on use if approved.
- Experience working in Agile methodologies (SCRUM) environment and familiar with iterative development cycles.
Required Skills
- Knowledge on Python & PySpark
- Azure Cloud – Synapse & Data Bricks & Data Factory
- Good knowledge on MS SQL
- ETL – Extract, Transform & Load
- Migration from On Prem ETL process to ETL process on the Cloud
Skills Nice to Have
- Experience in SAS or Big Data Technologies such as Hadoop/Hive
- Stack overflow account score
- Technical blogs & technical write-ups
- Part of any open-source contributions
Education Requirements
- Bachelor's degree in computer or related field.
Work Requirements
Must be a US Citizen
Autres détails
- Type de paie Salaire
- Indicateur d'emploi Regular
- Taux min. à l'embauche 90 000,00 $
- Taux max. à l'embauche 120 000,00 $