Azure Data Engineer

Bengaluru, Karnataka   |   Full Time

Must Have Skills:

  • Prior experience in ETL, data pipelines, data flow techniques using Azure Data Services
  • Working experience in Python, Scala, PySpark, Azure Data Factory, Azure Data Lake Gen2, Databricks, Azure Synapse and file formats like JSON & Parquet
  • Experience in creating ADF Pipelines to source and process data sets.
  • Experience in creating Databricks notebooks to cleanse, transform and enrich data sets.
  • Good understanding about SQL, Databases, NO-SQL DBs, Data Warehouse, Hadoop and various data storage options on the cloud.
  • Development experience in orchestration of pipelines
  • Experience in deployment and monitoring techniques
  • Working experience with Azure DevOps CI/CD pipelines to deploy Azure resources.
  • Experience in handling operations/Integration with source repository
  • Must have good knowledge on Datawarehouse concepts and Datawarehouse modelling

Good to Have Skills:

  • Familiarity with DevOps, Agile Scrum methodologies and CI/CD
  • Domain-driven development exposure
  • Analytical / problem solving skills
  • Strong communication skills
  • Good experience with unit, integration and UAT support
  • Able to design and code reusable components and functions
  • Should able to review design, code & provide review comments with justification
  • Zeal to learn new tool/technologies and adoption
  • Power BI and Data Catalog experience

Responsibilities

  • Analyze business problems and design technology solutions
  • Ability to understand the data transformation requirements and implement the same in an optimum solution using Azure data services
  • Capable to participate in customer discussion and suggest solutions as necessary
  • Ability to carry out the data modeling activities and deliver the solution in agreement with baselined time & quality
  • Stay focused on-task completion and delivery
  • Supporting existing processes and implementing change requirements as part of a structured change control process
  • Working in a project environment, communicating any identified risks and issues to the project manager accordingly and providing inputs to the change control process
  • The consultant need to be hands-on and highly technical. Consultant will be in a customer facing role and accountable for the end-to-end technology delivery and deployment experience of data pipelines using Azure data services.
  • Perform data cleansing, data validation, sanity checking, and unit testing associate with it
  • Perform production cutover activities from a technical perspective

Neudesic is an Equal Employment Opportunity Employer

 All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law.

Submit Your Application

You have successfully applied
  • You have errors in applying