Sr Data Analytics Engineer
VNB Consulting Services
Bengaluru · Karnataka · India
Jornada completa
2-5
5h ago
81%
Excelente
Descripción del puesto
Location: Work from Office (Bengaluru)
Experience: 3-5 years
About Us:
VNB Consulting Services, headquartered in New Jersey, is an end-to-end technology solution provider specializing in Apps, Automation, Analytics, and AI. Our mission is to deliver tested technology solutions that enhance existing technology, improve business processes, or develop new solutions.
Role Overview:
We are looking for a motivated Sr/Data Analytics Engineer to join our team and work with Microsoft Fabric to design, develop, and maintain data solutions. The candidate will support building data pipelines, integrate data sources, and enable analytics across the enterprise using Fabric’s unified platform.
Key Responsibilities:
Design, build, and maintain scalable data pipelines using Microsoft Fabric technologies (Dataflow Gen2, Data Pipelines, PySpark notebooks, Spark SQL, and Python).
Develop and optimize ETL/ELT processes using Azure Data Factory, ensuring efficient data extraction, transformation, and loading between source systems and D365.
Execute data ingestion, transformation, and loading for both structured and unstructured data from diverse sources.
Perform data transformations, cleaning, and validation to ensure high data quality.
Write and optimize SQL queries on Azure Synapse Analytics, leveraging both dedicated and serverless resources.
Conduct deep code-level analysis and troubleshooting of Spark core internals, Spark SQL, Structured Streaming, and Delta.
Monitor, troubleshot, and fine-tune data pipelines and workflows to enhance performance, especially with large datasets.
Ensure data governance, security, and compliance with privacy regulations throughout the data engineering lifecycle.
Build and maintain infrastructure for optimal data performance and reliability.
Document processes, workflows, and data models, and provide knowledge transfer/training to team members as needed.
Build reporting and dashboards using tools like Power BI.
Required Skills & Qualifications
SQL and Data Modelling Concepts
Familiarity with Microsoft Fabric or Azure Cloud Platform
Exposure to Microsoft Power BI, Azure Data Factory, or Fabric
Strong problem-solving and analytical skills
Eagerness to learn new tools and technologies in the data engineering ecosystem
Understanding of Python, Spark, or DAX
Nice to have:
Knowledge of data governance and security principles
Experience with any ETL tool or cloud data warehouse
Experience of Power BI, Azure Analysis Services
CI/CD of data pipelines
Microsoft Certifications (DP-700, DP-600)
Working knowledge of multiple database technologies
Experience working in agile methodology using either Azure DevOps or any similar tool
Why Join VNB Consulting Services?
Excellent pay and benefits
Flexible working schedule
Opportunity to work with cutting-edge Microsoft Fabric and Power BI technologies
Information Security Requirement - Basic awareness of Information Security (IS0 27001).
Candidates must apply with the latest copy of their resume.