Volver a todas las ofertas
VNB Consulting Services

Sr Data Analytics Engineer

VNB Consulting Services

Bengaluru · Karnataka · India Jornada completa 2-5 5h ago

Descripción del puesto

Location: Work from Office (Bengaluru) Experience: 3-5 years About Us: VNB Consulting Services, headquartered in New Jersey, is an end-to-end technology solution provider specializing in Apps, Automation, Analytics, and AI. Our mission is to deliver tested technology solutions that enhance existing technology, improve business processes, or develop new solutions. Role Overview: We are looking for a motivated Sr/Data Analytics Engineer to join our team and work with Microsoft Fabric to design, develop, and maintain data solutions. The candidate will support building data pipelines, integrate data sources, and enable analytics across the enterprise using Fabric’s unified platform. Key Responsibilities: Design, build, and maintain scalable data pipelines using Microsoft Fabric technologies (Dataflow Gen2, Data Pipelines, PySpark notebooks, Spark SQL, and Python). Develop and optimize ETL/ELT processes using Azure Data Factory, ensuring efficient data extraction, transformation, and loading between source systems and D365. Execute data ingestion, transformation, and loading for both structured and unstructured data from diverse sources. Perform data transformations, cleaning, and validation to ensure high data quality. Write and optimize SQL queries on Azure Synapse Analytics, leveraging both dedicated and serverless resources. Conduct deep code-level analysis and troubleshooting of Spark core internals, Spark SQL, Structured Streaming, and Delta. Monitor, troubleshot, and fine-tune data pipelines and workflows to enhance performance, especially with large datasets. Ensure data governance, security, and compliance with privacy regulations throughout the data engineering lifecycle. Build and maintain infrastructure for optimal data performance and reliability. Document processes, workflows, and data models, and provide knowledge transfer/training to team members as needed. Build reporting and dashboards using tools like Power BI. Required Skills & Qualifications SQL and Data Modelling Concepts Familiarity with Microsoft Fabric or Azure Cloud Platform Exposure to Microsoft Power BI, Azure Data Factory, or Fabric Strong problem-solving and analytical skills Eagerness to learn new tools and technologies in the data engineering ecosystem Understanding of Python, Spark, or DAX Nice to have: Knowledge of data governance and security principles Experience with any ETL tool or cloud data warehouse Experience of Power BI, Azure Analysis Services CI/CD of data pipelines Microsoft Certifications (DP-700, DP-600) Working knowledge of multiple database technologies Experience working in agile methodology using either Azure DevOps or any similar tool Why Join VNB Consulting Services? Excellent pay and benefits Flexible working schedule Opportunity to work with cutting-edge Microsoft Fabric and Power BI technologies Information Security Requirement - Basic awareness of Information Security (IS0 27001). Candidates must apply with the latest copy of their resume.