Lead Data Engineer

Company Description

Arista Networks is an industry leader in data-driven, client-to-cloud networking for large data center, campus and routing environments. Arista is a well-established and profitable company with over $8 billion in revenue. Arista’s award-winning platforms, ranging in Ethernet speeds up to 800G bits per second, redefine scalability, agility, and resilience.  Arista is a founding member of the Ultra Ethernet consortium. We have shipped over 20 million cloud networking ports worldwide with CloudVision and EOS, an advanced network operating system. Arista is committed to open standards, and its products are available worldwide directly and through partners.

At Arista, we value the diversity of thought and perspectives each employee brings. We believe fostering an inclusive environment where individuals from various backgrounds and experiences feel welcome is essential for driving creativity and innovation.

Our commitment to excellence has earned us several prestigious awards, such as the Great Place to Work Survey for Best Engineering Team and Best Company for Diversity, Compensation, and Work-Life Balance. At Arista, we take pride in our track record of success and strive to maintain the highest quality and performance standards in everything we do.

Job Description

Who You’ll Work With

You'll be part of the IT applications team as a Lead Data Engineer. 

What You’ll Do

• Collaborate with stakeholders and source data system teams to understand data requirements
• Architect and implement scalable workspace, data lake, dimensional models, data pipelines, data warehouses and other ETL/ELT processes using Fabric.
• Work with Fabric assets, Power BI, and other services to build end-to-end data solutions
• Ensure data quality, security, and compliance with regulations by implementing data validation, logging, monitoring, and role-based access controls.
• Perform root cause analysis on internal/external data and processes to answer specific business questions and identify opportunities for improvement.
• Manage platform cost optimization, data quality/governance, and performance tuning
• Follow software quality process and methodology standards, including those for design, data quality, code, version control, defect/change request tracking, documentation, work product review, unit testing and environment management.
• Review requirements / user stories and provide feedback to the team. Includes participation/input to the requirements process
• Integrate AI/ML models and GenAI capabilities into data products and workflows
• Help the QA and functional team to identify and define testing strategies for existing and new features 
• Ability to ensure that solutions developed by development teams fit the business needs
• Able to work under pressure and meet deadlines
• Comfortable working in evening hours (2pm to 11pm IST)

Qualifications

• 8+ years of experience in data engineering roles, preferably in a global enterprise environment
• Strong hands-on experience with Microsoft Fabric, Data Lake, Data Warehouse, Data pipelines and related broader Microsoft ecosystem.
• Expertise in Power BI semantic models and datasets for building dashboards and reports
• Strong DAX and Power Query skills
• Expert proficiency in SQL, Python, PySpark for data processing
• Must have implemented ETL solutions to integrate data from various sources into Azure Data Lake and Data Warehouse
• Good knowledge of EDW
• Strong understanding of data management processes, such as data normalisation and modelling, as well as data security principles, data access control and confidentiality.
• Good to have experience in Copilot or any AI/ML solutions with at least basic exposure to GenAI (LLMs, prompt engineering, AI API integration)
• Familiar with software quality assurance best practices & methodologies, and tools like Jira, GIT, etc.
• Experience with other SaaS/Cloud ERP, CRM systems like NetSuite or Salesforce or SAP S4/Hana is a plus
• Excellent problem-solving, communication, and collaboration skill

Additional Information

Arista stands out as an engineering-centric company. Our leadership, including founders and engineering managers, are all engineers who understand sound software engineering principles and the importance of doing things right.

We hire globally into our diverse team. At Arista, engineers have complete ownership of their projects. Our management structure is flat and streamlined, and software engineering is led by those who understand it best. We prioritize the development and utilization of test automation tools.

Our engineers have access to every part of the company, providing opportunities to work across various domains. Arista is headquartered in Santa Clara, California, with development offices in Australia, Canada, India, Ireland, and the US. We consider all our R&D centers equal in stature.

Join us to shape the future of networking and be part of a culture that values invention, quality, respect, and fun.