Data Engineer – Azure Tech Stack
ENGINEERING DEPARTMENT
REMOTE, U.S.
Company Overview:
SkilldLabs was born from our shared experience in overcoming hiring challenges, especially in finding top-tier talent in compatible time zones. We’ve grown into a leading provider of nearshore expert teams, working with startups to build cutting-edge products efficiently and quickly.
Position Overview:
As an Azure-focused Data Engineer, you’ll be at the forefront of designing and optimizing data infrastructure using tools like Azure Data Factory (ADF), Airflow, and Snowflake for data-sharing and warehousing. Your primary goal will be to ensure high-performance, scalable data solutions in the Azure cloud environment, supporting efficient data flows, ETL processes, and optimized querying for business insights.
Key Responsibilities:
- Design and maintain scalable ETL/ELT pipelines using Azure Data Factory (ADF) and Airflow for scheduling.
- Monitor and optimize Snowflake data warehouse performance by tuning queries, managing compute resources, and leveraging Snowflake’s data-sharing capabilities.
- Collaborate with cross-functional teams to integrate data across systems via ADF.
- Utilize clustering and partitioning strategies to enhance query performance.
- Analyze and optimize SQL queries, implementing indexing strategies to improve data retrieval efficiency.
- Scale Azure resources dynamically to meet workload requirements and system performance needs.
- Support and troubleshoot data workflows, ensuring seamless data movement and availability.
Requirements:
- 3+ years of experience as a Data Engineer with a focus on Azure-based data engineering tools.
- Proficiency with Azure Data Factory (ADF), Airflow, and Snowflake as part of the data stack.
- Strong SQL skills and experience with query optimization.
- Experience building and scaling data pipelines using both ETL and ELT methods.
- Hands-on experience with Azure cloud technologies.
- Understanding of data architecture design, data modeling, and database performance tuning.
- Ability to collaborate on designing cloud-based data solutions for real-time analytics and business intelligence.
- Certification in Azure or Snowflake (e.g., SnowPro Certified) is a plus.
What We Offer:
- Competitive salary and benefits
- Paid online learning and sponsored certifications
- Remote work flexibility and home office allowance
- Family leave and generous PTO
- Collaborative and inclusive work environment
- Company-sponsored team-building activities
- Payment in USD