Technical Lead – Data Engineering

Experience: 8+ Years
Location: Pune
Employment Type: Full-time

Mail us your profile at hr@decentjob.in 

About the Role

We are looking for a highly skilled and experienced Technical Lead – Data Engineering to design, build, and optimize scalable data pipelines and data platforms. The ideal candidate will have strong hands-on experience in ETL processes, data ingestion, and workflow automation, along with the ability to lead and mentor a team of data engineers.

Key Responsibilities

• Design, develop, and maintain robust ETL pipelines and data ingestion frameworks
• Build scalable and efficient data processing systems using Python
• Implement data quality checks and ensure data reliability and integrity
• Automate workflows and manage orchestration using tools like Airflow, Prefect, or Dagster
• Write optimized SQL queries for data extraction, transformation, and reporting
• Work with relational databases such as PostgreSQL, MySQL, or SQL Server
• Design and implement data models (star schema, normalization, etc.)
• Handle large datasets in formats like JSON, CSV, Parquet
• Collaborate with cross-functional teams including analytics, product, and engineering
• Lead, mentor, and guide a team of data engineers
• Ensure best practices in code quality, performance, and scalability
• Work with APIs and integrate external data sources
• Leverage containerization tools like Docker for deployment and scalability

Required Skills & Qualifications

• 8+ years of experience in Data Engineering / ETL Development
• Strong proficiency in Python (pandas, numpy, polars)
• Advanced SQL skills (joins, aggregations, query optimization)
• Hands-on experience with at least one RDBMS: PostgreSQL / MySQL / SQL Server
• Solid understanding of data warehousing concepts
• Experience with ETL and orchestration tools (Airflow, Prefect, Dagster)
• Knowledge of data modeling techniques
• Familiarity with REST APIs and data integration
• Experience with Docker or containerization tools
• Strong problem-solving and analytical skills

Preferred Qualifications

• Experience with cloud platforms (AWS / Azure / GCP)
• Exposure to big data technologies (Spark, Hadoop, etc.)
• Experience working in Agile/Scrum environments
• Strong leadership and stakeholder management skills

Why Join Us?

• Opportunity to work on scalable and impactful data platforms
• Collaborative and growth-driven environment
• Exposure to modern data engineering tools and technologies
• Leadership role with high ownership and visibility