Job Overview
We are looking for a bright and exceptional Engineering Lead to join our Technology team. In this role, you will work closely with Product Managers, Subject Matter Experts, Data Scientists and Software Engineers to design, build, and optimize scalable data pipelines for our Data Platform. The ideal candidate has strong hands-on experience in distributed data processing, expertise in architecting Data Pipelines and operational skills to drive efficiency and speed.
Key Responsibilities:
Work closely with the product and other teams to understand business requirements and translate them into robust engineering solutions.
Architect, build and maintain data solutions and pipelines to meet business requirements.
Engage and lead a team of talented technologists and establishing engineering best practices.
Act as a point of contact for managing and driving production defects & stability improvements to resolution
Oversee end-to-end data workflows from ingestion, transformation, and storage to data lake in both batch and streaming environments.
Drive improvements in performance, reliability, and scalability of data pipelines
Required Skills & Qualifications:
A bachelor’s degree in computer science, Math, or other technical fields with 6-8 years of experience, Fintech domain is a plus.
Demonstrated contribution to end-to-end delivery of enterprise-grade software
Experience on Data Engineering, Data Lakes, Data Warehousing, Data Pipelines, Data Analytics tools.
Experience using open-source Big Data technologies such as Spark, Hadoop, Elasticsearch, Kafka.
Hands-on experience in enterprise application development
Strong SQL skills and experience working with relational and NoSQL databases.
Experience in cloud technologies is a plus
Demonstrates advanced proficiency in Python for building scalable data pipelines, automating workflows
Experience building scalable ETL/ELT data pipelines and data lakes/warehouses.
Familiarity with workflow orchestration tools (Airflow, ADF, Glue Workflow, etc.).
Solid understanding of CI/CD, version control, and DevOps practices.
Experience working in agile, collaborative environments.
Attention to detail and quality, and the ability to work well in and across teams
Ability to advocate & influence multiple stakeholders
Excellent problem-solving, communication, and leadership skills.
Experience in leading a team of highly skilled engineers
Strong communication skills