Senior Data Engineer
On-site
Prime client of People Impact
Consulting Firm
Product
B2B
₹ 60-80 Lacs PA
Bootstrapped
Financial services
Bangalore, Karnataka, India
Post Status: Active
Permanent
20 applications
Experience: 12-18 Years
Skills
Apache Kafka
AWS
Terraform
DevOps
RDBMS
Python
PySpark
Apache Airflow
Data Modeling
Data Lakes
Posted 10 days ago

About the job

This is a Permanent Role with a Valued Clients of People Impact

Key Responsibilities

• Implement and maintain data pipelines for ingestion, transformation, and delivery​

• Ensure data quality through validation and monitoring processes​

• Collaborate with senior engineers to design scalable data solutions​

• Work with business analysts to understand and implement data requirements​

• Optimize data models and queries for performance and efficiency​

• Follow engineering best practices and contribute to team standards​

• Participate in code reviews and knowledge sharing activities​

• Implement data security controls and access policies​

• Troubleshoot and resolve data pipeline issues​

​​

Core Technical Skills​

• Cloud Platforms: Proficient with cloud-based data platforms (Snowflake, data lakehouse  architecture)​

• AWS Ecosystem: Strong knowledge of AWS services including Lambda, Glue, and S3​

• Streaming Architecture: Understanding of event-based or streaming data concepts using Kafka​

• Programming: Strong proficiency in Python and SQL​

• DevOps: Experience with CI/CD pipelines and infrastructure as code (Terraform)​

• Data Security: Knowledge of implementing basic data access controls​

• Database Systems: Experience with RDBMS (Oracle, Postgres, MSSQL) and exposure to NoSQL databases​

• Data Integration: Understanding of data integration patterns and techniques​

• Orchestration: Experience using workflow tools (Airflow, Control-M, etc.)​

• Engineering Practices: Experience with GitHub, code verification, and validation​

• Domain Knowledge: Basic knowledge of investment management industry concepts​

Bonus technical Skills:

• Understanding of containerization concepts​

• Exposure to API development using Python-based frameworks​

• Basic familiarity with Asset Management data domains​