Data Engineer
On-site
Client of People Impact
Consulting Firm
Product
B2B
₹ 60-70 Lacs PA
Bootstrapped
Information Technology
Bangalore, Karnataka, India
Post Status: Active
Permanent
103 applications
Experience: 5-12 Years
Skills
CI/CD
Apache Kafka
NoSQL
AWS
Terraform
Python
PySpark
Data Integration
Orchestration
Data Lakes
Posted 11 days ago

About the job

This is a Permanent Role with a Valued Clients of People Impact

We are looking for a Data Platform Engineer to build and maintain scalable cloud-based data pipelines that support analytics and investment decision-making. The role involves working with streaming data, data integration, and workflow orchestration across multiple systems to ensure reliable and timely data access. You will also collaborate with investment teams to deliver data solutions that improve trading and portfolio decisions.

Required Expertise

  • Data Platform Engineering: Design and optimize data pipelines on cloud-based lake house architectures (Snowflake, AWS S3/Glue/Lambda) to power analytics and investment decisions

  • Streaming & Real-Time Processing: Implement event-driven data pipelines using Kafka for real-time data ingestion and processing

  • Infrastructure & DevOps: Manage CI/CD pipelines and infrastructure as code (Terraform), ensuring reliable, repeatable deployments

  • Data Integration & Orchestration: Build end-to-end workflows using Airflow or Control-M, integrating data from RDBMS (Oracle, Postgres, MSSQL) and NoSQL databases

  • Engineering Best Practices: Own code quality through GitHub workflows, code review, and testing, while implementing data security and access controls

  • Collaboration with Investment Teams: Work closely with portfolio and trading teams to understand data needs and deliver solutions that drive investment outcomes — domain knowledge valued but not required