Data Engineer – Data Integration
Data Engineer – Data Integration | IBM India Pvt. Ltd. | Full-time (Fixed Term), Entry Level | Bachelor’s Degree (Preferred: Master’s in Data/Computer Science or related field) | Snowflake, Talend, SQL, ETL, Data Warehousing, Shell Scripting, Agile, Hadoop, Dimensional Modeling, Data Validation, Cloud Data Integration, Python (optional), Performance Tuning, Query Optimization
Contributed to building and maintaining scalable data pipelines and warehouse solutions using Snowflake and Talend in IBM’s Consulting Client Innovation Center. Supported batch and real-time data processing to derive insights and analytics across public and private sector client engagements.
Key Responsibilities:
- Designed and implemented scalable data warehouse architectures on Snowflake.
- Developed robust ETL pipelines using Talend for structured/unstructured data.
- Integrated multiple cloud data sources and built data validation/governance processes.
- Collaborated cross-functionally with consultants, engineers, and database teams in Agile setups.
- Resolved challenges in data ingestion, cleansing, and optimization across complex datasets.
Tools/Technologies Used: Snowflake, Talend, SQL, Shell Scripting, Hadoop Ecosystem, Cloud Storage (S3/Blob), Agile, Git
Notable Achievements:
- Streamlined ETL processes by 30% via optimized Talend jobs and advanced Snowflake tuning.
- Ensured high-quality analytics-ready datasets supporting large enterprise transformation projects.