Data Engineer

Home :: Data Engineer

Experience: 2+ years

Qualification: This is a professional position, and as such, we require, at minimum, a Bachelor’s degree in computer science, information technology, or a combination of education and experience equating to the U.S. equivalent of a Bachelor’s degree in one of the aforementioned subjects.

Job Description: 

  • Data Migration & ETL Development: Design, develop, and implement data migration strategies to move data from on-premise and cloud-based relational databases (Oracle, SQL Server, MySQL, PostgreSQL) to GCP-based data warehouses (BigQuery, Cloud SQL, Spanner).
  • ETL/ELT Pipeline Development: Build and optimize ETL/ELT pipelines using Informatica IICS (Cloud Data Integration, Cloud Mass Ingestion, Cloud Application Integration) to enable scalable and efficient data transformation.
  • Workflow Orchestration & Automation: Automate and manage data migration workflows using IICS Taskflows, Apache Airflow (Cloud Composer), and Dataflow, ensuring seamless execution of data integration tasks.
  • Schema Mapping & Data Modeling: Perform schema conversions, data type mappings, and entity relationships to align with data warehouse design standards, ensuring optimized data storage and retrieval
  • Data Transformation & Business Logic Implementation: Implement complex data transformation logic, aggregations, and business rules within Informatica IICS, SQL, and Google Dataflow to support business intelligence and analytics needs.
  • Data Validation & Quality Assurance: Develop and implement automated validation scripts and reconciliation techniques to ensure data accuracy, consistency, and integrity post-migration.
  • Performance Optimization: Optimize data ingestion, transformation, and query performance to improve processing speed and reduce storage costs, using SQL tuning, indexing strategies, and performance monitoring tools.
  • Security & Compliance: Implement data governance policies, IAM roles, encryption, and audit logging to ensure compliance with industry standards such as GDPR, HIPAA, and SOC2.
  • Monitoring & Troubleshooting: Configure logging, alerts, and monitoring using Google Stackdriver, Cloud Monitoring, and Informatica Operational Insights to proactively identify and resolve data pipeline issues.
  • Collaboration & Stakeholder Engagement: Work closely with DBAs, data analysts, BI teams, and application developers to facilitate seamless data migration, integration, and business continuity across cloud environments.
Scroll to Top