Data Engineer

Find the talent from anywhere in the world - Onboard them easily - Set up payroll and benefits in a few clicks

Job Overview

Type of Role	Full Time
Position	Data Engineer
Years of Exp. required	4 to 7 years
Academic Background	Bachelor's degree in Computer Science or a related field.
CTC	Competitive and commensurate with experience
Work Type	Work from office
No. of Working Days in a Week	5 Days

Who are we looking for?

We are seeking a talented Data Engineer with solid programming experience in Python, Scala, or Java. The ideal candidate should have hands-on experience with data analysis, creating data pipelines, and orchestration on GCP tools like Dataflow, Data Fusion, Composer, and BigQuery. The candidate will also perform as a technical data lead, taking accountability for data hygiene and ensuring data integrity.

How does your first 10 days look like?

• Get familiar with ongoing projects and data engineering tools.
• Collaborate with the team to understand current data pipeline processes.
• Dive into code development and data analysis tasks.
• Assume the role of a technical data lead, understanding tables, data use, replication, connection, and lineage

How does your 1st month look like?

• Actively participate in the development of data pipelines and ETL processes.
• Collaborate with data architects, data scientists, and business analysts.
• Work on optimizing and improving big data data pipelines.
• Identify the needs of the business and develop solutions that fit these needs.

How does your first 3 months look like?

• Take on more responsibilities in building and maintaining ETL processes.
• Identify and solve complex problems in data architecture and data management.
• Organize the integration of data and migration activities to enhance operating efficiency.
• Participate in improving business activities by implementing innovative data solutions.

How does your first 6 months look like?

• Develop robust data pipelines on the public Cloud using GCP, AWS, or Alibaba technologies.
• Collect, process, and compute business metrics from data using Python/Spark.
• Collaborate with the team on data discovery, modeling, mining, and archival.
• Evaluate existing data systems and propose enhancements.

How does your first 12 months look like?

• Serve as an integrator between data architects, data scientists, and other data consumers.
• Contribute to the development of new analysis tools and metrics.
• Work on projects measuring product engagement & consumability.
• Continue performing as a technical data lead, ensuring data hygiene and integrity.

KRA’s you will own

Primary

• Build and optimize big data data pipelines on public Cloud platforms.
• Collect, process, and compute business metrics from data.
• Develop data set processes for data discovery, modeling, mining, and archival.

Secondary

• Collaborate with data architects, data scientists, and business analysts.
• Serve as an integrator between various data-related roles.
• Contribute to the development of new analysis tools and metrics.

Channels you will own

• Work closely with the data engineering team.
• Collaborate with cross-functional teams, including data scientists and business analysts.

Tools you should be well versed with

• Programming languages: Python, Scala, Java.
• Big data technologies: Hadoop, Spark, Hive/Pig.
• Cloud platforms: GCP, AWS, Alibaba.
• Data processing tools: Dataflow, Data Fusion, Composer, BigQuery.
• SQL and NoSQL databases: MongoDB, Cassandra, HBase, DynamoDB.
• Version control: Git.
• Agile software development and Scrum methodology.

Candidate Fit

You are an Ideal candidate if

• Bachelor’s degree in Computer Science.
• 2+ years of experience in big data analytics or related roles.
• Strong analytical and critical thinking skills.
• Proficiency in SQL.
• Experience with ETL, data warehousing, and columnar databases.
• Excellent written and verbal communication skills.
• Positive, team-focused attitude.
• Ability to manage multiple tasks and requests.

You are a Worthy candidate if

• Familiarity with Agile software development and DevOps.
• Spring Webflux, Web Client, ecommerce domain experience.
• Knowledge of Spring Boot API development.
• Experience as a technical data lead, ensuring data hygiene and integrity.

Role Clarity

• Actively participate in building and optimizing data pipelines.
• Collaborate with data architects, data scientists, and business analysts.
• Contribute to the development of new analysis tools and metrics.
• Perform as a technical data lead, ensuring data hygiene and integrity.

Company Perks

• Competitive salary.
• Opportunities for professional development and training.
• Exposure to cutting-edge technologies.
• Collaboration with innovative teams.
• Mentorship and career growth opportunities.
• Work in a dynamic and creative environment.
• A work culture focused on innovation and creating lasting value for our clients and employees.