Data Engineer

We are seeking a talented Data Engineer with solid programming experience in Python, Scala, or Java. The ideal candidate should have hands-on experience with data analysis, creating data pipelines, and orchestration on GCP tools like Dataflow, Data Fusion, Composer, and BigQuery. The candidate will also perform as a technical data lead, taking accountability for data hygiene and ensuring data integrity.

• Get familiar with ongoing projects and data engineering tools.
• Collaborate with the team to understand current data pipeline processes.
• Dive into code development and data analysis tasks.
• Assume the role of a technical data lead, understanding tables, data use, replication, connection, and lineage

• Actively participate in the development of data pipelines and ETL processes.
• Collaborate with data architects, data scientists, and business analysts.
• Work on optimizing and improving big data data pipelines.
• Identify the needs of the business and develop solutions that fit these needs.

• Take on more responsibilities in building and maintaining ETL processes.
• Identify and solve complex problems in data architecture and data management.
• Organize the integration of data and migration activities to enhance operating efficiency.
• Participate in improving business activities by implementing innovative data solutions.

• Develop robust data pipelines on the public Cloud using GCP, AWS, or Alibaba technologies.
• Collect, process, and compute business metrics from data using Python/Spark.
• Collaborate with the team on data discovery, modeling, mining, and archival.
• Evaluate existing data systems and propose enhancements.

• Serve as an integrator between data architects, data scientists, and other data consumers.
• Contribute to the development of new analysis tools and metrics.
• Work on projects measuring product engagement & consumability.
• Continue performing as a technical data lead, ensuring data hygiene and integrity.

• Build and optimize big data data pipelines on public Cloud platforms.
• Collect, process, and compute business metrics from data.
• Develop data set processes for data discovery, modeling, mining, and archival.

• Collaborate with data architects, data scientists, and business analysts.
• Serve as an integrator between various data-related roles.
• Contribute to the development of new analysis tools and metrics.

• Work closely with the data engineering team.
• Collaborate with cross-functional teams, including data scientists and business analysts.

• Programming languages: Python, Scala, Java.
• Big data technologies: Hadoop, Spark, Hive/Pig.
• Cloud platforms: GCP, AWS, Alibaba.
• Data processing tools: Dataflow, Data Fusion, Composer, BigQuery.
• SQL and NoSQL databases: MongoDB, Cassandra, HBase, DynamoDB.
• Version control: Git.
• Agile software development and Scrum methodology.

• Bachelor’s degree in Computer Science.
• 2+ years of experience in big data analytics or related roles.
• Strong analytical and critical thinking skills.
• Proficiency in SQL.
• Experience with ETL, data warehousing, and columnar databases.
• Excellent written and verbal communication skills.
• Positive, team-focused attitude.
• Ability to manage multiple tasks and requests.

• Familiarity with Agile software development and DevOps.
• Spring Webflux, Web Client, ecommerce domain experience.
• Knowledge of Spring Boot API development.
• Experience as a technical data lead, ensuring data hygiene and integrity.

• Actively participate in building and optimizing data pipelines.
• Collaborate with data architects, data scientists, and business analysts.
• Contribute to the development of new analysis tools and metrics.
• Perform as a technical data lead, ensuring data hygiene and integrity.

• Competitive salary.
• Opportunities for professional development and training.
• Exposure to cutting-edge technologies.
• Collaboration with innovative teams.
• Mentorship and career growth opportunities.
• Work in a dynamic and creative environment.
• A work culture focused on innovation and creating lasting value for our clients and employees.