Job Description

Applies advanced subject matter knowledge to solve complex business issues and is regarded as a subject matter expert. Frequently contributes to the development of new ideas and methods. Works on complex problems where analysis of situations or data requires an in-depth evaluation of multiple factors. Leads and/or provides expertise to functional project teams and may participate in cross-functional initiatives. Acts as an expert providing direction and guidance to process improvements and establishing policies. Frequently represents the organization to external customers/clients. Exercises significant independent judgment within broadly defined policies and practices to determine best method for accomplishing work and achieving objectives. May provide mentoring and guidance to lower level employees.

Responsibilities

  • Leads multiple project teams of other software/data engineers and internal and outsourced development partners responsible for all stages of design and development for complex products and platforms, including solution design, analysis, coding, testing, and integration of structured/unstructured data.
  • Manages and expands relationships with internal and outsourced development partners on applications design and development.
  • Reviews and evaluates designs and project activities for compliance with architecture, security and quality guidelines and standards; provides tangible feedback to improve product quality and mitigate failure risk.
  • Provides domain-specific expertise and overall data systems leadership and perspective to cross-organization projects, programs, and activities.
  • Drives innovation and integration of new technologies into projects and activities in the big data space.
  • Collaborates and communicates with project team regarding project progress and issue resolution.
  • Represents the data engineering team for all phases of larger and more-complex development projects.
  • Provides guidance and mentoring to less experienced staff members.
  • Researches opportunities for acquiring new data and new uses for existing data.

Knowledge & Skills

  • Extensive experience with data engineering tools, languages, frameworks to mine, cleanse and explore data.
  • Excellent analytical and problem-solving skills.
  • Fluent in NoSQL & relational based systems.
  • Strong experience in overall architecture of big data systems, cloud services/systems.
  • Experience with source control management systems such as Git.
  • Experience working in an Agile software development environment.
  • Designing data systems/solutions to manage complex data in complex, distributed and massively parallel systems.
  • Evaluating forms and processes for database architecture testing and methodology, including writing and execution of test plans, debugging, and testing scripts and tools.
  • Excellent written and verbal communication skills; mastery in English and local language.
  • Comfortable working with remote, geographically dispersed teams.
  • Familiarity with the how privacy legislation affects big data usage.
  • Passionate about understanding customer/partner needs and creatively inventing solutions to meet those needs.
  • Ability to clearly explain complex data topics to technical and non-technical people unfamiliar with the domain.

Tools and Technology Experience

  • Python, PySpark
  • Spark, Databricks
  • Redshift
  • Airflow
  • Azure DevOps
  • Flask
  • Terraform
  • JSON & JSON Schema
  • AWS (RDS/Aurora, IAM)
  • Docker

Education & Experience

  • Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or equivalent.
  • Typically 6-10 years’ experience.

 

Is a Remote Job?
No
Employment Type
Full time

You’re out to reimagine and reinvent what’s possible—in your career as well as the world around you.  

So are we. We love taking on tough challenges, disrupting the status quo, and creating what’s...

Apply Now