Data Engineering Lead

Big data and analytics

Senior

Gurgaon

Who we are

We are Metyis, a forward-thinking, global company that collaborates with business partners and clients to create and implement the capacities and capabilities required to improve future performance. We operate across a wide range of industries, and with our embedded partnership model we commit to driving sustainable growth for industry-leading organisations, elevating their potential with a long-term vision.

At Metyis, we develop integrated solutions that enable growth by working within our business partners’ organisations with diverse and multidisciplinary teams. This collaborative environment allows Metyis to build strategies and execute them through an ecosystem that combines Big Data solutions, Digital Commerce solutions, Marketing & Design solutions, and Advisory services.

Our teams are set up so that you have plenty of room to build bigger and bolder ideas by speaking your mind and being creative with your knowledge. Imagine the things you could achieve with a multidisciplinary team that encourages you to be the best version of yourself.

We are Metyis. Partners for Impact.

What we offer

Interact with C-level at our clients on regular basis to drive their business towards impactful change
Lead your team in creating new business solutions
Seize opportunities at the client and at Metyis in our entrepreneurial environment
Become part of a fast-growing international and diverse team

What you will do

Independently lead & manage execution of data engineering projects
Engineer complete technical solutions to solve concrete business challenges in the areas of digital marketing, eCommerce, Business Intelligence and self-service analytics
Collect functional and non-functional requirements, consider technical environments, business constraints and enterprise organizations
Support our clients in executing their Big Data strategies by designing and building operational data platforms: ETL pipelines, data anonymization pipelines, data lakes, near real-time streaming data hubs, web services, training and scoring machine learning models.
Troubleshoot and quality check work done by team members
Collaborate closely with partners, strategy consultants and data scientists in a flat and agile organization where personal initiative is highly valued
Share data engineering knowledge by giving technical trainings
Communicate and interact with clients at the executive level
Guide and mentor team members

What you’ll bring

7-10 years of professional hands-on experience
A broad practice in multiple software engineering fields
Experience on managing & leading data engineering / warehousing projects
Must have experience on Python, SQL and Distributed programming languages, preferable Spark
Experience working on Cloud, Azure is a plus
Experience working setting up data lakes using entire Big Data and DWH ecosystem
Experience on data workflows and ETL, Apache Airflow is a plus
Comfortable with Unix OS type systems, Bash and Linux
Basic knowledge of webservices and APIs
Basic knowledge of Containers and Docker as platform
Experience using Version Control, Testing and development cycle, preferable git (Gitlab or GitHub)
Knowledge of security practices
Software development practices (Agile)
A Strong Focus On Data Processing
Object oriented programming
Data workflows, monitoring, architecture and security
Databases: theory and practice
Distributed data processing
Concepts of functional programming
Enterprise data warehousing, business intelligence and ETL principles
Good written and oral communication skills in English language