Scribd
Upload
25 views

Sr Data Engineer+ SCALA

Quantiphi is an AI-first digital engineering company focused on solving complex business problems through advanced data engineering and AI solutions. They are seeking a Senior Data Engineer with 3 to 6 years of experience, proficient in Scala and Apache Spark, to design and implement data solutions. The role requires expertise in building data pipelines, cloud technologies, and performance optimization, with additional skills in data visualization and governance considered a plus.

Uploaded by

Vinayak Chaturvedi
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
25 views

Sr Data Engineer+ SCALA

Quantiphi is an AI-first digital engineering company focused on solving complex business problems through advanced data engineering and AI solutions. They are seeking a Senior Data Engineer with 3 to 6 years of experience, proficient in Scala and Apache Spark, to design and implement data solutions. The role requires expertise in building data pipelines, cloud technologies, and performance optimization, with additional skills in data visualization and governance considered a plus.

Uploaded by

Vinayak Chaturvedi
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 2

Quantiphi is an award-winning AI-first digital engineering company driven by the desire to

solve transformational problems at the heart of the business. Quantiphi solves the toughest
and most complex business problems by combining deep industry experience, disciplined
cloud and data-engineering practices, and cutting-edge artificial intelligence research to
achieve quantifiable business impact at unprecedented speed. We are passionate about our
customers and obsessed with problem-solving to make products smarter, customer
experiences frictionless, processes autonomous, and businesses safer by detecting risks,
threats, and anomalies. Together with partners and customers, we embark on a data and AI-
led transformation journey that delivers impactful and measurable results.

Job Role - Sr Data Engineer


Experience : 3 to 6 Years
Location : Mumbai/ Bangalore/ Trivandrum (Hybrid)

As a Senior Data Engineer at Quantiphi, you will work on solving complex data challenges by designing,
developing, and implementing solutions for data migration, storage, and processing. You will be
responsible for building scalable and efficient data pipelines leveraging modern data engineering tools
and technologies

.Must-Have Skills:

● 3+ years of hands-on experience delivering end-to-end data solutions


● Strong experience in Scala programming with a focus on developing data pipelines using
Apache Spark
● Experience creating Scala/Spark jobs for data transformation and aggregation
● Proficiency with DataFrame/Dataset APIs, RDD transformations, and Spark SQL
● Hands-on experience with Spark query tuning and performance optimization
● Experience producing unit tests for Spark transformations using Scalatest, JUnit, or Mockito
● Ability to write Scaladoc-style documentation for all code
● Hands-on experience with performance tuning, error handling, data partitioning, and schema
evolution in Scala-based pipelines
● Experience designing and building data processing pipelines for large-scale data processing
● AWS Data Engineering expertise including S3, Lambda, AWS Glue.
● Experience developing and deploying ETL/ELT pipelines using AWS Glue and Scala or PySpark
● Experience with orchestration tools like Apache Airflow or AWS Step Functions
● Advanced SQL skills with a focus on query optimization for large datasets
● Experience integrating with SQL databases (e.g., Microsoft SQL Server, Oracle, Postgres, MySQL)
● Experience working with storage and database systems like HDFS, S3, Cassandra, and/or
DynamoDB
● Mandatory experience in building Scala-based connectors for Data Integration
● Deep understanding of distributed systems concepts
● Experience in Python/Pyspark for scripting and complementary data processing tasks
● Proven track record of building and deploying cloud-based data solutions at scale

Good-to-Have Skills:

● Experience in data virtualization(BI) using QuickSight or PowerBI or Looker or Tableau


● Familiarity with data governance frameworks such as Collibra
● Prior experience with on-premises to cloud or Cloud to Cloud migration projects handling
large data volumes
● Experience in designing and implementing data lakes and data warehouses on the cloud
● Awareness and application of industry best practices in data engineering

For more details visit our website or our LinkedIn Page

You might also like