brand logo
banner_image
View All Jobs

Consultant - Data Engineer (CON00667)

Bengaluru
Onsite
About Us
Affine is a global leader in professional services and solutions at the forefront of AI, data engineering, and cloud technologies. With our distributed team of over 500 analytics professionals across North America, Europe, and Asia, we are dedicated to enabling global enterprises to transform and innovate through the power of AI (Artificial Intelligence), data engineering, and cloud technologies.

We offer exciting career opportunities for professionals seeking to make a significant impact. Our diverse team represents a rich tapestry of talent, expertise, and cultural backgrounds. As an Affine employee, you'll be part of a dynamic and inclusive work environment that values collaboration, creativity, and continuous learning. Joining Affine means immersing yourself in a world of cutting-edge projects and solutions. We work closely with global clients spanning various sectors, including manufacturing, gaming, consumer packaged goods (CPG), media and entertainment, travel, and technology. As a member of our team, you'll have the opportunity to leverage your skills and contribute to transformative projects that shape industries and redefine the future.

We believe in investing in our people and nurturing their growth. Affine is dedicated to your professional development and offers a range of learning opportunities, mentorship programs, and career advancement paths. We also encourage innovation and thought leadership through our strong connections with esteemed institutions like UC Berkeley and premier Indian Institutes of Technology (IITs), ensuring that you stay at the forefront of industry advancements. At Affine, we foster a culture of collaboration, where ideas are valued, and teamwork is celebrated. As you work alongside some of the brightest minds in the industry, you'll be inspired to push boundaries, solve complex challenges, and make a lasting impact on the world.
Job Description
Objective:
As a Data Engineer, you will be responsible for building effective data solutions that will cater to the needs of Data Analysts, Data Scientists, and other Data Consumers across the organization. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. They assess a wide range of requirements and apply relevant database techniques to create a robust architecture and will ensure delivering of high quality ETL solutions.

Roles and Responsibilities:
  • Should be comfortable in building and optimizing  performant data pipelines which include data ingestion, data cleansing and curation into a datawarehouse, database, or any other data platform using Python
  • Must have solid understanding of data structures and algorithms
  • Must be extremely proficient with python core libraries and Object-Oriented Programming concepts
  • Must have experience working with REST API
  • Maintenance and optimization of existing processes
  • Experience in writing production ready code in Python and test, participate in code reviews to maintain and improve code quality, stability, and supportability
  • Experience in designing data warehouse/data mart
  • Experience with any RDBMS preferably SQL Server and must be able to write complex SQL queries
  • Leading the client calls to flag off any delays, blockers, escalations and collate all the requirements
  • Expertise in requirement gathering, technical design and functional documents
  • Experience in Agile/Scrum practices
  • Experience in leading other developers and guiding them technically
  • Experience in deploying data pipelines using automated CI/CD approach
  • Ability to write modularized reusable code components
  • Proficient in identifying data issues and anomalies during analysis
  • Strong analytical and logical skills
  • Must be able to comfortably tackle new challenges and learn
  • Must have strong verbal and written communication skills
Job Requirement
Technical Capabilities
Must Have –
  • Python (primary)/Pyspark
  • SQL
  • Any ETL (ADF/Databricks/Airflow)
  • DWH
  • Redshift/Synapse/Snowflake/Google Big Query/Hive
  • Object Oriented Programming
  • AWS/Azure/GCP/ Any Cloud
Good to Have-
  • Git/similar version control tool
  • Basic knowledge in CI/CD, Microservices
Education: UG/PG preferably in Computer Science/Information Technology or any other related fields

Be a part of Affine's Talent Pool

If you are unable to find relevant job opportunity above, join our Talent Pool by simply submitting your resume. Our Talent Acquisition team will contact you as soon as they find a great match for your profile and discuss exciting opportunities with you.

More About Us...

Affinites @ Work

Work Life Balance

Strike The Right Balance

Life @ Affine!

Career. Accelerate. Progress.

Challenge. Succeed. Rewards.

Learn. Upskill. Expertise.

Travel. Work. Rejuvenate.

Celebrate @ Work

Follow us at