Python, PySpark, ETL Developer

About the Role

As a Python, PySpark, ETL Developer at Infosys, you will be responsible for designing, developing, and implementing efficient ETL (Extract, Transform, Load) processes using Python and PySpark. Your primary focus will be on data processing, data transformation, and data loading into various data warehouses and databases.

You will work closely with cross-functional teams to understand business requirements, identify data sources, and design data pipelines to meet the organization's data needs. Your expertise in Python and PySpark will enable you to develop scalable and efficient data processing solutions.

Key Responsibilities

• Design and develop ETL processes using Python and PySpark to extract data from various sources, transform it into a standardized format, and load it into target systems.
• Develop and maintain data pipelines using PySpark to process large datasets efficiently and effectively.
• Collaborate with data analysts and scientists to understand business requirements and design data solutions that meet their needs.
• Develop and implement data quality checks to ensure data accuracy and integrity.
• Optimize ETL processes to improve performance and reduce processing time.
• Develop and maintain documentation of ETL processes and data pipelines.
• Stay up-to-date with industry trends and emerging technologies in data processing and analytics.

Skills & Qualifications

• Strong understanding of Python programming language and its applications in data processing.
• Experience with PySpark and its use cases in big data processing.
• Knowledge of data warehousing and ETL concepts.
• Strong analytical and problem-solving skills.
• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Experience with data visualization tools such as Tableau, Power BI, or D3.js.
• Knowledge of database management systems such as MySQL, PostgreSQL, or Oracle.

What You'll Learn

As a Python, PySpark, ETL Developer at Infosys, you will have the opportunity to learn and work with cutting-edge technologies in data processing and analytics. You will gain hands-on experience in designing and developing efficient ETL processes, working with big data, and collaborating with cross-functional teams.

You will also have the chance to learn from experienced professionals and contribute to projects that have a significant impact on the organization's data needs.

Resume Tip

When applying for this role, make sure to highlight your experience with Python and PySpark, as well as your understanding of data warehousing and ETL concepts. Include specific examples of projects you have worked on that demonstrate your skills in data processing and analytics.

Also, be sure to tailor your resume to the job description and requirements, and use keywords from the job posting to help your resume pass through applicant tracking systems (ATS).