reputed company Full Stack Data Engineer ETL, Data Pipelines, and reputed

About the Role

As a Full Stack Data Engineer at remotepromsp, you will be responsible for designing, developing, and maintaining end-to-end data pipelines that integrate with various data sources and destinations. This role involves working with a range of technologies, including ETL tools, data warehousing platforms, and big data processing frameworks. Your primary goal will be to ensure the smooth flow of data across the organization, enabling data-driven decision-making.

Key Responsibilities

• Design and develop scalable data pipelines using ETL tools like Azure Data Factory and Apache Beam.
• Develop and maintain data warehouses using platforms like Apache Hive and Apache Hadoop.
• Work with NoSQL databases like Apache Cassandra and MongoDB to store and process large amounts of semi-structured data.
• Implement data quality checks and data validation mechanisms to ensure data accuracy and integrity.
• Collaborate with cross-functional teams, including data scientists and business analysts, to understand data requirements and develop data solutions.
• Monitor and optimize data pipeline performance to ensure efficient data processing and reduced latency.
• Stay up-to-date with industry trends and emerging technologies in data engineering and contribute to the development of new data solutions.

Skills & Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Proficiency in programming languages like Python and SQL.
• Experience with big data processing frameworks like Apache Hadoop and Apache Spark.
• Knowledge of NoSQL databases like Apache Cassandra and MongoDB.
• Familiarity with data warehousing platforms like Apache Hive and Apache Hadoop.
• Experience with ETL tools like Azure Data Factory and Apache Beam.
• Good understanding of data modeling, data architecture, and data governance principles.

What You'll Learn

In this role, you will gain hands-on experience with a wide range of data engineering tools and technologies, including ETL tools, data warehousing platforms, and big data processing frameworks. You will also develop strong problem-solving skills, learn to work collaboratively with cross-functional teams, and gain a deeper understanding of data modeling, data architecture, and data governance principles.

Resume Tip

When applying for this role, make sure to highlight your experience with data engineering tools and technologies, including ETL tools, data warehousing platforms, and big data processing frameworks. Emphasize your ability to design and develop scalable data pipelines, work with NoSQL databases, and collaborate with cross-functional teams. Use specific examples from your previous projects or internships to demonstrate your skills and experience.