Position Overview: We are seeking a talented and experienced Data Engineer to join our team. As a Data Engineer, you will play a pivotal role in designing, constructing, and maintaining the systems and infrastructure required for the seamless collection, storage, processing, and analysis of data. Your expertise will contribute to the development of robust data pipelines, efficient data storage solutions, and optimized data processing mechanisms.

Key Responsibilities:

• Data Pipeline Development:
  • Collaborate with cross-functional teams to design, develop, and implement data pipelines that ensure the smooth and reliable movement of data from diverse sources (databases, APIs, files) to suitable data storage systems.
  • Execute data extraction, transformation, and loading (ETL) processes to guarantee data accuracy and consistency.
• Data Storage and Management:
  • Evaluate and select appropriate data storage solutions, including traditional relational databases, NoSQL databases, data lakes, and cloud-based storage systems.
  • Optimize chosen storage systems to meet data retrieval, scalability, and performance requirements.
• Data Transformation and Cleansing:
  • Apply your expertise to cleanse, validate, and transform raw data, making it ready for thorough analysis.
  • Enrich data and implement necessary transformations to ensure data accuracy and uniformity.
• Performance Optimization:
  • Assume responsibility for fine-tuning data processing pipelines and storage systems, striving for efficient and rapid data access.
  • Employ techniques such as database query optimization, data indexing, and caching mechanisms to enhance overall system performance.
• Data Integration:
  • Leverage your skills in integrating data from a variety of sources and technologies, creating a harmonized and coherent data view that facilitates streamlined analysis and reporting.
• Cloud Computing and Big Data Technologies:
  • Collaborate with our partners who are transitioning to cloud-based data infrastructure. Utilize platforms such as Azure and Google Cloud, along with big data technologies like Hadoop and Spark, to manage and process extensive datasets.

Required Skills and Qualifications:

• Bachelor’s degree in Computer Science, Engineering, or a related field.
• Proven track record with 4 to 5 years of experience as a Data Engineer or a similar role, showcasing your ability to design and implement effective data solutions.
• Proficiency in executing data extraction, transformation, and loading (ETL) processes.
• Experience working with a range of data storage solutions, including relational databases, NoSQL databases, and data lakes.
• Familiarity with cloud computing platforms (e.g., Azure, Google Cloud) and big data technologies (e.g., Hadoop, Spark).
• Strong programming skills in Python and SQL.
• Expertise in data integration best practices and techniques.
• Analytical mindset, coupled with strong problem-solving abilities.
• Excellent communication skills to effectively collaborate with cross-functional teams.
• Detail-oriented approach, committed to maintaining data accuracy and quality.
• Knowledge of technologies such as Qlik, Apache Kafka, Azure Data Factory, Azure Function Apps/Logic Apps, and PySpark is a plus.

Salary Range: The salary range for this position is between 300,000 to 400,000 per year, commensurate with experience and qualifications.

If you are a highly skilled and motivated individual with a passion for data engineering and a track record of delivering impactful solutions, we invite you to apply for this opportunity. Join our team and contribute to shaping the data landscape in a dynamic and innovative environment.