Title: Data Engineer
Location: Chicago IL(Only locals)
Job Summary: The Data Management Specialist will be responsible for managing and optimizing our organization's data infrastructure, ensuring data quality, and implementing data solutions using Spark, Data Bricks, Snowflake, and/or Redshift. The ideal candidate will have a strong background in data management, programming, and cloud-based data platforms.
Key Responsibilities:
Develop and maintain data pipelines using PySpark to process and transform large volumes of data.
Design, implement, and optimize data solutions using Data Bricks for data analytics and machine learning applications.
Manage and administer cloud-based data platforms such as Snowflake and Redshift, ensuring high availability, scalability, and performance.
Collaborate with cross-functional teams to understand data requirements and deliver tailored data solutions.
Implement data governance policies and procedures to ensure data quality, consistency, and security.
Monitor and troubleshoot data issues, ensuring timely resolution and minimal impact on business operations.
Stay updated with the latest trends and technologies in data management, cloud computing, and big data analytics.
Provide technical guidance and mentorship to junior data management team members.
Qualifications:
Bachelor s degree in computer science, Information Systems, or related field; master s degree preferred.
Minimum of 5 years of experience in data management, data engineering, or related role.
Strong programming skills in Python and experience with PySpark for data processing and analytics.
Hands-on experience with Data Bricks for building and optimizing data pipelines.
Proficiency in managing and administering cloud-based data platforms such as Snowflake and/or Redshift.
Solid understanding of data modeling, ETL processes, and data warehousing concepts.
Excellent analytical, problem-solving, and communication skills.
Ability to work effectively in a fast-paced environment and manage multiple priorities.
Preferred Qualifications:
Certifications in PySpark, Data Bricks, Snowflake, or Redshift.
Experience with other data management tools and technologies.
Knowledge of machine learning algorithms and techniques.
Experience working in banking and payments domain.
Report this job Dice Id: ******** Position Id: 8254088
