Position: Senior Data Engineer
Duration: 3 Months W2
Location: Salem, OR (Fully Remote)
Key Skills:
Proficiency in building and managing scalable, real-time data lake solutions utilizing AWS services such as EMR, S3, Hive, and Spark Extensive experience with cloud warehouse platforms, particularly Snowflake Expertise in messaging, streaming, and complex event processing tools and frameworks, with a focus on Spark Streaming or Structured Streaming and Apache Nifi Top 3 Skills:
Demonstrated ability to architect and develop cloud-scalable data solutions using AWS, EMR, S3, Hive, and Spark Hands-on experience with Snowflake and proficiency in utilizing cloud warehouse tools Proficiency in messaging/streaming/complex event processing tooling, particularly with Spark Streaming or Structured Streaming and Apache Nifi
**ATTN ADDITIONAL ASSIGNMENT INFORMATION***
1. candidate; 6-7 years preferred. industry does not matter as much as applied exp.
2. AWS Tech Stack experience; any experience with Databricks; Spark & Python for coding
3. Manager is looking at the quality of the Experience a Candidate has, What types of projects they've worked on, candidates that are accustomed to a complex environment, & level of coding experience
Qualifications: Bachelor's or Master's degree in Computer Science or related field 6+ years of experience in data engineering development 4+ years of experience implementing scalable data architectures 3+ years of experience in large-scale software development with a focus on data analytics and high-volume data processing 3+ years of experience with AWS and related services such as EC2, S3, DynamoDB, Kinesis Streams, etc. Expertise in Python is a must, with proficiency in other data-centric programming languages considered advantageous 5+ years of experience in database development, including relational and non-relational databases; SQL experience preferred Experience with CI/CD tools like Jenkins/Terraform and Docker for deploying containerized solutions in AWS Job Description: Lead the engineering efforts on modern, cloud-based data processing technology stack Develop robust data pipelines, validation frameworks, and job schedules with a focus on automation and scalability Contribute to the design and architecture of systems for storing and processing high volumes of data Ensure timely delivery of product and technical features according to specifications Collaborate closely with product owners, reporting analysts, data analysts, and business partners within an Agile/Scrum methodology Proactively build solutions that are automated, scalable, and sustainable to maintain product health and minimize defects and technical debt Excellent communication skills, ability to work effectively in a remote team environment using tools like Zoom, and demonstrate flexibility and adaptability.
Please Apply Online.
To learn more about Mavensoft visit us at
Neeraja
Mavensoft Technologies | 15248 NW Greenbrier Parkway, Beaverton, OR
Office: | Fax: Email: | Website: : Recommended Skills Adaptability Apache Hive Apache Spark Architecture Communication Continuous Integration
