The Data Processing and Workflow Foundations (DPWF) team is looking to hire a Senior Software Engineer that thrives at the intersection of infrastructure and software development. This team's challenges break into 2 domains, which we considerengineering kafka as a platformandpromotingevent driven architectures.
Engineering kafka as a platform: Higher-level orchestration of Kafka to support our multi-cloud, multi-region, deployments. A subset of current focuses include:
Software automation that creates, manages, and destroys kafka clusters in our environments.
APIs and controllers that support operation of kafka clusters at scale atop kubernetes
Automation of replication and other cluster management concerns.
Promoting event driven architectures: Reddit is increasingly adopting geographically distributed, eventually consistent architectures. As part of this shift, many systems are shifting to event driven architectures, and the DPWF team is working to make this adoption simpler and faster. Current projects are:
Reddit specific clients and templates with helper functions and features suited to our use of Kafka
Schema Registries and enforcement
Capacity management and ACLs through client enforced authentication
GitOps developer experience for Kafka interaction
As a member of the Data Processing and Workflow Foundations team, your work will span these 2 domains, which are rich with challenging infrastructure and software engineering problems. Your work will directly impact hundreds of millions of users around the world. Join us and help build the future of Reddit!
In your day-to-day, you can expect to:
Work collaboratively with a team of software engineers to create and maintain the foundational platform for running Reddit's infrastructure.
Deliver software to improve the availability, scalability, latency, and efficiency of Kafka and other messaging components.
Contribute feedback to the technical and strategic direction of eventing at Reddit.
Automate critical aspects of the event driven development process
Share on-call responsibilities.
You have:
4+ years of experience developing internet-scale software, preferably in the context of infrastructure.
Familiarity with asynchronous communication, bonus if familiar with Kafka specifically
Experience developing on top of Kubernetes or similar distributed systems.
Kubernetes controller or operator development experience is a huge plus.
Strong troubleshooting capabilities surrounding both systems and software.
Experience engineering large systems, tracking work, and being a self-starter on projects.
Excellent communication skills to collaborate with a service-oriented team and company.
Benefits:
Comprehensive Healthcare Benefits
401k Matching
Workspace benefits for your home office
Personal & Professional development funds
Family Planning Support
Flexible Vacation (please use them!) & Reddit Global Wellness Days
4+ months paid Parental Leave
Paid Volunteer time off
#LI-remote, #LI-JS5
