Software Engineer, Distributed Systems Job at Jobleads-US, San Francisco, CA

U0F3LzVMbkZOTkRoeXlzYVRSZzNjS2MzRXc9PQ==
  • Jobleads-US
  • San Francisco, CA

Job Description

We are actively recruiting for multiple Software Engineers across different levels for our org! About the Role Mixpanel is powered by a custom distributed database. This system ingests more than 1 Trillion user-generated events every month while ensuring end-to-end latencies of under a minute and queries typically scan more than 1 Quadrillion events over the span of a month. Over the last year, our inbound traffic has doubled. As our existing customers grow in volume and we add new ones, we expect this growth in traffic to continue. The Distributed Systems engineering teams are responsible for adding new capabilities and ensuring the smooth operation of the underlying systems. Responsibilities Mixpanel's infrastructure runs on Google Cloud Platform. We rely on Kubernetes and Docker for orchestration and containerization of our services. We primarily use Golang for writing services and all internal communication happens via GRPC. We use a combination of C and C++ wherever Golang doesn't meet our performance goals. As an engineer on the Distributed Systems teams, you'll be responsible for: Working with other engineers to build distributed systems that can handle data at scale Debugging production issues across multiple services and all levels of our infrastructure stack Ensuring reliability and uptime of the services you're responsible for Keeping an eye on how much your service costs every month and removing inefficiencies wherever possible Improving engineering standards and holding a high bar for code quality and simplicity Pushing the boundaries on how our customers analyze their product data A typical project requires a thorough understanding of how not just your service works but also how it interacts with other components. Here are some projects we've worked on in the past to give you an idea of what to expect. Most of the systems in our stack provide at least once semantics. As a result, we risk duplicating events that flow through them. To overcome this limitation, we added support for event deduplication that can work at our scale. Typical approaches for deduplication don't perform well on large amounts of data, so we had to do something highly custom for our stack. We wrote about this on our engineering blog here . Back in 2019, we migrated our ingestion API service from Python to Golang for better performance and type safety. We had to do this while ensuring that both systems handle data the same way. Because we had to compare, both, responses and transformed payloads, nothing out of the box worked for us. This blog post talks about how we did the actual migration without any customer visible downtime. In 2021, as our traffic grew almost 100%, the cost of storing data became untenable. Our engineers worked on an incremental way to eventually realize almost $30000 in savings per month. If projects like the ones listed above excite you, the Distributed Systems engineering team will be a great fit. We're Looking For Someone Who Has We have openings across multiple Distributed Systems teams. We're looking for engineers who have: A strong grasp of computer science fundamentals when it comes to dealing with distributed systems and networks. You'll routinely run into issues where "one in a million" chances actually happen in production A knack for problem-solving and thinking from first principles. You don't shy away from any problem, no matter the scale or impact A bias towards shipping early and iterating. We believe in making small incremental changes to existing systems instead of large multi-quarter undertakings Additional Resources Engineering Life Page Tracking events at millisecond granularity Ensuring Data Consistency Across Replicas Saving $30000 a month by improving Garbage Collection Strategies For Effective Data Compaction Monitoring Apache Kafka with JMX Exporter and Kafka Exporter Resharding petabytes of data to improve performance for our largest customers

  • LI-Remote
  • J-18808-Ljbffr Jobleads-US

Job Tags

Remote work,

Similar Jobs

UPMC Central PA

CRNP - Neurology Spring Grove Job at UPMC Central PA

 ...Exciting Opportunity for Neurology CRNP at UPMC Neurosciences Institute, Spring Grove. Join the vibrant healthcare team at UPMC with our Neuroscriences Institute in Spring Grove, PA, where we're thrilled to offer a compelling opportunity for Certified Registered Nurse... 

RQ Construction

Combination Pipe Welder Job at RQ Construction

 ...Defense market. We are looking to hire a skilled Combination Pipe Welder to join our Mechanical team for ongoing work at King's Bay...  ...: Medical, Dental, Vision, 401k with Match EDUCATION & EXPERIENCE ~ A high school diploma or GED is the preferred minimum formal... 

Open Door Unlimited, Inc.

Northern Florida Pediatrician Needed will consider J1 visa (FL687-PED) Job at Open Door Unlimited, Inc.

 ...Gainesville is seeking a BE/BC Pediatrician to add to their group. Offering a very nice employment package including PTO, malpractice, health insurance, a competitive salary and loan repayment. Accepts J1 and H1B visa candidates. 5 days a week/40-hour week required. FL687-PED... 

Matrix Service Inc.

IPTW Pipe Welder Job at Matrix Service Inc.

 ...Job Description Job Description PRIMARY FUNCTION: Perform welding functions per jobsite specifications; covering various welding procedures, brazing, and cutting on all types of pipe in a industrial construction environment. TYPICAL DUTIES: Actively support... 

Good Samaritan

RN - Registered Nurse - Miller - FT - Day Job at Good Samaritan

 ...Careers With Purpose Join our not-for-profit organization that has provided over 100 years of housing and services to seniors with a commitment to quality care and service in a Christian environment. Facility: GSS SD Miller Prairie Ctr Location: Miller...