Twitter
Facebook
LinkedIn
Google+
YouTube
Get more
Help Promote graphics!
Data Storage at Librato
LISA: Where systems engineering and operations professionals share real-world knowledge about designing, building, and maintaining the critical systems of our interconnected world.
The LISA conference has long served as the annual vendor-neutral meeting place for the wider system administration community. The LISA14 program recognized the overlap and differences between traditional and modern IT operations and engineering, and developed a highly-curated program around 5 key topics: Systems Engineering, Security, Culture, DevOps, and Monitoring/Metrics. The program included 22 half- and full-day training sessions; 10 workshops; and a conference program consisting of 50 invited talks, panels, refereed paper presentations, and mini-tutorials.
David Josephsen, librato.com
Librato runs a multi-tenant time-series data storage, analysis, and alerting platform as a service. In this talk we describe our internal data processing and storage infrastructure, which relies heavily on Apache’s Storm and Cassandra projects to process around 250k writes per second and store roughly 10 billion data samples. We give infrastructure details, recounting our initial design decisions as well as various scaling challenges that have forced us to refactor our storage designs. Finally we relate the system and performance metrics that we’ve found useful in monitoring our storage infrastructure.
David Josephsen, Librato
As the developer evangelist for Librato, Dave Josephsen hacks on tools, writes about statistics, systems monitoring, alerting, metrics collection and visualization, and generally does anything he can to help engineers and developers close the feedback loop in their systems. He writes the "iVoyer" column on systems monitoring in ;login: magazine.
LISA16 Open Access Sponsored by Bloomberg
Open Access Media
USENIX is committed to Open Access to the research presented at our events. Papers and proceedings are freely available to everyone once the event begins. Any video, audio, and/or slides that are posted after the event are also free and open to everyone. Support USENIX and our commitment to Open Access.
author = {David Josephsen},
title = {Data Storage at Librato},
year = {2014},
address = {Seattle, WA},
publisher = {USENIX Association},
month = nov
}
connect with us