|
Change #35638
2015-08-17
22:22:09
|
update
Calagator::Event
1250468938
Portland Linux/Unix Group Advanced Topics
Roll back
| description |
PLUG Advanced Topics
Using Mozilla's Heka project for log and event stream processing
Full description to come. |
→ |
Portland Linux/Unix Group Advanced Topics Meeting Announcement
Who: Nathan Williams<br>
What: Using Mozilla's Heka project for log and event stream processing<br>
Where: Free Geek, 1731 SE 10th Avenue, Portland (Left Entrance)<br>
When: Tuesday, August 18th, 2015 at 7pm<br>
Why: The pursuit of technology freedom<br>
Stream: http://pdxlinux.org/live/
Talk: A Practical Introduction to Scalable Stream Processing with Heka and how the log and event processing system at Treehouse has evolved from a typical Elasticsearch/Logstash/Kibana setup into a Heka-based system. We will also discuss the why behind this move and where we are headed.
Heka is an open source stream processing software system developed by Mozilla. Heka is a “Swiss Army Knife” type tool for data processing, useful for a wide variety of different tasks, such as:
* Loading and parsing log files from a file system.
* Accepting statsd type metrics data for aggregation and forwarding to upstream time series data stores such as graphite or InfluxDB.
* Launching external processes to gather operational data from the local system.
* Performing real time analysis, graphing, and anomaly detection on any data flowing through the Heka pipeline.
* Shipping data from one location to another via the use of an external transport (such as AMQP) or directly (via TCP).
* Delivering processed data to one or more persistent data stores.
https://github.com/mozilla-services/heka
Nathan is a sysadmin by trade who's been into Linux, automation and data for the last 10 years and is currently working at Treehouse as a systems developer. |
| title |
Portland Linux/Unix Group Advanced Topics |
→ |
Portland Linux/Unix Group Advanced Topics: Using Mozilla's Heka project for log and event stream processing |
|