Viewing 0 current events matching “datapdx” by Date.

Sort By: Date Event Name, Location , Default
No events were found.

Viewing 3 past events matching “datapdx” by Date.

Sort By: Date Event Name, Location , Default
Thursday
Mar 10
Data PDX: Quine, A Streaming Graph for Modern Data Pipelines
Google Meet

Presented by Ryan Wright, Founder, thatdot.com Abstract

This talk will introduce Quine: a brand new open source “streaming graph interpreter” meant as a new fundamental infrastructure component to address major challenges in data engineering and simplify enterprise data pipelines.

Quine fits in between the world of databases and stream processing systems. As data streams in from Kafka, Kinesis, etc., Quine builds it into a graph. Then using “standing queries”—queries that live inside the graph and efficiently propagate—it finds matches to complex patterns in the graph and streams the results out right away. Quine maintains a stateful representation of all data streamed through (like a database) so that complex results are built from the combination of new streaming data and potentially very old data—all without having to manage any time windows. Since the graph is fully versioned, you can always query for what the data used to be, at any historical moment. Quine is meant to be a complete package of everything that lives between two Kafka topics: high-volume events stream in, and highly-meaningful interpreted results stream out.

In this talk, we will explain the how Quine works under the hood, discuss some of the interesting and brain-bending challenges we had to confront in order to create it, and show some uses cases to illustrate why it’s important for modern data pipelines. Quine implements a property-graph data model on top of an asynchronous graph computational model. It’s like Pregel with Actors. Each node is capable of performing arbitrary computation, so we can bake in some powerful capabilities deep in the graph; and then package it up for easy use into user-contributed “recipes” available in the Github repo. Quine is free and open and the repo will be publicly available in February, and actively supported by thatDot and the community.

What You Will Learn This talk will introduce Quine: a brand new open source “streaming graph interpreter” meant as a new fundamental infrastructure component to address major challenges in data engineering and simplify enterprise data pipelines.

RSVP for Google Meet or Zoom link

Cost Free! (suggested donation $5-15 for non-members)

If you’ve paid any Data PDX/DAMA membership dues during 2019-2021 or are an employee of a corporate member, please choose Member RSVP.

Where

RSVP for Google or Zoom link

Date – Thursday, March 10th

Time – 4:30pm – 5:30pm

Website
Thursday
Apr 21
Data PDX: Enterprise Data Catalogs with Alation
Virtual
  • What problems do data catalogs solve?
  • Compliance, governance, analyst productivity, cloud migration
  • What are typical data catalog functionalities and what to look for
  • Demo from perspective of knowledge worker
  • Q&A
Website
Thursday
May 19
Data PDX: NIEM – The Grand Translator for Data Exchange
Virtual

Presenters

Mike Phillips – Vice president of Integrated Solutions, SLG Innovation. Co-Chair of the NIEM State, Local, Territorial and Trible Tiger Team.

Katherine Escobar – Deputy Division Chief, Data and Services Division, Cyber and Command, Control, Communications and Computers Integration (DD C5I), Joint Staff J6

Paul K. Wormeli – Innovation Strategist, Wormeli Consulting, LLC – Co-Chair of the NIEM State, Local, Territorial and Trible Tiger Team.

Abstract

An organization’s ability to effectively serve its customers hinges on the availability of current, accurate, and relevant information. The National Information Exchange Model (NIEM) is a community-driven, standards-based approach to exchanging information. Diverse communities can collectively leverage NIEM to increase efficiencies and improve decision-making.

NIEM is a common vocabulary that enables efficient information exchange across diverse public and private organizations. NIEM can save time and money by providing consistent, reusable data definitions and reusable processes. NIEM is available to everyone, including both public and private organizations.

NIEM includes a data model, governance, training, tools, technical support services, and an active community to assist users in adopting a standards-based approach to exchanging data.

What You Will Learn

This session will provide you with a NIEM overview and some practical applications.

Website