Description

Failures like the Silicon Valley Bank in 2023 is the extreme result of not accurately calculating risk in a timely manner. Nearly every financial institution has a focus on minimizing risk, but the way we calculate that inherently requires close analysis of categorical data and relationships. Yet the majority of our algorithms only work on static, numeric data. That means persisting the data, converting it using something like one hot encoding into numerical data that is bloated, sparse, and slow to analyze, then after analysis, often having to convert again to figure out the original categories. This is painfully slow, with the state of the art being measured in hours. If we could shift that analysis left, process the original categorical data as it streams in, without modification, that could cut mean time to insight down to seconds, and possibly save financial institutions some large dollar signs. That could also enable many other options, such as using graph NLP on flowing data, finding novel behavior, detecting anomalies such as cyber-attacks before they affect systems. The speed of an in-line data processing engine like Flink or KsqlDb combined with graph algorithms and categorical analysis is uniquely powerful. Come learn about a new open source streaming intelligence system that changes the game for risk analysis and other fast categorical data processing.

Details

July 12, 2024

10:45 am

-

11:20 am

Bread Financial Room AB (Union AB)

Add to Calendar

Track:

Data Engineering & Management

Level:

Advanced

Tags

Data Management
Data Management
Data Analytics
Data Analytics
Threat Analysis
Threat Analysis

Presenters

Paige Roberts
Director of Product Innovation
thatDot

Bio

I’ve worked as a software engineer, trainer, support tech, docs writer, marketer, product manager and consultant in the last 25 years. I may not be able to decide what I want to be when I grow up, but I’ve at least stuck to the data management and analysis field. Co-wrote and contributed to a few O’Reilly books: “97 Things Every Data Engineer Should Know,” “Accelerate Machine Learning with a Unified Analytics Architecture,” and “Up and Running with Aerospike.” These days I work for startup thatDot, makers of open source Quine, and inventors of streaming graph data processing and analytics.