Trifacta wins the Best Data-Driven SaaS Product award at the 2021 Annual Cloud & SaaS Awards

Start Free

Speed up your data preparation with Trifacta

Free Sign Up
Summer of SQL

A Q&A Series with Joe Hellerstein

See why SQL is Back
 
All Templates

Understand Data Better by Creating Combination Pairs from Correlation Analysis

Stock portfolio analysis Flow The flow view of this template

Transformations:
correl, deduplicate, join, pivot, $filepath

This template flow shows how you can create combination pairs for correlation analysis from example stock performance data (that you can obtain by using one of the Yahoo Finance APIs). It makes use of Trifacta’s cross join capabilities as well as the correl transform.

The flow reads from a set of files in a specific folder that are parameterized. Each file represents performance data for a particular stock, the ticker of the stock is accessed via the $filepath variable. It then creates combination pairs of stocks for correlation analysis by cross joining against itself as well as date of the performance data. Finally to get to the correlation, it makes use of the correl transform function. You can use the techniques in this example flow for many other similar use cases.

For more information, please see transformation function documentation for correl.

USE IN TRIFACTA USE IN DATAPREP

New user?

Use the buttons above and start your 30-day free trial. If your data is mostly on Google Cloud Platform, please use Dataprep. Otherwise, choose Trifacta.

Learn more about Dataprep