COVID-19 forced the Washington State Department of Health to speed up efforts to move analytics to the cloud. The scale of data coming in from legacy transactional systems and reference tables from hospitals, schools and clinic sites overwhelmed their traditional processes and virtual machines did not resolve the problem. Public Health has been underfunded for the past 50 years and our data systems reflect that. Nearly every data system had been built for a single purpose, overly customized and is not interoperable with other systems. Public health response requires a rapid data analysis to inform decision-making and public health action. Consequently, before one can analyze data they have to conduct long and painstaking work to clean, transform, standardize and restructure data before it can be queried. The tools to simplify or centralize this process were not available, causing both a long time to insight and a great amount of duplicative work done by agency analysts.
How Trifacta Solved this Problem
Trifacta sits within the internal CEDAR (Cloud Environment for Data Analytics and Reporting) platform on Microsoft Azure. Here, data scientists can access the raw data and create analytics-friendly tables for program analysts. Program analysts can then access these usable data sets and rapidly explore, clean, standardize and transform data in the cloud for analytics. Trifacta has been intuitive for analysts and allows them to perform familiar functions much more easily in Trifacta than in R or SAS. Data quality epis love the easy standardization, the different clustering algorithms and the ability to turn free text into categorical data quickly.
Clean consumable analytics-ready datasets allows for the ability to extract insights from massive data that was being collected, but not analyzed.
Trifacta has allowed WA DoH to build workflows that update tables for complex analysis across a number of teams and has reduced time spent by analysts working independently on data prep by 25%.
Established data pipelines that teams can create, share centrally and manage themselves without IT has created a self-service culture. Breaking the dependency on IT.
The Washington State Department of Health is a state agency of the state of Washington. Headquartered in Olympia, WA, the agency was created by the state legislature in May 1989 after splitting from the Washington State Department of Social and Health Services.It’s programs and services help prevent illness and injury, promote healthy places to live and work, provide information to help people make good health decisions and ensure the state of WA is prepared for emergencies.
“One of the biggest challenges with public health data systems is finding the right tools to invest in that can meet us where we are - in both skills and infrastructure - and help us transition to new methods and flexible and scalable environments. Experienced epidemiologists have survived countless attempts to address gaps with tools that don’t benefit the analyst or fix the problem. Our workforce is exhausted from COVID and we need to invest in tools that make their lives easier. Trifacta has been the easiest tool to introduce to epidemiologists. The interface is intuitive, and the visual profiling allows them to quickly dive into the data faster than ever before.”