Class is Now in Session

Presenting The Data School, an educational video series for people who work with data

Learn More

What’s the Difference Between Structured and Unstructured Data?

May 15, 2020

Structured and unstructured data are both used extensively in data analysis but operate quite differently. Let’s take a closer look at these two data formats to understand just how different structured data and unstructured data are. 

Structured data vs unstructured data

Searchability is often used to differentiate between structured vs unstructured data. Structured data typically contains data types that are combined in a way to make them easy to search for in their data set. Unstructured data, on the other hand, makes a searching capability much more difficult. 

Structured data is easily detectable via search because it is highly organized information. It uploads neatly into a relational database (think traditional row database structures) and lives in fixed fields. It’s the data that most of us are used to working with in order to analyze largely quantitative problems—think “how many products have been sold this quarter” or “how many customers have subscribed to the monthly newsletter,” for example. 

Examples of structured data include: 

  • Dates
  • Phone numbers
  • ZIP codes
  • Customer names

So what is unstructured data? Unstructured data may have its own internal structure but it does not conform neatly into a spreadsheet or database. It includes everything outside the bounds of structured data. It may be generated from a human or a machine; it can be text or images. 

While unruly in nature, it is also incredibly valuable—unstructured data has the potential to depict a complex web of information that offers strong clues about future outcomes. Think of customer web chats, for example, a platform where customers commonly air out their complaints and troubleshooting questions. Analyzed as a whole, this web chat data can help guide companies on what to prioritize resolving or what aspect of the product is driving the most interest. Or social media data, which can signal customer buying trends before they even start searching for a product. If structured data has historically been a company’s backbone, unstructured data is its competitive edge.  

Examples of unstructured data include: 

  • Web logs
  • Multimedia content
  • Email
  • Text files

Semi-structured data: neither structured nor unstructured

Semi-structured data is often left out of the structured vs unstructured data conversation, but it’s worth mentioning. At first glance, semi-structured data seems very messy, which might prompt you to ask, if this is semi-structured data, what is unstructured data?

In reality, semi-structured data has characteristics of both structured and unstructured data—it doesn’t conform to the structure associated with typical relational databases as structured data does, but it also has some structure in the form of semantic markup, which enforce hierarchies of records and fields within the data. 

Examples of semi-structured data include: 

  • XML 
  • JSON 

Storing and analyzing structured and unstructured data

Structured data is relatively simple to enter, store, query, and analyze, but it must be strictly defined in terms of field name and type (e.g. alpha, numeric, date, currency), and as a result is often restricted by character numbers or specific terminology. Analysts typically use simple or more complex VLOOKUP queries in Excel spreadsheets or Structured Query Language (SQL) to perform queries on structured data within relational databases. 

On the other hand, developments in preparing and analyzing unstructured data are fairly recent. New data storage systems, such as data lakes, have allowed organizations to make great strides in capturing and storing unstructured data, since it allows data to be stored in its raw format. However, the fundamental challenge of unstructured data sources is that they are difficult for nontechnical business users and data analysts alike to unbox, understand, and prepare unstructured data for analytic use. 

Though there’s a lot of talk about the difficulty in managing today’s volume of data—which is certainly a challenge—leveraging a reasonable amount of highly unstructured data can be equally trying. 

The future of data

What is unstructured data? Another answer might be: the future. By 2025, 80% of all data will be unstructured, and many organizations have reached that ratio already. There is undoubtedly a huge opportunity ahead with unstructured data sources, yet it poses the greatest challenge to organizations in terms of being able to access and analyze that data. 

What’s more, organizations likely won’t be just using unstructured data, but some combination of structured, unstructured or semi-structured data. Take the use case we mentioned earlier about the web chat data, for example. It’s worthwhile to analyze customer web chat text, but the analysis would be made much more valuable should the company be able to tie that text data to structured customer information stored neatly in a CRM. 

The challenge is accessing, preparing and combining this data in order to make sense of it—especially among business analysts who weren’t trained in computer engineering techniques. 

Data preparation for structured and unstructured data

Through our modern data preparation techniques, Trifacta enables both structured data and unstructured data preparation, analysis, and visualization. Trifacta’s intuitive interface empowers everyone—even the most non-technical of users—to interactively explore and prepare simple and complex data sources in order to execute data analytics.

Analysts can easily combine their current likely structured data with unstructured data, such as mapping social media with customer and sales automation data, for example. No matter the complexity and variance, Trifacta permits users to leverage the data they need early on in order to generate the right outputs for better decision-making.  If your next data analysis project involves putting structured data together with unstructured data, consider using Trifacta.

Related Posts

Data Discovery Tools: The Wave of the Future

As more companies demand big data backed decision making, data discovery tools are rising to the occasion.... more

  |  June 23, 2016

Not Your Dad’s Analytics and Business Intelligence

The world of analytics and business intelligence is changing. The explosion of size, scale, and variability... more

  |  August 6, 2016

Commit to Clean Data: Ensure Transparency

We’ve covered a lot of ground in our Clean Data Manifesto series, outlining the 5 tenets of clean data.... more

  |  September 12, 2018