Clean Keys Operator: Adding Missing Values

Overview

There are times when you'll want to add missing values to your data sets. You'll use the Clean Keys operator to do that. When you use data on your application, it's stored in an array. Arrays organize your data into fields or keys. Sometimes you don't have the keys or values you want in your data. The Clean Keys operator adds missing keys along with values you want to add.

For example, let's say you have a data set with employee AWS (Amazon Web Services) certification information. You want to identify the employees that aren't certified to enroll them. You'll use the Clean Keys operator to create a new key in your data to label those who need certification.

This use case demonstrates a secondary function of the operator. This operator will let you add missing fields to a data set, but you'll mainly use the Clean Keys to add missing values to existing keys.

Here's how the completed use case will look in the Module Builder:

Here's how the completed use case will look in Express View along with a look at the DevTools Console:

What You'll Learn

In this article, you'll learn how to add missing values to a filtered data set.

What You'll Need

To set up this use case, you'll need:

• 1 Data Table component

• 1 Hidden component

• 1 Data Workflow component

• 1 ViewGrid component

• 1 Button component

To set up your Data Workflow, you'll need:

• 1 Input operator

• 3 Console operators

• 1 Filter operator

• 1 Clean Keys operator

• 1 Output operator

These instructions assume you have a new module open, saved, and with a title.

Configuration

Configure the Data Table Component

First, you'll add a Data Table. You'll use this to hold your data with the employee certification information.

1. Drag and drop a Data Table component onto your canvas.

2. Enter dtAWSCertData in the Label and Property Name fields.

3. In the data table, enter the following:

   firstName	certification	accountValue	datOfBirth
   Blair	aws solutions architect	1000000	07/23/90
   JJ	none	678900	02/26/89
   Jim	none	1000000	01/04/88
   Evan	aws developer	null
   Charlotte	aws security	5000000	02/01/91
   Amy	aws database	5439294
   Brian	aws machine learning
   Rupert	none

   

4. Click Save.

Configure the Hidden Component

Then you'll add a Hidden component to store the output from your Data Workflow.

1. Drag and drop a Hidden component onto your canvas below your Data Table.

2. Enter getCert in the Property ID and Canvas Label Text fields.

3. Click Save.

Configure the Data Workflow Component

Next, you'll add your Data Workflow component. This component takes data from your Data Table and adds the certification values.

1. Drag and drop a Data Workflow component onto your canvas. Place your Data Workflow below the Hidden component.

2. Enter dwfFilterMissingKeys in the Canvas Label Text and Property Name fields.

   

Configure the Input Operator

1. Drag and drop an Input operator onto your Data Workflow canvas.

2. Configure the Input operator's Info window as follows:

   Setting	Value
   Category	Input
   Component	dtAWSCertData
   Required	Yes
   Source	Default

Configure the First Console Operator

You'll add a Console operator next. You'll use this Console to show the status of your data before it passes through the Filter operator.

1. Drag and drop a Console operator onto your Data Workflow canvas.

2. Configure the Console operator's Info window as follows:

   Setting	Value
   Category	Console
   Label	Input Data

3. Connect the output port (right) of the Input operator to the input port (left) of the Console operator.

Configure the Filter Operator

Then you'll add a Filter operator. You'll use this to remove certified employees from your data set.

1. Drag and drop a Filter operator onto your Data Workflow canvas.

2. Configure the Filter operator's Info window as follows:

   Setting	Value
   Category	Filter
   Label	Fill Needs Cert
   Do Not Sanitize Formula	Checked (yes)
   Expression	certification="none"

3. Connect the output port (right) of the Input operator to the input port (left) of the Filter operator.

Configure the Second Console Operator

Next, you'll add another Console operator. You'll use this Console to show the status of your data after it passes through your Filter.

1. Drag and drop another Console operator onto your Data Workflow canvas.

2. Configure the Console operator's Info window as follows:

   Setting	Value
   Category	Console
   Label	Filter Result

3. Connect the output port (top right) of the Filter operator to the input port (left) of the Console operator.

Configure the Clean Keys Operator

Now, you'll pass your data through the Clean Keys operator. You'll use this operator to add the Needs Certification key to the data set. The operator will also add Yes to the missing values in the new key.

1. Drag and drop a Clean Keys operator onto your Data Workflow canvas.

2. Configure the Clean Keys operator's Info window as follows:

   Setting	Value
   Category	Clean Keys
   Label	Fill Needs Cert
   Fill If	Missing
   Keys	needsCert
   Fill With	Yes

3. Connect the output port (right) of the Input operator to the input port (left) of the Clean Keys operator.

Configure the Third Console Operator

You'll add one last Console operator. This Console operator shows you the status of your data after the Clean Keys operator.

1. Drag and drop another Console operator onto your Data Workflow canvas.

2. Configure the Console operator's Info window as follows:

   Setting	Value
   Category	Console
   Label	Fill Qualify

3. Connect the output port (right) of the Clean Keys operator to the input port (left) of the Console operator.

Configure the Output Operator

1. Drag and drop an Output operator onto your Data Workflow canvas.

2. Configure the Output operator's Info window as follows:

   Setting	Value
   Category	Output
   Component	getCert
   Action	value

3. Connect the output port (right) of the Clean Keys operator to the input port (left) of the Output operator.

4. Save your Data Workflow.

Configure the ViewGrid Component

You'll need a way to show the changes you've made to the end-user. Use the ViewGrid component to show your data set with the filled data values.

1. Drag and drop a ViewGrid component onto your canvas. Place this ViewGrid component below your Data Workflow.

2. Enter gridNeedCertificates in the Label and Property Name fields.

3. Enter null in the Action field.

   Using null prevents the dashboard from showing Submit buttons on each row.

4. In the Inputs table, enter getCert for the first row of id.

5. In the Display table, enter the following: 

   Display	Formula	Heading
   firstName		First Name
   certification		Certification
   accountValue		Account Value
   dateOfBirth		Date of Birth
   needsCert		Needs Certification

   

6. Click Save.

Configure the Button Component

Finally, to trigger the Data Workflow, you'll add a Button component. End-users will use this Button to see the employees that need certification.

1. Drag and drop a Button component onto your canvas. Place this component after your  Data Table.

2. Enter btnNeedsCert in the Property ID field.

3. Enter Identify Who Needs Certification in the Label Text field.

4. Set the Button Action Type to Event.

5. Enter dwfFilterMissingKeys in the Trigger on Click field.

   

6. Click Save.

7. Save your module.

Nice job! Now that you're finished, you can preview the module in Express View. Start by opening the DevTools Console. Then, select the Identify Who Needs Certification Button. Your data will appear on the page.

In the Console, you'll see updates from your 3 Console operators. If you expand the 3 arrays, you'll see your original data table in the first Console. You'll see the changed data in the Filter Result Console array. Now, only uncertified employees appear in the data table. Since you wanted to add a new data key to the filtered results, you used the Missing feature. In the Fill Qualify Console array, you'll see the added key needsCert appear with the values Yes.

Lab

You can view this complete use case here: https://training.unqork.io/#/form/605a434fa1be432ac2f4744d/edit.