Phase 3: Data Preparation in CPMAI
Data Preparation is the third of six stages of the CPMAI methodology. This is where a team prepares data by cleansing, transformation, labelling, and validation. This stage consumes approximately 80% of time in typical AI projects. In the context of the CPMAI methodology, this stage is more important than selecting the appropriate algorithm in the subsequent stage. A good algorithm when used on poor quality data results in a poor model. On the other hand, using a less sophisticated algorithm on data that has been prepared, will yield a better model. Therefore, the quality and work done in the Data Preparation stage directly impacts the quality of the modeling process.
What Makes Data Preparation Distinct from Other Stages of CPMAI?
The goal of the Data Preparation stage is to take the raw data confirmed to be available in the preceding Data Understanding stage and convert it to clean and ready to use data for the modeling process. The Data Understanding stage confirms the availability of data. Many teams incorrectly assume that the Data Understanding stage also confirms the usability of data. This leads to a significant underestimation of this stage of the process, as the work required for data to be available and usable is substantially different.
Data Preparation Includes What Activities? 
In the process of Data Preparation, five activities focus on: cleaning data, transforming data, labeling data, checking the quality of data, and documenting compliance. Each activity progressively bridges the gap between the data assessment in Phase 2 of the process and a data set that is appropriate for training a model.
|
Activity |
Output |
|
Data Cleaning |
No duplicate data, no unprocessed missing values, and no data errors |
|
Data Transformation |
Conversion of data to a form and structure that is comprehensible to the model |
|
Data Labeling |
Data that has been consistently labeled for supervised learning |
|
Quality Check |
Checking that the prepared data meets the criteria defined in Phase 2 |
|
Compliance Documentation |
Documentation and data that shows traceability related to compliance and privacy |
What Is Data Cleaning In This Phase?
What Does It Mean To Transform Data Into Model-Ready Form?
How do you label data for supervised learning? 
What Are Some Examples of Validating Prepared Data Before Model Development?
What Are Some Examples of Documenting Data Lineage and Compliance?
What Result Do We Get from Data Preparation?
There are two key results of the Data Preparation process. The first and most important result is a dataset that satisfies the requirements of the model. The other equally important result is a description of the processes performed to clean, transform, and label the data. The model development phase begins with this result and any data quality issues that are not resolved will carry over to the model training phase.
|
Output |
Description |
|
Clean, Model-Ready Dataset |
Cleaned, transformed, and labeled data along with data lineage and compliance documentation. |
What If We Hurry and Skip Data Preparation?
How Does Data Preparation Relate to the PMI-CPMAI Exam? 
Data preparation falls under Domain III of the PMI-CPMAI exam in the area of Identifying Data Needs. Approximately 26% of the exam covers Identifying Data Needs and Data Understanding. Multiple questions on data preparation will likely assess the quality of data, how data is labeled, and the existence of compliance documents. The PMI Exam Content Outline combines all the activities of the readiness of the data in one domain; therefore, separation of activities by phases will not occur.
Where Does Data Preparation Fall in the Full CPMAI Methodology?
The CPMAI methodology has six phases, and data preparation is one of them. For more detail and to see where this phase falls in Business Understanding, Data Understanding, Model Development, Model Evaluation, and Model Operationalization, see The CPMAI Methodology: 6 Phases Explained.
Where Can You Find Opportunities to Apply Data Preparation?
For training opportunities on the CPMAI methodology, including data preparation, PMTI offers live instructor-led training through its CPMAI Certification Training.
Phase 3: Data Preparation FAQs
Why does Data Preparation take up so much of an AI project’s time?
Most teams usually underestimate the amount of work involved in the cleaning and the judgment required in the data transformations and the subsequent labeling and validation of the data. Furthermore, it is common to find serious quality issues that require data to be iteratively cleaned and transformed.
What does data leakage mean in the context of the steps of Data Preparation?
Data leakage describes a situation where training data incorporates information that a model should not use when making predictions. As a result, it yields excellent test performance and poor actual performance. Data Preparation’s validation step is the correct step to address this situation.
Data cleaning versus data transformation, what’s the difference?
Data cleaning comprises the elimination of errors, removal of duplicates, and filling of missing values. Data transformation is the restructuring of clean data so that it conforms to the requirement of the model’s architecture. Both have to be done, and in that order.
Which PMI-CPMAI exam domain includes Data Preparation?
Domain III: Identify Data Needs, which is the same Domain that includes Data Understanding performed as a prerequisite to the next step in Data Preparation, and comprises 26% of the questions likely to appear on the exam.




