Process COD-AB

Owned by FIS (Unlicensed)
Aug 28, 2017
2 min read

Overview

The processing phase cleans and standardizes the COD-AB and can be the most resource and time intensive stage of the COD cycle if the quality of the data is low. The COD-AB should meet the Gold Star standard quality checklist. This processing should be documented in the metadata. The processing does not need to be done in isolation by one group; the workload can be shared (see list of potential partners). A check should be done to see if any a new COD-PS datasets are available as this may impact COD-AB processing. The result of this process is a Candidate COD.

There are six types of processing to focus on with COD-AB

    1. Cleaning of topological;errors (gaps, overlaps)
    2. Cleaning attribute errors (names and P-codes)
    3. Ensuring parentage between administrative boundaries
    4. Adhering to standardization of items (column headings)
    5. Creation of standard for spatial data (projection, inclusion of UTF-8 if required)
    6. Ability to link to COD - Population Statistics (via P-code)


StepStep Details      Tips
1. Check in with data sourceContact data source before any processing is started to:
  • determine whether a new version is available 
  • notify them that data will be processed
  • check if they will adopt the dataset after
  • This step only needs to be done if data source is not part of IM network
  • The data sponsor should contact the data source 
  • Ask the data source what role they can play in the processing phase
  • If the data source is not going to take the improved dataset, consider the impact on the COD  next time they update their dataset
  • Discuss possible exceptions to errors; 
2. Plan processing
  • Identify who can help with process
  • estimate the amount of time required to process
  • Check to make sure there is not a new Populatiuon Statistics dataset available that may impact the processing of the COD-AB
  •  Check with partners who can help with processing; discuss the problems with partners and see if there are experts that can help
  • Consider ITOS to do the processing
  • add details to the COD Data Plan

3.Process data

Process data an keep track of changes made for metadata and to explain to partners in the endorsement phase. A Candidate COD is created from this.
  • If ITOS is not being used to process the data, use the COD-AB Gold Star Quality Checklist; to guide the processing and track changes being made in this.
  • If unsure how to process use the ITOS White Paper: COD Evaluation and Candidate Creation as a reference
  • Add additional metadata and other information to the COD Data Plan started in the planning phase
  • For errors that cannot be corrected or if data looks incorrect but is not include notes / explanation in the metadata. Examples include: 
    • Ideally all topological errors can be fixed but if they cannot be list those that have issues
    • Names truncated for in-country reasons are acceptable

Resources