Data Structure - First Analysis

Owned by Michael Rans
Oct 18, 2016
3 min read

Some spreadsheets have "master list" in the title and some do not.

Taking the latest master list for a few countries, unfortunately we see that the DTMs do not have a fixed structure. 

Below are examples of different headings for various DTM spreadsheets:

Libya: rd4_DTM_Master_List_Jun2016.xlsx

This is at an aggregated rather than survey level, has several sheets and 2 rows of headers for the main sheet entitled "1-DTM Round 4 Dataset":

Shabiya_Name_ENBaladiya_IDBaladiya_Name_ENBaladiya_Name_ARLatLongis area assessed by DTM? (Y,N)IDP HouseholdsIDP IndividualsIDP households displaced in 2011Type of Displacement 2011Baladiya of Origin 2011IDP households displaced 2012- mid-2014Type of Displacement 2012- mid-2014Baladiya of Origin 2012- mid-2014IDP households displaced after mid-2014Type of Displacement after mid-2014Baladiya of Origin after mid-2014Migrant Individuals in BaladiyaMigrant Individuals in Detention Centers in BaladiyaMigrant Individuals crossing BaladiyaReturnee HouseholdsReturnee Individualshouseholds displaced by general violence reasonshouseholds displaced by special security reasonshouseholds displaced by economic ReasonsArea have IDPs in Rented_House_PaidArea have IDPs in Rented_House_NotPaidArea have IDPs with Host community - relativesArea have IDPs with Host community - non-relativesArea have IDPs in schoolsArea have IDPs in Public_BuildingArea have IDPs SquattingArea have IDPs in Unfinished_BuildingArea have IDPs in Abandoned_ResortsArea have IDPs in Collective_NonFormal settlementsArea have IDPs where shelter type is unknown
ADM2_Shabiya_Name_ENADM3_Baladiya_IDADM3_Baladiya_Name_ENADM3_Baladiya_Name_ARLatitudeLongitudeArea assessed by DTMIDPs In Baladiya_HHIDPs In Baladiya_INDIDPs In Baladiya HH_2011Origin Type 2011Origin 2011IDPs In Baladiya_HH 2011_2014Origin Type 2011_2014Origin 2011_2014IDPs_In_Baladiya_HH 2014+Origin Type 2014+Origin 2014+Migrants in BaladiyaMigrants in Detention CenterCrossing MigrantsReturnees HHReturnees IndDisplacement for violenceDisplacement for SecurityDisplacement for EconomicRented accommodation (self-pay)Rented accommodation (paid by others)Host families who are relativesHost families who are not relativesSchoolsOther public buildingsSquatting on other people’s properties (e.g. in farms, flats, houses)In unfinished buildingsIn deserted resortsIn Informal Settings (e.g. tents, caravans, makeshift shelters)Unknown


Nigeria: rd10_DTM_Master_List_Jun2016.xlsx 

This is at an aggregated level and has just one sheet "Sheet1" with a single line header:


LGAWARDSTATUSLATITUDELONGITUDESITE MANAGEMENT AGENCY (SMA)SMA TYPEREGISTRATION ACTIVITYSUPPORT WASHSUPPORT HEALTHSUPPORT SHELTER/NFISUPPORT FOODSUPPORT PROTECTIONSUPPORT EDUCATIONSUPPORT LIVELIHOODSITE CLASSIFICATIONSITE TYPELAND OWNERSHIPCOMMON SHELTER TYPENO OF HOUSEHOLDSINFANTS MALEINFANTS FEMALECHILDREN MALECHILDREN FEMALEYOUTH MALEYOUTH FEMALEADULT MALEADULT FEMALEELDERLY MALEELDERLY FEMALETOTAL NUMBER OF IDPSPREVIOUSLY BEEN DISPLACEDINTENDED RETURN AREAWHY NOT RETURNNO SHELTERTENTSMAKESHIFTINDOORSACCESS ELECTRICITYACCESS SAFE COOKINGHAVE PRIVATE AREASHAVE MOSQUITO NETSMOST NEEDED NFIWATER SOURCE LOCATIONDRINKING WATER SOURCEWATER CONSUMPTIONDRINKING WATER POTABLEDRINKING WATER QUALITY COMPLAINTSLATRINE CONDITIONFUNCTIONING TOILETGARBAGE DISPOSALSOLID WASTE PROBLEMHAND WASHING STATIONSHYGIENE PROMOTION CAMPAIGNOPEN DEFECATIONACCESS TO FOODACCESS TO MARKETDISTRIBUTION FREQUENCYOBTAINING FOODMALNUTRITION SCREENINGMOST PREVALENT HEALTH PROBLEMACCESS TO MEDICINEACCESS TO HEALTH FACILITYLOCATION HEALTH FACILITYHEALTH FACILITIES PROVIDERACCESS TO EDUCATIONEDUCATION LOCATIONATTENDING SCHOOLMAJORITY OCCUPATIONACCESS TO INCOMELIVESTOCKCULTIVATION

Iraq: rd_50_DTM_Master_List_July2016.xlsx

This is at an aggregated level and has two sheets. The main sheet is "DTM DATASET" with a two line header:


Location of Displacement

Governorate of originShelter typePeriod of displacementLink for Map
Place idGovernorateDistrictLocation name
in English		Location name
in Arabic 		LatitudeLongitudeOCHA
admin 1		OCHA
admin 2		OCHA
PCode		FamiliesIndividualsAnbarBabylonBaghdadBasrahDahukDiyalaErbilKerbalaKirkukMissanMuthannaNajafNinewaQadissiyaSalah al-DinSulaymaniyahThi-QarWassitCampHost familiesHotel/MotelInformal settlementsOther shelter typeReligious buildingRented housesSchool buildingUnfinished/Abandoned buildingUnknown shelter typePre-June14 June-July14 August14Post September14 Post April15 Post March16Open Street MapGoogle MapBing Map


Yemen: r4_DTM_Master_List_Apr2016.xlsx

This has aggregated level data in different sheets. Sheet "Returnee hybrid data Locationlv" which has a single line header:

AreaAssessmentIDAssessmentRoundGovernorateGovernoratePCodeDistrictENDistrictPCodeRetIDPsFromDistrict_HHOfficialPlaceENPCodeReturnee_ConflictHHReturnee_DisasterHHReturnee_AccessibilityReturnee_WomenPerReturnee_MenPerReturnee_FemChildPerReturnee_MaleChildPerLatitudeLongitude

Sheet "IDPs Raw data" has this single line header:


AreaAssessmentIDAssessed GovernorateGovernorate PCodeAssessed DistrictDistrict PCodeInterview DateAssessment RoundSite NameSite Name ASite PCodeLatitudeLongitudeSite TypeHH IDPs in DistrictIndividual IDPs in DistrictArrival YearArrival Month in 2015Site Estimated Conflict HHsSite Estimated Disaster HHsSite Estimated IDPs HHsFamily SizeAccessibilityWomen %Men %Female Children %Male Children %Women Estimeted #Men Estimeted #Female Children Estimeted #Male Children Estimeted #CampsUsing rented accomodationWith host families who are relatives (no rent fee)With host families who are not relatives (no rent fee)Using schools, Health facilities, religious buildingUsing private or public buildingIn informal settlement (grouped families) in urban areasIn informal settlement (grouped families) in rural areasOut of settlement (isolated families)


Common Fields

From the headers above, there are certain fields which are common to all. These are:

  1. Latitude
  2. Longitude
  3. Location Name (ward, district etc.)
  4. Families/Households (most DTMs contain the number of individuals as well as the number of households; individuals and households are the key indicators for the DTM, and most of the other columns are disaggregation facets).
  5. Type of shelter (although this is represented in different ways eg. individual columns for each type or one column with the type)