{"id":250,"date":"2012-07-10T21:11:16","date_gmt":"2012-07-10T14:11:16","guid":{"rendered":"https:\/\/blogs.ubc.ca\/fishonfarms\/?p=250"},"modified":"2012-07-11T17:41:57","modified_gmt":"2012-07-11T10:41:57","slug":"sampling-methodology","status":"publish","type":"post","link":"https:\/\/blogs.ubc.ca\/fishonfarms\/2012\/07\/10\/sampling-methodology\/","title":{"rendered":"Sampling Methodology"},"content":{"rendered":"<p><span style=\"color: #003366;\"><strong>O<\/strong><\/span>ne of the issues that we have encountered during the first week of baseline is that some of the houses that were originally selected to be part of the study are no longer eligible.<\/p>\n<p>In some instances, the mother went to Phnom Penh or the Thai border to seek work. The purpose of our study is to show the effects of <span style=\"color: #003366;\"><strong>HFP<\/strong><\/span> and <span style=\"color: #003366;\"><strong>aquaculture<\/strong><\/span> on household food security and the nutritional status of women and children. As such, <span style=\"color: #003366;\"><strong>the woman of the house must be present year-round to reap the benefits of these interventions<\/strong><\/span>. By migrating for work, a woman\u2019s nutritional status at the end of the study would not reflect the addition of HFP and aquaculture in her life. Therefore, her household is now <span style=\"color: #003366;\"><strong>ineligible<\/strong><\/span> for participation in FoF.<\/p>\n<p>In other instances, when we arrived at the house we found out that the children were over the cutoff age of <span style=\"color: #003366;\"><strong>5<\/strong><\/span> years old. This happened for a variety of reasons: some women couldn\u2019t accurately remember the date of birth (the Khmer calendar is different from ours), the selection team didn\u2019t check the proper documents to verify the child\u2019s age, or the age on the village chief\u2019s list was incorrect. It\u2019s also possible that some women provided false ages for their children because they wanted to be part of a study that provides the expensive inputs needed for HFP and aquaculture.<\/p>\n<p>In any event, our team has been scrambling to fill their spots so that we have the right sample size for the study. We\u2019ve accounted for a possible <span style=\"color: #003366;\"><strong>15%<\/strong><\/span> of houses lost due to follow up, but we want to start with the biggest sample possible to minimize that loss given how expensive and time-consuming the project is.<span style=\"mso-spacerun: yes;\">\u00a0 <\/span><\/p>\n<p>This seems like a good opportunity to discuss the <span style=\"color: #003366;\"><strong>methodology<\/strong><\/span> behind household selection. In an earlier post (<span style=\"text-decoration: underline; color: #0000ff;\"><a href=\"https:\/\/blogs.ubc.ca\/fishonfarms\/2012\/07\/01\/household-selection\/\"><span style=\"text-decoration: underline; color: #0000ff;\">Household Selection<\/span><\/a><\/span>), I briefly outlined the <strong><span style=\"color: #003366;\">criteria<\/span><\/strong> that households needed to meet to be part of FoF. However, meeting the selection criteria does not mean a household is automatically enrolled in FoF. This is, after all, a <span style=\"color: #000000;\">scientific experiment<\/span>; certain <span style=\"color: #003366;\"><strong>research principles<\/strong><\/span> must be upheld.<\/p>\n<p>In order for this to be a <span style=\"color: #003366;\"><strong>valid<\/strong><\/span> and <span style=\"color: #003366;\"><strong>reliable<\/strong><\/span> scientific experiment, we need our <span style=\"color: #003366;\"><strong>sample<\/strong><\/span> to represent our <span style=\"color: #003366;\"><strong>target population<\/strong><\/span> as closely as possible while eliminating any potential <span style=\"color: #003366;\"><strong>biases<\/strong><\/span> or <span style=\"color: #003366;\"><strong>confounders<\/strong><\/span>. We achieve this by picking the proper sampling method. FoF is using a <span style=\"color: #003366;\"><strong>multi-stage sampling strategy<\/strong><\/span>. The first stage is <span style=\"color: #003366;\"><strong>cluster sampling<\/strong><\/span>, which is a form of probability sampling that examines naturally occurring groups such as villages. The second stage is <span style=\"color: #003366;\"><strong>systematic sampling<\/strong><\/span>, which is used to select the houses in the villages by picking a random point to start (eg the fourth house on the list) and continuing through the list in a systematic fashion (eg every fourth house on the list). A few <strong>key definitions<\/strong> are needed at this point:<\/p>\n<ul>\n<li><span style=\"color: #003366;\"><strong>Valid<\/strong><\/span> \u2013 we are measuring what we say we are going to measure<\/li>\n<li><span style=\"color: #003366;\"><strong>Reliable<\/strong><\/span>\u00a0\u2013 our measurements are as accurate as possible<\/li>\n<li><span style=\"color: #003366;\"><strong>Probability sampling<\/strong><\/span> \u2013 the entire target population is known, and thus everyone in that population has an equal chance of being selected<\/li>\n<li><span style=\"color: #003366;\"><strong>Randomization<\/strong><\/span> \u2013 picking units (in our case, villages) at random to ensure the sample is representative of the target population<\/li>\n<li><span style=\"color: #003366;\"><strong>Target Population<\/strong><\/span> &#8211; the population we want to study, as defined by certain parameters (eg location, age, SES)<\/li>\n<\/ul>\n<p>First, we looked at all of the villages in the province of <span style=\"color: #003366;\"><strong>Prey Veng<\/strong><\/span> on a list from the most recent census conducted by the <span style=\"color: #003366;\"><strong>Ministry of Planning<\/strong><\/span>\u00a0in 2008. We excluded the villages that had already been part of a HFP program by HKI that was funded by the EU, the villages that are part of the ongoing <span style=\"color: #003366;\"><strong>ODOV<\/strong><\/span>\u00a0(Organization for Development of Our Villages &#8211; one of our partner NGOs) food security project, and the villages that are taking part in other Cambodian NGO projects. This left us with 164 villages in\u00a0<span style=\"color: #003366;\"><strong>4<\/strong><\/span> districts: <span style=\"color: #003366;\"><strong>Ba<\/strong> <strong>Phnum<\/strong><\/span>, <span style=\"color: #003366;\"><strong>Kamchay<\/strong> <strong>Mear<\/strong><\/span>, <span style=\"color: #003366;\"><strong>Me<\/strong> <strong>Sung<\/strong><\/span>, and <span style=\"color: #003366;\"><strong>Svay<\/strong> <strong>Antor<\/strong><\/span>. Then the villages were <span style=\"color: #003366;\"><strong>randomized<\/strong><\/span>, resulting in 120 villages with 40 villages per group (HFP, HFP + aquaculture, or comparison) being selected.<span style=\"mso-spacerun: yes;\">\u00a0 <\/span>Finally, 30 out of 40 villages were selected after further randomization.<\/p>\n<p>Workers from the ODOV went into the field and met with the\u00a0<span style=\"color: #003366;\"><strong>village chiefs<\/strong><\/span>\u00a0(and in some instances, a village council) to divide the households with children under the age of five into <span style=\"color: #003366;\"><strong>3<\/strong><\/span> categories: <span style=\"color: #003366;\"><strong>poorest<\/strong><\/span>, <span style=\"color: #003366;\"><strong>poor<\/strong><\/span>, and <span style=\"color: #003366;\"><strong>medium<\/strong><\/span> wealth. They wrote their wealth ranking assessment for each household on a slip of paper that was placed into a box to maintain anonymity. This was done because it was our intention to try to help those most in need.<\/p>\n<p>The ODOV and the village chiefs met with the households categorized as poorest or poor to explain the project to them and to ask if they were interested in joining. If they responded \u201c<span style=\"color: #003366;\"><strong>yes<\/strong><\/span>\u201d, field staff went to the house to make sure it met the selection criteria. They made sure that each house had enough land to support HFP farms and fish ponds, and they assessed whether or not the house would be able to maintain these projects during the course of our study. They also inquired about the ages of the children, most often by looking at the village chief\u2019s list of villagers, but as we\u2019ve discovered this list isn\u2019t always correct.<\/p>\n<p>A list of all eligible households was sent back to HKI. The houses categorized as poor or poorest were listed, and from that list we began with the <span style=\"color: #003366;\"><strong>4th<\/strong><\/span>\u00a0house and picked every 4th house after that. We were able to find <span style=\"color: #003366;\"><strong>10 eligible houses<\/strong><\/span>\u00a0in each village by using this method. The ODOV received a list of selected households and went to the village chief to inform him of the date and time of the survey.<\/p>\n<p>In the field, each supervisor brings his or her list of 10 households per village that have been selected for the study. Sometimes, something goes amiss and the household is no longer eligible (for all of the reasons I listed above). Then we have 2 options: 1, we pick another house categorized as poor on the ODOV list that wasn\u2019t originally selected during the systematic sampling; or 2, we go back to the very first list that the ODOV produced (the one that listed all the households in the village before the wealth ranking) and we discuss with the chief whether or not picking a new house from that list is a good idea. This means that sometimes we will get houses that vary in socioeconomic status (SES). Ideally, we\u2019d like to control for SES before we collect data, but our survey includes a module about household income and wealth that will allow us to control for SES after the data has been collected.<\/p>\n<p>Once we have our 10 houses picked in the village, we hold a <span style=\"color: #003366;\"><strong>lottery<\/strong><\/span> to randomly select <span style=\"color: #003366;\"><strong>5 houses<\/strong><\/span> to participate in the <span style=\"color: #003366;\"><strong>24-hour recall<\/strong><\/span> and <span style=\"color: #003366;\"><strong>blood analysis<\/strong><\/span> components of our study. Slips of paper with the numbers 1 through 10 are placed faced down, and <span style=\"color: #003366;\"><strong>5 slips<\/strong> <strong>are drawn<\/strong><\/span>. Those houses are highlighted on the list. If, for some reason, we have to replace a house that has been highlighted, the replacement house is automatically assigned to be part of the 24-hour recall and blood draw. The enumerator goes to the house to conduct the 24-hour recall and to <span style=\"color: #003366;\"><strong>obtain consent<\/strong><\/span>\u00a0(very important) for the blood draw. The woman is given a slip of paper that has her unique identifier and the time and location of the blood draw. We are only conducting recalls and collecting samples from <span style=\"color: #003366;\"><strong>450 women<\/strong><\/span> (half of the women in the study) because the recalls are time-consuming and the blood collection is invasive and expensive.<\/p>\n<div id=\"attachment_253\" style=\"width: 410px\" class=\"wp-caption aligncenter\"><a href=\"https:\/\/blogs.ubc.ca\/fishonfarms\/files\/2012\/07\/lottery.jpg\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-253\" class=\"size-full wp-image-253\" title=\"Lottery\" src=\"https:\/\/blogs.ubc.ca\/fishonfarms\/files\/2012\/07\/lottery.jpg\" alt=\"\" width=\"400\" height=\"300\" srcset=\"https:\/\/blogs.ubc.ca\/fishonfarms\/files\/2012\/07\/lottery.jpg 400w, https:\/\/blogs.ubc.ca\/fishonfarms\/files\/2012\/07\/lottery-300x225.jpg 300w\" sizes=\"auto, (max-width: 400px) 100vw, 400px\" \/><\/a><p id=\"caption-attachment-253\" class=\"wp-caption-text\">Households selected by lottery for the 24-hour recall and blood draw<\/p><\/div>\n<p>And that is the method we used to recruit\u00a0<span style=\"color: #003366;\"><strong>900<\/strong><\/span> households for <span style=\"color: #003366;\"><strong>FoF<\/strong><\/span> while adhering to the principles of sound research as best as we possibly can.<\/p>\n<p>I\u2019d like to give a special thank you to <span style=\"color: #003366;\"><strong>Sokhoing Ly<\/strong><\/span> from <span style=\"color: #003366;\"><strong>HKI<\/strong><\/span> for explaining all of this to me with great patience.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>One of the issues that we have encountered during the first week of baseline is that some of the houses that were originally selected to be part of the study are no longer eligible. In some instances, the mother went &hellip; <a href=\"https:\/\/blogs.ubc.ca\/fishonfarms\/2012\/07\/10\/sampling-methodology\/\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":13128,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[523269,523278],"tags":[523271,523284,523259,523240,523282,523283,3611,523281,523244,326986,523270],"class_list":["post-250","post","type-post","status-publish","format-standard","hentry","category-baseline","category-project-information","tag-24-hour-recall","tag-ba-phnum","tag-blood-analysis","tag-hki","tag-kamchay-mear","tag-me-sung","tag-methodology","tag-odov","tag-prey-veng","tag-sampling","tag-svay-antor"],"_links":{"self":[{"href":"https:\/\/blogs.ubc.ca\/fishonfarms\/wp-json\/wp\/v2\/posts\/250","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.ubc.ca\/fishonfarms\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.ubc.ca\/fishonfarms\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.ubc.ca\/fishonfarms\/wp-json\/wp\/v2\/users\/13128"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.ubc.ca\/fishonfarms\/wp-json\/wp\/v2\/comments?post=250"}],"version-history":[{"count":9,"href":"https:\/\/blogs.ubc.ca\/fishonfarms\/wp-json\/wp\/v2\/posts\/250\/revisions"}],"predecessor-version":[{"id":259,"href":"https:\/\/blogs.ubc.ca\/fishonfarms\/wp-json\/wp\/v2\/posts\/250\/revisions\/259"}],"wp:attachment":[{"href":"https:\/\/blogs.ubc.ca\/fishonfarms\/wp-json\/wp\/v2\/media?parent=250"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.ubc.ca\/fishonfarms\/wp-json\/wp\/v2\/categories?post=250"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.ubc.ca\/fishonfarms\/wp-json\/wp\/v2\/tags?post=250"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}