Training and capacity building

We assist survey organizations worldwide with the development of their technical skills

Training and capacity building

We assist survey organizations worldwide with the development of their technical skills

For over thirty years Sistemas Integrales has assisted statistical and other organizations worldwide with the development of their capabilities through training on all elements of survey methods: sample design, instrument design, field implementation, quality control and data management.

This assistance is provided either in the form of courses for medium and large audiences or as hands-on workshops for small groups in the context of a concrete survey project. Such courses and workshops may range in duration from some days to two weeks and their contents are customized to meet participants’ needs. All meetings can be conducted in the client’s country or in ours, in English, French, Spanish, Portuguese or German.

Over the years we have delivered numerous courses and workshops in different countries for diverse institutions, either requested by or organized together with development agencies and universities

Sampling and Weighting Techniques. Inter-American Development Bank, Guyana Bureau of Statistics. Georgetown, 2018.

Sampling for Household Surveys. Organized by the Oxford Poverty & Human Development Initiative (OPHI). Oxford, 2016.

Techniques de Sondage pour les Enquêtes Auprès des Ménages. Organized by the World Bank for statisticians from West African countries. Dakar, 2016.

Sampling for Household Surveys in Southern Africa. For statisticians from 7 South African countries. Mauritius, 2016.

Sampling for Household Surveys. Organized by Oxford Policy Management. Oxford 2015 and 2016.

Sampling for Household Surveys. Organized by the World Bank. Washington D.C, every year from 2003 through 2015.

Design and Implementation of Living Standards Surveys. Organized by the World Bank. Washington D.C, every year from 1990 through 2015.

Berkeley-IDB Impact Evaluation Collaborative (BIC). Organized by the Inter-American Development Bank and the University of California, Berkeley. Berkeley, 2014.

International Course on Impact Evaluation in Practice. Organized by the Inter-American Development Bank, JPAL and Sistemas Integrales. Santiago, 2014.

International Workshop on Surveys and Public Policy Impact Evaluation. Organized by Sistemas Integrales, the World Bank and the Inter-American Development Bank. Santiago, 2013.

Sampling for Household Surveys. Organized by the International Food Policy Research Institute (IFPRI). Washington D.C., 2013.

International Workshop on Impact Evaluation of Public Policies. Organized by Sistemas Integrales, the Inter-American Development Bank and the World Bank. Santiago, 2012.

Berkeley-IDB Impact Evaluation Collaborative (BIC). Organized by the Inter-American Development Bank and the University of California, Berkeley. Berkeley, 2012.

Sampling for Household Surveys in Transition Economies. At the World Bank Training Center for Russia and Transition Countries. Vienna, 2012.

Sampling for Household Surveys. Organized by the Inter-American Development Bank. Washington D.C., 2009.

Sampling for Household Surveys in the Caribbean. Organized by the Organization of Eastern Caribbean States. Four Caribbean countries, 2006.

Sampling for Household Surveys in the Caribbean. Organized by the World Bank. Saint Lucia, 2006.

Design and Implementation of Living Standards Surveys in Latin America. Organized by the World Bank, the Inter-American Development Bank and INEGI. Aguascalientes, every year from 1999 through 2005.

Techniques de Sondage pour les Enquêtes Auprès des Ménages. Organized by the Institut National de la Statistique et des Études Économiques (INSEE). Libourne, 1997.

Sampling and Weighting Techniques. Inter-American Development Bank, Guyana Bureau of Statistics. Georgetown, 2018.

Sampling for Household Surveys. Organized by the Oxford Poverty & Human Development Initiative (OPHI). Oxford, 2016.

Techniques de Sondage pour les Enquêtes Auprès des Ménages. Organized by the World Bank for statisticians from West African countries. Dakar, 2016.

Sampling for Household Surveys in Southern Africa. For statisticians from 7 South African countries. Mauritius, 2016.

Sampling for Household Surveys. Organized by Oxford Policy Management. Oxford 2015 and 2016.

Sampling for Household Surveys. Organized by the World Bank. Washington D.C, every year from 2003 through 2015.

Design and Implementation of Living Standards Surveys. Organized by the World Bank. Washington D.C, every year from 1990 through 2015.

Berkeley-IDB Impact Evaluation Collaborative (BIC). Organized by the Inter-American Development Bank and the University of California, Berkeley. Berkeley, 2014.

International Course on Impact Evaluation in Practice. Organized by the Inter-American Development Bank, JPAL and Sistemas Integrales. Santiago, 2014.

International Workshop on Surveys and Public Policy Impact Evaluation. Organized by Sistemas Integrales, the World Bank and the Inter-American Development Bank. Santiago, 2013.

Sampling for Household Surveys. Organized by the International Food Policy Research Institute (IFPRI). Washington D.C., 2013.

International Workshop on Impact Evaluation of Public Policies. Organized by Sistemas Integrales, the Inter-American Development Bank and the World Bank. Santiago, 2012.

Berkeley-IDB Impact Evaluation Collaborative (BIC). Organized by the Inter-American Development Bank and the University of California, Berkeley. Berkeley, 2012.

Sampling for Household Surveys in Transition Economies. At the World Bank Training Center for Russia and Transition Countries. Vienna, 2012.

Sampling for Household Surveys. Organized by the Inter-American Development Bank. Washington D.C., 2009.

Sampling for Household Surveys in the Caribbean. Organized by the Organization of Eastern Caribbean States. Four Caribbean countries, 2006.

Sampling for Household Surveys in the Caribbean. Organized by the World Bank. Saint Lucia, 2006.

Design and Implementation of Living Standards Surveys in Latin America. Organized by the World Bank, the Inter-American Development Bank and INEGI. Aguascalientes, every year from 1999 through 2005.

Techniques de Sondage pour les Enquêtes Auprès des Ménages. Organized by the Institut National de la Statistique et des Études Économiques (INSEE). Libourne, 1997.

Courses

 

Sample design, measurement instruments, data management and quality control are key aspects of survey design and implementation to produce valid, reliable and consistent data. Our courses cover both theoretical and practical elements of the survey practice and are delivered by international experts in the field. They allow participants to examine first-hand experiences in concrete surveys, including problems encountered and solutions adopted.

Applied Sampling Courses

Sistemas Integrales delivers two complementary sampling courses, covering both theoretical notions and practical aspects of sampling for household surveys. The courses are aimed at managers and technical staff working within governments or international agencies and involved in programs on poverty, employment, health, education and living conditions. Both courses can be delivered in all countries and for audiences of different sizes, in English, French, Spanish and Portuguese.

Applied Sampling I. Introduction to Sampling for Household Surveys

This introductory course will allow participants to fully understand the steps involved in the design and selection of a complex household and population sample. Emphasis is on practical considerations rather than theoretical derivations, and classes include exercises and examples based on real surveys. By the end of the course, participants will be able to define both the technical requirements of a probability sample and the implementation conditions to be fulfilled throughout fieldwork.

Duration: Fourteen 2-hour sessions.

Prerequisites: Basic notions of probability theory. Working knowledge of Excel and Stata.
Requirements: Each participant should work with Excel and Stata on his/her own computer.

Content:

Sessions 1 and 2: Probability sampling and why sampling needs to be random. Types of non-probability samples and their pitfalls. Population and sampling distributions. Notions of population parameter, estimator, estimate and sampling error. The Central Limit Theorem. Unbiased estimators, precision and accuracy.

Session 3: Simple Random Sampling. Estimating a proportion. Sampling error: sampling variance, standard error, confidence intervals and coefficient of variation. How are sampling errors affected by the population size, the sample size, and the estimated parameter. Estimating a mean.

Session 4: Exercises with Simple Random Sampling: sample selection, point estimates and sampling errors. Systematic selection.

Sessions 5 and 6: Stratified sampling. Strata and domains. Statistical efficiency of a sample design. Advantages and disadvantages of different allocation criteria. Sample allocation simulations based on census data. Exercises.

Sessions 7 and 8: Cluster sampling and two-stage sampling. Advantages and drawbacks. Intraclass correlation and design effects. Area sampling. Unequal sized cluster sampling. Selection of primary sampling units with probabilities proportionate to size and selection of secondary sampling units with equal probabilities. Exercises.

Session 9: Weighting methods to compensate for unequal selection probabilities. Exercises on the computation of base weights under different sample designs.

Sessions 10 and 11: Complex area sampling. First- and second-stage sample frames. Segmenting. Stratification and selection of areas with probability proportionate to size using census data. Household listing operations. Satellite imagery used to assess the quality of the listing process. Household selection. Synthetic design effects. Exercises using anonymized data from real listing operations.

Sessions 12 and 13: Introduction to sampling error estimation for complex samples using Stata. The ultimate cluster approach. Linearized variance estimation. Design effects and their practical use in sample design and assessment. The svyset and svy Stata commands. Exercises and examples using real survey data.

Session 14: Nonsampling error. The Total Survey Error framework.

Final examination.

 

Applied Sampling II. Advanced Topics in Sampling and Weighting Techniques

This is a moderately advanced sampling course, with an emphasis on the practical aspects of sample design, weighting and estimation. The course includes in-class practice that will give participants hands-on experience with the techniques learned in both Applied Sampling courses I and II. This practice uses real survey data and covers all the successive stages of sample design, weighting, estimation and presentation of results. The course will also provide participants with an understanding of topics and challenges common to the survey practice.

Duration: Thirteen 2-hour sessions.
Prerequisites (minimum): Course I (Introduction to Sampling for Household Surveys). Working knowledge of Excel and Stata.
Prerequisites (desirable): Basic Stata programming skills.
Requirements: Each participant should work with Excel and Stata on his/her own computer.

Content:

Session 1: Regular updating and preparation of sampling frames. Master samples: benefits and drawbacks. Use of sample replicates over time.

Sessions 2 and 3: Multistage sampling. Practice with sample selection based on a complex design using census and listing data.

Sessions 4 and 5: Weighting techniques. Nonresponse and its effects on survey estimates. Adjusting base weights for eligibility and nonresponse. Exercises using field results. Poststratification and calibration using ancillary data: to reduce potential nonresponse bias and coverage bias; to improve estimate precision. Exercises.

Sessions 6 and 7: Variance estimation techniques: linearized variance, bootstrapping, balanced and jackknife repeated replication. Stata commands. Estimation for subgroups. Exercises. Best practices for the presentation of results from complex sample surveys.

Session 8: Longitudinal household surveys with rotating panels. Statistical benefits and operational challenges. International cases.

Session 9: Sampling rare populations. Traditional and innovative strategies. Analysis of real cases.

Sessions 10 and 11: Keeping measurement error under control via survey quality control and improved fieldwork strategies. The “Comprehensive Fieldwork Quality Control” (CFQC) system. Examples from different surveys. Exercises.

Session 12: Sampling for business surveys. Business registers, their completeness and opportunity. Element and group estimates.

Session 13: Sampling strategies using satellite imagery. Spatial population databases.  Geographic Information Systems (GIS) software.

Final examination.

 

 

workshops

 

Drawing on our extensive international experience, we train multilateral and government agencies in survey methodology to help them develop the skills required to execute and manage a specific survey. Over the years, we have delivered a large number of hands-on workshops to assist surveys of all types, including studies on living standards, labor force, income and expenditure, health and education, among others. This training typically takes place at the statistical bureau of the country where the survey is conducted or at our premises.

Workshop on Quality Control

International survey practice usually gives a great deal of attention to minimizing sampling error, whereas efforts to keep nonsampling error under control are often neglected. However, nonsampling errors may have serious implications on the accuracy and reliability of the data collected, and standard data cleaning at the end of fieldwork is not a solution and can be misleading.

The main objective of this workshop is to illustrate a number of complementary strategies for detecting and reducing some types of errors generated during the field stage, primarily coverage error, nonresponse error and interviewer effects. The workshop starts by presenting the total survey error framework, which identifies the possible sources of error existing in every survey. It then introduces a Quality Control System formed by a set of techniques that are implemented throughout the full fieldwork period to detect errors in a timely fashion and take immediate action while still on the field. Such techniques include computerized error and consistency checks, monitoring of quality indicators, double-blind back-checks and randomized audio auditing. Suitable corrective measures for dealing with the identified problems are also covered. The exposition will provide numerous examples based on recent surveys conducted in different countries and on diverse subjects such as poverty, consumption, labor, nutrition and gender violence.

Classes will address some theoretical considerations but will emphasize practice through a series of exercises. Participants will have the opportunity to work with instruments and data from real surveys, including their own surveys if available, and apply the quality control methods learned, mainly the definition, computation and analysis of quality indicators based on survey data and paradata. The software used is Stata or R, and a data visualization application.

    By the end of the workshop, participants will

    • be able to recognize the various sources of survey error
    • know how to implement a range of techniques to detect different types of error produced in the field
    • understand what actions can be taken to prevent and reduce those errors, thus improving the accuracy and reliability of the collected data
    • be able to assess the quality of any survey data before its analysis.

    Workshop on Survey Methods

    This particular workshop has a learning-by-doing approach and covers all practical aspects of sample design, instrument conception, fieldwork organization, quality control and budgeting, which are all key elements for producing valid, reliable and consistent data. All sessions are delivered by international experts.

    Who is this workshop for?

    This workshop is aimed at professionals from government and multilateral agencies, statistical offices and academics. It is intended for technical agents who work in the management and implementation of surveys. It is also ideal for people responsible for procuring survey services or who use survey data for the formulation, monitoring and evaluation of public policies in areas such as employment, health, education, poverty, nutrition, living conditions, etc. It can be delivered in all countries, in English, French, Spanish and Portuguese. 

    Objectives

    • Understand the importance of producing and analyzing valid and reliable data.
    • Identify and analyze the stages of the survey cycle, covering both design and implementation.
    • Gain the skills to develop and manage a survey project: sample design, instrument conception, fieldwork organization, quality control and budgeting.
    • Gain the skills to produce thorough and precise terms of reference for survey projects to be implemented by third parties.
    • Manage the necessary tools to assess the proposals submitted by survey firms.

    Address

    José M de la Barra 412, piso 4
    Postcode 6500446
    Santiago, Chile

    Phone

    +562 2638 1841
    +562 2639 4554

    Sistemas Integrales 2018 - All Rights Reserved

    Address

    José M de la Barra 412, piso 4
    Postcode 6500446
    Santiago, Chile

    Phone

    +562 2638 1841
    +562 2639 4554

    Sistemas Integrales 2018 – All Rights Reserved