Yang (2007: 76) asserts that the purpose of the research design is to define the structure of the enquiry into a research problem that would produce a valid and useful argument for the researchers audience within the material and intellectual resources and time available. Validity is achieved when the researcher measures what was supposed to be measured while reliability produces consistent measurements. O‟ Sullivan, Rassel and Berner (2003: 107) define reliability as the evaluation of the degree of random error associated with a measure. Threats to validity are reduced by general control procedures; control over subject and experimenter effects; control through the selection and assignment of subjects; and control through specific experimental design (Graziano and Raulin, 1997: 204).
8
In quantitative research the variables are measured in a predetermined and specific way and the data are numeric, whereas in qualitative research the emphasis is also on the use of verbal communication. This study uses the mixed method design that incorporates both the quantitative and qualitative approach (Leedy and Ormond, 2010: 99). According to O‟Sullivan et al (2003:
38), when both the quantitative and qualitative approach is used, the researcher manipulation of the situation under investigation is reduced.
A questionnaire is an effective and convenient method of obtaining answers to both structured and unstructured questions. Interviews assist with the understanding of the subject matter as it allows for flexibility, observation and control of the environment. Mailed surveys cost less than other data collection methods and they cause minimal inconvenience to the respondent.
However, it takes time for its delivery, response and return. Mail questionnaires normally have a low response rate (Leedy and Ormand, 2010: 189).
Triangulation is used in research when multiple sources of data are collected and analysed to ascertain their convergence to a particular theory (Leedy and Ormand, 2010: 99). It promotes interpretive validity and the extent to which the conclusions based on qualitative data are supported by the quantitative instruments used in the research (Maree, 2007: 39). The research instruments used in the study would be interviews and questionnaires.
1.7.2 Literature survey
The study used both primary and secondary sources of data. Primary data was collected through the quantitative design questionnaire mailed to the municipal managers in KZN and by conducting semi-structured interviews with municipal employees involved in performance management functions. Secondary data would be sourced from books, journals, internet, legislation, government reports, policy documents and newspaper articles.
9 1.7.3 Empirical Study
This study used the case study approach with the population being the sixty one municipalities in the KwaZulu-Natal province. The questionnaires were developed and piloted to four municipalities. The necessary changes were made and the final questionnaire was then mailed to all municipal managers in KZN. In this manner, control was introduced on the proper questionnaire construction and high construct validity was achieved. The qualitative aspect of this study included interviews with public sector employees involved in the M & E process. Wellman and Kruger (2002: 158) suggest that the advantages of interviews are that it creates great flexibility and adaptability and the interviewer is in control of the interview while, it can also be costly and time consuming.
1.7.4 Sample for the study
A sample is a subset of units selected from a larger set of the same units and it provides data for the use in estimating the characteristics of the larger set (O‟ Sullivan et al., 2003: 134). The purpose of sampling is to choose a set of units that are representative of a population so that the results can be generalized to the population (Gelo, Brakeman and Benita, 2008: 274). To ensure representativeness of the sample, probabilistic and purposive sampling may be undertaken. In probabilistic sampling, each unit of the population has the same probability to be included in the sample, while in purposive sampling the units are selected on the basis of chosen criteria applicable to the population (Gelo et al., 2008: 274).
Section 155 of the Constitution of the Republic of South Africa, Act 108 of 1996, established three categories of municipalities, namely,
Category A Metropolitan municipalities with exclusive municipal executive and legislative authority in their areas;
Category B Local municipalities that share municipal executive and legislative authority in their area with the category C municipality within whose area they fall; and
10
Category C District municipalities, having municipal executive and legislative authority in an area that includes more than one local municipality for which the district council is responsible.
The KZN province has one metropolitan region, fifty local municipalities and ten district municipalities. The sample would include the fifty municipalities in the B category, ten district municipalities in the C category and one metropole in the A category. Therefore the population of sixty one municipalities in the KZN province would also be the sample for the study.
1.7.5 Statistical analysis used in the study
Descriptive and inferential statistics was utilised to transform the data into meaningful information. According to Graziano and Raulin (1997: 96), descriptive statistics consists of three groups, namely, frequency counts and frequency distributions; graphical representations of data;
and summary statistics. Descriptive statistics include measuring the mean, frequency, range, variance and standard deviation. The Windows SPSS software programme would be used to create frequency distributions and graphical displays. Thereafter the Cronbach alpha would be used to measure internal consistency of the data within a group.
1.7.6 Limitations of the study
It is restricted to municipalities in KwaZulu-Natal and poses a challenge for extrapolation and generalization across all municipalities in South Africa.
The municipal officials engaged in performance management functions would be interviewed in municipalities where the municipal manager has provided the contact details of the relevant officials.
Officials may not have the required level of awareness and understanding of M & E concepts.
11