<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.1d1 20130915//EN" "http://jats.nlm.nih.gov/publishing/1.1d1/JATS-journalpublishing1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" article-type="research-article" xml:lang="en">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">SAJIP</journal-id>
<journal-title-group>
<journal-title>SA Journal of Industrial Psychology</journal-title>
</journal-title-group>
<issn pub-type="ppub">0258-5200</issn>
<issn pub-type="epub">2071-0763</issn>
<publisher>
<publisher-name>AOSIS</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">SAJIP-43-1453</article-id>
<article-id pub-id-type="doi">10.4102/sajip.v43i0.1453</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Original Research</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>The use of mixed-methods research to diagnose the organisational performance of a local government</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name>
<surname>Olivier</surname>
<given-names>Benjamin H.</given-names>
</name>
<xref ref-type="aff" rid="AF0001">1</xref>
</contrib>
<aff id="AF0001"><label>1</label>Department of Industrial and Organisational Psychology, College of Economic and Management Sciences, University of South Africa, South Africa</aff>
</contrib-group>
<author-notes>
<corresp id="cor1"><bold>Corresponding author</bold>: Benjamin Olivier, <email xlink:href="olivibh@unisa.ac.za">olivibh@unisa.ac.za</email></corresp>
</author-notes>
<pub-date pub-type="epub"><day>25</day><month>07</month><year>2017</year></pub-date>
<pub-date pub-type="collection"><year>2017</year></pub-date>
<volume>43</volume>
<elocation-id>1453</elocation-id>
<history>
<date date-type="received"><day>12</day><month>04</month><year>2017</year></date>
<date date-type="accepted"><day>23</day><month>05</month><year>2017</year></date>
</history>
<permissions>
<copyright-statement>&#x00A9; 2017. The Authors</copyright-statement>
<copyright-year>2017</copyright-year>
<license license-type="open-access" xlink:href="http://creativecommons.org/licenses/by/2.0/">
<license-p>Licensee: AOSIS. This work is licensed under the Creative Commons Attribution License.</license-p>
</license>
</permissions>
<abstract>
<sec id="st1">
<title>Orientation</title>
<p>The majority of local governments in South Africa are underperforming; a first step to improve their performance is to accurately diagnose their current functioning. The utilisation of a mixed-methods approach for this diagnosis based on a valid model of organisational performance will form a better and holistic understanding of how a local government is performing.</p>
</sec>
<sec id="st2">
<title>Research purpose</title>
<p>The aim of this study is to investigate the utility of mixed-methods research as a diagnostic approach for determining the organisational performance of a local government in South Africa.</p>
</sec>
<sec id="st3">
<title>Motivation for the study</title>
<p>The use of either quantitative or qualitative data gathering in isolation as part of an organisational diagnosis can lead to biased information and not identifying the root causes of problems. The use of mixed-methods research in which both quantitative and qualitative data gathering methods are utilised has been shown to produce numerous benefits, such as confirmation of gathered data, providing richer detail and initiating new lines of thinking. Such multiple methodologies are recognised as an essential component of any organisational diagnosis and can be an effective means of eliminating biases in singular data gathering methods.</p>
</sec>
<sec id="st4">
<title>Research design, approach and method</title>
<p>A concurrent transformative mixed-methods strategy based on the Burke&#x2013;Litwin model of organisational performance with triangulation of results and findings to determine convergence validity was used. A convenience sample of 116 (<italic>N</italic> = 203) permanent officials in a rural district municipality in South Africa completed a survey questionnaire and were also individually interviewed.</p>
</sec>
<sec id="st5">
<title>Main findings</title>
<p>Results indicate that mixed-methods research is a valid technique for establishing the integrity of survey data and for providing a better and holistic understanding of the functioning of an organisation. The results also indicate that the Burke&#x2013;Litwin model is a useful and valid diagnostic framework for identifying the strengths and development areas of an organisation&#x2019;s performance. Finally, the results established the reliability and validity of the survey instrument used for gathering data.</p>
</sec>
<sec id="st6">
<title>Practical and managerial implications</title>
<p>A mixed-methods research approach is a useful method to diagnose organisations&#x2019; performance to ensure data integrity and to obtain a comprehensive picture of an organisation&#x2019;s performance. A further practical implication is that managers and practitioners can use the Burke&#x2013;Litwin model as a basis for diagnosing the performance of an organisation with confidence, as it identifies the most important aspects of an organisation&#x2019;s functioning.</p>
</sec>
<sec id="st7">
<title>Contribution and value add</title>
<p>Organisational diagnoses are usually conducted by either quantitative or qualitative means, while the use of mixed-methods research is a relatively underutilised approach. This study aims to contribute to the availability of research approaches for diagnosing the performance of organisations.</p>
</sec>
</abstract>
</article-meta>
</front>
<body>
<sec id="s0001">
<title>Introduction</title>
<p>For the public sector, improving organisational effectiveness has become just as important as for the private sector (Boyne, James, John &#x0026; Petrovsky, <xref ref-type="bibr" rid="CIT0006">2009</xref>). Citizens all over the world are increasingly demanding that public sector organisations improve their service delivery and prove that they have an impact on complex social problems, while tax payers are demanding an acceptable return on the taxes that they pay to governments at all levels (Sowa, Seldon &#x0026; Sandfort, <xref ref-type="bibr" rid="CIT0069">2004</xref>). Since the 1980s, public sectors around the world have emphasised administrative reform to improve effectiveness and efficiency (Van Thiel &#x0026; Leeuw, <xref ref-type="bibr" rid="CIT0075">2002</xref>). This is also true for local government level, as municipalities are creatures of stature &#x2013; they exist to do things that parliament or a country&#x2019;s constitution has said that they should do (Jackson, <xref ref-type="bibr" rid="CIT0035">1984</xref>). As such, they are under pressure to perform, as a failure to do so will see them either being punished or rewarded by voter choice (Boyne et al., <xref ref-type="bibr" rid="CIT0006">2009</xref>).</p>
<p>In South Africa the large number of service delivery protests at local government level over the last 8 years is a clear indication that ordinary citizens are demanding that municipalities become more effective and start delivering on their constitutional mandate (Municipal IQ Hotspots Monitor, <xref ref-type="bibr" rid="CIT0053">2016</xref>). Demands for interventions to improve the functioning of municipalities are also increasing, and the South African Government had to launch an ambitious Local Government Turn-Around Strategy (LGTAS) in an attempt to improve local government effectiveness (Department of Cooperative Governance and Traditional Affairs [DCOGTA] <xref ref-type="bibr" rid="CIT0021">2009</xref>).</p>
<p>Hall (<xref ref-type="bibr" rid="CIT0029">1999</xref>) states that the first step towards improving organisational effectiveness is to determine how it is currently functioning, and to do this, an organisational diagnosis is necessary. This is supported by Saeed and Wang (<xref ref-type="bibr" rid="CIT0062">2013</xref>), who state that managers should be capable of speedily identifying the weaknesses of their organisations to stay competitive. Harrison (<xref ref-type="bibr" rid="CIT0030">2005</xref>) states that in organisational diagnosis, conceptual models and applied research methods are used to assess an organisation&#x2019;s current state and determine how to enhance performance, as without careful diagnosis, decision makers may waste effort by failing to attack the root causes of problems. Diagnosing organisations also form part of the action research approach to organisational development (OD), which is according to Cummings and Worley (<xref ref-type="bibr" rid="CIT0020">2015</xref>) a process for understanding, developing and changing organisations and improving their health, effectiveness and self-renewal capabilities. It is thus clear that the assessment of organisational effectiveness is essential to improve it.</p>
<p>The use of mixed-methods research in which quantitative and qualitative data gathering methods are utilised has been shown to produce numerous benefits, such as confirmation of gathered data, providing richer detail and initiating new lines of thinking (Rossman &#x0026; Wilson, <xref ref-type="bibr" rid="CIT0061">1991</xref>). Such multiple methodologies is recognised as an essential component of any organisational diagnosis (Paul, <xref ref-type="bibr" rid="CIT0059">1996</xref>) and can be an effective means of eliminating biases in quantitative and qualitative data gathering methods (Creswell, <xref ref-type="bibr" rid="CIT0019">2014</xref>). Organisational models, in turn, are useful for enhancing our understanding of organisational behaviour, helping us to categorise and interpret data about an organisation and providing a common, short-hand language (Howard, <xref ref-type="bibr" rid="CIT0031">1994</xref>). The Burke&#x2013;Litwin model of organisational performance has been shown to provide a valid framework for describing the relationships between different aspects of an organisation (Burke &#x0026; Litwin, <xref ref-type="bibr" rid="CIT0010">1992</xref>; Cummings &#x0026; Worley, <xref ref-type="bibr" rid="CIT0020">2015</xref>) and has been used with success to measure the performance of various diverse organisations in the private sector (Martins &#x0026; Coetzee, <xref ref-type="bibr" rid="CIT0047">2009</xref>).</p>
<p>The action research approach to OD and an organisational diagnosis as an important step in this process is well established (Cummings &#x0026; Worley, <xref ref-type="bibr" rid="CIT0020">2015</xref>; Falletta, <xref ref-type="bibr" rid="CIT0026">2005</xref>; French, Bell &#x0026; Zawacki, <xref ref-type="bibr" rid="CIT0027">1978</xref>; Jones &#x0026; Brazzel, <xref ref-type="bibr" rid="CIT0037">2006</xref>; Martins &#x0026; Geldenhuys, <xref ref-type="bibr" rid="CIT0048">2016</xref>; Saeed &#x0026; Wang, <xref ref-type="bibr" rid="CIT0062">2013</xref>). Similarly, authors have reported that the Burke&#x2013;Litwin model of organisational performance is a valid framework for diagnosing an organisation (Burke &#x0026; Litwin, <xref ref-type="bibr" rid="CIT0010">1992</xref>; Cummings &#x0026; Worley, <xref ref-type="bibr" rid="CIT0020">2015</xref>; Martins &#x0026; Coetzee, <xref ref-type="bibr" rid="CIT0047">2009</xref>). Numerous studies have also utilised a quantitative (Harrison, <xref ref-type="bibr" rid="CIT0030">2005</xref>; Smit, <xref ref-type="bibr" rid="CIT0067">1999</xref>; Wiley, <xref ref-type="bibr" rid="CIT0077">2010</xref>) or qualitative (Martins &#x0026; Coetzee, <xref ref-type="bibr" rid="CIT0047">2009</xref>; Thomas, <xref ref-type="bibr" rid="CIT0072">2012</xref>; Tsuchiya, <xref ref-type="bibr" rid="CIT0074">2016</xref>) approach to diagnose the current functioning of an organisation with excellent results. However, the use of mixed-methods research as a diagnostic approach based on the Burke&#x2013;Litwin model is largely non-existent. This study aims to contribute to the theoretical and empirical body of knowledge availability on utilising a mixed-methods approach based on the Burke&#x2013;Litwin model when conducting an organisational diagnosis and will provide both researchers and practitioners with alternative diagnostic strategies to utilise as part of the action research approach to OD.</p>
</sec>
<sec id="s0002">
<title>Research objective</title>
<p>The aim of the current study is to investigate the utility of mixed-methods research as a diagnostic approach for determining the organisational performance of a local government in South Africa.</p>
</sec>
<sec id="s0003">
<title>What will follow</title>
<p>The article starts with a review of relevant literature regarding local government in South Africa, mixed-methods research and the use of the Burke&#x2013;Litwin model in assessing the performance of organisations. The literature review is followed by the research methodology after which the results and findings of the study are discussed. The article then ends with limitations, recommendations for future research, implications for management and conclusions.</p>
</sec>
<sec id="s0004">
<title>Literature review</title>
<sec id="s20005">
<title>Importance of local government in South Africa</title>
<p>According to Mitlin (<xref ref-type="bibr" rid="CIT0051">2000</xref>), local government is a very important sphere of government all over the world because it is the sphere of government that is the closest to the people, as many basic services are delivered by municipalities, and local ward councillors are the politicians closest to communities. Furthermore, local governments are increasingly required to play larger roles in providing services, alleviating poverty and facilitating development (Andrews &#x0026; Shah, <xref ref-type="bibr" rid="CIT0001">2003</xref>; Cameron, <xref ref-type="bibr" rid="CIT0011">2005</xref>; Craythorne, <xref ref-type="bibr" rid="CIT0017">2006</xref>; Mortimer, <xref ref-type="bibr" rid="CIT0052">2004</xref>; Rakodi, <xref ref-type="bibr" rid="CIT0060">1997</xref>).</p>
<p>In South Africa, after the first democratic municipal elections in 1994, there were high expectations of local governments regarding service delivery (Mortimer, <xref ref-type="bibr" rid="CIT0052">2004</xref>). This is confirmed by the fact that the objectives for local government are set out in section 152 of the South African Constitution (Constitution of the Republic of South Africa, <xref ref-type="bibr" rid="CIT0016">1996</xref>). In accordance with the <italic>Local Government: Municipal Structures Act</italic> (<xref ref-type="bibr" rid="CIT0044">1998</xref>) and to fulfil its constitutional obligations, South Africa is divided into 283 municipalities, based on three legal categories, namely Metropolitan Municipalities (8), District Municipalities (44) and Local Municipalities (231). However, a central challenge for the many new institutions of local government in South Africa has been their viability and ability to build strong organisations capable of delivering on the principles of the Constitution (Atkinson, <xref ref-type="bibr" rid="CIT0002">2007</xref>).</p>
</sec>
<sec id="s20006">
<title>The effectiveness of local government in South Africa</title>
<p>The primary responsibility of local governments in South Africa today is to provide access to crucial public services (Constitution of the Republic of South Africa, <xref ref-type="bibr" rid="CIT0016">1996</xref>). Given their constitutional responsibilities, how are local governments in South Africa currently performing? According to the DCOGTA (<xref ref-type="bibr" rid="CIT0021">2009</xref>), which conducted its own investigation into the functioning of all municipalities in South Africa, the local sphere of government is fraught with community frustration over poor institutionalisation of systems, poor service delivery and poor political governance. The State of Local Government in South Africa Report (DCOGTA, <xref ref-type="bibr" rid="CIT0021">2009</xref>) further states that a culture of patronage and nepotism is now so widespread in many municipalities that the formal municipal accountability system is ineffective and inaccessible to many citizens. This is supported by Koma (<xref ref-type="bibr" rid="CIT0038">2010</xref>, p. 122), who states that &#x2018;The performance of numerous municipalities across the country has thus far clearly demonstrated huge deficiencies in as far the fulfilment of both their constitutional and legislative obligations are concerned&#x2019;. A report by the Department of Planning, Monitoring and Evaluation (<xref ref-type="bibr" rid="CIT0023">2014</xref>) states that local governments face challenges of poor governance, lack of accountability, a shortage of technical and professional skills, the inability to collect revenue from citizens and weak service delivery. These challenges were confirmed by a report by the South African Institute of Race Relations (<xref ref-type="bibr" rid="CIT0068">2014</xref>) in which 80 local government indicators derived from census data were used to assess the performance of all municipalities in South Africa. Finally, in the DCOGTA Annual Report for 2014/2015 (DCOGTA, <xref ref-type="bibr" rid="CIT0022">2016</xref>, p. 27), it is stated that &#x2018;In 2014, a third of municipalities are performing their functions adequately, a third is at risk as they are relatively functional, and the bottom third are failing people dramatically and require urgent intervention to correct the decay in the system&#x2019;.</p>
<p>The inability of local governments to deliver services as described above has been publicly evidenced in the spate of community protests in South Africa since 2009, which may be seen as a symptom of the alienation of citizens from local government. According to Municipal IQ Hotspots Monitor (<xref ref-type="bibr" rid="CIT0053">2016</xref>), there have been 983 major service delivery protests staged against local governments over the period 2009&#x2013;2015, occurring roughly at a rate of a protest every second day, which is illustrated in <xref ref-type="fig" rid="F0001">Figure 1</xref>. These protests indicate an escalating loss of confidence in local government service delivery in South Africa over the last 7 years covered by the Municipal IQ Hotspots Monitor report.</p>
<fig id="F0001">
<label>FIGURE 1</label>
<caption><p>Major service delivery protests in South Africa over the period 2009&#x2013;2015.</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="SAJIP-43-1453-g001.tif"/>
</fig>
<p>According to Atkinson (<xref ref-type="bibr" rid="CIT0002">2007</xref>), Schmidt (<xref ref-type="bibr" rid="CIT0064">2010</xref>), Mbecke (<xref ref-type="bibr" rid="CIT0049">2014</xref>) and Mutiro and Fore (<xref ref-type="bibr" rid="CIT0054">2015</xref>), the main reasons for the mass protests over the last few years are (1) municipal ineffectiveness in service delivery because of a lack of leadership, corporate governance and widespread corruption; (2) the poor responsiveness of municipalities to citizens&#x2019; grievances; and (3) the conspicuous consumption entailed by a culture of self-enrichment on the part of municipal councillors and staff. Adding to this, Leibbrandt and Botha (<xref ref-type="bibr" rid="CIT0042">2014</xref>) state that the inability to execute strategies is one of the main problems in local governments in South Africa today. It is thus obvious that the majority of local governments in South Africa are currently underperforming, deemed to be ineffective and in crisis.</p>
</sec>
<sec id="s20007">
<title>Importance of assessing the organisational performance of local government</title>
<p>To improve the effectiveness of municipalities in South Africa, and thus the lives of all its citizens, it will firstly be necessary to measure current performance. This will ensure that the correct aspects are addressed to improve effectiveness. In fact, this diagnostic approach to improving organisational effectiveness is applicable to any kind of organisation (Harrison, <xref ref-type="bibr" rid="CIT0030">2005</xref>).</p>
<p>Falletta (<xref ref-type="bibr" rid="CIT0026">2005</xref>, p. 3), states that &#x2018;organisational diagnosis involves diagnosing or assessing an organisation&#x2019;s current level of functioning in order to design appropriate change interventions&#x2019;. Lee and Brower (<xref ref-type="bibr" rid="CIT0039">2006</xref>) support this view and state that the practical use of assessing organisational effectiveness stems from the intent to analyse the present state of an organisation and to improve performance of the organisation in accordance with diagnostic findings. According to Immordino (<xref ref-type="bibr" rid="CIT0034">2010</xref>), to remain effective, organisations of all kinds must continually improve themselves in response to the challenges that they face; those in the public sector are no exception. This is because all levels of governments are under constant pressure to improve their efficiency, effectiveness and responsiveness (Boyne et al., <xref ref-type="bibr" rid="CIT0006">2009</xref>). It is thus clear that a diagnosis of a municipality is an important first step towards its effectiveness.</p>
</sec>
<sec id="s20008">
<title>Mixed-methods research</title>
<p>According to Johnson, Onwuegbuzie and Turner (<xref ref-type="bibr" rid="CIT0036">2007</xref>, p. 112), &#x2018;Mixed methods research is becoming increasingly articulated, attached to research practice, and recognized as the third major research approach or research paradigm, along with qualitative research and quantitative research&#x2019;. Despite this, Leech and Onwuegbuzie (<xref ref-type="bibr" rid="CIT0040">2009</xref>, p. 265) state that &#x2018;The mixed method paradigm is still in its adolescence, and, thus, is still relatively unknown and confusing to many researchers&#x2019;. In fact, Johnson et al. (<xref ref-type="bibr" rid="CIT0036">2007</xref>) identified and discussed 19 different definitions of mixed-methods research from the literature.</p>
<p>According to Johnson et al. (<xref ref-type="bibr" rid="CIT0036">2007</xref>), since the 1960s various other terms have been used to refer to mixed-methods research, including multiple operationalism, triangulation, blended research, integrative research, multiple methods and mixed research. Although triangulation became a popular way of referring to mixed-methods research in the literature, it would seem that currently, triangulation is only one component of such a design, explaining the mixing of data once it has been gathered (Torrance, <xref ref-type="bibr" rid="CIT0073">2012</xref>). This view is supported by recent authors who all tend to use the term mixed-methods research (Bryman, <xref ref-type="bibr" rid="CIT0009">2007</xref>; Creswell, <xref ref-type="bibr" rid="CIT0018">2009</xref>, <xref ref-type="bibr" rid="CIT0019">2014</xref>; Johnson et al., <xref ref-type="bibr" rid="CIT0036">2007</xref>; Tashakkori &#x0026; Teddlie, <xref ref-type="bibr" rid="CIT0071">2010</xref>). Creswell (<xref ref-type="bibr" rid="CIT0019">2014</xref>) provides a recent explanation of mixed-methods research, which contains several core characteristics, including that it involves the collection of both qualitative and quantitative data; that it includes the analysis of both forms of data; that the two forms of data are integrated in the design analysis through merging the data, connecting the data, or embedding the data; and that these procedures are incorporated into a mixed-methods design that includes the timing of data collection as well as the emphasis for each database.</p>
<p>Various authors have set out the advantages of a mixed-methods approach, including participant enrichment, instrument integrity, treatment integrity, significance enhancement (Johnson et al., <xref ref-type="bibr" rid="CIT0036">2007</xref>), drawing on both qualitative and quantitative research and minimising the limitations of both approaches, and providing a more complete understanding of research questions (Creswell, <xref ref-type="bibr" rid="CIT0019">2014</xref>). These advantages have prompted researchers to use mixed-methods research in various diverse setting over the last 20 years, including to diagnose a pharmacy department in a non-profit research hospital (Paul, <xref ref-type="bibr" rid="CIT0059">1996</xref>), to assess organisational culture (Yauch &#x0026; Steudel, <xref ref-type="bibr" rid="CIT0078">2003</xref>), to study relocation decision making and couple relationships (Challiol &#x0026; Mignonac, <xref ref-type="bibr" rid="CIT0013">2005</xref>), to study adolescent alcohol use (Newman, Shell, Ming, Jianping &#x0026; Maas, <xref ref-type="bibr" rid="CIT0055">2006</xref>), to study social support in widowhood (Scott et al., <xref ref-type="bibr" rid="CIT0065">2007</xref>), to evaluate a school principal development programme (Youngs &#x0026; Piggot-Irvin, <xref ref-type="bibr" rid="CIT0079">2012</xref>) and to study antecedents of servant leadership (Beck, <xref ref-type="bibr" rid="CIT0004">2014</xref>). However, there is a lack of studies utilising a mixed-methods research approach to diagnose the organisational performance of organisations in general and local governments in particular.</p>
</sec>
<sec id="s20009">
<title>Models of organisational performance</title>
<p>According to Lusthaus, Adrien, Anderson, Carden and Montalv&#x00E1;n (<xref ref-type="bibr" rid="CIT0046">2002</xref>), an organisational model is a framework for analysing the strengths and weaknesses of an organisation in relation to its performance. This view is supported by Immordino (<xref ref-type="bibr" rid="CIT0034">2010</xref>), who states that using a model is a structured method of collecting and evaluating information about those areas of an organisation&#x2019;s operations that are most closely associated with organisational excellence.</p>
<p>Falletta (<xref ref-type="bibr" rid="CIT0026">2005</xref>) argues that an organisational model is a representation of an organisation that helps us to understand more clearly and quickly what we are observing in organisations and that it provides a systematic way to collect data on the organisation and to understand and categorise the data. Cummings and Worley (<xref ref-type="bibr" rid="CIT0020">2015</xref>) support this view, explaining that organisational models are conceptual frameworks that practitioners use to understand organisations. Both Falletta (<xref ref-type="bibr" rid="CIT0026">2005</xref>) and Wiley (<xref ref-type="bibr" rid="CIT0077">2010</xref>) state that models often identify vital organisational variables, which are hypothesised to exist based on prior research and depict the nature of the relationships between these key variables. Harrison (<xref ref-type="bibr" rid="CIT0030">2005</xref>) argues that models are important in organisational assessment, as they help to choose which data to attend to and which data to ignore, to determine what kinds of analysis should be applied to the data and to interpret the meaning of the output of those analyses.</p>
</sec>
<sec id="s20010">
<title>The Burke&#x2013;Litwin model of organisational performance</title>
<p>To assess the performance of a municipality in South Africa, it was essential to choose an organisational model that complied with certain diagnostic requirements. Martins and Coetzee (<xref ref-type="bibr" rid="CIT0047">2009</xref>) mention that such a model must be well researched, while Olivier (<xref ref-type="bibr" rid="CIT0056">2014</xref>) states that it should address as many of the elements of an organisation&#x2019;s functioning as possible. Although Jones and Brazzel (<xref ref-type="bibr" rid="CIT0037">2006</xref>) state that there is no one best diagnostic model to use, the Burke&#x2013;Litwin model (Burke &#x0026; Litwin, <xref ref-type="bibr" rid="CIT0010">1992</xref>) was considered by the researcher to comply with all the stated requirements.</p>
<p>The Burke&#x2013;Litwin model of organisational performance is founded on a functional cause-and-effect framework and explains how linkages between 11 elements contribute towards organisational performance, which is the 12th element (Burke &#x0026; Litwin, <xref ref-type="bibr" rid="CIT0010">1992</xref>). Burke and Litwin (<xref ref-type="bibr" rid="CIT0010">1992</xref>) describe organisational performance as the outcome of work performance, effort and achievement, and indicators of this would include productivity, customer satisfaction and service quality. According to Jones and Brazzel (<xref ref-type="bibr" rid="CIT0037">2006</xref>) and Martins and Coetzee (<xref ref-type="bibr" rid="CIT0047">2009</xref>), the Burke&#x2013;Litwin model highlights two distinct sets of organisational dynamics. One set is primarily associated with the transactional level of human behaviour or the everyday interactions and exchanges that create the climate of the organisation, while the second set of dynamics is concerned with processes of human transformation, amounting to sudden &#x2018;leaps&#x2019; in behaviour. See <xref ref-type="fig" rid="F0002">Figure 2</xref> for a visual exposition of the model.</p>
<fig id="F0002">
<label>FIGURE 2</label>
<caption><p>The causal model of organisational performance.</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="SAJIP-43-1453-g002.tif"/>
</fig>
<sec id="s30011">
<title>Transformational factors affecting organisational performance</title>
<p>Burke and Litwin (<xref ref-type="bibr" rid="CIT0010">1992</xref>) state that transformational variables refer to areas in which alteration is caused by interaction with environmental forces (both within and without) and which require entirely new sets of behaviour on the part of organisational members. According to Burke and Litwin (<xref ref-type="bibr" rid="CIT0010">1992</xref>), the following four transformational factors affect organisational performance:</p>
<p><bold>External environment:</bold> Any outside condition or situation that influences the performance of the organisation. These conditions include marketplaces, world financial conditions and political and governmental circumstances.</p>
<p><bold>Mission and strategy:</bold> What employees believe is the central purpose of the organisation and how the organisation intends to achieve that purpose over time.</p>
<p><bold>Leadership:</bold> Executive behaviour that encourages others to take necessary actions.</p>
<p><bold>Culture:</bold> The collection of overt and covert rules, values and principles that guide organisational behaviour and that have been strongly influenced by history, custom and practice.</p>
</sec>
<sec id="s30012">
<title>Transactional factors affecting organisational performance</title>
<p>According to Burke and Litwin (<xref ref-type="bibr" rid="CIT0010">1992</xref>), the following seven transactional variables, referring to interactions that take place primarily via relatively short-term reciprocity among people and groups, affect organisational performance:</p>
<p><bold>Structure:</bold> The arrangement of functions and people into specific areas and levels of responsibility, decision making authority and relationships.</p>
<p><bold>Management practices:</bold> What managers do in the normal course of events to use human and material resources to carry out the organisation&#x2019;s strategy.</p>
<p><bold>Systems:</bold> Standardised policies and mechanisms that facilitate work. Systems primarily manifest themselves in the organisation&#x2019;s reward systems and in control systems such as goal and budget development and human resource allocation.</p>
<p><bold>Work group climate:</bold> The collective current impressions, expectations and feelings of the members of local work units.</p>
<p><bold>Skills or job match:</bold> The behaviour required for task effectiveness, including specific skills and knowledge required for people to accomplish the work assigned and for which they feel directly responsible.</p>
<p><bold>Individual needs and values:</bold> The specific psychological factors that provide desire and worth for individual actions or thoughts.</p>
<p><bold>Motivation:</bold> Aroused behavioural tendencies to move towards goals, to take necessary action and to persist until satisfaction has been attained.</p>
<p>The Burke&#x2013;Litwin model of organisational performance has been shown to provide a valid framework for describing the relationships between different aspects of an organisation (Burke &#x0026; Litwin, <xref ref-type="bibr" rid="CIT0010">1992</xref>; Cummings &#x0026; Worley, <xref ref-type="bibr" rid="CIT0020">2015</xref>) and has been used with success to measure the performance of various diverse organisations (Martins &#x0026; Coetzee, <xref ref-type="bibr" rid="CIT0047">2009</xref>; Olivier, <xref ref-type="bibr" rid="CIT0056">2014</xref>).</p>
<p>From the literature review, the following mixed-methods research question was formulated:
<disp-quote>
<p>Do the quantitative results and qualitative findings of an organisational diagnosis based on the Burke&#x2013;Litwin model of organisational performance show convergent validity as to how a local government is performing?</p>
</disp-quote></p>
</sec>
</sec>
</sec>
<sec id="s0013">
<title>Research design</title>
<sec id="s20014">
<title>Research approach and strategy</title>
<p>A concurrent transformative mixed-methods strategy using triangulation to determine convergence validity was used (Creswell, <xref ref-type="bibr" rid="CIT0018">2009</xref>; McFee, <xref ref-type="bibr" rid="CIT0050">1992</xref>). This strategy entails the concurrent collection of both quantitative and qualitative data (Creswell, <xref ref-type="bibr" rid="CIT0019">2014</xref>), guided by the researcher&#x2019;s use of a specific theoretical perspective (Creswell, <xref ref-type="bibr" rid="CIT0018">2009</xref>), the separate analysis of the quantitative and qualitative data gathered (Braun &#x0026; Clarke, <xref ref-type="bibr" rid="CIT0007">2013</xref>; Creswell, <xref ref-type="bibr" rid="CIT0019">2014</xref>) and triangulation of data to determine convergence validity of the data gathered (Creswell, <xref ref-type="bibr" rid="CIT0018">2009</xref>; McFee, <xref ref-type="bibr" rid="CIT0050">1992</xref>). This strategy is depicted in <xref ref-type="fig" rid="F0003">Figure 3</xref>. Quantitative data were gathered by means of a survey instrument while qualitative data were gathered by means of interviews, with the Burke&#x2013;Litwin model of organisational performance as the theoretical perspective on which the gathering of both types of data were based (Burke &#x0026; Litwin, <xref ref-type="bibr" rid="CIT0010">1992</xref>).</p>
<fig id="F0003">
<label>FIGURE 3</label>
<caption><p>A visual exposition of the concurrent transformative strategy with triangulation.</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="SAJIP-43-1453-g003.tif"/>
</fig>
<p>The reasons for using this strategy was firstly to form a better and holistic understanding of how the local government in the study was performing by using both quantitative and qualitative performance data, which Collins, Onwuegbuzie and Sutton (<xref ref-type="bibr" rid="CIT0015">2006</xref>, p. 116) refer to as &#x2018;significance enhancement&#x2019;. Secondly, it was used to establish the content validity of the questionnaire used by means of triangulation, comparing the interview data to the questionnaire data, which Collins et al. (<xref ref-type="bibr" rid="CIT0015">2006</xref>, p. 116) refer to as &#x2018;instrument fidelity&#x2019;, which was necessary as the content validity of the survey instrument used had not yet been established for a local government, and thirdly, to use a validated organisational performance model to guide the quantitative and qualitative data gathering such as that propagated by Burke and Litwin (<xref ref-type="bibr" rid="CIT0010">1992</xref>), which addresses all the elements of an organisation&#x2019;s functioning (Martins &#x0026; Coetzee, <xref ref-type="bibr" rid="CIT0047">2009</xref>; Olivier, <xref ref-type="bibr" rid="CIT0056">2014</xref>).</p>
<p>The research followed an organisational diagnostic approach. Organisational diagnosis is seen as central to the practice of OD, being a data gathering method of determining a valid and accurate picture of an organisation&#x2019;s current functioning (Brown, <xref ref-type="bibr" rid="CIT0008">2011</xref>; Cummings &#x0026; Worley, <xref ref-type="bibr" rid="CIT0020">2015</xref>; French et al., <xref ref-type="bibr" rid="CIT0027">1978</xref>). According to Cummings and Worley (<xref ref-type="bibr" rid="CIT0020">2015</xref>), diagnosis is the process of understanding how an organisation is currently functioning and providing the information necessary to design improvement interventions. For this reason, various authors have over the years emphasised the importance of assessing an organisation to understand it and improve its functioning (Brown, <xref ref-type="bibr" rid="CIT0008">2011</xref>; Cummings &#x0026; Worley, <xref ref-type="bibr" rid="CIT0020">2015</xref>; Ghorpade, <xref ref-type="bibr" rid="CIT0028">1971</xref>; Hall, <xref ref-type="bibr" rid="CIT0029">1999</xref>; Harrison, <xref ref-type="bibr" rid="CIT0030">2005</xref>; Lusthaus et al., <xref ref-type="bibr" rid="CIT0046">2002</xref>).</p>
</sec>
<sec id="s20015">
<title>Research method</title>
<sec id="s30016">
<title>Research setting</title>
<p>As stated previously, South Africa is divided into 283 municipalities, based on three legal categories, namely 8 densely populated metropolitan municipalities, 44 district municipalities and 231 local municipalities (<italic>Local Government: Municipal Structures Act</italic>, <xref ref-type="bibr" rid="CIT0044">1998</xref>). This research was conducted in one of the 44 district municipalities located in a small rural or lightly settled town, which has five local municipalities within its area of jurisdiction. Its main function is to coordinate the delivery of municipal services to inhabitants between the five local municipalities. The district municipality consisted of 203 permanent officials who fulfilled the various line and support functions in the municipality.</p>
</sec>
<sec id="s30017">
<title>Entr&#x00E9;e and establishing researcher roles</title>
<p>The primary researcher was introduced to the management team of the municipality in this study by their internal OD consultant, who attended an OD programme presented by the researcher as a lecturer at the University of South Africa. The primary researcher was subsequently contracted by the district municipality (client) to conduct an organisational diagnosis to determine the current functioning of the municipality and to compile a suggested intervention plan to rectify any identified development areas. Three experienced OD consultants who were all thoroughly trained on the Burke&#x2013;Litwin model and on interviewing techniques also formed part of the research team. OD consultants rather than once-off interviewers were used to conduct the interviews as they would also be involved in providing feedback to the municipality and in implementing interventions to address the identified developmental areas. The primary researcher subsequently contracted the terms of reference for the diagnosis with the management team, while the municipality&#x2019;s internal OD consultant was used extensively to gain access to the management team and personnel within the municipality and to set up the necessary appointments and assist with logistical arrangements.</p>
</sec>
<sec id="s30018">
<title>Research participants and sampling</title>
<p>The population for this study was all the permanent official of a rural district municipality in South Africa, namely 203. The sampling method utilised was convenience sampling, a non-probability sampling method (Babbie, <xref ref-type="bibr" rid="CIT0003">2010</xref>), which is according to Onwuegbuzie and Collins (<xref ref-type="bibr" rid="CIT0057">2007</xref>) one of 24 sampling methods available and suitable for mixed-methods research. This method was used as all permanent officials of the district municipality were invited to voluntarily take part in the data gathering, which was explained as consisting of a self-completion questionnaire and one-on-one individual interviews. A sample of 116 (57&#x0025;) officials was willing to participate in the study, which is nearly double the 30&#x0025; which Salkind (<xref ref-type="bibr" rid="CIT0063">2012</xref>) considers to be a good representation of the population for a quantitative survey of this nature. The same sample was used for the qualitative data gathering phase, which Onwuegbuzie and Collins (<xref ref-type="bibr" rid="CIT0057">2007</xref>) refer to as an identical sample relationship and which they state is appropriate for a concurrent mixed-methods research design. The aim of such a design, as used in this study, is to compare both forms of data to search for congruent findings, that is, how the statistical results in the quantitative analysis compare with the themes identified in the qualitative data collection (Creswell, <xref ref-type="bibr" rid="CIT0018">2009</xref>). The composition of the sample is indicated in <xref ref-type="table" rid="T0001">Table 1</xref>.</p>
<table-wrap id="T0001">
<label>TABLE 1</label>
<caption><p>Composition of the research sample (<italic>n</italic> = 116).</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left">Variable</th>
<th align="left">Category</th>
<th align="center">Frequency</th>
<th align="center">&#x0025; of <italic>n</italic></th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left" rowspan="2">Gender</td>
<td align="left">Male</td>
<td align="center">77</td>
<td align="center">66.4</td>
</tr>
<tr>
<td align="left">Female</td>
<td align="center">39</td>
<td align="center">33.6</td>
</tr>
<tr>
<td align="left" rowspan="4">Rank</td>
<td align="left">Managers</td>
<td align="center">33</td>
<td align="center">28.5</td>
</tr>
<tr>
<td align="left">Supervisors</td>
<td align="center">20</td>
<td align="center">17.2</td>
</tr>
<tr>
<td align="left">Officials</td>
<td align="center">36</td>
<td align="center">31.0</td>
</tr>
<tr>
<td align="left">Other (personal assistants, etc.)</td>
<td align="center">27</td>
<td align="center">23.3</td>
</tr>
<tr>
<td align="left" rowspan="6">Qualification</td>
<td align="left">Grade 10</td>
<td align="center">5</td>
<td align="center">4.3</td>
</tr>
<tr>
<td align="left">Grade 12</td>
<td align="center">27</td>
<td align="center">23.3</td>
</tr>
<tr>
<td align="left">Artisan</td>
<td align="center">5</td>
<td align="center">4.3</td>
</tr>
<tr>
<td align="left">Diploma</td>
<td align="center">40</td>
<td align="center">34.5</td>
</tr>
<tr>
<td align="left">Bachelor&#x2019;s degree</td>
<td align="center">17</td>
<td align="center">14.7</td>
</tr>
<tr>
<td align="left">Postgraduate</td>
<td align="center">22</td>
<td align="center">19.0</td>
</tr>
<tr>
<td align="left" rowspan="4">Experience</td>
<td align="left">&#x003E; 20 years</td>
<td align="center">5</td>
<td align="center">4.3</td>
</tr>
<tr>
<td align="left">10&#x2013;20 years</td>
<td align="center">6</td>
<td align="center">5.2</td>
</tr>
<tr>
<td align="left">5&#x2013;9 years</td>
<td align="center">14</td>
<td align="center">12.1</td>
</tr>
<tr>
<td align="left">&#x003C; 5 years</td>
<td align="center">91</td>
<td align="center">78.4</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>As can be seen from <xref ref-type="table" rid="T0001">Table 1</xref>, the majority of the sample were men (66.4&#x0025;), supervisors or managers (45.7&#x0025;), had a tertiary education (68.2&#x0025;) and had less than 5 years of experience at the municipality (78.4&#x0025;).</p>
</sec>
<sec id="s30019">
<title>Measuring instrument: Quantitative data collection</title>
<p>Quantitative data were gathered by means of the Organisational Performance Questionnaire (OPQ), a survey instrument developed specifically for the district municipality. Firstly, a study was made of the questions used in the 2002 Langley Research Center (LaRC) Organizational Performance Survey. This survey, which consisted of 134 questions, was compiled to measure the 12 elements of the Burke&#x2013;Litwin model (Burke &#x0026; Litwin, <xref ref-type="bibr" rid="CIT0010">1992</xref>) and was constructed between 2000 and 2002 in a joint effort between LaRC and IBM (at the time PriceWaterhouseCoopers LLC) [IBM Business Consulting Services, <xref ref-type="bibr" rid="CIT0033">2003</xref>]. Secondly, the questions used in the LaRC survey were then adapted to local government terminology and refined based on the researcher&#x2019;s knowledge of local government and the Burke&#x2013;Litwin model. This resulted in a draft survey instrument, which the researcher named the OPQ, consisting of 96 items. Thirdly, a pilot study was conducted with the draft version of the OPQ to test its face validity, according to the guidelines provided by Collingridge (<xref ref-type="bibr" rid="CIT0014">2014</xref>). This was done by requesting a group of 15 managers representing all the different departments in the district municipality to complete the OPQ and to specifically comment on four aspects, namely did they understand the instructions given to complete the questionnaire, was the correct biographical information requested from respondents, was the terminology used appropriate for the district municipality and did they understand the questions posed. The managers in the pilot study were satisfied with the draft survey instrument and no changes were suggested and this survey instrument was then accepted as the final OPQ, which consisted of a biographical section and 96 questions assessing each of the 12 Burke&#x2013;Litwin elements.</p>
<p>Respondents who completed the OPQ were required to rate each of the survey questions on a four-point Likert scale (Likert, <xref ref-type="bibr" rid="CIT0043">1932</xref>), where 1 was Strongly Disagree, 2 was Disagree, 3 was Agree and 4 was Strongly Agree. Undecided was allocated a score of nought and thus did not influence calculations. Each of the 12 elements was measured separately and produced a separate score for the element, reflecting the respondents&#x2019; evaluation of the elements.</p>
<p>It was decided with the management team of the district municipality before the data gathering process commenced what interpretations would be used with the OPQ results. The discussions were guided by the cut-off scores recommended by the Human Science Research Council of South Africa, as reported by Castro and Martins (<xref ref-type="bibr" rid="CIT0012">2010</xref>), in which a score of acceptable performance of 3.2 (64&#x0025;) was recommended on a five-point Likert scale. On a four-point scale as was used in this study, 64&#x0025; converted to 2.56 or less, but it was decided to increase this cut-off score of acceptable performance to a 3 out of 4, or 75&#x0025;. The following calculations were used to decide on the following score ranges for this study:</p>
<p><bold>Development area:</bold> A total average score for a Burke&#x2013;Litwin element of 1.0&#x2013;2.9 (74&#x0025; or lower).</p>
<p><bold>Acceptable: Maintain:</bold> A total average score for a Burke&#x2013;Litwin element of 3.0&#x2013;4.0 (75&#x2013;100&#x0025;).</p>
</sec>
<sec id="s30020">
<title>Data collection method and recording: Qualitative data</title>
<p>Semi-structured individual interviews were conducted with each member of the same sample who completed the OPQ. During the interviews, each participant was shown a diagram of the Burke&#x2013;Litwin model and asked the following question which was formulated by the researcher:
<disp-quote>
<p>&#x2018;Looking at the Burke&#x2013;Litwin model, how would you rate the performance of your municipality on each of the 12 elements?&#x2019; That is, is an element according to you acceptable and must be maintained, or do you consider it to be a development area?</p>
</disp-quote></p>
<p>If a respondent was unsure about what the element entailed, the researcher would shortly explain it to him or her. The interviewers also probed the answers given by each respondent until clarity was reached on each element regarding a rating. Interviewers then asked each respondent for specific reasons as to why they considered an element to be a developmental area, if it was so identified. These ratings and reasons were then noted by each interviewer in writing for each respondent for each element. Because of the large number of interviews that had to be conducted by each of the four researchers on each day, it was not feasible in terms of time and resources to record and transcribe each interview. Furthermore, interviewers did not have to record everything that was said by an interviewee after probing questions were asked, but only his or her rating of an element as acceptable or developmental, and the reasons if developmental was identified.</p>
</sec>
</sec>
<sec id="s20021">
<title>Research procedure</title>
<p>After contracting with the management team of the district municipality, the actual data were gathered by inviting all permanent officials in the municipality to participate in the process. The municipality&#x2019;s internal methods, namely emails and staff meetings, were used to share information on the planned data gathering with all applicable staff members. Communication of the data gathering process included a message from the municipal manager explaining the purpose of the survey, the issue of confidentiality and anonymity, what the results would be used for and the actions the municipality would be able to take based on the information gathered.</p>
<p>A specific day was identified and scheduled for initial data gathering and planning and communicated to all permanent officials in the municipality. A total of 116 permanent officials were willing to participate in the study and arrived on the specified day at a predetermined venue. After confirming the purpose of the data gathering exercise, officials were requested to complete and sign an informed consent form in which they undertook to voluntarily complete a survey instrument and be exposed to individual one-on-one interviews. Thereafter, all 116 officials completed the OPQ in one venue at the same time under supervision of the main researcher. This was followed by scheduling 1-h semi-structured individual interviews with these same 116 officials over the next 5 days as follows:
<list list-type="bullet">
<list-item><p>Day 1: Five interviews conducted by four interviewers = 20 interviews</p></list-item>
<list-item><p>Day 2: Seven interviews conducted by four interviewers = 28 interviews</p></list-item>
<list-item><p>Day 3: Seven interviews conducted by four interviewers = 28 interviews</p></list-item>
<list-item><p>Day 4: Seven interviews conducted by four interviewers = 28 interviews</p></list-item>
<list-item><p>Day 5: Three interviews conducted by four interviewers = 12 interviews</p></list-item>
<list-item><p>Total: 116 interviews</p></list-item>
</list></p>
</sec>
<sec id="s20022">
<title>Statistical analysis of quantitative data</title>
<p>Quantitative data gathered by means of the OPQ were analysed by using SPSS version 23 (IBM, <xref ref-type="bibr" rid="CIT0032">2015</xref>). Cronbach&#x2019;s alphas were calculated to measure the internal consistency of the OPQ while means, standard deviations and average scores for each of the Burke&#x2013;Litwin elements were calculated to produce scores for the entire municipality. As the district municipality&#x2019;s management team was only interested in overall scores for each Burke&#x2013;Litwin element, differences in scores between the different biographical groupings were not calculated.</p>
</sec>
<sec id="s20023">
<title>Qualitative data analysis</title>
<p>The qualitative data that were gathered by means of the semi-structured individual interviews were analysed in two ways. Firstly, responses were measured in terms of response rates (Vitale, Armenakis &#x0026; Field, <xref ref-type="bibr" rid="CIT0076">2008</xref>). This was done by summating the ratings (acceptable or developmental area) given by each respondent to each element for a total for each element. If 75&#x0025; (87) or more of the respondents, the previously determined cut-off point, indicated that an element was acceptable and should be maintained, it was noted as such. If less than 75&#x0025; indicated that an element was a development area, it was also noted as such. Secondly, the specific reasons given as to why respondents considered an element to be a developmental area were analysed by means of thematic analysis, defined by Braun and Clarke (<xref ref-type="bibr" rid="CIT0007">2013</xref>, p. 178) as &#x2018;a method for identifying themes (or patterns of meaning) across a data set in relation to a research question&#x2019;. This analysis followed the seven stages propagated by Braun and Clarke (<xref ref-type="bibr" rid="CIT0007">2013</xref>), namely: (1) transcription, (2) reading familiarisation, (3) coding, (4) searching for themes, (5) reviewing themes, (6) defining and naming themes and (7) writing the report.</p>
</sec>
<sec id="s20024">
<title>Strategies employed to ensure quality of data</title>
<sec id="s30025">
<title>Strategies employed to ensure quality of quantitative data</title>
<p>The first strategy employed to ensure the quality of the quantitative data was to use a 57&#x0025; sample for the study, which is nearly double the 30&#x0025; that Salkind (<xref ref-type="bibr" rid="CIT0063">2012</xref>) considered to be a good representation of the population for a diagnostic survey. Secondly, the development of the survey instrument used in the study (OPQ) followed a rigorous development protocol prescribed by Borg and Mastrangelo (<xref ref-type="bibr" rid="CIT0005">2008</xref>), Collingridge (<xref ref-type="bibr" rid="CIT0014">2014</xref>) and Wiley (<xref ref-type="bibr" rid="CIT0077">2010</xref>). Thirdly, the face validity of the OPQ was established by means of a pilot study (Collingridge, <xref ref-type="bibr" rid="CIT0014">2014</xref>; Wiley, <xref ref-type="bibr" rid="CIT0077">2010</xref>). Fourthly, respondents completed the OPQ in one session under supervision so that any uncertainties could be clarified immediately, such as not understanding the meaning of a specific question. Lastly, the content validity of the OPQ was established by means of triangulation, which indicated that the results of the questionnaire and the results of the individual interviews showed convergence validity (Creswell, <xref ref-type="bibr" rid="CIT0018">2009</xref>; McFee, <xref ref-type="bibr" rid="CIT0050">1992</xref>).</p>
</sec>
<sec id="s30026">
<title>Strategies employed to ensure quality of qualitative data</title>
<p>The quality of the qualitative data was ensured by focussing on trustworthiness using the four criteria and applicable suggested provisions for each criteria as developed by Guba (as cited in Elo et al., <xref ref-type="bibr" rid="CIT0025">2014</xref>; Shenton, <xref ref-type="bibr" rid="CIT0066">2004</xref>). <italic>Credibility</italic> was ensured by adopting well established research methods (interviews; thematic data analysis), developing an early familiarity with the culture of the municipality (preliminary visits to the municipality; studying various appropriate documents prior to the data gathering), ensuring honesty of interviewees (giving them the opportunity to refuse to participate in the interviews) and by utilising only highly qualified and experienced researchers (all researchers were registered industrial psychologists and experienced OD consultants). <italic>Transferability</italic> was ensured by providing the reader with sufficient contextual information about the study (type, size and location of municipality; number of participants; data collection methods; number and duration of interviews; time period over which data were collected) to decide whether the findings could be transferred to similar situations. <italic>Dependability</italic> was ensured through the thorough scientific planning and execution of the study and the in-depth description of the research design and procedure that was followed. Lastly, <italic>confirmability</italic> or objectivity was ensured by using a team of four researchers to plan, collect and analyse the qualitative data in order to reduce the effect of single-researcher bias that could have influenced the study.</p>
</sec>
<sec id="s30027">
<title>Strategies employed to ensure quality of mixed-methods data</title>
<p>Mixed-methods validity, referred to as data legitimation by Leech, Onwuegebuzie and Combs (<xref ref-type="bibr" rid="CIT0041">2011</xref>) and Onwuegbuzie and Johnson (<xref ref-type="bibr" rid="CIT0058">2006</xref>), was ensured by utilising four of the nine legitimation types propagated by Onwuegbuzie and Johnson (<xref ref-type="bibr" rid="CIT0058">2006</xref>). <italic>Sample integration legitimation</italic> was ensured by using a large and identical sample (<italic>n</italic> = 116 = 57&#x0025;) for both the OPQ and the interviews. This enabled the combination of inferences that emerged from both approaches to construct what Tashakkori and Teddlie (<xref ref-type="bibr" rid="CIT0070">2003</xref>, p. 687) refer to as &#x2018;meta-inferences&#x2019;. <italic>Weakness minimisation legitimation</italic> was ensured by compensating for the weakness in the quantitative approach (respondents not fully understanding the questions in the instruments) by the strength of the qualitative approach (interviewers could probe responses to ensure clarity and comprehension of questions asked). <italic>Conversion legitimation</italic> was applied by counting the number of times an interviewee rated an element in the Burke&#x2013;Litwin model as either acceptable or a development area and comparing these ratings with the scores obtained for each element on the OPQ. This comparison confirmed convergent validity as the ratings and scores were similar. <italic>Multiple validities legitimation</italic> was achieved because of the fact that appropriate strategies to ensure quantitative, qualitative and mixed-methods data quality were applied and achieved, as described in the previous sections.</p>
</sec>
</sec>
</sec>
<sec id="s0028">
<title>Ethical considerations</title>
<p>The research was conducted within an ethical framework as suggested by Creswell (<xref ref-type="bibr" rid="CIT0019">2014</xref>). This included obtaining informed consent from all participants, protection of their identities and allowing them to withdraw from the study at any time. Approval to use the data for research purposes was obtained from the municipal manager of the municipality, while ethical clearance to conduct the study was obtained from the researcher&#x2019;s university.</p>
</sec>
<sec id="s0029">
<title>Results: Quantitative data</title>
<sec id="s20030">
<title>Reliability of the Organisational Performance Questionnaire</title>
<p><xref ref-type="table" rid="T0002">Table 2</xref> indicates the reliability statistics that were obtained for the OPQ, which measured the 12 elements of the Burke&#x2013;Litwin model. An overall reliability coefficient of 0.76 was obtained, while a low of 0.63 for the elements External Environment and Individual Needs and Values and a high of 0.91 for Management Practices was obtained. These reliability statistics indicate that the OPQ can be considered as a reliable instrument, as Babbie (<xref ref-type="bibr" rid="CIT0003">2010</xref>) states that coefficients that are 0.3 and higher are considered acceptable for the behavioural sciences.</p>
<table-wrap id="T0002">
<label>TABLE 2</label>
<caption><p>Reliability statistics for the 12 Burke&#x2013;Litwin elements measured by the Organisational Performance Questionnaire.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left">Element no.</th>
<th align="left">Element description</th>
<th align="center">Cronbach&#x2019;s alpha</th>
<th align="center">No. of items</th>
<th align="center">Mean</th>
<th align="center">Standard deviation</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left">1</td>
<td align="left">External environment</td>
<td align="center">0.63</td>
<td align="center">5</td>
<td align="center">3.104</td>
<td align="center">2.918</td>
</tr>
<tr>
<td align="left">2</td>
<td align="left">Mission and strategy</td>
<td align="center">0.66</td>
<td align="center">5</td>
<td align="center">3.274</td>
<td align="center">2.626</td>
</tr>
<tr>
<td align="left">3</td>
<td align="left">Leadership</td>
<td align="center">0.88</td>
<td align="center">9</td>
<td align="center">2.652</td>
<td align="center">6.419</td>
</tr>
<tr>
<td align="left">4</td>
<td align="left">Culture</td>
<td align="center">0.71</td>
<td align="center">5</td>
<td align="center">3.006</td>
<td align="center">3.317</td>
</tr>
<tr>
<td align="left">5</td>
<td align="left">Structure</td>
<td align="center">0.77</td>
<td align="center">5</td>
<td align="center">2.902</td>
<td align="center">3.747</td>
</tr>
<tr>
<td align="left">6</td>
<td align="left">Management practices</td>
<td align="center">0.91</td>
<td align="center">13</td>
<td align="center">2.659</td>
<td align="center">8.363</td>
</tr>
<tr>
<td align="left">7</td>
<td align="left">Systems</td>
<td align="center">0.86</td>
<td align="center">13</td>
<td align="center">2.674</td>
<td align="center">7.837</td>
</tr>
<tr>
<td align="left">8</td>
<td align="left">Work unit climate</td>
<td align="center">0.78</td>
<td align="center">10</td>
<td align="center">2.835</td>
<td align="center">5.653</td>
</tr>
<tr>
<td align="left">9</td>
<td align="left">Skills/job match</td>
<td align="center">0.75</td>
<td align="center">6</td>
<td align="center">2.740</td>
<td align="center">3.802</td>
</tr>
<tr>
<td align="left">10</td>
<td align="left">Individual needs and values</td>
<td align="center">0.63</td>
<td align="center">5</td>
<td align="center">3.026</td>
<td align="center">2.790</td>
</tr>
<tr>
<td align="left">11</td>
<td align="left">Motivation</td>
<td align="center">0.71</td>
<td align="center">8</td>
<td align="center">2.966</td>
<td align="center">3.931</td>
</tr>
<tr>
<td align="left">12</td>
<td align="left">Organisational performance</td>
<td align="center">0.87</td>
<td align="center">12</td>
<td align="center">2.780</td>
<td align="center">7.995</td>
</tr>
<tr>
<td align="left" colspan="6"><hr/></td>
</tr>
<tr>
<td align="left"><bold>-</bold></td>
<td align="left"><bold>Totals</bold></td>
<td align="center"><bold>0.76</bold></td>
<td align="center"><bold>96</bold></td>
<td align="center"><bold>-</bold></td>
<td align="center"><bold>-</bold></td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="s20031">
<title>Average scores for the Burke&#x2013;Litwin elements</title>
<p><xref ref-type="fig" rid="F0004">Figure 4</xref> indicates the average scores obtained on the 12 Burke&#x2013;Litwin elements measured by the OPQ for the municipality, while <xref ref-type="table" rid="T0003">Table 3</xref> sets out the interpretation of the obtained scores as previously contracted with the municipality management team. The results indicate that four of the elements obtained a score of 3.0 and above and were considered as acceptable and should be maintained (External Environment, Mission and Strategy, Culture and Individual Needs and Values), while eight of the elements obtained a score of below 3.0 and were subsequently considered to be development areas.</p>
<fig id="F0004">
<label>FIGURE 4</label>
<caption><p>Organisational Performance Questionnaire average scores for each Burke&#x2013;Litwin element (<italic>n</italic> = 116).</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="SAJIP-43-1453-g004.tif"/>
</fig>
<table-wrap id="T0003">
<label>TABLE 3</label>
<caption><p>Interpretation of Organisation Performance Questionnaire scores per element (<italic>n</italic> = 116).</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left">Element number</th>
<th align="left">Element description</th>
<th align="left">Score</th>
<th align="left">Interpretation</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left">1</td>
<td align="left">External environment</td>
<td align="left">3.1</td>
<td align="left">Acceptable: Maintain</td>
</tr>
<tr>
<td align="left">2</td>
<td align="left">Mission and strategy</td>
<td align="left">3.3</td>
<td align="left">Acceptable: Maintain</td>
</tr>
<tr>
<td align="left">3</td>
<td align="left">Leadership</td>
<td align="left">2.7</td>
<td align="left">Development area</td>
</tr>
<tr>
<td align="left">4</td>
<td align="left">Culture</td>
<td align="left">3.0</td>
<td align="left">Acceptable: Maintain</td>
</tr>
<tr>
<td align="left">5</td>
<td align="left">Structure</td>
<td align="left">2.7</td>
<td align="left">Development area</td>
</tr>
<tr>
<td align="left">6</td>
<td align="left">Management practices</td>
<td align="left">2.7</td>
<td align="left">Development area</td>
</tr>
<tr>
<td align="left">7</td>
<td align="left">Systems</td>
<td align="left">2.7</td>
<td align="left">Development area</td>
</tr>
<tr>
<td align="left">8</td>
<td align="left">Work unit climate</td>
<td align="left">2.8</td>
<td align="left">Development area</td>
</tr>
<tr>
<td align="left">9</td>
<td align="left">Skills or job match</td>
<td align="left">2.7</td>
<td align="left">Development area</td>
</tr>
<tr>
<td align="left">10</td>
<td align="left">Individual needs and values</td>
<td align="left">3.0</td>
<td align="left">Acceptable: Maintain</td>
</tr>
<tr>
<td align="left">11</td>
<td align="left">Motivation</td>
<td align="left">2.9</td>
<td align="left">Development area</td>
</tr>
<tr>
<td align="left">12</td>
<td align="left">Organisational performance</td>
<td align="left">2.8</td>
<td align="left">Development area</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>The results indicate that in general, the transformational aspects of the Burke&#x2013;Litwin model were considered to be acceptable, that is, interaction with environmental forces (both within and without) and which require entirely new sets of behaviour on the part of organisational members (Burke &#x0026; Litwin, <xref ref-type="bibr" rid="CIT0010">1992</xref>). The results also indicate that most of the development areas were situated in transactional aspects, referring to interactions that take place primarily via relatively short-term reciprocity among people and groups and which affect organisational performance (Burke &#x0026; Litwin, <xref ref-type="bibr" rid="CIT0010">1992</xref>).</p>
</sec>
</sec>
<sec id="s0032">
<title>Findings: Qualitative data</title>
<p>The findings of the individual interviews, shown in <xref ref-type="table" rid="T0004">Table 4</xref>, indicated that four of the elements were considered by participants to be acceptable and should be maintained (External Environment, Mission and strategy, Culture and Individual Needs and Values), while participants considered eight of the elements to be development areas. <xref ref-type="table" rid="T0004">Table 4</xref> also indicates the final themes that were identified from the thematic analysis of the reasons given by respondents as to why an element was considered as a development area.</p>
<table-wrap id="T0004">
<label>TABLE 4</label>
<caption><p>Summary of the ratings by respondents for each Burke and Litwin element during the individual interviews and final themes identified from the interviews (<italic>n</italic> = 116).</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left">Element number</th>
<th align="left">Element description</th>
<th align="left">Ratings given and frequency in brackets</th>
<th align="left">Finals themes identified and why a development area</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">1</td>
<td align="left">External environment</td>
<td align="left"><list list-type="bullet"><list-item><p>Acceptable: Maintain (90)</p></list-item><list-item><p>Developmental area (26)</p></list-item></list></td>
<td align="left">Not applicable</td>
</tr>
<tr>
<td align="left">2</td>
<td align="left">Mission and strategy</td>
<td align="left"><list list-type="bullet"><list-item><p>Acceptable: Maintain (96)</p></list-item><list-item><p>Developmental area (20)</p></list-item></list></td>
<td align="left">Not applicable</td>
</tr>
<tr>
<td align="left">3</td>
<td align="left">Leadership</td>
<td align="left"><list list-type="bullet"><list-item><p>Developmental area (78)</p></list-item><list-item><p>Acceptable: Maintain (38)</p></list-item></list></td>
<td align="left"><list list-type="bullet"><list-item><p>Not enough interaction with employees</p></list-item><list-item><p>Not acting as role models and setting the example</p></list-item></list></td>
</tr>
<tr>
<td align="left">4</td>
<td align="left">Culture</td>
<td align="left"><list list-type="bullet"><list-item><p>Acceptable: Maintain (87)</p></list-item><list-item><p>Developmental area (29)</p></list-item></list></td>
<td align="left">Not applicable</td>
</tr>
<tr>
<td align="left">5</td>
<td align="left">Structure</td>
<td align="left"><list list-type="bullet"><list-item><p>Acceptable: Maintain (78)</p></list-item><list-item><p>Developmental area (38)</p></list-item></list></td>
<td align="left"><list list-type="bullet"><list-item><p>Confusing organisational structure</p></list-item><list-item><p>Levels of responsibility and decision making not clear</p></list-item></list></td>
</tr>
<tr>
<td align="left">6</td>
<td align="left">Management practices</td>
<td align="left"><list list-type="bullet"><list-item><p>Developmental area (78)</p></list-item><list-item><p>Acceptable: Maintain (38)</p></list-item></list></td>
<td align="left"><list list-type="bullet"><list-item><p>Lack of co-operation and interaction between municipal departments</p></list-item><list-item><p>Municipal departments work in isolation</p></list-item><list-item><p>Lack of regular, formal meetings between managers and employees</p></list-item></list></td>
</tr>
<tr>
<td align="left">7</td>
<td align="left">Systems</td>
<td align="left"><list list-type="bullet"><list-item><p>Developmental area (78)</p></list-item><list-item><p>Acceptable: Maintain (38)</p></list-item></list></td>
<td align="left"><list list-type="bullet"><list-item><p>Not enough vehicles and office equipment</p></list-item><list-item><p>Policies and procedures outdated</p></list-item><list-item><p>New appointees not inducted</p></list-item><list-item><p>Turn-around time for procurement of emergency repairs too long</p></list-item></list></td>
</tr>
<tr>
<td align="left">8</td>
<td align="left">Work unit climate</td>
<td align="left"><list list-type="bullet"><list-item><p>Developmental area (81)</p></list-item><list-item><p>Acceptable: Maintain (35)</p></list-item></list></td>
<td align="left"><list list-type="bullet"><list-item><p>Employees not involved in decision making</p></list-item><list-item><p>Goals and responsibilities not clear</p></list-item><list-item><p>Lack of single building to house whole municipality</p></list-item></list></td>
</tr>
<tr>
<td align="left">9</td>
<td align="left">Skills/job match</td>
<td align="left"><list list-type="bullet"><list-item><p>Developmental area (78)</p></list-item><list-item><p>Acceptable: Maintain (38)</p></list-item></list></td>
<td align="left"><list list-type="bullet"><list-item><p>Lack of needs-based training</p></list-item><list-item><p>Lack of necessary skills to do current work</p></list-item></list></td>
</tr>
<tr>
<td align="left">10</td>
<td align="left">Individual needs and values</td>
<td align="left"><list list-type="bullet"><list-item><p>Acceptable: Maintain (87)</p></list-item><list-item><p>Developmental area (29)</p></list-item></list></td>
<td align="left">Not applicable</td>
</tr>
<tr>
<td align="left">11</td>
<td align="left">Motivation</td>
<td align="left"><list list-type="bullet"><list-item><p>Developmental area (84)</p></list-item><list-item><p>Acceptable: Maintain (32)</p></list-item></list></td>
<td align="left"><list list-type="bullet"><list-item><p>Employees not inspired to do their work</p></list-item><list-item><p>People come and go as they please</p></list-item><list-item><p>Employees do not achieve allocated objectives</p></list-item></list></td>
</tr>
<tr>
<td align="left">12</td>
<td align="left">Organisational performance</td>
<td align="left"><list list-type="bullet"><list-item><p>Developmental area (81)</p></list-item><list-item><p>Acceptable: Maintain (35)</p></list-item></list></td>
<td align="left"><list list-type="bullet"><list-item><p>Municipality&#x2019;s service delivery not up to standard</p></list-item><list-item><p>Employees do not have a sense of urgency</p></list-item><list-item><p>Municipality does not measure its performance regularly</p></list-item></list></td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="s0033">
<title>Comparison (Triangulation) of quantitative and qualitative data</title>
<p>In order to determine whether there was convergent validity between the quantitative results and qualitative findings (Creswell, <xref ref-type="bibr" rid="CIT0018">2009</xref>; McFee, <xref ref-type="bibr" rid="CIT0050">1992</xref>), the scores obtained from the OPQ were compared to the verbal ratings, which were given to each of the 12 Burke&#x2013;Litwin elements by the participants. This comparison (triangulation) produced the results indicated in <xref ref-type="table" rid="T0005">Table 5</xref>.</p>
<table-wrap id="T0005">
<label>TABLE 5</label>
<caption><p>Triangulation of quantitative and qualitative data.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left">Element number</th>
<th align="left">Element description</th>
<th align="left">Rating: OPQ</th>
<th align="left">Rating: Interviews</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left">1</td>
<td align="left">External environment</td>
<td align="left">Acceptable: Maintain (3.1)</td>
<td align="left">Acceptable: Maintain</td>
</tr>
<tr>
<td align="left">2</td>
<td align="left">Mission and strategy</td>
<td align="left">Acceptable: Maintain (3.3)</td>
<td align="left">Acceptable: Maintain</td>
</tr>
<tr>
<td align="left">3</td>
<td align="left">Leadership</td>
<td align="left">Development area (2.7)</td>
<td align="left">Development area</td>
</tr>
<tr>
<td align="left">4</td>
<td align="left">Culture</td>
<td align="left">Acceptable: Maintain (3.0)</td>
<td align="left">Acceptable: Maintain</td>
</tr>
<tr>
<td align="left">5</td>
<td align="left">Structure</td>
<td align="left">Development area (2.7)</td>
<td align="left">Development area</td>
</tr>
<tr>
<td align="left">6</td>
<td align="left">Management practices</td>
<td align="left">Development area (2.7)</td>
<td align="left">Development area</td>
</tr>
<tr>
<td align="left">7</td>
<td align="left">Systems</td>
<td align="left">Development area (2.7)</td>
<td align="left">Development area</td>
</tr>
<tr>
<td align="left">8</td>
<td align="left">Work unit climate</td>
<td align="left">Development area (2.8)</td>
<td align="left">Development area</td>
</tr>
<tr>
<td align="left">9</td>
<td align="left">Skills or job match</td>
<td align="left">Development area (2.7)</td>
<td align="left">Development area</td>
</tr>
<tr>
<td align="left">10</td>
<td align="left">Individual needs and values</td>
<td align="left">Acceptable: Maintain (3.0)</td>
<td align="left">Acceptable: Maintain</td>
</tr>
<tr>
<td align="left">11</td>
<td align="left">Motivation</td>
<td align="left">Development area (2.9)</td>
<td align="left">Development area</td>
</tr>
<tr>
<td align="left">12</td>
<td align="left">Organisational performance</td>
<td align="left">Development area (2.8)</td>
<td align="left">Development area</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn><p>OPQ, Organisation Performance Questionnaire.</p></fn>
</table-wrap-foot>
</table-wrap>
<p>The results of the comparison indicated that the same four elements that obtained a score of 3.0 or above on the OPQ were considered by participants in the interviews to be acceptable and should be maintained (External Environment, Mission and strategy, Culture and Individual Needs and Values), while the same eight elements that obtained a score of below 3.0 on the OPQ were considered by participants in the interviews to be development areas.</p>
</sec>
<sec id="s0034">
<title>Discussion</title>
<p>This study investigated the utility of mixed-methods research as a diagnostic approach for determining the organisational performance of a local government in South Africa. The theoretical perspective on which the transformative mixed-methods approach was based was the Burke&#x2013;Litwin model of organisational performance. This study is considered to be important as organisational diagnoses are usually conducted by either quantitative or qualitative means, while the use of mixed-methods research is a relatively underutilised approach, which could contribute to the availability of research approaches for diagnosing the performance of organisations.</p>
<p>The mixed-methods research question posed was whether the quantitative results and qualitative findings of an organisational diagnosis based on the Burke&#x2013;Litwin model of organisational performance show convergent validity as to how a local government is performing. Results indicate that the elements of the Burke&#x2013;Litwin model identified by the OPQ as acceptable and/or development areas were identical to those elements identified by participants during the individual interviews, thus establishing convergent validity. Mixed-methods research was thus shown to be a valid technique for establishing the integrity of survey data, which is propagated by Onwuegbuzie and Johnson (<xref ref-type="bibr" rid="CIT0058">2006</xref>) and supported by research conducted by Collins et al. (<xref ref-type="bibr" rid="CIT0015">2006</xref>) and Vitale et al. (<xref ref-type="bibr" rid="CIT0076">2008</xref>).</p>
<p>The results also indicate that mixed-methods research provided a pragmatic advantage for gathering diagnostic data of a local government, as the qualitative responses augmented and explained survey responses, an advantage identified by Driscoll, Appiah-Yeboah, Salib and Rupert (<xref ref-type="bibr" rid="CIT0024">2007</xref>). Also, mixed-methods research draws on both qualitative and quantitative data, which provided a better and holistic understanding of the functioning of an organisation, a major advantage of mixed-methods research propagated by Creswell (<xref ref-type="bibr" rid="CIT0019">2014</xref>) and what Collins et al. (<xref ref-type="bibr" rid="CIT0015">2006</xref>, p. 116) refer to as &#x2018;significance enhancement&#x2019;. This supports research in which mixed-methods research was used successfully for various research objectives, including the diagnosis of a pharmacy department (Paul, <xref ref-type="bibr" rid="CIT0059">1996</xref>), to assess organisational culture (Yauch &#x0026; Steudel, <xref ref-type="bibr" rid="CIT0078">2003</xref>), to study relocation decision making and couple relationships (Challiol &#x0026; Mignonac, <xref ref-type="bibr" rid="CIT0013">2005</xref>), to study adolescent alcohol use (Newman et al., <xref ref-type="bibr" rid="CIT0055">2006</xref>), to study social support in widowhood (Scott et al., <xref ref-type="bibr" rid="CIT0065">2007</xref>), to evaluate a school principal development programme (Youngs &#x0026; Piggot-Irvin, <xref ref-type="bibr" rid="CIT0079">2012</xref>) and to study antecedents of servant leadership (Beck, <xref ref-type="bibr" rid="CIT0004">2014</xref>).</p>
<p>The results also indicate that the Burke&#x2013;Litwin model (Burke &#x0026; Litwin, <xref ref-type="bibr" rid="CIT0010">1992</xref>) is a useful and valid diagnostic framework for identifying the strengths and development areas of an organisation&#x2019;s performance, as has been confirmed by other studies (Martins &#x0026; Coetzee, <xref ref-type="bibr" rid="CIT0047">2009</xref>; Olivier, <xref ref-type="bibr" rid="CIT0056">2014</xref>).</p>
<p>The results also established the OEQ as a reliable and valid survey instrument for gathering data based on the Burke&#x2013;Litwin model of organisational performance. Reliability was confirmed by an overall Pearson&#x2019;s correlation coefficient of 0.76, while content validity was confirmed by the triangulation of quantitative and qualitative data, which indicated that the results of the OPQ were similar to the findings of the individual interviews. Triangulation was thus shown to be a valid technique for establishing the integrity of survey data, referred to as establishing &#x2018;instrument fidelity&#x2019; by Collins et al. (<xref ref-type="bibr" rid="CIT0015">2006</xref>, p. 116).</p>
</sec>
<sec id="s0035">
<title>Limitations and recommendations for future studies</title>
<p>The first limitation of this study was that it utilised a concurrent transformative mixed-methods strategy using triangulation to determine convergence validity, which according to Creswell (<xref ref-type="bibr" rid="CIT0018">2009</xref>, p. 214) &#x2018;requires great effort and expertise to adequately study a phenomenon with two separate methods&#x2019;. It was also found that it was a challenge to compare the results of a survey (quantitative data) with the findings of individual interviews (qualitative data). This limitation was overcome by a thorough study of mixed-methods research strategies and previous mixed-methods studies and by using a four-member research team, which ensured unbiased interpretations and comparisons of survey and interview data because of continuous cross-checking. This limitation was further overcome by using common terminology when integrating the OPQ and interview ratings, namely <italic>Acceptable: Maintain</italic> and <italic>Developmental area</italic>. A second limitation of the study was that it was conducted in only one local government in South Africa, so results may not be generalisable to other local governments or organisations in the private sector. A third limitation was that although the OPQ as a diagnostic instrument was shown to possess face and content validity, its construct validity has not yet been statistically established. Lastly, the individual interviews conducted as part of the qualitative data gathering were not audio recorded and transcribed because of the large number of interviews that had to be conducted by each of the four researchers on each day, which could have resulted in information being lost. Lastly, the diagnosis was conducted over a period of 3 months, so the municipality may have already began rectifying certain identified challenges by the time that the feedback report based on the diagnosis was compiled and presented to management.</p>
<p>It is recommended that a mixed-methods approach to organisational diagnosis be followed in other municipalities as well as in private sector organisations to determine the utility of this approach in diverse settings. A further recommendation is that the construct validity of the OPQ be statistically established for a variety of profit and non-profit organisations.</p>
</sec>
<sec id="s0036">
<title>Practical implications for management</title>
<p>A mixed-methods research approach is a useful method for diagnosing the performance of organisations to ensure data integrity and to obtain a more comprehensive picture of an organisation&#x2019;s performance (Collins et al., <xref ref-type="bibr" rid="CIT0015">2006</xref>; Creswell, <xref ref-type="bibr" rid="CIT0019">2014</xref>). However, the process of combining survey data with qualitative data can be time consuming and discourage managers from using this approach, opting for the quick-diagnosis survey approach. This time consuming aspect could even lead to researchers reducing sample sizes or limiting interview time, as pointed out by Driscoll et al. (<xref ref-type="bibr" rid="CIT0024">2007</xref>). A further practical implication is that managers and practitioners can use the Burke&#x2013;Litwin model as a basis for diagnosing the performance of an organisation with confidence, as it identifies the most important aspects of an organisation&#x2019;s functioning.</p>
</sec>
<sec id="s0037">
<title>Conclusion</title>
<p>The results of this study support the views of numerous researchers that mixed-methods research provides a more holistic and comprehensive understanding of the phenomena being studied (Beck, <xref ref-type="bibr" rid="CIT0004">2014</xref>; Challiol &#x0026; Mignonac, <xref ref-type="bibr" rid="CIT0013">2005</xref>; Collins et al., <xref ref-type="bibr" rid="CIT0015">2006</xref>; Creswell, <xref ref-type="bibr" rid="CIT0019">2014</xref>; Newman et al., <xref ref-type="bibr" rid="CIT0055">2006</xref>; Paul, <xref ref-type="bibr" rid="CIT0059">1996</xref>; Scott et al., <xref ref-type="bibr" rid="CIT0065">2007</xref>; Yauch &#x0026; Steudel, <xref ref-type="bibr" rid="CIT0078">2003</xref>; Youngs &#x0026; Piggot-Irvin, <xref ref-type="bibr" rid="CIT0079">2012</xref>). When such an approach is based on a valid model of organisational performance such as the Burke and Litwin model (Burke &#x0026; Litwin, <xref ref-type="bibr" rid="CIT0010">1992</xref>), an accurate and valid picture of an organisation&#x2019;s current functioning can be obtained as a first step to improving organisational performance (Martins &#x0026; Coetzee, <xref ref-type="bibr" rid="CIT0047">2009</xref>; Olivier, <xref ref-type="bibr" rid="CIT0056">2014</xref>).</p>
</sec>
</body>
<back>
<ack>
<title>Acknowledgements</title>
<sec id="s20038" sec-type="COI-statement">
<title>Competing interests</title>
<p>The author declares that he has no financial or personal relationships which may have inappropriately influenced him in writing this article.</p>
</sec>
</ack>
<ref-list id="references">
<title>References</title>
<ref id="CIT0001"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Andrews</surname>, <given-names>M</given-names></string-name>., &#x0026; <string-name><surname>Shah</surname>, <given-names>A</given-names></string-name></person-group>. (<year>2003</year>). <article-title>Assessing local government performance in developing countries</article-title>. In <person-group person-group-type="editor"><string-name><given-names>A.</given-names> <surname>Shah</surname></string-name>, (Ed.)</person-group>, <source><italic>Handbook of public sector performance reviews</italic></source>, Vol. <volume>2</volume> (pp. <fpage>3.2</fpage>&#x2013;<lpage>3.26</lpage>). <publisher-loc>Washington, DC</publisher-loc>: <publisher-name>World Bank</publisher-name>.</mixed-citation></ref>
<ref id="CIT0002"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Atkinson</surname>, <given-names>D</given-names></string-name></person-group>. (<year>2007</year>). <chapter-title>Taking to the streets: Has developmental local government failed in South Africa?</chapter-title> In <person-group person-group-type="editor"><string-name><given-names>S.</given-names> <surname>Buhlungu</surname></string-name>, <string-name><given-names>J.</given-names> <surname>Daniel</surname></string-name>, <string-name><given-names>R.</given-names> <surname>Southall</surname></string-name>, &#x0026; <string-name><given-names>J.</given-names> <surname>Lutchman</surname></string-name> (Eds.)</person-group>, <source><italic>State of the nation: South Africa 2007</italic></source> (pp. <fpage>251</fpage>&#x2013;<lpage>286</lpage>). <publisher-loc>Cape Town</publisher-loc>: <publisher-name>Human Sciences Research Council</publisher-name>.</mixed-citation></ref>
<ref id="CIT0003"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Babbie</surname>, <given-names>E</given-names></string-name></person-group>. (<year>2010</year>). <source><italic>The practice of social research</italic></source>. (<edition>12th</edition> edn.). <publisher-loc>Belmont, CA</publisher-loc>: <publisher-name>Cengage Learning</publisher-name>.</mixed-citation></ref>
<ref id="CIT0004"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Beck</surname>, <given-names>C.D</given-names></string-name></person-group>. (<year>2014</year>). <article-title>Antecedents of servant leadership: A mixed methods study</article-title>. <source><italic>Leadership and Organizational Studies</italic></source>, <volume>21</volume>(<issue>3</issue>), <fpage>299</fpage>&#x2013;<lpage>314</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1177/1548051814529993">https://doi.org/10.1177/1548051814529993</ext-link></comment></mixed-citation></ref>
<ref id="CIT0005"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Borg</surname>, <given-names>I</given-names></string-name>., &#x0026; <string-name><surname>Mastrangelo</surname>, <given-names>P.M</given-names></string-name></person-group>. (<year>2008</year>). <source><italic>Employee surveys in management: Theories, tools and practical applications</italic></source>. <publisher-loc>Cambridge, MA</publisher-loc>: <publisher-name>Hogrefe and Auber</publisher-name>.</mixed-citation></ref>
<ref id="CIT0006"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Boyne</surname>, <given-names>G.A</given-names></string-name>., <string-name><surname>James</surname>, <given-names>O</given-names></string-name>., <string-name><surname>John</surname>, <given-names>P</given-names></string-name>., &#x0026; <string-name><surname>Petrovsky</surname>, <given-names>N</given-names></string-name></person-group>. (<year>2009</year>). <article-title>Democracy and government performance: Holding incumbents accountable in English local governments</article-title>. <source><italic>The Journal of Politics</italic></source>, <volume>71</volume>(<issue>4</issue>), <fpage>1273</fpage>&#x2013;<lpage>1284</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1017/S0022381609990089">https://doi.org/10.1017/S0022381609990089</ext-link></comment></mixed-citation></ref>
<ref id="CIT0007"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Braun</surname>, <given-names>V</given-names></string-name>., &#x0026; <string-name><surname>Clarke</surname>, <given-names>V</given-names></string-name></person-group>. (<year>2013</year>). <source><italic>Successful qualitative research: A practical guide for beginners</italic></source>. <publisher-loc>Thousand Oaks, CA</publisher-loc>: <publisher-name>Sage</publisher-name>.</mixed-citation></ref>
<ref id="CIT0008"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Brown</surname>, <given-names>D.R</given-names></string-name></person-group>. (<year>2011</year>). <source><italic>An experiential approach to organizational development</italic></source>. (<edition>8th</edition> edn.). <publisher-loc>Upper Saddle River, NJ</publisher-loc>: <publisher-name>Prentice Hall</publisher-name>.</mixed-citation></ref>
<ref id="CIT0009"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Bryman</surname>, <given-names>A</given-names></string-name></person-group>. (<year>2007</year>). <article-title>Barriers to integrating quantitative and qualitative research</article-title>. <source><italic>Journal of Mixed Methods Research</italic></source>, <volume>1</volume>(<issue>1</issue>), <fpage>8</fpage>&#x2013;<lpage>22</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1177/2345678906290531">https://doi.org/10.1177/2345678906290531</ext-link></comment></mixed-citation></ref>
<ref id="CIT0010"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Burke</surname>, <given-names>W.W</given-names></string-name>., &#x0026; <string-name><surname>Litwin</surname>, <given-names>G.H</given-names></string-name></person-group>. (<year>1992</year>). <article-title>A causal model of organisational performance and change</article-title>. <source><italic>Journal of Management</italic></source>, <volume>8</volume>(<issue>3</issue>), <fpage>523</fpage>&#x2013;<lpage>546</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1177/014920639201800306">https://doi.org/10.1177/014920639201800306</ext-link></comment></mixed-citation></ref>
<ref id="CIT0011"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Cameron</surname>, <given-names>R</given-names></string-name></person-group>. (<year>2005</year>). <article-title>Metropolitan restructuring (and more restructuring) in South Africa</article-title>. <source><italic>Public Administration and Development</italic></source>, <volume>25</volume>(<issue>4</issue>), <fpage>329</fpage>&#x2013;<lpage>339</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1002/pad.383">https://doi.org/10.1002/pad.383</ext-link></comment></mixed-citation></ref>
<ref id="CIT0012"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Castro</surname>, <given-names>M.L</given-names></string-name>., &#x0026; <string-name><surname>Martins</surname>, <given-names>N</given-names></string-name></person-group>. (<year>2010</year>). <article-title>The relationship between organisational climate and employee satisfaction in a South African information and technology organisation</article-title>. <source><italic>South African Journal of Industrial Psychology</italic></source>, <volume>36</volume>(<issue>1</issue>), <fpage>1</fpage>&#x2013;<lpage>9</lpage>.</mixed-citation></ref>
<ref id="CIT0013"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Challiol</surname>, <given-names>H</given-names></string-name>., &#x0026; <string-name><surname>Mignonac</surname>, <given-names>K</given-names></string-name></person-group>. (<year>2005</year>). <article-title>Relocation decision-making and couple relationships: A quantitative and qualitative study of dual-earner couples</article-title>. <source><italic>Journal of Organizational Behavior</italic></source>, <volume>26</volume>(<issue>3</issue>), <fpage>247</fpage>&#x2013;<lpage>274</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1002/job.311">https://doi.org/10.1002/job.311</ext-link></comment></mixed-citation></ref>
<ref id="CIT0014"><mixed-citation publication-type="other"><person-group person-group-type="author"><string-name><surname>Collingridge</surname>, <given-names>D</given-names></string-name></person-group>. (<year>2014</year>). <source><italic>Validating a questionnaire</italic></source>. <comment>Retrieved February 25, 2017, from <ext-link ext-link-type="uri" xlink:href="http://www.methodspace.com/validating-a-questionnaire/">http://www.methodspace.com/validating-a-questionnaire/</ext-link></comment></mixed-citation></ref>
<ref id="CIT0015"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Collins</surname>, <given-names>K.M.T</given-names></string-name>., <string-name><surname>Onwuegbuzie</surname>, <given-names>A.J</given-names></string-name>., &#x0026; <string-name><surname>Sutton</surname>, <given-names>I.L</given-names></string-name></person-group>. (<year>2006</year>). <article-title>A model incorporating the rationale and purpose for conducting mixed methods research in special education and beyond</article-title>. <source><italic>Learning Disabilities: A Contemporary Journal</italic></source>, <volume>4</volume>, <fpage>67</fpage>&#x2013;<lpage>100</lpage>.</mixed-citation></ref>
<ref id="CIT0016"><mixed-citation publication-type="book"><person-group person-group-type="author"><collab>Constitution of the Republic of South Africa</collab></person-group>. (<year>1996</year>). <source><italic>Government Gazette</italic></source>. (No. 17678). <publisher-loc>Pretoria</publisher-loc>: <publisher-name>Government Printer</publisher-name>.</mixed-citation></ref>
<ref id="CIT0017"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Craythorne</surname>, <given-names>D.L</given-names></string-name></person-group>. (<year>2006</year>). <source><italic>Municipal administration: The handbook</italic></source>. (<edition>6th</edition> edn.). <publisher-loc>Cape Town</publisher-loc>: <publisher-name>Juta</publisher-name>.</mixed-citation></ref>
<ref id="CIT0018"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Creswell</surname>, <given-names>J.W</given-names></string-name></person-group>. (<year>2009</year>). <source><italic>Research design: Qualitative, quantitative and mixed methods approaches</italic></source>. (<edition>3rd</edition> edn.). <publisher-loc>Thousand Oaks, CA</publisher-loc>: <publisher-name>Sage</publisher-name>.</mixed-citation></ref>
<ref id="CIT0019"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Creswell</surname>, <given-names>J.W</given-names></string-name></person-group>. (<year>2014</year>). <source><italic>Research design: Qualitative, quantitative and mixed methods approaches</italic></source>. (<edition>4th</edition> edn.). <publisher-loc>Thousand Oaks, CA</publisher-loc>: <publisher-name>Sage</publisher-name>.</mixed-citation></ref>
<ref id="CIT0020"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Cummings</surname>, <given-names>T.G</given-names></string-name>., &#x0026; <string-name><surname>Worley</surname>, <given-names>C.G</given-names></string-name></person-group>. (<year>2015</year>). <source><italic>Organisation development and change</italic></source>. (<edition>10th</edition> edn.). <publisher-loc>Stamford, CT</publisher-loc>: <publisher-name>Cengage Learning</publisher-name>.</mixed-citation></ref>
<ref id="CIT0021"><mixed-citation publication-type="book"><person-group person-group-type="author"><collab>Department of Cooperative Governance and Traditional Affairs (DCOGTA)</collab></person-group>. (<year>2009</year>). <source><italic>State of local government in South Africa report</italic></source>. <publisher-loc>Pretoria</publisher-loc>: <publisher-name>Government Press</publisher-name>.</mixed-citation></ref>
<ref id="CIT0022"><mixed-citation publication-type="other"><person-group person-group-type="author"><collab>Department of Cooperative Governance and Traditional Affairs (DCOGTA)</collab></person-group>. (<year>2016</year>). <source><italic>Annual report for the financial year 2014/2015</italic></source>. <comment>Retrieved April 16, 2017, from <ext-link ext-link-type="uri" xlink:href="http://www.cogta.gov/cgta_2016/wp-content/uploads/2016/06/COGTA-Annual-Report-2014-2015.pdf">www.cogta.gov/cgta_2016/wp-content/uploads/2016/06/COGTA-Annual-Report-2014-2015.pdf</ext-link></comment></mixed-citation></ref>
<ref id="CIT0023"><mixed-citation publication-type="other"><person-group person-group-type="author"><collab>Department of Planning, Monitoring and Evaluation</collab></person-group>. (<year>2014</year>). <source><italic>Twenty year review: South Africa 1994&#x2013;2014: Background paper: Local government</italic></source>. <comment>Retrieved April 16, 2017, from <ext-link ext-link-type="uri" xlink:href="http://www.dpme.gov.za/publications/&#x2026;/20YR&#x0025;20Local&#x0025;20Government.pdf">www.dpme.gov.za/publications/&#x2026;/20YR&#x0025;20Local&#x0025;20Government.pdf</ext-link></comment></mixed-citation></ref>
<ref id="CIT0024"><mixed-citation publication-type="other"><person-group person-group-type="author"><string-name><surname>Driscoll</surname>, <given-names>D.L</given-names></string-name>., <string-name><surname>Appiah-Yeboah</surname>, <given-names>A</given-names></string-name>., <string-name><surname>Salib</surname>, <given-names>P</given-names></string-name>., &#x0026; <string-name><surname>Rupert</surname>, <given-names>D.J</given-names></string-name></person-group>. (<year>2007</year>). <source><italic>Merging qualitative and quantitative data in mixed methods research: How to and why not</italic></source>. <comment>Retrieved January 15, 2017, from <ext-link ext-link-type="uri" xlink:href="http://digitalcommons.unl.edu/icwdmeea/18">http://digitalcommons.unl.edu/icwdmeea/18</ext-link></comment></mixed-citation></ref>
<ref id="CIT0025"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Elo</surname>, <given-names>S</given-names></string-name>., <string-name><surname>K&#x00E4;&#x00E4;ri&#x00E4;inen</surname>, <given-names>M</given-names></string-name>., <string-name><surname>Kanste</surname>, <given-names>O</given-names></string-name>., <string-name><surname>P&#x00F6;lkki</surname>, <given-names>T</given-names></string-name>., <string-name><surname>Utriainen</surname>, <given-names>K</given-names></string-name>., &#x0026; <string-name><surname>Kyng&#x00E4;s</surname>, <given-names>H</given-names></string-name></person-group>. (<year>2014</year>). <article-title>Qualitative content analysis: A focus on trustworthiness</article-title>. <source><italic>Sage Open</italic></source>, <volume>4</volume>(<issue>1</issue>), <fpage>1</fpage>&#x2013;<lpage>10</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1177/2158244014522633">https://doi.org/10.1177/2158244014522633</ext-link></comment></mixed-citation></ref>
<ref id="CIT0026"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Falletta</surname>, <given-names>S.V</given-names></string-name></person-group>. (<year>2005</year>). <source><italic>Organizational diagnostic models: A review and synthesis</italic></source>. <publisher-loc>Sunnyvale, CA</publisher-loc>: <publisher-name>Leadersphere</publisher-name>.</mixed-citation></ref>
<ref id="CIT0027"><mixed-citation publication-type="book"><person-group person-group-type="editor"><string-name><surname>French</surname>, <given-names>W.L</given-names></string-name>., <string-name><surname>Bell</surname>, <given-names>C.H</given-names></string-name>., &#x0026; <string-name><surname>Zawacki</surname>, <given-names>R.A</given-names></string-name>. (Eds.)</person-group>. (<year>1978</year>). <source><italic>Organisation development: Theory, practice and research</italic></source>. <publisher-loc>Dallas, TX</publisher-loc>: <publisher-name>Business Publications</publisher-name>.</mixed-citation></ref>
<ref id="CIT0028"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Ghorpade</surname>, <given-names>J</given-names></string-name></person-group>. (<year>1971</year>). <source><italic>Assessment of organizational effectiveness: Issues, analysis, readings</italic></source>. <publisher-loc>Pacific Palisades, CA</publisher-loc>: <publisher-name>Goodyear</publisher-name>.</mixed-citation></ref>
<ref id="CIT0029"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Hall</surname>, <given-names>R.H</given-names></string-name></person-group>. (<year>1999</year>). <source><italic>Organizations: Structures, processes and outcomes</italic></source>. (<edition>7th</edition> edn.). <publisher-loc>Upper Saddle River, NJ</publisher-loc>: <publisher-name>Prentice Hall</publisher-name>.</mixed-citation></ref>
<ref id="CIT0030"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Harrison</surname>, <given-names>M.I</given-names></string-name></person-group>. (<year>2005</year>). <source><italic>Diagnosing organizations: Methods, models, and processes</italic></source>. (<edition>3rd</edition> edn.). <publisher-loc>Thousand Oaks, CA</publisher-loc>: <publisher-name>Sage</publisher-name>.</mixed-citation></ref>
<ref id="CIT0031"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Howard</surname>, <given-names>A</given-names></string-name></person-group>. (<year>1994</year>). <source><italic>Diagnosis for organizational change: Methods and models</italic></source>. <publisher-loc>New York</publisher-loc>: <publisher-name>The Guilford Press</publisher-name>.</mixed-citation></ref>
<ref id="CIT0032"><mixed-citation publication-type="book"><person-group person-group-type="author"><collab>IBM</collab></person-group> (<year>2015</year>). <source><italic>IBM statistics for Windows, version 23</italic></source>. <publisher-loc>Armonk, NW</publisher-loc>: <publisher-name>IBM Corp</publisher-name>.</mixed-citation></ref>
<ref id="CIT0033"><mixed-citation publication-type="book"><person-group person-group-type="author"><collab>IBM Business Consulting</collab></person-group>. (<year>2003</year>). <source><italic>2002 Langley Research Center (LaRC) Organizational Performance Survey</italic></source>. <publisher-loc>Fairfax, VA</publisher-loc>: <publisher-name>IBM Publishers</publisher-name>.</mixed-citation></ref>
<ref id="CIT0034"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Immordino</surname>, <given-names>K.M</given-names></string-name></person-group>. (<year>2010</year>). <source><italic>Organizational assessment and improvement in the public sector</italic></source>. <publisher-loc>Boca Raton, FL</publisher-loc>: <publisher-name>CRC Press</publisher-name>.</mixed-citation></ref>
<ref id="CIT0035"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Jackson</surname>, <given-names>W.U</given-names></string-name></person-group>. (<year>1984</year>). <article-title>Assessing performance in local government</article-title>. <source><italic>Long Range Planning</italic></source>, <volume>17</volume>(<issue>3</issue>), <fpage>24</fpage>&#x2013;<lpage>31</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/0024-6301(84)90005-0">https://doi.org/10.1016/0024-6301(84)90005-0</ext-link></comment></mixed-citation></ref>
<ref id="CIT0036"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Johnson</surname>, <given-names>R.B</given-names></string-name>., <string-name><surname>Onwuegbuzie</surname>, <given-names>A.J</given-names></string-name>., &#x0026; <string-name><surname>Turner</surname>, <given-names>L.A</given-names></string-name></person-group>. (<year>2007</year>). <article-title>Toward a definition of mixed methods research</article-title>. <source><italic>Journal of Mixed Methods Research</italic></source>, <volume>1</volume>(<issue>2</issue>), <fpage>112</fpage>&#x2013;<lpage>133</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1177/1558689806298224">https://doi.org/10.1177/1558689806298224</ext-link></comment></mixed-citation></ref>
<ref id="CIT0037"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Jones</surname>, <given-names>B.B</given-names></string-name>., &#x0026; <string-name><surname>Brazzel</surname>, <given-names>M</given-names></string-name></person-group>. (<year>2006</year>). <source><italic>The NTL handbook of organizational development and change: Principles, practices and perspectives</italic></source>. <publisher-loc>San Francisco, CA</publisher-loc>: <publisher-name>Pfeiffer</publisher-name>.</mixed-citation></ref>
<ref id="CIT0038"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Koma</surname>, <given-names>S.B</given-names></string-name></person-group>. (<year>2010</year>). <article-title>The state of local government in South Africa: Issues, trends and options</article-title>. <source><italic>Journal of Public Administration</italic></source>, <volume>45</volume>(<issue>1.1</issue>), <fpage>111</fpage>&#x2013;<lpage>120</lpage>.</mixed-citation></ref>
<ref id="CIT0039"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Lee</surname>, <given-names>D</given-names></string-name>., &#x0026; <string-name><surname>Brower</surname>, <given-names>R.S</given-names></string-name></person-group>. (<year>2006</year>). <article-title>Pushing the envelope on organizational effectiveness: Combining an old framework and a sharp tool</article-title>. <source><italic>Public Performance and Management Review</italic></source>, <volume>30</volume>(<issue>2</issue>), <fpage>155</fpage>&#x2013;<lpage>178</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.2753/PMR1530-9576300202">https://doi.org/10.2753/PMR1530-9576300202</ext-link></comment></mixed-citation></ref>
<ref id="CIT0040"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Leech</surname>, <given-names>N.L</given-names></string-name>., &#x0026; <string-name><surname>Onwuegbuzie</surname>, <given-names>A.J</given-names></string-name></person-group>. (<year>2009</year>). <article-title>A typology of mixed methods research designs</article-title>. <source><italic>Quality and Quantity</italic></source>, <volume>43</volume>(<issue>2</issue>), <fpage>265</fpage>&#x2013;<lpage>275</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/s11135-007-9105-3">https://doi.org/10.1007/s11135-007-9105-3</ext-link></comment></mixed-citation></ref>
<ref id="CIT0041"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Leech</surname>, <given-names>N.L</given-names></string-name>., <string-name><surname>Onwuegbuzie</surname>, <given-names>A.J</given-names></string-name>., &#x0026; <string-name><surname>Combs</surname>, <given-names>J.C</given-names></string-name></person-group>. (<year>2011</year>). <article-title>Writing publishable mixed methods research articles: Guidelines for emerging scholars in the health sciences and beyond</article-title>. <source><italic>International Journal of Multiple Research Approaches</italic></source>, <volume>5</volume>(<issue>1</issue>), <fpage>7</fpage>&#x2013;<lpage>24</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.5172/mra.2011.5.1.7">https://doi.org/10.5172/mra.2011.5.1.7</ext-link></comment></mixed-citation></ref>
<ref id="CIT0042"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Leibbrandt</surname>, <given-names>J.H</given-names></string-name>., &#x0026; <string-name><surname>Botha</surname>, <given-names>C.J</given-names></string-name></person-group>. (<year>2014</year>). <article-title>Leadership and management as an enabler for strategy execution in municipalities in South Africa</article-title>. <source><italic>Mediterranean Journal of Social Sciences</italic></source>, <volume>5</volume>(<issue>20</issue>), <fpage>329</fpage>&#x2013;<lpage>339</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.5901/mjss.2014.v5n20p329">https://doi.org/10.5901/mjss.2014.v5n20p329</ext-link></comment></mixed-citation></ref>
<ref id="CIT0043"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Likert</surname>, <given-names>R</given-names></string-name></person-group>. (<year>1932</year>). <article-title>A technique for the measurement of attitudes</article-title>. <source><italic>Archives of Psychology</italic></source>, <volume>140</volume>, <fpage>152</fpage>.</mixed-citation></ref>
<ref id="CIT0044"><mixed-citation publication-type="book"><person-group person-group-type="author"><collab>Local Government: Municipal Structures Act</collab></person-group>. (<year>1998</year>). <source><italic>Government Gazette</italic></source>. (No. 19614). <publisher-loc>Pretoria</publisher-loc>: <publisher-name>Government Printer</publisher-name>.</mixed-citation></ref>
<ref id="CIT0045"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Locke</surname>, <given-names>K</given-names></string-name></person-group>. (<year>2001</year>). <source><italic>Grounded theory in management research</italic></source>. <publisher-loc>London</publisher-loc>: <publisher-name>Sage</publisher-name>.</mixed-citation></ref>
<ref id="CIT0046"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Lusthaus</surname>, <given-names>C</given-names></string-name>., <string-name><surname>Adrien</surname>, <given-names>M</given-names></string-name>., <string-name><surname>Anderson</surname>, <given-names>G</given-names></string-name>., <string-name><surname>Carden</surname>, <given-names>F</given-names></string-name>., &#x0026; <string-name><surname>Montalv&#x00E1;n</surname>, <given-names>G.P</given-names></string-name></person-group>. (<year>2002</year>). <source><italic>Organizational assessment: A framework for improving performance</italic></source>. <publisher-loc>Washington, DC</publisher-loc>: <publisher-name>Inter-American Development Bank</publisher-name>.</mixed-citation></ref>
<ref id="CIT0047"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Martins</surname>, <given-names>N</given-names></string-name>., &#x0026; <string-name><surname>Coetzee</surname>, <given-names>M</given-names></string-name></person-group>. (<year>2009</year>). <article-title>Applying the Burke-Litwin model as a diagnostic framework for assessing organisational effectiveness</article-title>. <source><italic>South African Journal of Human Resource Management</italic></source>, <volume>7</volume>(<issue>1</issue>), <fpage>144</fpage>&#x2013;<lpage>156</lpage>.</mixed-citation></ref>
<ref id="CIT0048"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Martins</surname>, <given-names>N</given-names></string-name>., &#x0026; <string-name><surname>Geldenhuys</surname>, <given-names>D</given-names></string-name></person-group>. (<year>2016</year>). <source><italic>Fundamentals of organisation development</italic></source>. <publisher-loc>Cape Town</publisher-loc>: <publisher-name>Juta</publisher-name>.</mixed-citation></ref>
<ref id="CIT0049"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Mbecke</surname>, <given-names>P</given-names></string-name></person-group>. (<year>2014</year>). <article-title>Corporate municipal governance for effective and efficient public service delivery in South Africa</article-title>. <source><italic>Journal of Governance and Regulation</italic></source>, <volume>3</volume>(<issue>4</issue>), <fpage>98</fpage>&#x2013;<lpage>106</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.22495/jgr_v3_i4_c1_p2">https://doi.org/10.22495/jgr_v3_i4_c1_p2</ext-link></comment></mixed-citation></ref>
<ref id="CIT0050"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>McFee</surname>, <given-names>G</given-names></string-name></person-group>. (<year>1992</year>). <article-title>Triangulation in research: Two confusions</article-title>. <source><italic>Educational Research</italic></source>, <volume>34</volume>(<issue>3</issue>), <fpage>215</fpage>&#x2013;<lpage>219</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1080/0013188920340305">https://doi.org/10.1080/0013188920340305</ext-link></comment></mixed-citation></ref>
<ref id="CIT0051"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Mitlin</surname>, <given-names>D</given-names></string-name></person-group>. (<year>2000</year>). <article-title>Towards <italic>more</italic> pro-poor local governments in urban areas</article-title>. <source><italic>Environment and Urbanization</italic></source>, <volume>12</volume>(<issue>1</issue>), <fpage>3</fpage>&#x2013;<lpage>11</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1177/095624780001200101">https://doi.org/10.1177/095624780001200101</ext-link></comment></mixed-citation></ref>
<ref id="CIT0052"><mixed-citation publication-type="thesis"><person-group person-group-type="author"><string-name><surname>Mortimer</surname>, <given-names>N.L</given-names></string-name></person-group>. (<year>2004</year>). <source><italic>The establishment and development of a performance management system in the local government sector in South Africa</italic></source>. <comment>Unpublished doctoral thesis</comment>, <publisher-name>University of Kwa-Zulu Natal</publisher-name>, <publisher-loc>Durban, South Africa</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0053"><mixed-citation publication-type="other"><person-group person-group-type="author"><collab>Municipal IQ Hotspots Monitor</collab></person-group>. (<year>2016</year>). <source><italic>Municipal data and Intelligence</italic></source>. <comment>Retrieved March 08, 2017, from <ext-link ext-link-type="uri" xlink:href="http://www.municipaliq.co.za/index.php?site_page=hotspots.php">www.municipaliq.co.za/index.php?site_page=hotspots.php</ext-link></comment></mixed-citation></ref>
<ref id="CIT0054"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Mutiro</surname>, <given-names>N</given-names></string-name>., &#x0026; <string-name><surname>Fore</surname>, <given-names>S</given-names></string-name></person-group>. (<year>2015</year>). <article-title>The perception of corporate services directorate in a metropolitan municipality on King III good governance compliance in business and projects</article-title>. <source><italic>Journal of Governance and Regulation</italic></source>, <volume>4</volume>(<issue>1</issue>), <fpage>130</fpage>&#x2013;<lpage>140</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.22495/jgr_v4_i1_c1_p4">https://doi.org/10.22495/jgr_v4_i1_c1_p4</ext-link></comment></mixed-citation></ref>
<ref id="CIT0055"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Newman</surname>, <given-names>I</given-names></string-name>., <string-name><surname>Shell</surname>, <given-names>D.F</given-names></string-name>., <string-name><surname>Ming</surname>, <given-names>Q</given-names></string-name>., <string-name><surname>Jianping</surname>, <given-names>X</given-names></string-name>., &#x0026; <string-name><surname>Maas</surname>, <given-names>M.R</given-names></string-name></person-group>. (<year>2006</year>). <source><italic>Adolescent alcohol use: Mixed methods research approach</italic></source>. <publisher-name>Educational Psychology Papers and Publications</publisher-name>. <comment>Paper 92. Retrieved March 17, 2017, from <ext-link ext-link-type="uri" xlink:href="http://digitalcommons.unl.edu/edpsychpapers/92">http://digitalcommons.unl.edu/edpsychpapers/92</ext-link></comment></mixed-citation></ref>
<ref id="CIT0056"><mixed-citation publication-type="thesis"><person-group person-group-type="author"><string-name><surname>Olivier</surname>, <given-names>B.H</given-names></string-name></person-group>. (<year>2014</year>). <source><italic>The development and validation of an assessment framework for measuring the organisational effectiveness of a metropolitan municipality in South Africa</italic></source>. <comment>Unpublished doctor&#x2019;s thesis</comment>, <publisher-name>University of South Africa</publisher-name>, <publisher-loc>Pretoria, South Africa</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0057"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Onwuegbuzie</surname>, <given-names>A.J</given-names></string-name>., &#x0026; <string-name><surname>Collins</surname>, <given-names>M.T</given-names></string-name></person-group>. (<year>2007</year>). <article-title>A typology of mixed methods sampling designs in social science research</article-title>. <source><italic>The Qualitative Report</italic></source>, <volume>12</volume>(<issue>2</issue>), <fpage>281</fpage>&#x2013;<lpage>316</lpage>.</mixed-citation></ref>
<ref id="CIT0058"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Onwuegbuzie</surname>, <given-names>A.J</given-names></string-name>., &#x0026; <string-name><surname>Johnson</surname>, <given-names>R.B</given-names></string-name></person-group>. (<year>2006</year>). <article-title>The validity issue in mixed research</article-title>. <source><italic>Research in the Schools</italic></source>, <volume>13</volume>(<issue>1</issue>), <fpage>48</fpage>&#x2013;<lpage>63</lpage>.</mixed-citation></ref>
<ref id="CIT0059"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Paul</surname>, <given-names>J</given-names></string-name></person-group>. (<year>1996</year>). <article-title>Between-method triangulation in organizational diagnosis</article-title>. <source><italic>International Journal of Organizational Analysis</italic></source>, <volume>4</volume>(<issue>2</issue>), <fpage>135</fpage>&#x2013;<lpage>156</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1108/eb028845">https://doi.org/10.1108/eb028845</ext-link></comment></mixed-citation></ref>
<ref id="CIT0060"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Rakodi</surname>, <given-names>C</given-names></string-name></person-group>. (<year>1997</year>). <chapter-title>Global forces, urban challenges, and urban management in Africa</chapter-title>. In <person-group person-group-type="editor"><string-name><given-names>C.</given-names> <surname>Rakodi</surname></string-name> (Ed.)</person-group>, <source><italic>The urban challenge in Africa: Growth and management of its largest cities</italic></source> (pp. <fpage>17</fpage>&#x2013;<lpage>73</lpage>). <publisher-loc>New York</publisher-loc>: <publisher-name>United Nations University Press</publisher-name>.</mixed-citation></ref>
<ref id="CIT0061"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Rossman</surname>, <given-names>G</given-names></string-name>., &#x0026; <string-name><surname>Wilson</surname>, <given-names>B</given-names></string-name></person-group>. (<year>1991</year>). <article-title>Numbers and words revisited: Being shamelessly eclectic</article-title>. <source><italic>Evaluation Review</italic></source>, <volume>9</volume>(<issue>5</issue>), <fpage>627</fpage>&#x2013;<lpage>643</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1177/0193841X8500900505">https://doi.org/10.1177/0193841X8500900505</ext-link></comment></mixed-citation></ref>
<ref id="CIT0062"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Saeed</surname>, <given-names>B.B</given-names></string-name>., &#x0026; <string-name><surname>Wang</surname>, <given-names>W</given-names></string-name></person-group>. (<year>2013</year>). <article-title>Organisational diagnoses: A survey of the literature and proposition of a new diagnostic model</article-title>. <source><italic>International Journal of Information Systems and Change Management</italic></source>, <volume>6</volume>(<issue>3</issue>), <fpage>222</fpage>&#x2013;<lpage>238</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1504/IJISCM.2013.058328">https://doi.org/10.1504/IJISCM.2013.058328</ext-link></comment></mixed-citation></ref>
<ref id="CIT0063"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Salkind</surname>, <given-names>N.J</given-names></string-name></person-group>. (<year>2012</year>). <source><italic>Exploring research</italic></source>. (<edition>8th</edition> edn.). <publisher-loc>Upper Saddle River, NJ</publisher-loc>: <publisher-name>Prentice Hall</publisher-name>.</mixed-citation></ref>
<ref id="CIT0064"><mixed-citation publication-type="other"><person-group person-group-type="author"><string-name><surname>Schmidt</surname>, <given-names>D</given-names></string-name></person-group>. (<year>2010</year>). <article-title>Leadership in local governance and development</article-title>. In <source><italic>Ethical leadership and political culture in local government: A civil society perspective on local Government in South Africa</italic></source>. <comment>Retrieved April 16, 2017, from <ext-link ext-link-type="uri" xlink:href="http://ggln.org.za/ggln-sorg-report-july2010.pdf">http://ggln.org.za/ggln-sorg-report-july2010.pdf</ext-link></comment></mixed-citation></ref>
<ref id="CIT0065"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Scott</surname>, <given-names>S.B</given-names></string-name>., <string-name><surname>Bergeman</surname>, <given-names>C.S</given-names></string-name>., <string-name><surname>Verney</surname>, <given-names>A</given-names></string-name>., <string-name><surname>Longenbaker</surname>, <given-names>S</given-names></string-name>., <string-name><surname>Markey</surname>, <given-names>M.A</given-names></string-name>., &#x0026; <string-name><surname>Bisconti</surname>, <given-names>T.L</given-names></string-name></person-group>. (<year>2007</year>). <article-title>Social support in widowhood: A mixed methods study</article-title>. <source><italic>Journal of Mixed Methods Research</italic></source>, <volume>1</volume>(<issue>3</issue>), <fpage>242</fpage>&#x2013;<lpage>266</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1177/1558689807302453">https://doi.org/10.1177/1558689807302453</ext-link></comment></mixed-citation></ref>
<ref id="CIT0066"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Shenton</surname>, <given-names>A.K</given-names></string-name></person-group>. (<year>2004</year>). <article-title>Strategies for ensuring trustworthiness in qualitative research projects</article-title>. <source><italic>Education for Information</italic></source>, <volume>22</volume>, <fpage>63</fpage>&#x2013;<lpage>75</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3233/EFI-2004-22201">https://doi.org/10.3233/EFI-2004-22201</ext-link></comment></mixed-citation></ref>
<ref id="CIT0067"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Smit</surname>, <given-names>B.R</given-names></string-name></person-group>. (<year>1999</year>). <article-title>Using the South African excellence model to focus improvement strategies in South Africa</article-title>. <source><italic>South African Journal of Industrial Engineering</italic></source>, <volume>10</volume>(<issue>1</issue>), <fpage>63</fpage>&#x2013;<lpage>72</lpage>.</mixed-citation></ref>
<ref id="CIT0068"><mixed-citation publication-type="other"><person-group person-group-type="author"><collab>South African Institute of Race Relations</collab></person-group>. (<year>2014</year>). <source><italic>The 80/20 report: Local government in 80 indicators after 20 years of democracy</italic></source>. <comment>Retrieved April 16, 2017, from <ext-link ext-link-type="uri" xlink:href="http://www.poa.gov.za/localgovernment/Supporting&#x0025;20Documentation/The&#x0025;2080-20&#x0025;20Report&#x0025;20on&#x0025;20Local&#x0025;20Government-26&#x0025;20May&#x0025;202014.pdf">http://www.poa.gov.za/localgovernment/Supporting&#x0025;20Documentation/The&#x0025;2080-20&#x0025;20Report&#x0025;20on&#x0025;20Local&#x0025;20Government-26&#x0025;20May&#x0025;202014.pdf</ext-link></comment></mixed-citation></ref>
<ref id="CIT0069"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Sowa</surname>, <given-names>J.E</given-names></string-name>., <string-name><surname>Seldon</surname>, <given-names>S.C</given-names></string-name>., &#x0026; <string-name><surname>Sandfort</surname>, <given-names>J.R</given-names></string-name></person-group>. (<year>2004</year>). <article-title>No longer unmeasurable? A multidimensional integrated model of nonprofit organizational effectiveness</article-title>. <source><italic>Nonprofit and Voluntary Sector Quarterly</italic></source>, <volume>33</volume>(<issue>4</issue>), <fpage>711</fpage>&#x2013;<lpage>728</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1177/0899764004269146">https://doi.org/10.1177/0899764004269146</ext-link></comment></mixed-citation></ref>
<ref id="CIT0070"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Tashakkori</surname>, <given-names>A</given-names></string-name>., &#x0026; <string-name><surname>Teddlie</surname>, <given-names>C</given-names></string-name></person-group>. (<year>2003</year>). <chapter-title>The past and future of mixed methods research: From data triangulation to mixed model designs</chapter-title>. In <person-group person-group-type="editor"><string-name><given-names>A.</given-names> <surname>Tashakkori</surname></string-name> &#x0026; <string-name><given-names>C.</given-names> <surname>Teddlie</surname></string-name> (Eds.)</person-group>, <source><italic>Handbook of mixed methods in social and behavioral research</italic></source> (pp. <fpage>671</fpage>&#x2013;<lpage>701</lpage>). <publisher-loc>Thousand Oaks, CA</publisher-loc>: <publisher-name>Sage</publisher-name>.</mixed-citation></ref>
<ref id="CIT0071"><mixed-citation publication-type="book"><person-group person-group-type="editor"><string-name><surname>Tashakkori</surname>, <given-names>A</given-names></string-name>., &#x0026; <string-name><surname>Teddlie</surname>, <given-names>C</given-names></string-name>. (Eds.)</person-group>. (<year>2010</year>). <source><italic>Handbook of mixed methods in social and behavioral research</italic></source>. (<edition>2nd</edition> edn.). <publisher-loc>Thousand Oaks, CA</publisher-loc>: <publisher-name>Sage</publisher-name>.</mixed-citation></ref>
<ref id="CIT0072"><mixed-citation publication-type="thesis"><person-group person-group-type="author"><string-name><surname>Thomas</surname>, <given-names>K.M</given-names></string-name></person-group>. (<year>2012</year>). <source><italic>An organizational diagnosis of a centralized investigational new drug core within a large academic health center</italic></source>. <comment>Unpublished master&#x2019;s dissertation</comment>, <publisher-name>University of Pennsylvania</publisher-name>, <publisher-loc>Philadelphia, PA</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0073"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Torrance</surname>, <given-names>H</given-names></string-name></person-group>. (<year>2012</year>). <article-title>Triangulation, respondent validation, and democratic participation in mixed methods research</article-title>. <source><italic>Journal of Mixed Methods Research</italic></source>, <volume>6</volume>(<issue>2</issue>), <fpage>111</fpage>&#x2013;<lpage>123</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1177/1558689812437185">https://doi.org/10.1177/1558689812437185</ext-link></comment></mixed-citation></ref>
<ref id="CIT0074"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Tsuchiya</surname>, <given-names>K</given-names></string-name></person-group>. (<year>2016</year>). <article-title>Intervention in time of organization: Case study of organizational diagnosis during organization development</article-title>. <source><italic>The Japanese Journal of Experimental Social Psychology</italic></source>, <volume>56</volume>(<issue>1</issue>), <fpage>70</fpage>&#x2013;<lpage>81</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.2130/jjesp.si2-5">https://doi.org/10.2130/jjesp.si2-5</ext-link></comment></mixed-citation></ref>
<ref id="CIT0075"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Van Thiel</surname>, <given-names>S</given-names></string-name>., &#x0026; <string-name><surname>Leeuw</surname>, <given-names>F.L</given-names></string-name></person-group>. (<year>2002</year>). <article-title>The performance paradox in the public sector</article-title>. <source><italic>Public Performance and Management Review</italic></source>, <volume>25</volume>(<issue>3</issue>), <fpage>267</fpage>&#x2013;<lpage>281</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.2307/3381236">https://doi.org/10.2307/3381236</ext-link></comment></mixed-citation></ref>
<ref id="CIT0076"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Vitale</surname>, <given-names>D.C</given-names></string-name>., <string-name><surname>Armenakis</surname>, <given-names>A.A</given-names></string-name>., &#x0026; <string-name><surname>Field</surname>, <given-names>H.S</given-names></string-name></person-group>. (<year>2008</year>). <article-title>Integrating qualitative and quantitative methods for organizational diagnosis: Possible priming effects?</article-title> <source><italic>Journal of Mixed Methods Research</italic></source>, <volume>2</volume>(<issue>1</issue>), <fpage>87</fpage>&#x2013;<lpage>105</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1177/1558689807309968">https://doi.org/10.1177/1558689807309968</ext-link></comment></mixed-citation></ref>
<ref id="CIT0077"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Wiley</surname>, <given-names>J.W</given-names></string-name></person-group>. (<year>2010</year>). <source><italic>Strategic employee surveys</italic></source>. <publisher-loc>San Francisco, CA</publisher-loc>: <publisher-name>Jossey-Bass</publisher-name>.</mixed-citation></ref>
<ref id="CIT0078"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Yauch</surname>, <given-names>C.A</given-names></string-name>., &#x0026; <string-name><surname>Steudel</surname>, <given-names>H.J</given-names></string-name></person-group>. (<year>2003</year>). <article-title>Complementary use of qualitative and quantitative cultural assessment methods</article-title>. <source><italic>Organizational Research Methods</italic></source>, <volume>6</volume>(<issue>4</issue>), <fpage>465</fpage>&#x2013;<lpage>481</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1177/1094428103257362">https://doi.org/10.1177/1094428103257362</ext-link></comment></mixed-citation></ref>
<ref id="CIT0079"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Youngs</surname>, <given-names>H</given-names></string-name>., &#x0026; <string-name><surname>Piggot-Irvine</surname>, <given-names>E</given-names></string-name></person-group>. (<year>2012</year>). <article-title>The application of a multiphase triangulation approach to mixed methods: The research of an aspiring school principal development program</article-title>. <source><italic>Journal of Mixed Methods Research</italic></source>, <volume>6</volume>(<issue>3</issue>), <fpage>184</fpage>&#x2013;<lpage>198</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1177/1558689811420696">https://doi.org/10.1177/1558689811420696</ext-link></comment></mixed-citation></ref>
</ref-list>
<fn-group>
<fn><p><bold>How to cite this article:</bold> Olivier B.H. (2017). The use of mixed-methods research to diagnose the organisational performance of a local government. <italic>SA Journal of Industrial Psychology/SA Tydskrif vir Bedryfsielkunde, 43</italic>(0), a1453. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.4102/sajip.v43i0.1453">https://doi.org/10.4102/sajip.v43i0.1453</ext-link></p></fn>
</fn-group>
</back>
</article>