The study in this article provides reasons why BI is not fully implemented in some organizations. The thematic approach to determining why the technological tools are or are not used by managers provides an actionable set of areas where improvements can be made. One aspect that may relate to our discussions on asking the right questions is, "do managers really need to know how to use BI tools?" In many organizations, managers have enough knowledge about specialized data and tools to know how to task their specialists (BI analysts, in this case) to use them to answer their requirements. This can give analysts too much power in organizations with poor systems, whose data quality is questionable, or with authoritarian cultures where analysts fear giving the "wrong" answer. But in a highly effective environment, managers manage, and analysts analyze.
Research design and methodology
Thematic analysis of the interview documents
Table 4 shows the identified dominant themes and their descriptions. These themes were identified in the theoretical framework, which underpin the interview questions. The themes are: individual characteristics, system quality characteristics, organisational culture, macro-environment factors, behavioural beliefs and attitudes, effort perception, social influence, facilitating conditions, and 'other'.
Theme |
Description |
Individual characteristics |
Age, readiness for change |
Organisational factorsa |
This deals with focus on the customer, management support, user participation in the implementation, user training, and the iterative development approach |
System quality characteristics |
This deals with information quality, system quality, accessibility, and the user interface of the SAP Bl tool |
Organisational culture |
Information readiness, information culture, and change management |
Macro-environment factors |
Relevant business sector, competitiveness of the environment |
Behavioural beliefs and attitudes |
Relative advantage and job relevance |
Effort perception |
Ease of use |
Social influence |
Visibility and image |
Facilitating conditions |
Technical support |
Other |
Placing analytics usage on an individual's performance management scorecard |
TABLE 4: Dominant emerging themes.
Individual characteristics deal with age and the readiness for change of the managers. Organisational factors focus on management support of SAP BI, user participation in the implementation, user training, and the iterative development approach of SAP BI reports. System quality characteristics are concerned with information quality, system quality, accessibility, and the user interface of the SAP BI tool. Organisational culture deals with information readiness, information culture and change management, and macro-environment factors within the relevant business sector and competitiveness of the environment. Effort perception is the user's view on how easy the tool is to use. Social influence deals with visibility and image of the managers, whilst facilitating conditions with the technical support and report creation for SAP BI. The 'other' theme deals with placing SAP BI on the managers Information Technology Pillars Model (IPM) scorecard. These themes are described in Table 4.
Eight respondents across the directorates were interviewed. The interview duration was between 10 and 15 min. Table 5 provides an analysis of feedback from the interviews and identified relevant themes.
Questions |
Key findings |
Theme |
How often do you use SAP Bl? |
There is a general consensus that managers are not using SAP Bl. |
Organisational factors |
What challenges do you face when using SAP Bl? |
Performance was an issue. The user interface was not intuitive. Data quality was a problem. |
System quality characteristics |
How do you overcome these challenges? |
The super users draw reports in ECC6 which is a lengthy process. |
- |
Have you attended any training? How would you rate the training? |
The training is too generic. It should be customised per directorate. |
Organisational factors |
How do managers obtain data or information when they need to provide reports and supporting evidence to management? |
Managers receive the data from the clerks who extract the information on their behalf. |
Organisational culture |
Do you think if SAP Bl was on an individual's IPM scorecard, that usage would improve? |
Some managers felt this would definitely help, whilst others questioned the measurement and reliability of this. |
Other |
SAP Bl, SAP business intelligence; IPM, Information Technology Pillars Model. |
TABLE 5: Mapping of themes to interview documents.
The general consensus from the interviews is that managers are not using SAP BI. Managers appreciate the value of reporting; however, they are not extracting the information themselves. Many of the managers are receiving reporting information from their assistants or clerks. They are not using the tool frequently and, as a result, find the user interface difficult and cumbersome to use. They resort, therefore, to assistance from their staff, as the latter can extract the required information far more quickly than they can. The managers stated that the SAP BI training needs to be customised to their specific environment. The current training approach is more generic and deals with navigation around the tool. Customising the training would result in tailored specific needs for an area, that is, financial reporting, human resources reporting, or property management reporting. Data quality is a concern for the managers using SAP BI. Often, the SAP BI batch is completed with errors, resulting in data being incorrect. This casts doubt on the reliability of the data and results in managers using SAP R/3 instead as the main source of information. Reporting from R/3 is often slow because of the volume of data and results in managers not being able to make timely decisions or react quickly to changing circumstances. Some of the managers felt that performance of the reports was an issue, which resulted in managers not using SAP BI. The managers had different views on placing reporting on managers' IPM scorecard. Some felt strongly that this would enforce usage of the tool, whilst others felt that it would be counter-productive as managers would merely login to the tool to be 'viewed' as using SAP BI.