Resource Planning
Qualitative Assessment of Project Performance
Project managers should provide an opportunity to ask such questions as "What is your gut feeling about how the project going?" and "How do you think our client perceives the project?" This creates the opportunity for reflection and dialogue around larger issues on the project. The project manager creates an atmosphere for the team to go beyond the data and search for meaning. This type of discussion and reflection is very difficult in the stress of day-to-day problem solving.
The project manager has several tools for developing good quantitative information - based on numbers and measurements - such as the project schedules, budgets, and budget reports, risk analysis, and goal tracking. This quantitative information is essential to understanding the current status and trends on the project. Just as important is the development of qualitative information - comparisons of qualities - such as judgments made by expert team members that go beyond the quantitative data provided in a report. Some would label this the "gut feeling" or intuition of experienced project managers.
The Humm Factor is a survey tool developed by Russ Darnall to capture the thoughts of project participants. It derived its name from a project manager who always claimed he could tell you more by listening to the hum of the project than reading all the project reports. "Do you feel the project is doing the things it needs to do to stay on schedule?" and "Is the project team focused on project goals?" are the types of questions that can be included in the Humm Factor. It is distributed on a weekly or less frequent basis depending on the complexity profile of the project. A project with a high level of complexity due to team-based and cultural issues will be surveyed more frequently.
The qualitative responses are converted to a quantitative value as a score from 1 to 10. Responses are tracked by individuals and the total project, resulting in qualitative comparisons over time. The project team reviews the ratings regularly, looking for trends that indicate an issue may be emerging on the project that might need exploring.
Example: Humm Survey Uncovers Concerns
On a project in South Carolina, the project surveyed the project leadership with a Humm Survey each week. The Humm Factor indicated an increasing worry about the schedule beginning to slip when the schedule reports indicated that everything was according to plan. When the project manager began trying to understand why the Humm Factor was showing concerns about the schedule, he discovered an apprehension about the performance of a critical project supplier. When he asked team members, they responded, "It was the way they answered the phone or the hesitation when providing information - something didn't feel right."
The procurement manager visited the supplier and discovered the company was experiencing financial problems and had serious cash flow problems. The project manager was able to develop a plan to help the supplier through the period, and the supplier eventually recovered. The project was able to meet performance goals. The Humm Factor survey provided a tool for members of the project team to express concerns that were based on very soft data, and the project team was able to discover a potential problem.
Another project team used the Humm Factor to survey the client monthly. The completed surveys went to a person who was not on the project team to provide anonymity to the responses. The responses were discussed at the monthly project review meetings, and the project manager summarized the results and addressed all the concerns expressed in the report. "I don't feel my concerns are being heard" was one response that began increasing during the project, and the project manager spent a significant portion of the next project review meeting attempting to understand what this meant. The team discovered that as the project progressed toward major milestones, the project team became more focused on solving daily problems, spent more time in meetings, and their workday was becoming longer. The result was fewer contacts with the clients, slower responses in returning phone calls, and much fewer coffee breaks where team members could casually discuss the project with the client.
The result of the conversation led to better understanding by both the project team and client team of the change in behavior based on the current phase of the project and the commitment to developing more frequent informal discussion about the project.