The primary objective of this study is to determine whether practicing personnelists and research scholars agree on what constitutes an effective performance appraisal system in public safety organization. If Personnel managers at public safety organization possess knowledge of the characteristics of effective performance appraisal system in public safety organizations, they are more likely to design and/or advocate performance appraisal system in public safety organizations that include these important attributes. In addition, the research is an opportunity for the academic community to learn from the experience of practitioners. Concepts and techniques that are valued by academics may not be functional or effective for those involved in the development and administration of performance appraisal system in public safety organizations. Thus, areas of disagreement can serve to identify subjects for further research and improve both theory and practice.