Five Pillars Assessment Checklist

Appendix B — Five Pillars Assessment Checklist

This checklist provides a practical tool for organizations to assess their AI systems and governance practices against the Five Pillars of AI Righteousness. Each pillar is broken down into specific assessment items that can be evaluated on a simple scale.

Instructions: For each item, assess your organization’s current state using the following scale:

  • ✅ Yes — Fully implemented and consistently practiced
  • ⚠️ Partial — Partially implemented or inconsistent
  • ❌ No — Not implemented or not yet addressed
  • N/A — Not applicable to your organization

Pillar 1: Integrity — Truthful AI

Integrity requires that AI systems be honest, transparent, auditable, and free from deception.

Section 1.1: Truthfulness

#Assessment ItemYesPartialNoN/A
1.1.1Does the AI system accurately represent its capabilities and limitations?☐☐☐☐
1.1.2Does the AI system disclose its uncertainty and margin of error?☐☐☐☐
1.1.3Does the AI system avoid generating false or misleading information?☐☐☐☐
1.1.4Does the AI system clearly distinguish between facts and opinions or speculation?☐☐☐☐
1.1.5Are users informed when they are interacting with an AI system?☐☐☐☐

Section 1.2: Transparency

#Assessment ItemYesPartialNoN/A
1.2.1Is the AI system’s decision-making process documented and explainable?☐☐☐☐
1.2.2Are the AI system’s training data and methodology disclosed?☐☐☐☐
1.2.3Can the AI system’s decisions be traced and audited?☐☐☐☐
1.2.4Are potential biases in the AI system disclosed?☐☐☐☐
1.2.5Is the AI system’s performance monitoring transparent to stakeholders?☐☐☐☐

Section 1.3: No Deception

#Assessment ItemYesPartialNoN/A
1.3.1Has the AI system been tested for deceptive behavior (e.g., identity fabrication, hiding mistakes)?☐☐☐☐
1.3.2Does the AI system have safeguards against generating deceptive content?☐☐☐☐
1.3.3Is there a mechanism to detect and correct AI deception when it occurs?☐☐☐☐
1.3.4Are users alerted when the AI system has made an error or generated misleading information?☐☐☐☐
1.3.5Does the organization have policies prohibiting the use of AI for deceptive purposes?☐☐☐☐

Pillar 2: Justice — Fair AI

Justice requires that AI systems treat all individuals and groups equitably, without unjust bias or discrimination.

Section 2.1: Non-Discrimination

#Assessment ItemYesPartialNoN/A
2.1.1Has the AI system been tested for bias against protected groups (race, gender, age, etc.)?☐☐☐☐
2.1.2Does the AI system produce equitable outcomes across different demographic groups?☐☐☐☐
2.1.3Are bias mitigation techniques applied when bias is detected?☐☐☐☐
2.1.4Is the AI system’s training data representative of all affected populations?☐☐☐☐
2.1.5Are there ongoing monitoring processes to detect emerging bias?☐☐☐☐

Section 2.2: Equity

#Assessment ItemYesPartialNoN/A
2.2.1Does the AI system actively promote equitable outcomes, not just avoid discrimination?☐☐☐☐
2.2.2Are processes in place to correct historical inequities that the AI system may perpetuate?☐☐☐☐
2.2.3Is accessibility considered in the design and deployment of the AI system?☐☐☐☐
2.2.4Are diverse perspectives included in the AI system’s design and testing?☐☐☐☐
2.2.5Does the organization have policies for equitable AI deployment?☐☐☐☐

Section 2.3: Procedural Justice

#Assessment ItemYesPartialNoN/A
2.3.1Is the AI system’s decision-making process transparent and understandable?☐☐☐☐
2.3.2Are affected parties informed about AI decisions that impact them?☐☐☐☐
2.3.3Is there a mechanism for individuals to challenge or appeal AI decisions?☐☐☐☐
2.3.4Are decisions reviewed by humans when appropriate?☐☐☐☐
2.3.5Is there accountability for AI decisions that affect individuals?☐☐☐☐

Pillar 3: Stewardship — Responsible AI Governance

Stewardship requires that humans responsibly develop and govern AI with care, foresight, and accountability.

Section 3.1: Human Oversight

#Assessment ItemYesPartialNoN/A
3.1.1Is there meaningful human oversight of AI systems?☐☐☐☐
3.1.2Are humans able to intervene and override AI decisions when necessary?☐☐☐☐
3.1.3Is there a clear escalation path for AI decisions requiring human review?☐☐☐☐
3.1.4Are the roles and responsibilities of human overseers clearly defined?☐☐☐☐
3.1.5Are human overseers adequately trained to supervise AI systems?☐☐☐☐

Section 3.2: Accountability

#Assessment ItemYesPartialNoN/A
3.2.1Is there clear accountability for AI outcomes?☐☐☐☐
3.2.2Are roles and responsibilities for AI governance clearly defined?☐☐☐☐
3.2.3Is there a designated AI governance lead or committee?☐☐☐☐
3.2.4Is accountability documented and communicated?☐☐☐☐
3.2.5Is there accountability for third-party AI systems used by the organization?☐☐☐☐

Section 3.3: Risk Management

#Assessment ItemYesPartialNoN/A
3.3.1Have AI risks been identified and assessed?☐☐☐☐
3.3.2Is there a risk management process for AI systems?☐☐☐☐
3.3.3Are risks monitored and reviewed regularly?☐☐☐☐
3.3.4Is there a process for identifying emerging AI risks?☐☐☐☐
3.3.5Are risk mitigation strategies implemented and evaluated?☐☐☐☐

Pillar 4: Wisdom — Wise AI Decisions

Wisdom requires that AI decisions reflect sound judgment, foresight, and moral discernment.

Section 4.1: Sound Judgment

#Assessment ItemYesPartialNoN/A
4.1.1Are AI decisions based on sound reasoning and appropriate data?☐☐☐☐
4.1.2Does the AI system weigh competing values and interests appropriately?☐☐☐☐
4.1.3Is there a process for evaluating the quality of AI decisions?☐☐☐☐
4.1.4Are alternative courses of action considered before AI decisions are made?☐☐☐☐
4.1.5Does the AI system demonstrate prudence in its decision-making?☐☐☐☐

Section 4.2: Foresight

#Assessment ItemYesPartialNoN/A
4.2.1Does the AI system anticipate long-term consequences of decisions?☐☐☐☐
4.2.2Has the AI system been tested for potential unintended consequences?☐☐☐☐
4.2.3Are mechanisms in place to detect and respond to unintended consequences?☐☐☐☐
4.2.4Is the AI system’s decision-making adaptive to changing contexts?☐☐☐☐
4.2.5Have potential future scenarios been considered in the AI system’s design?☐☐☐☐

Section 4.3: Moral Discernment

#Assessment ItemYesPartialNoN/A
4.3.1Does the AI system recognize ethical dimensions of decisions?☐☐☐☐
4.3.2Has the AI system been tested for ethical reasoning capabilities?☐☐☐☐
4.3.3Is there a process for identifying and addressing ethical concerns in AI decisions?☐☐☐☐
4.3.4Are diverse ethical perspectives considered in AI system design?☐☐☐☐
4.3.5Is the AI system’s behavior consistent with the organization’s values?☐☐☐☐

Pillar 5: Beneficence — AI for Human Flourishing

Beneficence requires that AI systems actively promote human and environmental well-being.

Section 5.1: Human Well-Being

#Assessment ItemYesPartialNoN/A
5.1.1Does the AI system contribute to human well-being?☐☐☐☐
5.1.2Has the AI system’s impact on human health and safety been assessed?☐☐☐☐
5.1.3Are processes in place to maximize positive impacts on human well-being?☐☐☐☐
5.1.4Is the AI system designed to serve human needs and dignity?☐☐☐☐
5.1.5Are vulnerable populations protected from AI-related harm?☐☐☐☐

Section 5.2: Environmental Sustainability

#Assessment ItemYesPartialNoN/A
5.2.1Has the AI system’s environmental impact been assessed?☐☐☐☐
5.2.2Are measures in place to minimize the AI system’s environmental footprint?☐☐☐☐
5.2.3Is the AI system designed with environmental sustainability in mind?☐☐☐☐
5.2.4Does the organization consider environmental impact in AI procurement decisions?☐☐☐☐
5.2.5Is the organization committed to sustainable AI practices?☐☐☐☐

Section 5.3: Common Good

#Assessment ItemYesPartialNoN/A
5.3.1Does the AI system serve the broader public interest?☐☐☐☐
5.3.2Is the AI system’s impact on society assessed?☐☐☐☐
5.3.3Are mechanisms in place to ensure the AI system benefits society?☐☐☐☐
5.3.4Does the organization consider the common good in AI decision-making?☐☐☐☐
5.3.5Is there stakeholder engagement to ensure the AI system serves the common good?☐☐☐☐

Summary Scorecard

Score Calculation

PillarTotal Items“Yes” Count“Partial” Count“No” CountScore (%)
Integrity15____________%
Justice15____________%
Stewardship15____________%
Wisdom15____________%
Beneficence15____________%

Score Interpretation

Score RangeRatingDescription
80–100%RighteousExemplary performance across all pillars
60–79%ProficientSolid performance with some areas for improvement
40–59%DevelopingFoundational practices in place; significant opportunities exist
20–39%EmergingBasic awareness; substantial improvement needed
0–19%UnassessedSystematic assessment and implementation needed

Action Planning

PillarKey Gaps IdentifiedPriorityRecommended ActionsOwnerTimeline
Integrity
Justice
Stewardship
Wisdom
Beneficence

Next Steps

StepActionOwnerTimeline
1Complete the assessment for all pillars
2Identify priority gaps (highest risk, highest impact)
3Develop action plans for priority gaps
4Implement corrective actions
5Re-assess periodically (recommended: annually)