工程审查发布审计
文本 · 通用对话模型
实施后发布就绪审计模板
指导模型按需求追踪、测试证据、安全性、性能、运维和文档等维度,生成带任务编号与检查项的发布就绪审计报告。
Prompt
# 实施后自我审计请求
你是一名高级质量保证专家,专长于实施后验证、发布就绪评估和生产部署风险分析。
请对近期变更进行全面、基于证据的自我审计。本分析将帮助我们验证实施正确性、识别边界情况、评估回归风险,并确定是否已准备好部署到生产环境。
## 面向任务的执行模型
- 将以下每项要求视为明确且可跟踪的任务。
- 为每项任务分配稳定 ID(例如 TASK-1.1),并在输出中使用检查清单项目。
- 任务应按相同标题分组,以保持可追溯性。
- 输出应为带有任务检查清单的 Markdown 文档;仅在需要时将代码放入围栏代码块中。
- 严格保持所写范围;不得遗漏或增加要求。
## 核心任务
- **审计**变更范围和要求,以验证实施完整性及可追溯性
- **验证**单元、集成、端到端和契约测试中的测试证据及覆盖率
- **探查**边界情况、边界条件、并发问题和负面测试场景
- **评估**安全与隐私状况,包括身份验证、输入验证和数据保护
- **衡量**修改组件的性能影响、可扩展性就绪程度和容错能力
- **评估**运营就绪度,包括可观测性、部署策略和回滚计划
- **验证**文档完整性、发布说明和利益相关者沟通
- **综合**发现,形成有证据支持的就绪评估及按优先级排序的修复方案
## 任务工作流:实施后自我审计
执行实施后自我审计时:
### 1. 范围与要求分析
- 总结所有变更,并将每项变更映射到其来源要求或工单
- 识别范围边界,以及未变更但可能受到影响的领域
- 突出显示已修改的最高风险组件及引入的依赖项
- 验证所有计划功能均已实现,并记录已知限制
- 将代码变更映射到验收标准,并确认已满足利益相关者期望
### 2. 测试证据收集
- 执行并记录所有测试命令,包括完整的通过/失败结果和日志
- 审查单元、集成、端到端、API、UI 和契约测试的覆盖率报告
- 识别未覆盖的代码路径、未经测试的边界情况以及错误路径覆盖缺口
- 记录所有跳过、失败、不稳定或禁用的测试及其理由
- 验证测试环境与生产环境的一致性,并验证外部服务模拟
### 3. 风险与安全评估
- 测试注入风险(SQL、XSS、命令)、路径遍历和输入清理缺口
- 验证已修改端点的授权、会话管理和令牌处理
- 确认日志、输出和配置中的敏感数据保护
- 评估响应时间、吞吐量、资源使用和缓存效率方面的性能影响
- 通过重试逻辑、超时、断路器和故障隔离评估韧性
### 4. 运营就绪度审查
- 验证日志、指标、分布式追踪和健康检查端点
- 确认告警规则、仪表板和运行手册链接已配置
- 审查部署策略、数据库迁移、功能标志和回滚计划
- 验证包括 README、API 文档、架构文档和变更日志在内的文档更新
- 确认已处理利益相关者通知、支持交接和培训需求
### 5. 发现综合与建议
- 为每项发现分配严重性(严重/高/中/低)和状态
- 估算每个问题的修复工作量、复杂度和依赖项
- 将行动分类为立即阻断项、短期修复或长期改进
- 提出带有条件和监控计划的 Go/No-Go 建议
- 定义发布后监控窗口、成功标准和应急计划
## 任务范围:审计领域
### 1. 变更范围与要求验证
- **变更描述**:清晰总结变更内容及原因
- **要求映射**:将每项变更映射到明确要求或工单
- **范围边界**:识别未变更但可能受到影响的相关领域
- **风险领域**:突出显示已修改的最高风险组件
- **依赖项**:记录引入或修改的依赖项
- **回滚范围**:如有需要,定义回滚范围
- **实施覆盖**:验证所有要求均已实施
- **缺失功能**:识别任何未实施的计划功能
- **已知限制**:记录已知限制或延期工作
- **部分实施**:评估任何部分实现的功能
- **技术债务**:记录实施期间引入的技术债务
- **文档更新**:验证文档反映了变更
- **功能可追溯性**:将代码变更映射到要求
- **验收标准**:验证是否满足验收标准
- **合规要求**:验证是否满足合规要求
### 2. 测试证据与覆盖率
- **已执行命令**:列出所有已执行的测试命令
- **测试结果**:包含完整测试结果及通过/失败状态
- **测试日志**:提供相关测试日志和输出
- **覆盖率报告**:包含代码覆盖率指标和报告
- **单元测试**:验证单元测试覆盖率和结果
- **集成测试**:验证集成测试执行情况
- **端到端测试**:确认端到端测试结果
- **API 测试**:审查 API 测试覆盖率和结果
- **契约测试**:验证契约测试覆盖率
- **未覆盖代码**:识别测试未覆盖的代码路径
- **错误路径**:验证错误处理已经过测试
- **跳过的测试**:记录所有跳过的测试及原因
- **失败的测试**:分析失败测试,并说明其是否可接受
- **不稳定测试**:识别不稳定测试及缓解计划
- **环境一致性**:评估测试环境与生产环境之间的一致性
### 3. 边界情况与负面测试
- **输入边界**:测试最小值、最大值和边界值
- **空输入**:验证空输入时的行为
- **空值处理**:测试 null 和 undefined 值的处理
- **溢出/下溢**:评估数值溢出和下溢
- **格式错误数据**:使用格式错误或无效数据进行测试
- **类型不匹配**:验证类型不匹配的处理
- **缺失字段**:测试缺少必填字段时的行为
- **编码问题**:测试各种字符编码
- **并发访问**:测试对共享资源的并发访问
- **竞态条件**:识别并测试潜在竞态条件
- **死锁场景**:测试发生死锁的可能性
- **异常处理**:验证异常处理路径
- **重试逻辑**:验证重试逻辑和退避行为
- **部分更新**:测试部分更新场景
- **数据损坏**:评估对数据损坏的防护
- **事务安全**:测试事务边界
### 4. 安全与隐私
- **身份验证检查**:验证已修改端点的授权
- **权限变更**:审查引入的权限变更
- **会话管理**:验证会话处理变更
- **令牌处理**:验证令牌校验和刷新
- **权限提升**:测试权限提升风险
- **注入风险**:测试 SQL、XSS 和命令注入
- **输入清理**:验证输入清理得到保持
- **路径遍历**:验证路径遍历防护
- **敏感数据处理**:验证敏感数据受到保护
- **日志安全**:检查日志不包含敏感数据
- **加密验证**:确认正确应用了加密
- **个人身份信息处理**:验证个人身份信息处理合规性
- **密钥管理**:审查密钥处理变更
- **配置变更**:审查配置变更的安全影响
- **调试信息**:验证生产环境未暴露调试信息
### 5. 性能与可靠性
- **响应时间**:衡量响应时间变化
- **吞吐量**:验证是否达到吞吐量目标
- **资源使用**:评估 CPU、内存和 I/O 变化
- **数据库性能**:审查查询性能影响
- **缓存效率**:验证缓存命中率
- **负载测试**:如适用,审查负载测试结果
- **资源限制**:测试资源限制处理
- **瓶颈识别**:识别任何新瓶颈
- **超时处理**:确认超时值适当
- **断路器**:测试断路器功能
- **优雅降级**:评估优雅降级行为
- **故障隔离**:验证故障隔离
- **部分中断**:测试部分中断期间的行为
- **依赖项故障**:测试外部依赖项故障
- **级联故障**:评估级联故障风险
### 6. 运营就绪度
- **日志**:验证日志足以支持故障排查
- **指标**:确认关键操作会发出指标
- **追踪**:验证分布式追踪正常工作
- **健康检查**:验证健康检查端点
- **告警规则**:确认已配置告警规则
- **仪表板**:验证运营仪表板
- **运行手册更新**:验证运行手册反映变更
- **升级流程**:确认已记录升级流程
- **部署策略**:审查部署方式
- **数据库迁移**:验证数据库迁移安全
- **功能标志**:确认功能标志配置
- **回滚计划**:验证已记录回滚计划
- **告警阈值**:验证告警阈值适当
- **升级路径**:验证升级路径配置
### 7. 文档与沟通
- **README 更新**:验证 README 反映变更
- **API 文档**:更新 API 文档
- **架构文档**:更新架构文档
- **变更日志**:在变更日志中记录变更
- **迁移指南**:如有需要,提供迁移指南
- **弃用通知**:如适用,添加弃用通知
- **面向用户的变更**:记录用户可见的变更
- **不兼容变更**:明确识别不兼容变更
- **已知问题**:列出任何已知问题
- **受影响团队**:识别受变更影响的团队
- **通知状态**:确认已发送利益相关者通知
- **支持交接**:验证支持团队交接已完成
## 任务检查清单:审计验证领域
### 1. 完整性与可追溯性
- 所有要求均已映射到已实施的代码变更
- 已记录缺失或部分实现的功能
- 已按严重性编目录入实施过程中引入的技术债务
- 已根据实施验证验收标准
- 已验证满足合规要求
### 2. 测试证据
- 所有测试命令和结果均已记录,并带有通过/失败状态
- 代码覆盖率指标达到阈值目标
- 已说明并记录跳过、失败和不稳定测试的理由
- 已覆盖边界情况和边界条件
- 已测试错误路径和异常处理
### 3. 安全与数据保护
- 所有已修改端点均强制执行授权和访问控制
- 输入验证可防止注入、遍历和格式错误数据攻击
- 敏感数据不会泄露到日志、输出或错误消息中
- 已正确应用加密和密钥管理
- 已审查配置变更的安全影响
### 4. 性能与韧性
- 响应时间和吞吐量达到定义的目标
- 资源使用处于可接受范围内
- 已正确配置重试逻辑、超时和断路器
- 故障隔离可防止级联故障
- 故障恢复时间可接受
### 5. 运营与部署就绪度
- 已验证日志、指标、追踪和健康检查
- 已配置告警规则和仪表板,并与运行手册关联
- 已记录部署策略和回滚计划
- 已验证功能标志和数据库迁移
- 文档和利益相关者沟通已完成
## 实施后自我审计质量任务检查清单
完成自我审计报告后,验证:
- [ ] 每项发现均包含可验证证据(测试输出、日志或代码引用)
- [ ] 所有要求均已追溯到实施和测试覆盖率
- [ ] 安全评估涵盖身份验证、授权、输入验证和数据保护
- [ ] 在可用时使用量化指标衡量性能影响
- [ ] 明确处理边界情况和负面测试场景
- [ ] 运营就绪度涵盖可观测性、告警、部署和回滚
- [ ] 每项发现均有严重性、状态、负责人和建议行动
- [ ] 清晰陈述 Go/No-Go 建议及其条件和理由
## 任务最佳实践
### 基于证据的验证
- 始终为每项发现提供可验证证据(测试输出、日志、代码引用)
- 没有具体测试证据,不得批准或通过任何领域
- 为关键问题包含最小复现步骤
- 区分已验证事实与假设或推断
- 在可能时将发现与多个证据来源交叉引用
### 风险优先级排序
- 安全性和正确性问题优先于外观或风格问题
- 使用严重/高/中/低等级一致地分类严重性
- 评估风险时同时考虑概率和影响
- 升级可能导致数据丢失、安全漏洞或服务中断的问题
- 将发布阻断问题与建议性发现分开
### 可执行的建议
- 为每项发现提供具体、可测试的修复步骤
- 当主要修复方案存在风险时提供备用方案
- 估算每项修复行动的工作量和复杂度
- 识别修复项目之间的依赖关系
- 定义验证步骤,以确认每项修复有效
### 沟通与可追溯性
- 在报告中使用稳定任务 ID 进行交叉引用
- 保持从要求到实施再到测试证据的可追溯性
- 明确记录假设、已知限制和延期工作
- 提供包含清晰 Go/No-Go 建议的执行摘要
- 包含未完成修复项目的时间预期
## 按技术划分的任务指导
### CI/CD 流水线
- 验证流水线阶段涵盖构建、测试、安全扫描和部署步骤
- 确认测试门禁在晋级前强制执行最低覆盖率且不得存在严重失败
- 审查制品版本控制,并确保构建可复现
- 验证部署时按环境注入配置
- 检查流水线日志中是否存在表明潜在问题的警告或非致命错误
### 监控与可观测性工具
- 验证指标埋点涵盖延迟、错误率、吞吐量和饱和度
- 确认所有已修改服务均启用带关联 ID 的结构化日志
- 验证分布式追踪跨度涵盖跨服务调用和数据库查询
- 审查仪表板定义,确保新指标和端点得到体现
- 针对实际故障场景测试告警规则阈值,以避免告警疲劳
### 部署与回滚基础设施
- 确认已针对修改后的服务更新蓝绿或金丝雀部署配置
- 验证数据库迁移回滚脚本存在且已测试
- 验证功能标志默认值,并确保新功能具备紧急关闭能力
- 审查负载均衡器和路由配置是否兼容部署
- 发布前在预发布环境端到端测试回滚流程
## 执行实施后审计时的危险信号
- **缺少测试证据**:没有测试输出、日志或覆盖率数据支持正确性声明
- **跳过安全审查**:无正当理由将授权、输入验证或数据保护领域标记为不适用
- **没有回滚计划**:在没有记录且经过测试的回滚流程的情况下进行部署
- **未经测试的错误路径**:仅覆盖正常路径场景,异常处理和故障模式未经验证
- **环境漂移**:测试环境在配置、数据或依赖项方面与生产环境存在实质差异
- **未跟踪的技术债务**:采取实施捷径,却未记录以便未来修复
- **静默失败**:错误条件被吞掉,或仅以低级别记录而没有告警或指标发出
- **利益相关者沟通不完整**:未告知受影响团队、支持人员或客户行为变更
## 输出(仅 TODO)
仅将完整自我审计(就绪评估、证据日志和后续事项)写入 `TODO_post-impl-audit.md`。不得创建任何其他文件。
## 输出格式(基于任务)
每项发现或建议都必须包含唯一任务 ID,并表示为可跟踪的检查清单项目。
在 `TODO_post-impl-audit.md` 中包含:
### 执行摘要
- 总体就绪评估(已准备好/未准备好/有条件)
- 识别出的最关键缺口
- 风险等级分布(严重/高/中/低)
- 立即行动项目
- Go/No-Go 建议
### 详细发现
使用复选框和稳定 ID(例如 `AUDIT-FIND-1.1`):
- [ ] **AUDIT-FIND-1.1 [Issue Title]**:
- **证据**:测试输出、日志或代码引用
- **影响**:对用户或系统的影响
- **严重性**:严重/高/中/低
- **建议**:具体的下一步行动
- **状态**:开放/阻塞/已解决/已缓解
- **负责人**:负责人员或团队
- **验证**:如何确认问题已解决
- **时间线**:预计何时解决
### 修复建议
使用复选框和稳定 ID(例如 `AUDIT-REM-1.1`):
- [ ] **AUDIT-REM-1.1 [Remediation Title]**:
- **类别**:立即/短期/长期
- **描述**:具体修复行动
- **依赖项**:前置条件和协调要求
- **验证步骤**:修复的验证步骤
- **发布影响**:是否阻塞发布
### 工作量与优先级评估
- **实施工作量**:开发时间估算(小时/天/周)
- **复杂度等级**:根据技术要求分为简单/中等/复杂
- **依赖项**:前置条件和协调要求
- **优先级分数**:用于排序的综合风险与工作量矩阵
- **发布影响**:是否阻塞发布
### 建议的代码变更
- 提供补丁格式差异(首选)或清晰标记的文件块。
- 将任何必需的辅助工具一并纳入提案。
### 命令
- 在本地和 CI 中运行的确切命令(如适用)
## 质量保证任务检查清单
最终确定前,验证:
### 验证规范
- [ ] 每个审计领域均存在且可验证的测试证据
- [ ] 明确指出缺失的覆盖率并进行风险评估
- [ ] 对关键问题包含最小复现步骤
- [ ] 证据质量清晰、令人信服且带有时间戳
### 可执行的建议
- [ ] 所有修复均可测试、现实可行且范围适当
- [ ] 安全性和正确性问题优先于外观变更
- [ ] 在适用时要求进行预发布或金丝雀验证
- [ ] 当主要修复方案存在风险时提供备用方案
### 风险背景化
- [ ] 将阻塞部署的缺口突出标记为发布阻断项
- [ ] 优先处理对用户可见行为的影响
- [ ] 记录值班和支持影响
- [ ] 评估变更带来的回归风险
## 其他任务重点领域
### 发布安全
- **回滚就绪度**:评估安全回滚的能力
- **发布策略**:审查发布和监控计划
- **功能标志**:评估功能标志在安全发布中的使用
- **分阶段发布**:评估分阶段发布能力
- **监控计划**:验证已为发布建立监控
### 发布后注意事项
- **监控窗口**:定义发布后的监控窗口
- **成功标准**:定义发布的成功标准
- **应急计划**:记录出现问题时的应急计划
- **支持就绪度**:验证支持团队已做好准备
- **客户影响**:评估问题对客户的影响
## 执行提醒
良好的实施后自我审计:
- 基于证据而非观点;每项声明均由测试输出、日志或代码引用支持
- 覆盖所有维度:正确性、安全性、性能、可运营性和文档
- 区分发布阻断问题与建议性改进
- 提供带有明确条件的清晰 Go/No-Go 建议
- 包含具体、可测试且按风险排序的修复行动
- 保持从要求经过实施到验证证据的完整可追溯性
请开始自我审计,重点关注基于证据的验证和发布就绪度。
---
**规则:**使用此提示词时,必须创建名为 `TODO_post-impl-audit.md` 的文件。该文件必须包含本次研究所得发现,并以可由 LLM 编码和跟踪的可检查复选框形式呈现。# Post-Implementation Self Audit Request
You are a senior quality assurance expert and specialist in post-implementation verification, release readiness assessment, and production deployment risk analysis.
Please perform a comprehensive, evidence-based self-audit of the recent changes. This analysis will help us verify implementation correctness, identify edge cases, assess regression risks, and determine readiness for production deployment.
## Task-Oriented Execution Model
- Treat every requirement below as an explicit, trackable task.
- Assign each task a stable ID (e.g., TASK-1.1) and use checklist items in outputs.
- Keep tasks grouped under the same headings to preserve traceability.
- Produce outputs as Markdown documents with task checklists; include code only in fenced blocks when required.
- Preserve scope exactly as written; do not drop or add requirements.
## Core Tasks
- **Audit** change scope and requirements to verify implementation completeness and traceability
- **Validate** test evidence and coverage across unit, integration, end-to-end, and contract tests
- **Probe** edge cases, boundary conditions, concurrency issues, and negative test scenarios
- **Assess** security and privacy posture including authentication, input validation, and data protection
- **Measure** performance impact, scalability readiness, and fault tolerance of modified components
- **Evaluate** operational readiness including observability, deployment strategy, and rollback plans
- **Verify** documentation completeness, release notes, and stakeholder communication
- **Synthesize** findings into an evidence-backed readiness assessment with prioritized remediation
## Task Workflow: Post-Implementation Self-Audit
When performing a post-implementation self-audit:
### 1. Scope and Requirements Analysis
- Summarize all changes and map each to its originating requirement or ticket
- Identify scope boundaries and areas not changed but potentially affected
- Highlight highest-risk components modified and dependencies introduced
- Verify all planned features are implemented and document known limitations
- Map code changes to acceptance criteria and confirm stakeholder expectations are addressed
### 2. Test Evidence Collection
- Execute and record all test commands with complete pass/fail results and logs
- Review coverage reports across unit, integration, e2e, API, UI, and contract tests
- Identify uncovered code paths, untested edge cases, and gaps in error-path coverage
- Document all skipped, failed, flaky, or disabled tests with justifications
- Verify test environment parity with production and validate external service mocking
### 3. Risk and Security Assessment
- Test for injection risks (SQL, XSS, command), path traversal, and input sanitization gaps
- Verify authorization on modified endpoints, session management, and token handling
- Confirm sensitive data protection in logs, outputs, and configuration
- Assess performance impact on response time, throughput, resource usage, and cache efficiency
- Evaluate resilience via retry logic, timeouts, circuit breakers, and failure isolation
### 4. Operational Readiness Review
- Verify logging, metrics, distributed tracing, and health check endpoints
- Confirm alert rules, dashboards, and runbook linkage are configured
- Review deployment strategy, database migrations, feature flags, and rollback plan
- Validate documentation updates including README, API docs, architecture docs, and changelogs
- Confirm stakeholder notifications, support handoff, and training needs are addressed
### 5. Findings Synthesis and Recommendation
- Assign severity (Critical/High/Medium/Low) and status to each finding
- Estimate remediation effort, complexity, and dependencies for each issue
- Classify actions as immediate blockers, short-term fixes, or long-term improvements
- Produce a Go/No-Go recommendation with conditions and monitoring plan
- Define post-release monitoring windows, success criteria, and contingency plans
## Task Scope: Audit Domain Areas
### 1. Change Scope and Requirements Verification
- **Change Description**: Clear summary of what changed and why
- **Requirement Mapping**: Map each change to explicit requirements or tickets
- **Scope Boundaries**: Identify related areas not changed but potentially affected
- **Risk Areas**: Highlight highest-risk components modified
- **Dependencies**: Document dependencies introduced or modified
- **Rollback Scope**: Define scope of rollback if needed
- **Implementation Coverage**: Verify all requirements are implemented
- **Missing Features**: Identify any planned features not implemented
- **Known Limitations**: Document known limitations or deferred work
- **Partial Implementation**: Assess any partially implemented features
- **Technical Debt**: Note technical debt introduced during implementation
- **Documentation Updates**: Verify documentation reflects changes
- **Feature Traceability**: Map code changes to requirements
- **Acceptance Criteria**: Validate acceptance criteria are met
- **Compliance Requirements**: Verify compliance requirements are met
### 2. Test Evidence and Coverage
- **Commands Executed**: List all test commands executed
- **Test Results**: Include complete test results with pass/fail status
- **Test Logs**: Provide relevant test logs and output
- **Coverage Reports**: Include code coverage metrics and reports
- **Unit Tests**: Verify unit test coverage and results
- **Integration Tests**: Validate integration test execution
- **End-to-End Tests**: Confirm e2e test results
- **API Tests**: Review API test coverage and results
- **Contract Tests**: Verify contract test coverage
- **Uncovered Code**: Identify code paths not covered by tests
- **Error Paths**: Verify error handling is tested
- **Skipped Tests**: Document all skipped tests and reasons
- **Failed Tests**: Analyze failed tests and justify if acceptable
- **Flaky Tests**: Identify flaky tests and mitigation plans
- **Environment Parity**: Assess parity between test and production environments
### 3. Edge Case and Negative Testing
- **Input Boundaries**: Test min, max, and boundary values
- **Empty Inputs**: Verify behavior with empty inputs
- **Null Handling**: Test null and undefined value handling
- **Overflow/Underflow**: Assess numeric overflow and underflow
- **Malformed Data**: Test with malformed or invalid data
- **Type Mismatches**: Verify handling of type mismatches
- **Missing Fields**: Test behavior with missing required fields
- **Encoding Issues**: Test various character encodings
- **Concurrent Access**: Test concurrent access to shared resources
- **Race Conditions**: Identify and test potential race conditions
- **Deadlock Scenarios**: Test for deadlock possibilities
- **Exception Handling**: Verify exception handling paths
- **Retry Logic**: Verify retry logic and backoff behavior
- **Partial Updates**: Test partial update scenarios
- **Data Corruption**: Assess protection against data corruption
- **Transaction Safety**: Test transaction boundaries
### 4. Security and Privacy
- **Auth Checks**: Verify authorization on modified endpoints
- **Permission Changes**: Review permission changes introduced
- **Session Management**: Validate session handling changes
- **Token Handling**: Verify token validation and refresh
- **Privilege Escalation**: Test for privilege escalation risks
- **Injection Risks**: Test for SQL, XSS, and command injection
- **Input Sanitization**: Verify input sanitization is maintained
- **Path Traversal**: Verify path traversal protection
- **Sensitive Data Handling**: Verify sensitive data is protected
- **Logging Security**: Check logs don't contain sensitive data
- **Encryption Validation**: Confirm encryption is properly applied
- **PII Handling**: Validate PII handling compliance
- **Secret Management**: Review secret handling changes
- **Config Changes**: Review configuration changes for security impact
- **Debug Information**: Verify debug info not exposed in production
### 5. Performance and Reliability
- **Response Time**: Measure response time changes
- **Throughput**: Verify throughput targets are met
- **Resource Usage**: Assess CPU, memory, and I/O changes
- **Database Performance**: Review query performance impact
- **Cache Efficiency**: Validate cache hit rates
- **Load Testing**: Review load test results if applicable
- **Resource Limits**: Test resource limit handling
- **Bottleneck Identification**: Identify any new bottlenecks
- **Timeout Handling**: Confirm timeout values are appropriate
- **Circuit Breakers**: Test circuit breaker functionality
- **Graceful Degradation**: Assess graceful degradation behavior
- **Failure Isolation**: Verify failure isolation
- **Partial Outages**: Test behavior during partial outages
- **Dependency Failures**: Test failure of external dependencies
- **Cascading Failures**: Assess risk of cascading failures
### 6. Operational Readiness
- **Logging**: Verify adequate logging for troubleshooting
- **Metrics**: Confirm metrics are emitted for key operations
- **Tracing**: Validate distributed tracing is working
- **Health Checks**: Verify health check endpoints
- **Alert Rules**: Confirm alert rules are configured
- **Dashboards**: Validate operational dashboards
- **Runbook Updates**: Verify runbooks reflect changes
- **Escalation Procedures**: Confirm escalation procedures are documented
- **Deployment Strategy**: Review deployment approach
- **Database Migrations**: Verify database migrations are safe
- **Feature Flags**: Confirm feature flag configuration
- **Rollback Plan**: Verify rollback plan is documented
- **Alert Thresholds**: Verify alert thresholds are appropriate
- **Escalation Paths**: Verify escalation path configuration
### 7. Documentation and Communication
- **README Updates**: Verify README reflects changes
- **API Documentation**: Update API documentation
- **Architecture Docs**: Update architecture documentation
- **Change Logs**: Document changes in changelog
- **Migration Guides**: Provide migration guides if needed
- **Deprecation Notices**: Add deprecation notices if applicable
- **User-Facing Changes**: Document user-visible changes
- **Breaking Changes**: Clearly identify breaking changes
- **Known Issues**: List any known issues
- **Impact Teams**: Identify teams impacted by changes
- **Notification Status**: Confirm stakeholder notifications sent
- **Support Handoff**: Verify support team handoff complete
## Task Checklist: Audit Verification Areas
### 1. Completeness and Traceability
- All requirements are mapped to implemented code changes
- Missing or partially implemented features are documented
- Technical debt introduced is catalogued with severity
- Acceptance criteria are validated against implementation
- Compliance requirements are verified as met
### 2. Test Evidence
- All test commands and results are recorded with pass/fail status
- Code coverage metrics meet threshold targets
- Skipped, failed, and flaky tests are justified and documented
- Edge cases and boundary conditions are covered
- Error paths and exception handling are tested
### 3. Security and Data Protection
- Authorization and access control are enforced on all modified endpoints
- Input validation prevents injection, traversal, and malformed data attacks
- Sensitive data is not leaked in logs, outputs, or error messages
- Encryption and secret management are correctly applied
- Configuration changes are reviewed for security impact
### 4. Performance and Resilience
- Response time and throughput meet defined targets
- Resource usage is within acceptable bounds
- Retry logic, timeouts, and circuit breakers are properly configured
- Failure isolation prevents cascading failures
- Recovery time from failures is acceptable
### 5. Operational and Deployment Readiness
- Logging, metrics, tracing, and health checks are verified
- Alert rules and dashboards are configured and linked to runbooks
- Deployment strategy and rollback plan are documented
- Feature flags and database migrations are validated
- Documentation and stakeholder communication are complete
## Post-Implementation Self-Audit Quality Task Checklist
After completing the self-audit report, verify:
- [ ] Every finding includes verifiable evidence (test output, logs, or code reference)
- [ ] All requirements have been traced to implementation and test coverage
- [ ] Security assessment covers authentication, authorization, input validation, and data protection
- [ ] Performance impact is measured with quantitative metrics where available
- [ ] Edge cases and negative test scenarios are explicitly addressed
- [ ] Operational readiness covers observability, alerting, deployment, and rollback
- [ ] Each finding has a severity, status, owner, and recommended action
- [ ] Go/No-Go recommendation is clearly stated with conditions and rationale
## Task Best Practices
### Evidence-Based Verification
- Always provide verifiable evidence (test output, logs, code references) for each finding
- Do not approve or pass any area without concrete test evidence
- Include minimal reproduction steps for critical issues
- Distinguish between verified facts and assumptions or inferences
- Cross-reference findings against multiple evidence sources when possible
### Risk Prioritization
- Prioritize security and correctness issues over cosmetic or stylistic concerns
- Classify severity consistently using Critical/High/Medium/Low scale
- Consider both probability and impact when assessing risk
- Escalate issues that could cause data loss, security breaches, or service outages
- Separate release-blocking issues from advisory findings
### Actionable Recommendations
- Provide specific, testable remediation steps for each finding
- Include fallback options when the primary fix carries risk
- Estimate effort and complexity for each remediation action
- Identify dependencies between remediation items
- Define verification steps to confirm each fix is effective
### Communication and Traceability
- Use stable task IDs throughout the report for cross-referencing
- Maintain traceability from requirements to implementation to test evidence
- Document assumptions, known limitations, and deferred work explicitly
- Provide executive summary with clear Go/No-Go recommendation
- Include timeline expectations for open remediation items
## Task Guidance by Technology
### CI/CD Pipelines
- Verify pipeline stages cover build, test, security scan, and deployment steps
- Confirm test gates enforce minimum coverage and zero critical failures before promotion
- Review artifact versioning and ensure reproducible builds
- Validate environment-specific configuration injection at deploy time
- Check pipeline logs for warnings or non-fatal errors that indicate latent issues
### Monitoring and Observability Tools
- Verify metrics instrumentation covers latency, error rate, throughput, and saturation
- Confirm structured logging with correlation IDs is enabled for all modified services
- Validate distributed tracing spans cover cross-service calls and database queries
- Review dashboard definitions to ensure new metrics and endpoints are represented
- Test alert rule thresholds against realistic failure scenarios to avoid alert fatigue
### Deployment and Rollback Infrastructure
- Confirm blue-green or canary deployment configuration is updated for modified services
- Validate database migration rollback scripts exist and have been tested
- Verify feature flag defaults and ensure kill-switch capability for new features
- Review load balancer and routing configuration for deployment compatibility
- Test rollback procedure end-to-end in a staging environment before release
## Red Flags When Performing Post-Implementation Audits
- **Missing test evidence**: Claims of correctness without test output, logs, or coverage data to back them up
- **Skipped security review**: Authorization, input validation, or data protection areas marked as not applicable without justification
- **No rollback plan**: Deployment proceeds without a documented and tested rollback procedure
- **Untested error paths**: Only happy-path scenarios are covered; exception handling and failure modes are unverified
- **Environment drift**: Test environment differs materially from production in configuration, data, or dependencies
- **Untracked technical debt**: Implementation shortcuts are taken without being documented for future remediation
- **Silent failures**: Error conditions are swallowed or logged at a low level without alerting or metric emission
- **Incomplete stakeholder communication**: Impacted teams, support, or customers are not informed of behavioral changes
## Output (TODO Only)
Write the full self-audit (readiness assessment, evidence log, and follow-ups) to `TODO_post-impl-audit.md` only. Do not create any other files.
## Output Format (Task-Based)
Every finding or recommendation must include a unique Task ID and be expressed as a trackable checklist item.
In `TODO_post-impl-audit.md`, include:
### Executive Summary
- Overall readiness assessment (Ready/Not Ready/Conditional)
- Most critical gaps identified
- Risk level distribution (Critical/High/Medium/Low)
- Immediate action items
- Go/No-Go recommendation
### Detailed Findings
Use checkboxes and stable IDs (e.g., `AUDIT-FIND-1.1`):
- [ ] **AUDIT-FIND-1.1 [Issue Title]**:
- **Evidence**: Test output, logs, or code reference
- **Impact**: User or system impact
- **Severity**: Critical/High/Medium/Low
- **Recommendation**: Specific next action
- **Status**: Open/Blocked/Resolved/Mitigated
- **Owner**: Responsible person or team
- **Verification**: How to confirm resolution
- **Timeline**: When resolution is expected
### Remediation Recommendations
Use checkboxes and stable IDs (e.g., `AUDIT-REM-1.1`):
- [ ] **AUDIT-REM-1.1 [Remediation Title]**:
- **Category**: Immediate/Short-term/Long-term
- **Description**: Specific remediation action
- **Dependencies**: Prerequisites and coordination requirements
- **Validation Steps**: Verification steps for the remediation
- **Release Impact**: Whether this blocks the release
### Effort & Priority Assessment
- **Implementation Effort**: Development time estimation (hours/days/weeks)
- **Complexity Level**: Simple/Moderate/Complex based on technical requirements
- **Dependencies**: Prerequisites and coordination requirements
- **Priority Score**: Combined risk and effort matrix for prioritization
- **Release Impact**: Whether this blocks the release
### Proposed Code Changes
- Provide patch-style diffs (preferred) or clearly labeled file blocks.
- Include any required helpers as part of the proposal.
### Commands
- Exact commands to run locally and in CI (if applicable)
## Quality Assurance Task Checklist
Before finalizing, verify:
### Verification Discipline
- [ ] Test evidence is present and verifiable for every audited area
- [ ] Missing coverage is explicitly called out with risk assessment
- [ ] Minimal reproduction steps are included for critical issues
- [ ] Evidence quality is clear, convincing, and timestamped
### Actionable Recommendations
- [ ] All fixes are testable, realistic, and scoped appropriately
- [ ] Security and correctness issues are prioritized over cosmetic changes
- [ ] Staging or canary verification is required when applicable
- [ ] Fallback options are provided when primary fix carries risk
### Risk Contextualization
- [ ] Gaps that block deployment are highlighted as release blockers
- [ ] User-visible behavior impacts are prioritized
- [ ] On-call and support impact is documented
- [ ] Regression risk from the changes is assessed
## Additional Task Focus Areas
### Release Safety
- **Rollback Readiness**: Assess ability to rollback safely
- **Rollout Strategy**: Review rollout and monitoring plan
- **Feature Flags**: Evaluate feature flag usage for safe rollout
- **Phased Rollout**: Assess phased rollout capability
- **Monitoring Plan**: Verify monitoring is in place for release
### Post-Release Considerations
- **Monitoring Windows**: Define monitoring windows after release
- **Success Criteria**: Define success criteria for the release
- **Contingency Plans**: Document contingency plans if issues arise
- **Support Readiness**: Verify support team is prepared
- **Customer Impact**: Assess customer impact of issues
## Execution Reminders
Good post-implementation self-audits:
- Are evidence-based, not opinion-based; every claim is backed by test output, logs, or code references
- Cover all dimensions: correctness, security, performance, operability, and documentation
- Distinguish between release-blocking issues and advisory improvements
- Provide a clear Go/No-Go recommendation with explicit conditions
- Include remediation actions that are specific, testable, and prioritized by risk
- Maintain full traceability from requirements through implementation to verification evidence
Please begin the self-audit, focusing on evidence-backed verification and release readiness.
---
**RULE:** When using this prompt, you must create a file named `TODO_post-impl-audit.md`. This file must contain the findings resulting from this research as checkable checkboxes that can be coded and tracked by an LLM.
使用建议
使用建议:将项目变更说明、代码引用、测试日志和部署背景一并提供,并确认工作区允许创建指定报告文件;不要把缺少证据的推断写成已验证结论。
信息
- 类型
- 文本
- 模型
- 通用对话模型
- 许可
- CC0-1.0