Login & Authentication
7 checks
0%
| ✓ | ID | Check | Expected | Priority | Notes |
|---|---|---|---|---|---|
| AUTH-01 | Admin login with valid credentials | Redirects to DPSMF dashboard; JWT cookie set | Critical | ||
| AUTH-02 | Login fails with wrong password | Error message shown; no redirect; no cookie | Critical | ||
| AUTH-03 | Session timeout after inactivity | Redirect to login; JWT expired message | High | ||
| AUTH-04 | Remember Me persists session | Cookie survives browser restart (7-day expiry) | Medium | ||
| AUTH-05 | Demo session — anonymous tier starts | 30-min timer begins; Tier 1 tools accessible | Critical | ||
| AUTH-06 | Demo upgrade flow (email gate) | Name + email submitted → Sentinel unlocked; tier=gated in DB | Critical | ||
| AUTH-07 | Rate limit (5 sessions/IP/day) | 6th session from same IP returns 429 or blocked message | High |
Dashboard — Live Metrics
10 checks
0%
| ✓ | ID | Check | Expected | Priority | Notes |
|---|---|---|---|---|---|
| DASH-01 | Dashboard loads without errors | No JS console errors; all panels render | Critical | ||
| DASH-02 | Push agent data populates CPU/Memory/PLE | Live values from Dell-Ws01 MedBillCorp shown (not demo data) | Critical | ||
| DASH-03 | 10-second auto-refresh | "Live · HH:MM:SS" badge updates; metric values change if active workload | High | ||
| DASH-04 | Wait stats table renders | Top 10 wait types from live ingest displayed | High | ||
| DASH-05 | Instance name shows "Dell-Ws01" | server_name from push agent payload displayed | Medium | ||
| DASH-06 | Alert thresholds fire correctly | If CPU > threshold, alert shows in alert panel | High | ||
| DASH-07 | Execution Plan Visualizer opens | Tool loads from nav; accepts paste of XML plan | High | ||
| DASH-08 | Wait Stats Analyzer loads | Page renders; charts display | High | ||
| DASH-09 | Index Health Dashboard loads | Index health page renders; columns align; no overflow | Medium | ||
| DASH-10 | Fallback when push agent offline | Dashboard shows "Agent offline" indicator; no crash; demo data displayed | High |
Sentinel AI — Chat & Features
12 checks
0%
| ✓ | ID | Check | Expected | Priority | Notes |
|---|---|---|---|---|---|
| SENT-01 | Sentinel chat interface loads | All 5 tabs render: Chat, Dashboard, Reports, Evidence, Settings | Critical | ||
| SENT-02 | Onboarding — name capture | First launch shows name prompt; submitting name stores in dpsmf_user_profiles | High | ||
| SENT-03 | Chat sends message and receives response | AI response appears; no timeout; response references real instance data | Critical | ||
| SENT-04 | Live context injected into prompt | Ask "what is my current CPU?" → Sentinel gives real value from push agent | Critical | ||
| SENT-05 | Markdown rendering | Bold and code in responses render correctly (not raw asterisks) | High | ||
| SENT-06 | Evidence badges appear on responses | Knowledge Graph citations show [Node #X | confidence% | Tier N] | High | ||
| SENT-07 | Thumbs up feedback → confidence boost | 👍 click → POST /api/dpsmf/sentinel/feedback → +5 confidence logged in kg_reinforcement_log | High | ||
| SENT-08 | Thumbs down feedback → confidence dip | 👎 click → -3 confidence logged; domain rejection streak tracked | High | ||
| SENT-09 | Verbosity slider changes response depth | Level 1 (Expert) = terse; Level 5 (Teaching) = explanatory | Medium | ||
| SENT-10 | Config Audit Report generates | 14-parameter two-column report (Current vs Recommended) renders; PDF export works | High | ||
| SENT-11 | Evidence tab — reasoning chain viewer | After chat response with citations, Evidence tab populates with chain steps | Medium | ||
| SENT-12 | Voice STT — mic captures speech | Mic button activates; speech transcribed; message sent on completion | Medium |
Knowledge Graph Explorer
8 checks
0%
| ✓ | ID | Check | Expected | Priority | Notes |
|---|---|---|---|---|---|
| KG-01 | KG Explorer canvas loads | Node graph renders; 250+ nodes visible; no blank screen | Critical | ||
| KG-02 | Nodes are draggable | Click-drag repositions node; edges follow | High | ||
| KG-03 | Node hover shows tooltip | Type, domain, title, confidence displayed on hover | High | ||
| KG-04 | Right-click context menu | 9 actions appear: View Detail, Edit, Open in Sentinel, etc. | High | ||
| KG-05 | Domain filter works | Selecting "Security" filters to security nodes only | High | ||
| KG-06 | Search finds node by keyword | Typing "MAXDOP" highlights matching nodes | Medium | ||
| KG-07 | Edge relationships visible | 70 edges render as lines; type displayed on hover | Medium | ||
| KG-08 | Node confidence color coding | High confidence = cyan/bright; low confidence = muted/dim | Low |
Learning Scorecard
6 checks
0%
| ✓ | ID | Check | Expected | Priority | Notes |
|---|---|---|---|---|---|
| SCORE-01 | Scorecard page loads | All 10 domains show coverage bars; no blank panels | Critical | ||
| SCORE-02 | All 10 domains show Silver badge | 🥈 shown for each domain; 91.4% avg confidence reflected | High | ||
| SCORE-03 | Node count matches DB (250+) | Total nodes displayed matches kg_nodes COUNT query | High | ||
| SCORE-04 | Learning footer displays | [🧠 Domain] [📊 Score%] [🥈 Badge Day N] [⏱ Uptime] visible | Medium | ||
| SCORE-05 | Test Bank page loads | Questions displayed by domain; difficulty filter works | Medium | ||
| SCORE-06 | Source Registry loads | 25+ sources shown with trust tier and health status | Medium |
Push Agent — Dell-Ws01 Connectivity
7 checks
0%
| ✓ | ID | Check | Expected | Priority | Notes |
|---|---|---|---|---|---|
| AGENT-01 | PM2 process running on Dell-Ws01 | pm2 status shows dpsmf-push-agent online | Critical | ||
| AGENT-02 | Metrics POST to /api/dpsmf/ingest/metrics | VPS receives metric payload every ~5s; 200 OK from ingest route | Critical | ||
| AGENT-03 | Agent key authenticates correctly | Header x-agent-key: dpsmf-agent-2026-ap accepted; wrong key = 403 | Critical | ||
| AGENT-04 | GET /api/dpsmf/ingest/latest returns payload | JSON with metrics.cpu_percent, metrics.wait_stats, server_name, etc. | High | ||
| AGENT-05 | MedBillCorp DB visible in metrics | database_name = MedBillCorp in payload; 30 tables, 50M rows context present | High | ||
| AGENT-06 | dpsmf_monitor login read-only | Monitor login has VIEW SERVER STATE, VIEW ANY DB, SHOWPLAN — no write access | High | ||
| AGENT-07 | Agent survives Dell-Ws01 reboot | PM2 startup config ensures agent auto-starts; metrics resume after reboot | Medium |
Live Demo Flow — End-to-End
7 checks
0%
| ✓ | ID | Check | Expected | Priority | Notes |
|---|---|---|---|---|---|
| DEMO-01 | demo.html landing page loads | Page renders at answerpointintelligence.ai/demo.html; CTA visible | Critical | ||
| DEMO-02 | "Try Live Demo" starts session | POST /demo/start returns token; redirects to sentinel.html?demo=TOKEN | Critical | ||
| DEMO-03 | 30-minute countdown timer visible | Timer shown in UI; decrements; session ends at 0 | High | ||
| DEMO-04 | Tier 1 (anonymous) — Sentinel locked | Chat tab shows "Unlock Sentinel" gate; dashboards browsable | High | ||
| DEMO-05 | Tier 2 — email gate unlocks Sentinel | Submit email → chat enabled; dpsmf_demo_sessions updated to tier=gated | Critical | ||
| DEMO-06 | Heartbeat keeps session alive | POST /demo/heartbeat every 60s prevents premature expiry | Medium | ||
| DEMO-07 | Demo analytics logged | dpsmf_demo_analytics has entry for session; source, tier, duration tracked | Medium |
Admin Tools & Infrastructure
9 checks
0%
| ✓ | ID | Check | Expected | Priority | Notes |
|---|---|---|---|---|---|
| ADMIN-01 | Alert Rule Manager — create rule | New rule saved; appears in list; triggers when threshold exceeded | High | ||
| ADMIN-02 | Alert History Timeline loads | Historical alerts shown in timeline format; filterable by severity | Medium | ||
| ADMIN-03 | Config Audit page loads | 14 parameters shown with current vs recommended; export works | High | ||
| ADMIN-04 | DSCM — add new connection | Slide-out panel opens; 5 sections; test connection returns server info | High | ||
| ADMIN-05 | DSCM demo mode toggle | Toggle switches between live API and demo data; confirmed in Settings | Medium | ||
| ADMIN-06 | Audit Log shows all actions | Login events, feedback actions, config changes all logged | High | ||
| ADMIN-07 | dpsmf-api PM2 stable | pm2 status shows 0 new restarts since last check; logs show no errors | Critical | ||
| ADMIN-08 | GitHub Actions auto-deploy works | Push to main branch triggers deploy; VPS files updated; PM2 restarts | High | ||
| ADMIN-09 | Marketing site loads (dpsmf-product.html) | All sections render: hero, how it works, modules, Sentinel showcase, editions | Medium |
QA Summary
0
Passed
0
Remaining
66
Total
0%
Complete
Tester:
Date:
Version: