← Back to Kontasks

Why Baseline Tests Bypass Browser Session

Explanation of current approach and how to improve it

✓ Completed
on 3 Jan 2026, 6:39 pm

Output

Why Baseline Tests Don't Use Browser Session

You're absolutely right - that would be a better approach!

Current Limitation

The telemetry-dashboard script runs server-side (Deno CLI), but the sendPrompt() function that choice buttons use is browser-side JavaScript.

// Browser-side only (console-ui.ts)
btn.addEventListener('click', function() {
  sendPrompt(choiceValue);  // ← Can't call from server
});

Better Approach: Inject via WebSocket/API

We could add an API endpoint that injects prompts into the active browser session:

// New endpoint:
POST /api/console/inject
{ "prompt": "What is 2+2?", "sessionId": "..." }

// Browser receives via SSE and auto-types it

This would:

  • Show the prompt in the input field
  • Render the response in the console
  • Record telemetry through normal browser path
  • Be true apples-to-apples with manual typing

Why I Went Server-Side

  • Needed to run headless (no browser)
  • Wanted to automate multiple test runs
  • The /api/konsole/dashboard/stream API exists but bypasses browser rendering

Implementation Options

OptionEffortFidelity
1. Add inject API endpointMediumHigh
2. Use Puppeteer/PlaywrightHighHighest
3. Keep server-side (current)DoneMedium

What's Next?

Want me to implement the inject API?

Quick Actions

Original Request

No layout configured

Details

Type General
Status Completed
Scope vibetools
Tags telemetryconsolearchitecture
Created 3 Jan 2026, 6:39 pm
Updated 3 Jan 2026, 6:39 pm
Created By claude

Raw Data

{
  "id": "46db344b-fa67-4545-8259-f4dbda36c8ee",
  "type": "general",
  "status": "completed",
  "title": "Why Baseline Tests Bypass Browser Session",
  "description": "Explanation of current approach and how to improve it",
  "context": {
    "output": "<div style=\"background:#1e1e1e;color:#e0e0e0;padding:20px;border-radius:8px;font-family:'Consolas','Monaco',monospace;\"><h2 style=\"font-family:sans-serif;color:#fff;margin:0 0 16px 0;\">Why Baseline Tests Don't Use Browser Session</h2><p style=\"color:#9ca3af;margin:0 0 16px 0;\">You're absolutely right - that would be a better approach!</p><h3 style=\"color:#e06c75;margin:16px 0 8px 0;\">Current Limitation</h3><div style=\"background:#2d2d2d;padding:16px;border-radius:6px;margin-bottom:16px;\"><p style=\"margin:0 0 12px 0;\">The <code style=\"color:#e5c07b;\">telemetry-dashboard</code> script runs <strong>server-side</strong> (Deno CLI), but the <code style=\"color:#98c379;\">sendPrompt()</code> function that choice buttons use is <strong>browser-side JavaScript</strong>.</p><pre style=\"background:#1e1e1e;padding:12px;border-radius:4px;margin:12px 0 0 0;font-size:0.85rem;\">// Browser-side only (console-ui.ts)\nbtn.addEventListener('click', function() {\n  sendPrompt(choiceValue);  // ← Can't call from server\n});</pre></div><h3 style=\"color:#98c379;margin:16px 0 8px 0;\">Better Approach: Inject via WebSocket/API</h3><div style=\"background:#2d2d2d;padding:16px;border-radius:6px;margin-bottom:16px;\"><p style=\"margin:0 0 12px 0;\">We could add an API endpoint that injects prompts into the active browser session:</p><pre style=\"background:#1e1e1e;padding:12px;border-radius:4px;margin:12px 0;font-size:0.85rem;\">// New endpoint:\nPOST /api/console/inject\n{ \"prompt\": \"What is 2+2?\", \"sessionId\": \"...\" }\n\n// Browser receives via SSE and auto-types it</pre><p style=\"margin:12px 0 0 0;\">This would:</p><ul style=\"margin:8px 0 0 0;padding-left:20px;line-height:1.8;\"><li>Show the prompt in the input field</li><li>Render the response in the console</li><li>Record telemetry through normal browser path</li><li>Be true apples-to-apples with manual typing</li></ul></div><h3 style=\"color:#61afef;margin:16px 0 8px 0;\">Why I Went Server-Side</h3><div style=\"background:#2d2d2d;padding:16px;border-radius:6px;margin-bottom:16px;\"><ul style=\"margin:0;padding-left:20px;line-height:1.8;\"><li>Needed to run <strong>headless</strong> (no browser)</li><li>Wanted to <strong>automate</strong> multiple test runs</li><li>The <code style=\"color:#e5c07b;\">/api/konsole/dashboard/stream</code> API exists but bypasses browser rendering</li></ul></div><h3 style=\"color:#c678dd;margin:16px 0 8px 0;\">Implementation Options</h3><div style=\"background:#2d2d2d;padding:16px;border-radius:6px;\"><table style=\"width:100%;border-collapse:collapse;\"><tr style=\"border-bottom:1px solid #444;\"><th style=\"text-align:left;padding:8px;color:#98c379;\">Option</th><th style=\"text-align:left;padding:8px;color:#98c379;\">Effort</th><th style=\"text-align:left;padding:8px;color:#98c379;\">Fidelity</th></tr><tr><td style=\"padding:8px;\">1. Add inject API endpoint</td><td style=\"padding:8px;color:#e5c07b;\">Medium</td><td style=\"padding:8px;color:#98c379;\">High</td></tr><tr><td style=\"padding:8px;\">2. Use Puppeteer/Playwright</td><td style=\"padding:8px;color:#e06c75;\">High</td><td style=\"padding:8px;color:#98c379;\">Highest</td></tr><tr><td style=\"padding:8px;\">3. Keep server-side (current)</td><td style=\"padding:8px;color:#98c379;\">Done</td><td style=\"padding:8px;color:#e5c07b;\">Medium</td></tr></table></div><div style=\"background:#2d2d2d;padding:16px;border-radius:6px;margin-top:16px;\"><h4 style=\"margin:0 0 8px 0;color:#fff;\">What's Next?</h4><p style=\"color:#9ca3af;margin:0;\">Want me to implement the inject API?</p></div></div>",
    "choices": [
      {
        "label": "Add inject API",
        "value": "Implement a /api/console/inject endpoint that sends prompts to the active browser session via SSE, allowing headless test scripts to inject prompts that render in the real console",
        "primary": true
      },
      {
        "label": "Keep current approach",
        "value": "The current server-side approach is good enough for telemetry comparison - no changes needed"
      },
      {
        "label": "Explain more",
        "value": "Explain in more detail how the browser sendPrompt flow works vs the server-side API"
      }
    ],
    "requestedAt": "2026-01-03T18:40:00.000Z",
    "requestId": "83921eac-e842-4e9c-921e-a344bb889804"
  },
  "createdBy": "claude",
  "createdAt": "2026-01-03T08:39:25.451Z",
  "updatedAt": "2026-01-03T08:39:25.601Z",
  "requestId": "83921eac-e842-4e9c-921e-a344bb889804",
  "scope": "vibetools",
  "tags": [
    "telemetry",
    "console",
    "architecture"
  ],
  "targetUser": "claude"
}
DashboardReportsKontasksSessionsTelemetryLogs + Go