Lightcone Session Control#

Three tools for manual step-by-step control of a cloud computer. Use when you need precise multi-step interaction with a website or desktop application.

For simple "go do this" tasks, prefer lightcone-browse (the /lightcone-browse command) instead.

Tools#

ToolPurposelightcone_session_createCreate a cloud computer (browser or desktop)lightcone_session_actionSend actions (click, type, scroll, screenshot, etc.)lightcone_session_closeShut down the computer

Workflow Pattern#

text

1. lightcone_session_create  → get session ID + initial screenshot
2. lightcone_session_action  → navigate, click, type, screenshot (repeat)
3. lightcone_session_close   → shut down

lightcone_session_create#

ParameterRequiredDescriptionurlNoURL to navigate to immediatelykindNo"browser" (default) or "desktop"

Returns: session ID (e.g., lc-a1b2c3d4) + screenshot of initial state.

lightcone_session_action#

ParameterRequiredDescriptionsessionIdYesSession ID from createactionYesOne of the actions belowurlFor navigateTarget URLx, yFor click/scrollPixel coordinatestextFor typeText to enterkeysFor hotkeyComma-separated keys, e.g. "Control,c"``dx, dyFor scrollScroll deltassecondsFor waitDuration in secondscommandFor debugShell command to run

Actions#

ActionReturnsUse forscreenshotScreenshotSee current statenavigateScreenshotGo to a URLclickScreenshotClick at (x, y)doubleClickScreenshotDouble-click at (x, y)rightClickScreenshotRight-click for context menutypeScreenshotEnter text at cursorhotkeyScreenshotKeyboard shortcut (e.g., Enter, Tab, Control+a)scrollScreenshotScroll at positionhtmlPage HTMLExtract page sourcewaitScreenshotPause before next actiondebugCommand outputRun shell command in the computer

Example: Login and extract data#

text

Step 1: Create a cloud computer at the login page
  lightcone_session_create { url: "https://app.example.com/login" }

Step 2: Type username (click the email field first)
  lightcone_session_action { sessionId: "lc-...", action: "click", x: 640, y: 300 }
  lightcone_session_action { sessionId: "lc-...", action: "type", text: "user@example.com" }

Step 3: Type password
  lightcone_session_action { sessionId: "lc-...", action: "hotkey", keys: "Tab" }
  lightcone_session_action { sessionId: "lc-...", action: "type", text: "password123" }

Step 4: Submit
  lightcone_session_action { sessionId: "lc-...", action: "hotkey", keys: "Return" }
  lightcone_session_action { sessionId: "lc-...", action: "wait", seconds: 3 }

Step 5: Screenshot to verify login succeeded
  lightcone_session_action { sessionId: "lc-...", action: "screenshot" }

Step 6: Extract page content
  lightcone_session_action { sessionId: "lc-...", action: "html" }

Step 7: Shut down
  lightcone_session_close { sessionId: "lc-..." }

Tips#

• Always take a screenshot after navigation to see the current state before clicking
• Use coordinates from the screenshot to target clicks accurately
• Wait 2-3 seconds after navigation or form submission for pages to load
• Use html action to extract structured data from the page
• Always close sessions when done to free resources