add call package from lattice by chee · Pull Request #100 · inkandswitch/patchwork-pkg-base

chee · 2026-11-13T01:30:48Z

No description provided.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

…ge area) Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

patchcrow · 2026-11-13T01:30:59Z

✅ Patchwork glance ready

https://patchwork-preview-100--patchwork-base.netlify.app

Patchwork from inkandswitch/patchwork.inkandswitch.com, packages from this PR at ed189f1.

build-info.json

The stage's area reached CallFloating and CallStage as the box itself, so calling it threw once there was one. And choosing "in the sidebar" ran as a getter, never reaching setFaces. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

Lattice's settings (lattice-wm:call) can share the origin: faces put away or "in the sidebar" there carried over. And tabs go by name, with the first shown when nothing's chosen: "Call" came before Chat and Comments. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

Copilot

🟡 Changes recommended

The camera fallback loads unverified CDN code with repository and account access, while incorrectly passed area accessors cause runtime exceptions that break floating faces and the stage.

11 open issues

Avoid loading an unverified face detector from a CDN · New
Pass the stage area accessor through to both components · New
Prevent the chevron click from reopening the menu · New
Give the faces callback an event parameter · New
Stop progress callbacks after a download fails · New
Read computed titles from the loaded plugin module · New
Reconcile room holds for late-mounted views · New
Make avatar converter availability reactive · New
Make the floating-face control keyboard accessible · New
Hide the stage popover before requesting fullscreen · New
Keep call surfaces host-side in isolation mode · New

1 file not reviewed

call/pnpm-lock.yaml: Generated file

What changed in this PR

Ports Lattice’s calling functionality into a standalone Patchwork package and connects it to threepane through runtime plugin IDs, without linking the tools at build time.

Changes:

Adds call controls, video views, floating faces, and supporting media and session utilities.
Integrates an optional call provider, sidebar controls, automatic video tab, and stage area into threepane.
Adds standalone build configuration and tests for call behavior and frame integration.

File	Description
`threepane/src/styles.css`	Supports fitted and hidden sidebar widgets.
`threepane/src/PatchworkFrame.tsx`	Wraps the frame in the optional call provider.
`threepane/src/datatypes.ts`	Defines runtime call component IDs.
`threepane/src/components/SidebarWidgets.tsx`	Adds the call control panel to the sidebar.
`threepane/src/components/SidebarWidgets.test.tsx`	Tests panel placement, visibility, and deduplication.
`threepane/src/components/DocumentAreaRoot.tsx`	Integrates video-tab opening and marks the stage area.
`threepane/src/components/CallVideoOpener.tsx`	Coordinates video demand with sidebar selection.
`threepane/src/components/CallVideoOpener.test.tsx`	Tests video-tab selection and subscriptions.
`call/vitest.config.js`	Configures browser-like call tests.
`call/vite.config.js`	Configures standalone bundling and CSS injection.
`call/test/wiggle.test.js`	Tests waveform and border geometry.
`call/test/video.test.js`	Tests call video rendering.
`call/test/sizes.test.js`	Tests layouts, encoding limits, and speaking thresholds.
`call/test/room.test.js`	Tests room normalization and title lookup.
`call/test/provider.test.js`	Tests provider lifecycle and subscription behavior.
`call/test/layer.test.js`	Tests questions, floating faces, and stage areas.
`call/test/lasting.test.js`	Tests state shared across module reloads.
`call/test/kept.test.js`	Tests stored settings and rejoin timing.
`call/test/fake.js`	Provides fake repository and media fixtures.
`call/test/faces.test.js`	Tests participant face lookup and rendering.
`call/test/control-panel.test.js`	Tests sidebar controls and sizing.
`call/test/channel.test.js`	Tests document signaling channels.
`call/test/call.test.js`	Tests call sessions, presence, and rejoining.
`call/test/button.test.js`	Tests titlebar call actions and subscriptions.
`call/src/video.js`	Renders call participants in a sidebar view.
`call/src/vendor/deepfilternet/LICENSE`	Includes the vendored denoiser’s MIT license.
`call/src/vendor/deepfilternet/deepfilternet.js`	Provides DeepFilterNet worklet setup.
`call/src/vendor/deepfilternet/deepfilternet-worklet-processor.js`	Runs vendored audio denoising in a worklet.
`call/src/ui/ui.js`	Implements faces, call prompts, floating views, and stage.
`call/src/ui/styles.css`	Styles call controls and video surfaces.
`call/src/ui/icons.js`	Provides call-specific SVG icons.
`call/src/ui/colour.js`	Assigns fallback participant colors.
`call/src/ui/avatar.js`	Converts avatar URLs for display.
`call/src/ui/arriving.js`	Tracks newly arriving participants for animation.
`call/src/ui/area.js`	Observes the frame’s designated stage bounds.
`call/src/ui/along.js`	Supports scrolling participant rows.
`call/src/provider.js`	Tracks visible rooms and serves call subscriptions.
`call/src/protocol.js`	Defines call state and subscription contracts.
`call/src/protocol-names.js`	Exports shared call event names.
`call/src/index.js`	Registers call components and the titlebar tool.
`call/src/engine/wiggle.js`	Calculates waveform-driven face borders.
`call/src/engine/speaking.js`	Detects speaking activity from audio streams.
`call/src/engine/sizes.js`	Selects layouts, video limits, and speaking thresholds.
`call/src/engine/room.js`	Normalizes room IDs and resolves document titles.
`call/src/engine/rejoin.js`	Records recent calls for reload recovery.
`call/src/engine/noise.js`	Downloads, caches, and applies optional noise suppression.
`call/src/engine/lasting.js`	Preserves live state across module replacements.
`call/src/engine/kept.js`	Safely reads and writes session storage.
`call/src/engine/face.js`	Detects faces and centers camera previews.
`call/src/engine/channel.js`	Uses document messages for call signaling.
`call/src/control-panel.js`	Implements sidebar call controls and settings.
`call/src/call-face.js`	Exposes participant faces as a reusable component.
`call/src/button.js`	Implements provider-backed titlebar call actions.
`call/pnpm-workspace.yaml`	Supplies package-local pnpm settings.
`call/package.json`	Declares dependencies and standalone tool scripts.
`call/.gitignore`	Excludes generated build and deployment files.

_{Review effort: Max}

+    const vision = await import(`${MEDIAPIPE}/vision_bundle.mjs`);
+    const files = await vision.FilesetResolver.forVisionTasks(`${MEDIAPIPE}/wasm`);


+  element.addEventListener(CALL_EVENT, onCall);
+  // what was mounted before this was (it was loaded late, or swapped in
+  // anew): on screen already, and unmounted like the rest later
+  for (const view of element.querySelectorAll("patchwork-view[doc-url]")) hold(view.getAttribute("doc-url"));


+    if (full && document.fullscreenElement !== stage) {
+      stage.requestFullscreen?.().catch(() => setFull(false));


+                  sidebars, and carries on as docs change. Not waited on: it's
+                  late-bound, and renders nothing without the package.
+                */}
+                <patchwork-view component={CALL_PROVIDER}>


Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Refactor event handling for menu button interactions. Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Add active flag to control download state updates. Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Found in two headless browsers: the control panel read call.get().… as the call went, and choosing floating again left the video tab showing when no tab had been chosen before. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

Hearing a room threw, and lost the room's listener, when someone said bye there before they'd been heard (a join that hadn't finished, hung up). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

chee and others added 12 commits November 13, 2026 00:54

docs: call package design and plan

2d12246

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

call: scaffold package, port pure modules from lattice

9697ec4

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

call: room urls and names

8e6857b

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

call: port the engine, rooms keyed by url

b013afc

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

call: provider and protocol

93697ae

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

call: faces, styles, call-face

3a2995c

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

call: question, floating faces and stage

ca6df88

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

call: control panel and video tab

5a4c465

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

call: test media streams a <video> takes

0716125

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

call: doc-title button

c8c72dd

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

threepane: host the call (provider, control panel, widget sizing, sta…

a1f1598

…ge area) Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

threepane: open the call video tab when asked

b2f6548

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

chee and others added 3 commits November 13, 2026 01:34

respond to tests

03863b4

chee requested a max review from Copilot November 13, 2026 01:49

Copilot started reviewing on behalf of chee November 13, 2026 01:50

View session

Copilot AI reviewed Nov 13, 2026

View reviewed changes

chee and others added 10 commits November 13, 2026 08:48

Update area function references in render

f1c90d9

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Change span to button for drag functionality

7b16811

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Refactor avatarSrc initialization with await

7dafb9b

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Improve onClick and onPointerDown handlers

ad17fd4

Refactor event handling for menu button interactions. Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Implement active flag for download state management

e7805a8

Add active flag to control download state updates. Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Fix title retrieval from datatype module

33149eb

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

call: a bye from someone never heard is nothing

36b5876

Hearing a room threw, and lost the room's listener, when someone said bye there before they'd been heard (a join that hadn't finished, hung up). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

be slightly less of it

03b8741

rubber duck

ed189f1

Navigation Menu

Repository navigation

add call package from lattice - #100

add call package from lattice#100
chee wants to merge 25 commits into
mainfrom
call-package

chee commented Nov 13, 2026

Uh oh!

patchcrow commented Nov 13, 2026 •

edited

Loading

Uh oh!

Copilot AI left a comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

		const vision = await import(`${MEDIAPIPE}/vision_bundle.mjs`);
		const files = await vision.FilesetResolver.forVisionTasks(`${MEDIAPIPE}/wasm`);

		if (full && document.fullscreenElement !== stage) {
		stage.requestFullscreen?.().catch(() => setFull(false));

Conversation

chee commented Nov 13, 2026

Uh oh!

patchcrow commented Nov 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

✅ Patchwork glance ready

https://patchwork-preview-100--patchwork-base.netlify.app

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

🟡 Changes recommended

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

patchcrow commented Nov 13, 2026 •

edited

Loading