Skip to main content
Version: 0.2.0 (Latest)

Cores

In Padas UI, the console, Management → Cores is the registry sync surface for each registered Motion Engine (console: Cores; tree: core/). You equalize drift with Sync, add workloads with Deploy, and unbind + delete with Remove. Needs deploy comes from fingerprint drift. This page does not author pipeline topology or replace live runtime graphs—that work lives under Configurations and Control Tower.

Architecture context​

LayerRole
Padas UI (console and control plane)Stores the operator desired set, drives Deploy / Sync / Remove to each Core, and surfaces fingerprint drift.
Motion EngineHolds its own runtime registry after push; runs workloads only after runtime activation.
This pagePer-Core Deploy (add), Sync (equalize + orphan delete), Remove (selective drop) — not stream processing itself.
warning
  • Sync makes this Core match the UI desired set (including orphan delete); it does not start runtime execution.
  • Remove is the selective drop path. Core Sync is the bulk equalize (orphans included).
  • Runtime activation (start / stop) is separate—use Advanced after the registry is current.

What this page manages​

TopicWhere
Core Deploy / Sync / RemoveThis page — per Core row.
Entity Deploy / Sync / Remove (scoped bind + push, equalize, or unbind + delete)Tasks / Sources / Sinks / Management → Pipelines
Pipeline topology (graph authoring)Pipelines
Engine registration (Host / Port) + enrollServices → Cores — enroll the engine
Live execution graph and pipeline-level controlsControl Tower

Sync lifecycle​

At a high level: define registry objects → bind membership (via entity Deploy, Core Deploy, Home Add-entity packages, or Home pipeline Apply/Link) → Sync when drift appears → activate execution elsewhere. Use Remove to drop workloads from the Core.

StepMeaning
MembershipDesired placement is written as transactional silent bind inside entity Deploy, Core Deploy, or Home Add-entity packages (bind rolls back if push fails). Home Apply / Link for pipelines may bind without push.
SyncRow Sync (when needs deploy) equalizes this Core’s desired set (pipelines expand to flat streams / tasks / connectors) and deletes orphans not in that set. Empty desired set wipes after confirm.
ActivationAdvanced start / stop controls runtime execution after a successful sync/deploy.

Sync vs Deploy vs Remove vs Start​

Do not conflate the three registry gestures:

ActionWhereScopeRuntime activation
SyncThis page (when needs deploy)Equalize desired set including orphan DELETE (empty = wipe with confirm)No
DeployThis page + Tasks / Sources / Sinks / PipelinesSilent bind (if needed) + push selected / that entity (transactional — new bind rolls back if push fails); hidden when there is no deploy targetNo
RemoveThis page + Tasks / Sources / Sinks / PipelinesSelective unbind + scoped delete; hidden when nothing is assigned. Not on HomeNo
Start / Stop (Advanced)Advanced / Core ActionsUses last successful sync/deployYes

Core inventory​

Scan rows for connectivity, bound workloads, and needs deploy before incident deep dives.

ColumnUse
Core ID / NameStable row identity and operator label.
Host / PortManagement endpoint—should match Cores registration.
Sources / Tasks / SinksWorkloads in the UI desired set for this Core.
Deployed TimeLast successful sync/deploy timestamp for display/ops—not the needs-deploy decision.
ActionsSync (when needs deploy), Deploy (when catalog has entities not yet on this Core), Remove (when this Core has assigned entities).
Management Cores list with Host, Port, component tags, and actions
Core inventory and sync posture.

Filters and search behave like other Management grids.

Working with Deploy, Sync, and Remove​

ControlEffect
DeployModal with three dropdowns (tasks / sources / sinks). Dropdowns start empty; options are entities not yet on this Core. Select what to bind + push (transactional). Empty submit forbidden. Hidden when there is nothing left to add.
SyncEqualize this Core’s registry to the UI desired set (including orphan DELETE). Confirm warns orphans will be removed. Empty desired set wipes after confirm.
RemoveSame three-dropdown shape; options are entities already assigned to this Core. Select what to unbind + delete. Empty submit forbidden. Hidden when nothing is assigned. Selective — does not require Sync.

Until Sync/Deploy completes, the engine can keep the previous registry revision for affected objects. Membership for individual workloads is added via Deploy or Home flows—not by an Assign-only step on this page.

Needs deploy (fingerprint drift)​

Needs deploy means the desired fingerprint differs from the observed fingerprint for the Core’s desired set. It is not driven by Assigned Time (that column is retired). Core reachability is shown by runtime status, not a separate unreachable chip.

BehaviorDetail
DecisionAggregate fingerprint of the desired set vs service; when they differ, per-entity fingerprints identify missing / changed ids.
No observe yetWithout a fingerprint compare, needs-deploy stays off (do not invent drift).
During SyncRuntime execution can keep using the prior registry revision until Sync finishes successfully.
Operator responseRun row Sync to equalize drift; use Deploy to add missing catalog entities; use Remove to drop extras. For a single workload, prefer entity actions on Tasks / Sources / Sinks / Pipelines.
SecretsSecret-only edits may not light needs-deploy (fingerprint omits sensitive fields); Configurations save confirm asks you to Deploy when only secrets change. Mixed edits (secret + non-secret) rely on fingerprint/needs-deploy instead. Configurations do not show needs-deploy chips.
Core row with Needs deploy indicator on a component tag
Fingerprint drift on bound components.

Relationship to pipelines​

SurfaceResponsibility
CoresDeploy / Sync / Remove for flat streams / tasks / connectors. Pipelines are UI-only and are never Core registry entities.
PipelinesPipeline Deploy / Sync / Remove (bind + constituent push, scoped reconcile, or unbind + scoped delete).
Control TowerRuntime execution visibility — live topology, stage health, graph-level actions on the selected Core; Home Apply / Link for pipeline membership.

Core Sync expands pipeline membership into the flat desired set; it does not push a pipeline object to the engine.

Activation after sync​

Sync / Deploy alone do not start workloads. After registry parity is current, use Advanced (Tasks, Sources, Sinks) for runtime activation. Control Tower complements this with pipeline execution visibility and controls when pipelines are attached.

Operational workflow​

  1. Verify engine connectivity — Host / Port align with Cores.
  2. Review desired-set workloads — tags show sources, tasks, sinks bound for each row.
  3. Check needs deploy — clear fingerprint drift before trusting registry parity.
  4. Deploy / Sync / Remove — add with Deploy, equalize with Sync, drop extras with Remove; use entity pages for single-workload scope.
  5. Start workloads — Advanced when execution should run.
  6. Observe behavior — Control Tower and Pipelines status for graph-level posture.