Automation Troubleshooting
Automation troubleshooting
Section titled “Automation troubleshooting”Use this page for scheduler and delivery issues (cron + heartbeat).
Command ladder
Section titled “Command ladder”builderforce statusbuilderforce gateway statusbuilderforce logs --followbuilderforce doctorbuilderforce channels status --probeThen run automation checks:
builderforce cron statusbuilderforce cron listbuilderforce system heartbeat lastCron not firing
Section titled “Cron not firing”builderforce cron statusbuilderforce cron listbuilderforce cron runs --id <jobId> --limit 20builderforce logs --followGood output looks like:
cron statusreports enabled and a futurenextWakeAtMs.- Job is enabled and has a valid schedule/timezone.
cron runsshowsokor explicit skip reason.
Common signatures:
cron: scheduler disabled; jobs will not run automatically→ cron disabled in config/env.cron: timer tick failed→ scheduler tick crashed; inspect surrounding stack/log context.reason: not-duein run output → manual run called without--forceand job not due yet.
Cron fired but no delivery
Section titled “Cron fired but no delivery”builderforce cron runs --id <jobId> --limit 20builderforce cron listbuilderforce channels status --probebuilderforce logs --followGood output looks like:
- Run status is
ok. - Delivery mode/target are set for isolated jobs.
- Channel probe reports target channel connected.
Common signatures:
- Run succeeded but delivery mode is
none→ no external message is expected. - Delivery target missing/invalid (
channel/to) → run may succeed internally but skip outbound. - Channel auth errors (
unauthorized,missing_scope,Forbidden) → delivery blocked by channel credentials/permissions.
Heartbeat suppressed or skipped
Section titled “Heartbeat suppressed or skipped”builderforce system heartbeat lastbuilderforce logs --followbuilderforce config get agents.defaults.heartbeatbuilderforce channels status --probeGood output looks like:
- Heartbeat enabled with non-zero interval.
- Last heartbeat result is
ran(or skip reason is understood).
Common signatures:
heartbeat skippedwithreason=quiet-hours→ outsideactiveHours.requests-in-flight→ main lane busy; heartbeat deferred.empty-heartbeat-file→HEARTBEAT.mdexists but has no actionable content.alerts-disabled→ visibility settings suppress outbound heartbeat messages.
Timezone and activeHours gotchas
Section titled “Timezone and activeHours gotchas”builderforce config get agents.defaults.heartbeat.activeHoursbuilderforce config get agents.defaults.heartbeat.activeHours.timezonebuilderforce config get agents.defaults.userTimezone || echo "agents.defaults.userTimezone not set"builderforce cron listbuilderforce logs --followQuick rules:
Config path not found: agents.defaults.userTimezonemeans the key is unset; heartbeat falls back to host timezone (oractiveHours.timezoneif set).- Cron without
--tzuses gateway host timezone. - Heartbeat
activeHoursuses configured timezone resolution (user,local, or explicit IANA tz). - ISO timestamps without timezone are treated as UTC for cron
atschedules.
Common signatures:
- Jobs run at the wrong wall-clock time after host timezone changes.
- Heartbeat always skipped during your daytime because
activeHours.timezoneis wrong.
Related: