Skip to content

Scheduled Background Jobs

This document lists all scheduled background jobs (Celery beat tasks) configured in the system.

Scheduled Jobs

Job Name Task Schedule Description
cancel-expired-invitations waldur_core.users.cancel_expired_invitations 1 day Invitation lifetime must be specified in Waldur Core settings with parameter
"INVITATION_LIFETIME". If invitation creation time is less than expiration time, the invitation will set as expired.
cancel_expired_group_invitations waldur_core.users.cancel_expired_group_invitations 1 day Invitation lifetime must be specified in Waldur Core settings with parameter
"GROUP_INVITATION_LIFETIME". If invitation creation time is less than expiration time,
the invitation will set as expired.
check-expired-permissions waldur_core.permissions.check_expired_permissions 1 day Task not found in registry
check-polices waldur_mastermind.policy.check_polices Cron: * * 1 * * (m/h/dM/MY/d) Evaluate all policies across all policy types in the system.
core-reset-updating-resources waldur_core.reset_updating_resources 10 minutes Reset resources stuck in UPDATING state when their Celery tasks are completed.
create-reviews-if-strategy-is-after-proposal waldur_mastermind.proposal.create_reviews_if_strategy_is_after_proposal 1 hour Task not found in registry
create-reviews-if-strategy-is-after-round waldur_mastermind.proposal.create_reviews_if_strategy_is_after_round 1 hour Task not found in registry
create_customer_permission_reviews waldur_core.structure.create_customer_permission_reviews 1 day Create customer permission reviews for customers that need periodic review of user permissions.
expired-reviews-should-be-cancelled waldur_mastermind.proposal.expired_reviews_should_be_cancelled 1 hour Task not found in registry
mark-offering-backend-as-disconnected-after-timeout waldur_mastermind.marketplace_site_agent.mark_offering_backend_as_disconnected_after_timeout 1 hour Task not found in registry
mark_resources_as_erred_after_timeout waldur_mastermind.marketplace.mark_resources_as_erred_after_timeout 2 hours Mark stale orders and their resources as erred if they have been executing for more than 2 hours.
marketplace-openstack.create-resources-for-lost-instances-and-volumes waldur_mastermind.marketplace_openstack.create_resources_for_lost_instances_and_volumes 6 hours Create marketplace resources for OpenStack instances and volumes that exist in backend but are missing from marketplace.
marketplace-openstack.refresh-instance-backend-metadata waldur_mastermind.marketplace_openstack.refresh_instance_backend_metadata 1 day Refresh metadata for OpenStack instances from backend to ensure marketplace resources have up-to-date information.
notification_about_project_ending waldur_mastermind.marketplace.notification_about_project_ending Cron: 0 10 * * * (m/h/dM/MY/d) Send notifications about projects ending in 1 day and 7 days.
notification_about_resource_ending waldur_mastermind.marketplace.notification_about_resource_ending Cron: 0 10 * * * (m/h/dM/MY/d) Send notifications about resources ending in 1 day and 7 days.
notify_about_stale_resource waldur_mastermind.marketplace.notify_about_stale_resource Cron: 0 15 5 * * (m/h/dM/MY/d) Notify customers about resources that have not generated invoice items in the last 3 months.
openstack-delete-expired-backups openstack.DeleteExpiredBackups 10 minutes Delete expired OpenStack backup resources that have reached their retention period.
openstack-delete-expired-snapshots openstack.DeleteExpiredSnapshots 10 minutes Delete expired OpenStack snapshot resources that have reached their retention period.
openstack-tenant-properties-list-pull-task openstack.tenant_properties_list_pull_task 1 day Pull OpenStack tenant properties like flavors, images, and volume types from backend.
openstack-tenant-pull-quotas openstack.TenantPullQuotas 12 hours Pull quota limits and usage information for all OpenStack tenants.
openstack-tenant-resources-list-pull-task openstack.tenant_resources_list_pull_task 1 hour Pull OpenStack tenant resources like instances, volumes, and snapshots from backend.
openstack-tenant-subresources-list-pull-task openstack.tenant_subresources_list_pull_task 2 hours Pull OpenStack tenant subresources like security groups, networks, subnets, and ports from backend.
openstack_mark_as_erred_old_tenants_in_deleting_state openstack.mark_as_erred_old_tenants_in_deleting_state 1 day Mark OpenStack tenants as erred if they have been in deleting state for more than 1 day.
process-pending-project-invitations waldur_core.users.process_pending_project_invitations 2 hours Process project invitations for projects that have become active.
process_pending_project_orders waldur_mastermind.marketplace.process_pending_project_orders 2 hours Process orders for projects that have become active.
proposals-for-ended-rounds-should-be-cancelled waldur_mastermind.proposal.proposals_for_ended_rounds_should_be_cancelled 1 hour Task not found in registry
pull-priorities waldur_mastermind.support.pull_priorities 1 day Pull priority levels from the active support backend.
pull-service-properties waldur_core.structure.ServicePropertiesListPullTask 1 day Pull service properties from all active service backends.
pull-service-resources waldur_core.structure.ServiceResourcesListPullTask 1 hour Pull resources from all active service backends.
pull-support-users waldur_mastermind.support.pull_support_users 6 hours Pull support users from the active support backend.
remove_deleted_robot_accounts waldur_mastermind.marketplace.remove_deleted_robot_accounts 1 day Remove robot accounts that are in DELETED state.
This task runs daily to clean up robot accounts that have been marked for deletion.
send-messages-about-pending-orders waldur_mastermind.marketplace_site_agent.send_messages_about_pending_orders 1 hour Task not found in registry
send-monthly-invoicing-reports-about-customers invoices.send_monthly_invoicing_reports_about_customers Cron: 0 0 2 * * (m/h/dM/MY/d) Send monthly invoicing reports via email to configured recipients.
send-notifications-about-upcoming-ends invoices.send_notifications_about_upcoming_ends 1 day Send notifications about upcoming end dates of fixed payment profiles.
send-reminder-for-pending-invitations waldur_core.users.send_reminder_for_pending_invitations 1 day Send reminder emails for pending invitations that are about to expire.
send-scheduled-broadcast-notifications waldur_mastermind.notifications.send_scheduled_broadcast_messages 12 hours Send broadcast messages that have been scheduled for delivery.
send_telemetry waldur_mastermind.marketplace.send_metrics 1 day Send anonymous usage metrics and telemetry data to the Waldur team.
structure-set-erred-stuck-resources waldur_core.structure.SetErredStuckResources 1 hour This task marks all resources which have been provisioning for more than 3 hours as erred.
sync-resources waldur_mastermind.marketplace_site_agent.sync_resources 10 minutes Task not found in registry
sync_request_types waldur_mastermind.support.sync_request_types 1 day Synchronize request types from the active support backend.
terminate_expired_resources waldur_mastermind.marketplace.terminate_expired_resources 1 day Terminate marketplace resources that have reached their end date.
terminate_resources_if_project_end_date_has_been_reached waldur_mastermind.marketplace.terminate_resources_if_project_end_date_has_been_reached 1 day Terminate resources when their project has reached its end date.
terminate_resources_in_state_erred_without_backend_id_and_failed_terminate_order waldur_mastermind.marketplace.terminate_resources_in_state_erred_without_backend_id_and_failed_terminate_order 1 day Clean up erred Slurm resources that failed both creation and termination.
update-custom-quotas waldur_core.quotas.update_custom_quotas 1 hour Task not found in registry
update-invoices-total-cost invoices.update_invoices_total_cost 1 day Update cached total cost for current month invoices.
update-standard-quotas waldur_core.quotas.update_standard_quotas 1 day Task not found in registry
valimo-auth-cleanup-auth-results waldur_auth_valimo.cleanup_auth_results 1 hour Clean up Valimo authentication results older than 7 days.
waldur-create-invoices invoices.create_monthly_invoices Monthly (1st day of month at midnight) - For every customer change state of the invoices for previous months from "pending" to "billed"
and freeze their items.
- Create new invoice for every customer in current month if not created yet.
waldur-create-offering-users-for-site-agent-offerings waldur_mastermind.marketplace_site_agent.sync_offering_users 1 day Task not found in registry
waldur-firecrest-pull-jobs waldur_firecrest.pull_jobs 1 hour Pull SLURM jobs from Firecrest API for all offering users with valid OAuth tokens.
waldur-freeipa-sync-groups waldur_freeipa.sync_groups 10 minutes This task is used by Celery beat in order to periodically
schedule FreeIPA group synchronization.
waldur-freeipa-sync-names waldur_freeipa.sync_names 1 day Synchronize user names between Waldur and FreeIPA backend.
waldur-marketplace-calculate-usage waldur_mastermind.marketplace.calculate_usage_for_current_month 1 hour Calculate marketplace resource usage for the current month across all customers and projects.
waldur-marketplace-script-pull-resources waldur_marketplace_script.pull_resources 1 hour Pull resources from marketplace script offerings by executing configured pull scripts.
waldur-marketplace-script-remove-old-dry-runs waldur_marketplace_script.remove_old_dry_runs 1 day Remove old dry run records that are older than one day.
waldur-mastermind-reject-past-bookings waldur_mastermind.booking.reject_past_bookings Cron: 0 10 * * * (m/h/dM/MY/d) Reject booking resources that have start times in the past.
waldur-mastermind-send-notifications-about-upcoming-bookings waldur_mastermind.booking.send_notifications_about_upcoming_bookings Cron: 0 9 * * * (m/h/dM/MY/d) Send email notifications to users about their upcoming bookings.
waldur-pid-update-all-referrables waldur_pid.update_all_referrables 1 day Update DataCite DOI information for all referrable objects with existing DOIs.
waldur-pull-remote-eduteams-ssh-keys waldur_auth_social.pull_remote_eduteams_ssh_keys 3 minutes Task not found in registry
waldur-pull-remote-eduteams-users waldur_auth_social.pull_remote_eduteams_users 5 minutes Task not found in registry
waldur-rancher-delete-leftover-keycloak-groups waldur_rancher.delete_leftover_keycloak_groups 1 hour Delete remote Keycloak groups with no linked groups in Waldur
waldur-rancher-delete-leftover-keycloak-memberships waldur_rancher.delete_leftover_keycloak_memberships 1 hour Delete remote Keycloak user memberships in groups with no linked instances in Waldur
waldur-rancher-sync-keycloak-users waldur_rancher.sync_keycloak_users 15 minutes Synchronize Keycloak users with pending group memberships in Rancher.
waldur-rancher-sync-rancher-group-bindings waldur_rancher.sync_rancher_group_bindings 1 hour Sync group bindings in Rancher with the groups in Waldur.
waldur-rancher-sync-rancher-roles waldur_rancher.sync_rancher_roles 1 hour Synchronize Rancher roles with local role templates for clusters and projects.
waldur-rancher-update-clusters-nodes waldur_rancher.pull_all_clusters_nodes 1 day Pull node information for all Rancher clusters and update their states.
waldur-remote-notify-about-pending-project-update-requests waldur_mastermind.marketplace_remote.notify_about_pending_project_update_requests 7 days Notify about pending project update requests.

This task sends email notifications to project owners about pending
project update requests that have been waiting for more than a week.
Runs weekly via celery beat.
waldur-remote-offerings-sync waldur_mastermind.marketplace_remote.remote_offerings_sync 1 day Synchronize remote offerings based on RemoteSynchronisation configurations.

This task processes active remote synchronization configurations,
running synchronization for each configured remote marketplace.
Runs daily via celery beat.
waldur-remote-pull-erred-orders waldur_mastermind.marketplace_remote.pull_erred_orders 1 day Pull and synchronize erred remote marketplace orders.

This task specifically handles erred local orders that may have been
resolved in remote Waldur instances. It synchronizes UPDATE and TERMINATE
order states and adjusts local resource states accordingly.
Runs daily via celery beat.
waldur-remote-pull-invoices waldur_mastermind.marketplace_remote.pull_invoices 1 hour Pull and synchronize remote marketplace resource invoice data.

This task synchronizes invoice items for marketplace resources from
remote Waldur instances, including current and previous month data.
Runs every 60 minutes via celery beat.
waldur-remote-pull-offering-users waldur_mastermind.marketplace_remote.pull_offering_users 1 hour Pull and synchronize remote marketplace offering users.

This task synchronizes user associations with marketplace offerings from
remote Waldur instances, ensuring local user mappings are up to date.
Runs every 60 minutes via celery beat.
waldur-remote-pull-offerings waldur_mastermind.marketplace_remote.pull_offerings 1 hour Pull and synchronize remote marketplace offerings.

This task synchronizes offerings from remote Waldur instances, updating
local offering data including components, plans, and access endpoints.
Runs every 60 minutes via celery beat.
waldur-remote-pull-orders waldur_mastermind.marketplace_remote.pull_orders 1 hour Pull and synchronize remote marketplace orders.

This task synchronizes order states from remote Waldur instances,
updating local order states and associated resource backend IDs.
Only processes non-terminal orders. Runs every 60 minutes via celery beat.
waldur-remote-pull-resources waldur_mastermind.marketplace_remote.pull_resources 1 hour Pull and synchronize remote marketplace resources.

This task synchronizes resource data from remote Waldur instances,
updating local resource states and importing remote orders when needed.
Runs every 60 minutes via celery beat.
waldur-remote-pull-robot-accounts waldur_mastermind.marketplace_remote.pull_robot_accounts 1 hour Pull and synchronize remote marketplace resource robot accounts.

This task synchronizes robot account data for marketplace resources from
remote Waldur instances, including account types, usernames, and keys.
Runs every 60 minutes via celery beat.
waldur-remote-pull-usage waldur_mastermind.marketplace_remote.pull_usage 1 hour Pull and synchronize remote marketplace resource usage data.

This task synchronizes component usage data from remote Waldur instances,
including both regular usage and user-specific usage metrics.
Pulls usage data from the last 4 months. Runs every 60 minutes via celery beat.
waldur-remote-push-project-data waldur_mastermind.marketplace_remote.push_remote_project_data 1 day Push project data to remote Waldur instances.

This task pushes local project data (name, description, end date, etc.)
to remote Waldur instances for projects that have marketplace resources.
Runs daily via celery beat.
waldur-remote-sync-remote-project-permissions waldur_mastermind.marketplace_remote.sync_remote_project_permissions 6 hours Synchronize project permissions with remote Waldur instances.

This task ensures that project permissions are synchronized between
local and remote Waldur instances when eduTEAMS sync is enabled.
It creates remote projects if needed and manages user role assignments.
Runs every 6 hours via celery beat.
waldur-sync-daily-quotas analytics.sync_daily_quotas 1 day Task not found in registry
waldur-update-all-pid waldur_pid.update_all_pid 1 day Update all PID (Persistent Identifier) information for referrable objects with DataCite DOIs.