Description

Contains a list of subscribers that are either:

  • pending to go offline
  • offline

Pending subscribers are pushed there by directory-reach-extractor and kept until offline package is considered ready to be uploaded.

It also contains a list of channels that are relevant in a context of pending offline users. This list is used by directory-reach-extractor to detect a full cycle of offline package creation. In other words, if channel had been already added to the list, it means that all pending users are most likely there (since we process subscribers-reach for each channel).

Data flow

  • offline package is new and empty
  • directory-reach-extractor is processing subscribers-reach and pushing pending users to the offline package
  • offline package is being considered as ready to be uploaded by either:
    • stumbling upon a channel that was already processed (full cycle has been made)
    • reaching a certain time threshold
  • offline package is being uploaded to the storage (S3)
  • all pending data is removed from the offline package
  • package is ready to be downloaded and extracted on the other side (sender cluster)