On July 23rd at ~1000PDT (~1700 UTC) SEDNA's message ingest experienced a delay in sending and receiving messages. During this time, some users may have observed messages arriving later than expected along with intermittent delays in sending messages. All other functions within SEDNA, search, compose, tagging, etc, were fully operational.
An inbound message containing irregular message content failed our import process. Our team attempted to manually import said message which resulted in our ingest servers to throttle processing items in our task queue.
To prevent this issue from happening again, our team has either begun, or completed the following: