By default, SAML session state is stored in the IDistributedCache which defaults to the in-memory cache.
I’m not sure how this would be impacted by the CDN.
You’re welcome to enable SAML trace and send us the log file as an email attachment to confirm what you’re seeing and in case it offers any clues.