Skip to content

Add even more logging - #183

Open
simon-ess wants to merge 3 commits into
masterfrom
more_logging_sheesh
Open

simon-ess wants to merge 3 commits into
masterfrom
more_logging_sheesh

Conversation

@simon-ess

Copy link
Copy Markdown
Contributor

We are trying to better understand the life cycle of IOC connections, having seen some very odd behaviour for the recceiver under load.

When logging a protocol error, show the data passed as well. Also,
provide better logging during sessions management by the processor.
@simon-ess
simon-ess requested a review from jacomago October 7, 2026 08:42
@simon-ess simon-ess self-assigned this Oct 7, 2026
Comment thread server/recceiver/recast.py Outdated
@shroffk

shroffk commented Oct 7, 2026

Copy link
Copy Markdown
Collaborator

Can you describe the recciever behaviour in question here... while we are deploying the new recciever here I am interested in seeing if the same issue is present.

Several messages that describe exceptional circumstances are being hidden
by the debug level log severity. These are being upgraded.

General principle is that messages that occur once-per-record should be
debug, but once-per-ioc is fine, and anything that is exceptional even
on a per-record basis can be info or warning.
@simon-ess
simon-ess force-pushed the more_logging_sheesh branch from 203ad5d to 89a78d1 Compare October 8, 2026 10:34
@sonarqubecloud

sonarqubecloud Bot commented Oct 8, 2026

Copy link
Copy Markdown

@simon-ess

Copy link
Copy Markdown
Contributor Author

@shroffk - What don't have a full picture of what is happening. But broadly what we are seeing is that on our busiest recceiver (2500+ IOCs), the recceiver suddenly starts dropping connections from the IOCs, causing a flood of connect/disconnect logs and ultimately a memory spike causing it to crash.

We do not have a clear sense of why this is happening, and are trying to sort it out.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants