If your SCUM server is getting 5 FPS, with no players connected, that's not an indicator of poor server performance. It is expected behaviour.
The game's developers have designed the server to enter an "Idle" state when no players are connected, which runs at this low FPS of 5.
The "Minimum" FPS in your configuration file is actually the Idle FPS.