When driving low powered vehicles, when revved, the rpm’s drop too quickly back down to idle. Higher powered vehicles drop faster but still shouldn’t drop as quick as they do according to real engines. I think tweaking this would be realistic to the game.
It does depend on what engine and what flywheel you've got. Also make sure its not because it engaged clutch due to any assist.