Your planning system is bad. This was the original origin of using story points instead of days, because the designers of extreme programming found that the work of 1 "ideal day" (8 hours of uninterrupted productive coding) could be done in about 3 days.
And don't get me started on measuring velocity, especially across teams. Your environment sounds like its poisoned by middle management.
It's not my planning system but it was broken indeed even though they brought in a licensed scrum master as a consultant but he was more interested in running things the way middle managers wanted it as that guaranteed his job security.
Anyway, thank God I left, but from what I hear from other mates in the industry it's not better in other companies in my area since they're all run by middle managers.
Maybe it's a problem specific to Germany where managers are always right and their authority is unquestionable.
And don't get me started on measuring velocity, especially across teams. Your environment sounds like its poisoned by middle management.