Fermionic dark matter in our Galactic core?