In fact, there is a direct relationship between fat and testosterone levels, so good fat is very important for growing your muscle.
If you limit the intake of good fat, you cannot grow muscle.
You can get good fats from fish oil, avocado, nuts and olive oil. Your recommended daily fat intake is 0.02% of your body weight.