Yes, experiment with reducing the olive oil a bit. That was my thought after reading the first paragraph of you post, prior to even seeing your question in the last sentence. Right now, if you're adding 4T olive oil to 3 meals a day, you're getting about 50 to 55% of your calories from fat. I've read many athletes consume over 50% dietary fat. It's fine, as long as you're not gaining body fat, but you have the added concern of staying in your weight category. Your goal would be to reduce the olive oil as much as you can while still maintaining sufficient energy. You should be able to work it out. Good luck!