We may have been able to increase our levels, but that does not necessarily mean we have gotten strong. I think Raphtalia and Firo realize this too.
It seems that Level is a sort of magical property of an individual, and things like skill and intelligence are separate.
I don’t think I have the reaction speed or mentality to take on stronger opponents yet.
This is an unfortunate side-effect of grinding.