But the fact is: If you replace the olive oil in your diet with beans (calorie for calorie), your olive oil–enriched diet would end up producing significantly higher LDL cholesterol levels than your bean–enriched diet. Does that mean olive oil raises LDL cholesterol? Well, yes, compared to beans, but it lowers LDL cholesterol compared to butter.