The methods we develop can be readily extended to any ensemble problem formulated as an LP. We
demonstrate this by adapting the approach to regression in Section 6. In Section 7, we examine the hard
margin LP formulation of [11] which is also a special case of the column generation approach. By use of
duality theory and optimality conditions, we can gain insight into how LP boosting works mathematically,
specifically demonstrating the critical differences between the prior hard margin approach and the proposed
soft margin approach. Computational results and practical issues for implementation of the method are
given in Section 8.