- Using features where only certain entries are categorical. - Support sparse input - Support non-sparse output