Yes, coconut milk would be the best I think. My friend makes delcicious infused fudge, but once she changed her recipe to a "low fat" mylk and it just wasn't the same.