batch-update Modified Newton-Raphson to quickly update a fitted model with new data see pdf see pdf relevant papers http://papers.nips.cc/paper/2365-large-scale-online-learning.pdf Yann LeCun and Leon Bottou