MLRG/fall09

From ResearchWiki

You do not have permission to edit this page, for the following reason:

You can view and copy the source of this page:

= CS7941: Online Learning = '''Time:''' Fridays, 2-3:20 '''Location:''' MEB 3105, except as noted '''Topic:''' Online learning == Participants == * [http://www.cs.utah.edu/~hal/ Hal Daumé III], Assistant Professor, School of Computing * [http://www.cs.utah.edu/~seth/ Seth Juarez], PhD Student, School of Computing * [http://www.cs.utah.edu/~piyush/ Piyush Rai], PhD Student, School of Computing * [mailto:youngjun@cs.utah.edu Youngjun Kim], PhD Student, School of Computing * [http://www.cs.utah.edu/~arvind/ Arvind Agarwal], PhD Student, School of Computing * [mailto:jiang@cs.utah.edu Jiarong Jiang], PhD Student, School of Computing * [mailto:avishek@cs.utah.edu Avishek Saha], PhD Student, School of Computing * [http://www.cs.utah.edu/~amitg/ Amit Goyal], PhD Student, School of Computing * [mailto:huangrh@cs.utah.edu Ruihong Huang], PhD Student, School of Computing * [http://www.cs.utah.edu/~pinnaman Ramesh Pinnamaneni], MS Student, School of Computing * [mailto:jags@cs.utah.edu Jagadeesh Jagarlamudi], PhD Student, School of Computing * [mailto:lalindra.desilva@utah.edu Lalindra De Silva], PhD Student, School of Computing * [http://www.cs.utah.edu/~abhik Abhishek Kumar], PhD Student, School of Computing * [mailto:mcason@cs.utah.edu Mike Cason], PhD Student, School of Computing * [http://www.cs.utah.edu/~teichert/ Adam R. Teichert], MS Student, School of Computing * [mailto:vishayv@cs.utah.edu Vishay Vanjani], MS Student, School of Computing * [http://www.bmi.utah.edu/?module=facultyDetails&personId=10769&orgId=382 Shuying Shen], PhD Student, Department of Biomedical Informatics * [mailto:amrish.kapoor@utah.edu Amrish Kapoor], PhD Student, School of Computing == Schedule == {| border="1" style="width: 100%; text-align:left" class="content" |- ! Date || Papers || Presenter |- | Sep 04 || [http://www.cs.cmu.edu/afs/cs/usr/avrim/www/Papers/survey.ps.gz Online Learning Survey] by Avrim Blum || Hal |- | Sep 11 || [http://www.cse.ucsc.edu/classes/cmps242/Fall02/paps/winnow.ps Learning Quickly when Irrelevant Attributes Abound: A New Linear-threshold Algorithm] by Nick Littlestone || Sandeep and Shuying |- | Sep 18 || [http://www.soe.ucsc.edu/~manfred/pubs/J36.pdf Exponentiated Gradient versus Gradient Descent for Linear Predictors]. Kivenen and Warmuth. || Jagadeesh |- | Sep 25 || [http://people.cs.uchicago.edu/~kalai/papers/onlineopt/onlineopt.pdf Efficient algorithms for the online decision problem] by Adam Kalai and Santosh Vempala || Seth |- | Oct 02 || [http://www.cs.ualberta.ca/~maz/publications/ICML03.pdf Online convex programming and generalized infinitesimal gradient ascent] by M. Zinkevich || Jiarong and Mike |- | Oct 23 || [http://www.cis.upenn.edu/~crammer/publications/icml08_variance.pdf Confidence-Weighted Linear Classification] by Mark Dredze, Koby Crammer and Fernando Pereira || Amit and Lalindra |- | Oct 30 || [http://nic.schraudolph.org/pubs/KarVisSchSmo05.pdf Step Size-Adapted Online Support Vector Learning] by Karatzoglou, Vishwanathan, Schraudolph, and Smola || Ramesh and Shomit |- | Nov 06 || [http://www.cs.huji.ac.il/~singer/papers/ballseptron.ps.gz A New Perspective on an Old Perceptron Algorithm] by Shai Shalev-Shwartz and Yoram Singer || Youngjun and vishay |- | Nov 13 || [http://www.cs.huji.ac.il/~singer/papers/o2b_nips.pdf Data-Driven Online to Batch Conversions] by Ofer Dekel and Yoram Singer || Ruihong and Adam |- | Nov 20 || [http://icml2008.cs.helsinki.fi/papers/511.pdf Efficient Bandit Algorithms for Online Multiclass Prediction] by Ambuj Tewari, Shai Shalev-Shwartz and Sham Kakade [http://ttic.uchicago.edu/~shai/talks/Banditron.pdf Talk Slides] || Amrish & Avishek |- | Dec 04 || [http://jmlr.csail.mit.edu/papers/volume10/langford09a/langford09a.pdf Sparse Online Learning via Truncated Gradient] by John Langford, Lihong Li and Tong Zhang || Abhishek and Piyush |- | Dec 11 || [xxx] by xxx || |- |} == Possible Papers == * Nick Littlestone, [http://www.cse.ucsc.edu/classes/cmps242/Fall02/paps/winnow.ps Learning Quickly when Irrelevant Attributes Abound: A New Linear-threshold Algorithm]. Machine Learning 2:285--318, 1987. (The version pointed to here is the tech report UCSC-CRL-87-28.) * Littlestone and Warmuth, The Weighted Majority Algorithm. Information and Computation 108(2):212-261, 1994. * Nicolo Cesa-Bianchi, Yoav Freund, David Haussler, David Helmbold, Robert Schapire, and Manfred Warmuth, How to use expert advice, Journal of the ACM, 44(3):427-485, May 1997. * Yoav Freund and Robert Schapire, Adaptive game playing using multiplicative weights, Games and Economic Behavior, 29:79-103, 1999. * Adam Kalai and Santosh Vempala, [http://people.cs.uchicago.edu/~kalai/papers/onlineopt/onlineopt.pdf Efficient algorithms for the online decision problem], COLT '03. * Peter Auer, Nicolo Cesa-Bianchi, Yoav Freund, Robert Schapire: The Nonstochastic Multiarmed Bandit Problem, SIAM J. Comput. 32(1): 48-77 (2002). * [http://www.cs.cmu.edu/~avrim/Papers/banditLP.ps Online Geometric Optimization in the Bandit Setting Against an Adaptive Adversary]. By Brendan McMahan and Avrim Blum. COLT '04. * Abie Flaxman, Adam Tauman Kalai, and Brendan McMahan. Online Convex Optimization in the Bandit Setting: Gradient Descent Without a Gradient. In Proceedings of the Sixteenth Annual ACM-SIAM Symposium on Discrete Algorithms (SODA), pp. 385-394, 2005. * M. Zinkevich. [http://www.cs.ualberta.ca/~maz/publications/ICML03.pdf Online convex programming and generalized infinitesimal gradient ascent]. In Twentieth International Conference on Machine Learning, 2003. * [http://www.cis.upenn.edu/~crammer/publications/crammer06a.pdf Online Passive-Aggressive Algorithms]. Koby Crammer, Ofer Dekel, Joseph Keshet, Shai Shalev-Shwartz, Yoram Singer * [http://www.cis.upenn.edu/~crammer/publications/icml08_variance.pdf Confidence-Weighted Linear Classification] Mark Dredze, Koby Crammer and Fernando Pereira. Proceedings of the 25th International Conference on Machine Learning (ICML), 2008 * John Langford, Lihong Li and Tong Zhang. [http://www.stat.rutgers.edu/~tzhang/papers/jmlr09-sparseonline.pdf Sparse Online Learning via Truncated Gradient]. Journal of Machine Learning Research, 10:777-801, 2009. * Alexandros Karatzoglou, S.V.N. Vishwanathan, Nicol N. Schraudolph, and Alex J. Smola. [http://nic.schraudolph.org/pubs/KarVisSchSmo05.pdf Step Size-Adapted Online Support Vector Learning]. In Proc. 8th Intl. Symp. Signal Processing & Applications, IEEE, 2005. * [http://www.cis.upenn.edu/~mkearns/papers/onlinerisk.pdf Risk-Sensitive Online Learning]. With E. Even-Dar and J. Wortman. ALT 2006. * Ofer Dekel and Yoram Singer. [http://www.cs.huji.ac.il/~singer/papers/o2b_nips.pdf Data-Driven Online to Batch Conversions] NIPS*05 * Shai Shalev-Shwartz and Yoram Singer. [http://www.cs.huji.ac.il/~singer/papers/ballseptron.ps.gz A New Perspective on an Old Perceptron Algorithm]. COLT*05 * [http://www.soe.ucsc.edu/~manfred/pubs/J36.pdf Exponentiated Gradient versus Gradient Descent for Linear Predictors]. Kivenen and Warmuth, information and computation 132, 163 (1997). * [http://hunch.net/~jl/projects/interactive/sidebandits/bandit.pdf The Epoch-Greedy Algorithm for Contextual Multi-armed Bandits] John Langford and Tong Zhang, NIPS 2007. == Paper Summaries == ==Past Semesters== * [[MLRG/summer09|Summer 2009]] (Assorted Topics) * [[MLRG/spring09|Spring 2009]] (Learning Theory) * [[MLRG/fall08|Fall 2008]] (Graphical Models) * [[MLRG/summer08|Summer 2008]] (Multitask Learning) * [[MLRG/spring08|Spring 2008]] (Kernel Methods) * [[MLRG/fall07|Fall 2007]] (Unsupervised Bayes) * [[MLRG/summer07|Summer 2007]] (Manifolds) [[Category:Seminars]]

Return to MLRG/fall09.