Deep Learning is an incredible, perhaps even mystical (read inscrutable), science: data goes in, backprop occurs, and incomprehensible algorithms are manifested. Finetuning is an integral part of this AI stack, and thus, despite the supposed onset of RSI, being aware of and understanding which techniques are most in accord with the Bitter Lesson is critical for achieving SOTA performance. Example topics will include: LoRA, Continual Learning, etc.
Jack Murphy is an Applied Deep Learning Researcher working on foundation language model training, finetuning, optimization, evaluation, and product integration at the intersection of Cybersecurity + AI. Before picking up Deep Learning he published research in Number Theory and studied Mathematics and Computer Science at Williams College.
