Over the Rainbow

High Probability Analysis for SGD

Beyond Bounded Domain and Bounded Gradients

Long time no see! This one is the longest post I have written so far—so grab a drink, it will take a little time to read! For better readability, you can refer to the pdf version. I am learning ho...

A Short Escape to Jeju

I recently took a three-day trip to Jeju Island with my friends—a much-needed escape from our busy routines. On the first day, the sky was overcast, and the ocean looked dark and moody. But the se...

Proof of the Contraction Properties of PDHG

In this blog, we introduce how to simply derive the nonexpansiveness and contraction properties of primal-dual hybrid gradient method (PDHG) iteration through the language of operator theory. In [...

What is Good Research? A Catalog of Professional Views

I’ve been quite busy with PhD interviews recently, and I’ve found the experience to be very rewarding. I see interviews as a great opportunity to engage in meaningful conversations with experts. Du...

TeXmacs Tips

Efficient Math Typing, Crash Fixes, and More

About TeXmacs TeXmacs is my favorite text editor, especially useful for those who frequently need to type mathematical formulas. I highly recommend giving it a try! In case you need help getting ...

Performance Estimation Problems II

Convergence Proofs and Stepsize Optimization

This is the second post in a series on Performance Estimation Problems (PEP). In this post, I’ll introduce applications of the PEP framework, particularly in convergence proofs and stepsize optimiz...

Performance Estimation Problems I

Methodology Review

This is the first post in a new series on Performance Estimation Problems (PEP). I’ve divided the series into two parts: the first introduces the PEP framework, and the second covers applications o...

A Bunny Lover’s Guide to Happy and Healthy Hops 🐰

The original post is written in Chinese, and this version is translated by ChatGPT. My little bunny hopped into my life in May 2022, and it’s been two and a half years of fluffy joy since then. ...

Polynomial Optimization II

Multivariant problems

This note is taken from the summer course, in which Prof.Cédric Josz makes everything clear and intuitive! This blog is about multivariate polynomial optimization, including both unconstrained and ...

Polynomial Optimization I

Univariant unconstrained problems

This note is taken from the summer course, in which Prof.Cédric Josz makes everything clear and intuitive! This blog is about univariate unconstrained polynomial optimization, and the multivariate ...