Lei et al. systematically characterized the epistasis among natural mutations in the neuraminidase of human influenza H3N2 virus, which provide insights into the biophysical constraints that shaped its evolution trajectory over the past half-century.