Needless text
November 19, 2024
Whenever I am trying to do something fun (read: poorly considered) with torch.compile I find myself googling for the same handful of references, most of which are in the PyTorch Drive folder, so putting them here for my own reference.
November 15, 2024
Every time I have to set up a clean system I manage to mess up cuda somehow, so leaving this as an aide memoir. In general, there is a default nvidia-cuda-toolkit package that ships with Ubuntu-based systems, and you should ignore that. The right options are either:
November 5, 2024
A very good passing comment from Nikita at work. When folks train in eager mode they are generally able to leverage the full set of aten ops, with their attendant implementations in different backends.
November 2, 2024
September 24, 2024
The always prolific Lucidrains has been implementing AlphaFold3 in PyTorch:
July 14, 2024
June 28, 2024
June 24, 2024
June 24, 2024
There have been a few, good, attempts at Transformer based recommendation systems, but this one from Jiaqi Zhai and the folks inside the modern recommendation systems team at Meta is particularly strong.
May 24, 2024